2026-02-13T03:50:41.574 INFO:root:teuthology version: 1.2.4.dev9+ga2c505dae 2026-02-13T03:50:41.592 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T03:50:41.676 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48125 branch: wip-pdonnell-testing-20260210.171210 description: fs/workload/{0-distro begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-no-extra-options} 0-use-snaprealm/{global} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/pjd}} email: pdonnell@redhat.com first_in_suite: false flavor: default job_id: '48125' kernel: client: branch: testing sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: trial name: pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20260210.171210 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd - disabled max_mds: 5 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mgr/snap_schedule/allow_m_granularity: true mgr/snap_schedule/dump_on_update: true mgr/snap_schedule/log_level: debug mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: client_fscrypt_dummy_encryption: true fuse default permissions: false fuse set user groups: true global: ms die on skipped message: false mds: mds_bal_replicate_threshold: 1 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - is offline because no MDS - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - BLUESTORE_SLOW_OP_ALERT - slow operation indications in BlueStore - experiencing slow operations in BlueStore - MGR_MODULE_ERROR - OSD_DOWN - osd.* is down - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - osds down - osd.* is down - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - pg .* is stuck inactive - pg .* is .*degraded mgr-modules: - snap_schedule sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f subvols: create: 2 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - nowsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20260210.171210 sha1: cfcf307502511ba51c39a8b9085c2fcde505d421 owner: scheduled_pdonnell@soko04.front.sepia.ceph.com priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7166 sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f sleep_before_teardown: 0 subset: 604/1024 suite: fs suite_branch: wip-pdonnell-testing-20260210.171210 suite_path: /home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph suite_sha1: cfcf307502511ba51c39a8b9085c2fcde505d421 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: trial092.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK6DVTS9P8hxdrJDF3yjt0HtOvUKpIcpq1ezY09IGXaEPCYWixgsv7xPBduxvMCZ3Pd52T7K68yQUWa9oPVaUfI= trial099.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPNifMViSFyM1JEpki/V3cMxF8ZDKIX8ykXLyogAoaINIlNl+yypO2CWhJUptHxAmnsXuILz0mrN01d/UBOhgCw= trial158.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFnV45PPHzNBRokppnXAeGH8i9B3CYMWrw9nYANVzNDdlC2JHP9Bz2EglWYqUQEhCeAc9Ys55UbeYzAP5SwCJ08= tasks: - pexec: all: - sudo dnf remove nvme-cli -y - sudo dnf install nvmetcli nvme-cli -y - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: distro-suffix: rockylinux-10 roleless: false skip_dashboard: true - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - exec: mon.a: - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((800-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - quiescer: null - workunit: clients: all: - suites/pjd.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - "local kernel = py_attrgetter(yaml).get('kernel')\nif kernel ~= nil then\n local\ \ branch = py_attrgetter(kernel).get('branch')\n if branch and not kernel.branch:find\ \ \"-all$\" then\n log.debug(\"removing default kernel specification: %s\"\ , kernel)\n py_attrgetter(kernel).pop('branch', nil)\n py_attrgetter(kernel).pop('deb',\ \ nil)\n py_attrgetter(kernel).pop('flavor', nil)\n py_attrgetter(kernel).pop('kdb',\ \ nil)\n py_attrgetter(kernel).pop('koji', nil)\n py_attrgetter(kernel).pop('koji_task',\ \ nil)\n py_attrgetter(kernel).pop('rpm', nil)\n py_attrgetter(kernel).pop('sha1',\ \ nil)\n py_attrgetter(kernel).pop('tag', nil)\n end\nend\n" - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end - "if yaml.os_type == \"rocky\" then\n log.debug(\"not testing on rocky: https://tracker.ceph.com/issues/74907\"\ )\n reject()\nend\n" teuthology_branch: kernel-fix-3 teuthology_sha1: a2c505dae37458c5537fa44f1320bd04eef25bb1 timestamp: 2026-02-13_01:53:26 tube: trial user: pdonnell verbose: false worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482 2026-02-13T03:50:41.677 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa; will attempt to use it 2026-02-13T03:50:41.677 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks 2026-02-13T03:50:41.677 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-13T03:50:41.678 INFO:teuthology.task.internal:Checking packages... 2026-02-13T03:50:41.679 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '8f8d38294e4db8750b4b1649f62ce37caa63080f' 2026-02-13T03:50:41.679 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-13T03:50:41.679 INFO:teuthology.packaging:ref: None 2026-02-13T03:50:41.679 INFO:teuthology.packaging:tag: None 2026-02-13T03:50:41.679 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20260210.171210 2026-02-13T03:50:41.679 INFO:teuthology.packaging:sha1: 8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T03:50:41.679 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20260210.171210 2026-02-13T03:50:41.793 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5241.g8f8d3829 2026-02-13T03:50:41.794 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-13T03:50:41.806 INFO:teuthology.task.internal:no buildpackages task found 2026-02-13T03:50:41.806 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-13T03:50:41.820 INFO:teuthology.task.internal:Saving configuration 2026-02-13T03:50:41.840 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-13T03:50:41.852 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-13T03:50:41.923 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial092.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48125', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-13 03:47:24.668751', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK6DVTS9P8hxdrJDF3yjt0HtOvUKpIcpq1ezY09IGXaEPCYWixgsv7xPBduxvMCZ3Pd52T7K68yQUWa9oPVaUfI='} 2026-02-13T03:50:41.977 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial099.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48125', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-13 03:47:24.669118', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPNifMViSFyM1JEpki/V3cMxF8ZDKIX8ykXLyogAoaINIlNl+yypO2CWhJUptHxAmnsXuILz0mrN01d/UBOhgCw='} 2026-02-13T03:50:42.033 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial158.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48125', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-13 03:47:24.668106', 'locked_by': 'scheduled_pdonnell@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFnV45PPHzNBRokppnXAeGH8i9B3CYMWrw9nYANVzNDdlC2JHP9Bz2EglWYqUQEhCeAc9Ys55UbeYzAP5SwCJ08='} 2026-02-13T03:50:42.033 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-13T03:50:42.044 INFO:teuthology.task.internal:roles: ubuntu@trial092.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2026-02-13T03:50:42.044 INFO:teuthology.task.internal:roles: ubuntu@trial099.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2026-02-13T03:50:42.044 INFO:teuthology.task.internal:roles: ubuntu@trial158.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2026-02-13T03:50:42.044 INFO:teuthology.run_tasks:Running task console_log... 2026-02-13T03:50:42.231 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8a11310220>, signals=[15]) 2026-02-13T03:50:42.231 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-13T03:50:42.242 INFO:teuthology.task.internal:Opening connections... 2026-02-13T03:50:42.242 DEBUG:teuthology.task.internal:connecting to ubuntu@trial092.front.sepia.ceph.com 2026-02-13T03:50:42.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T03:50:42.304 DEBUG:teuthology.task.internal:connecting to ubuntu@trial099.front.sepia.ceph.com 2026-02-13T03:50:42.304 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T03:50:42.365 DEBUG:teuthology.task.internal:connecting to ubuntu@trial158.front.sepia.ceph.com 2026-02-13T03:50:42.366 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T03:50:42.429 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-13T03:50:42.441 DEBUG:teuthology.orchestra.run.trial092:> uname -m 2026-02-13T03:50:42.457 INFO:teuthology.orchestra.run.trial092.stdout:x86_64 2026-02-13T03:50:42.457 DEBUG:teuthology.orchestra.run.trial092:> cat /etc/os-release 2026-02-13T03:50:42.512 INFO:teuthology.orchestra.run.trial092.stdout:NAME="CentOS Stream" 2026-02-13T03:50:42.513 INFO:teuthology.orchestra.run.trial092.stdout:VERSION="9" 2026-02-13T03:50:42.513 INFO:teuthology.orchestra.run.trial092.stdout:ID="centos" 2026-02-13T03:50:42.513 INFO:teuthology.orchestra.run.trial092.stdout:ID_LIKE="rhel fedora" 2026-02-13T03:50:42.513 INFO:teuthology.orchestra.run.trial092.stdout:VERSION_ID="9" 2026-02-13T03:50:42.513 INFO:teuthology.orchestra.run.trial092.stdout:PLATFORM_ID="platform:el9" 2026-02-13T03:50:42.513 INFO:teuthology.orchestra.run.trial092.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T03:50:42.513 INFO:teuthology.orchestra.run.trial092.stdout:ANSI_COLOR="0;31" 2026-02-13T03:50:42.513 INFO:teuthology.orchestra.run.trial092.stdout:LOGO="fedora-logo-icon" 2026-02-13T03:50:42.513 INFO:teuthology.orchestra.run.trial092.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T03:50:42.513 INFO:teuthology.orchestra.run.trial092.stdout:HOME_URL="https://centos.org/" 2026-02-13T03:50:42.513 INFO:teuthology.orchestra.run.trial092.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T03:50:42.513 INFO:teuthology.orchestra.run.trial092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T03:50:42.513 INFO:teuthology.orchestra.run.trial092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T03:50:42.513 INFO:teuthology.lock.ops:Updating trial092.front.sepia.ceph.com on lock server 2026-02-13T03:50:42.584 DEBUG:teuthology.orchestra.run.trial099:> uname -m 2026-02-13T03:50:42.599 INFO:teuthology.orchestra.run.trial099.stdout:x86_64 2026-02-13T03:50:42.599 DEBUG:teuthology.orchestra.run.trial099:> cat /etc/os-release 2026-02-13T03:50:42.655 INFO:teuthology.orchestra.run.trial099.stdout:NAME="CentOS Stream" 2026-02-13T03:50:42.655 INFO:teuthology.orchestra.run.trial099.stdout:VERSION="9" 2026-02-13T03:50:42.655 INFO:teuthology.orchestra.run.trial099.stdout:ID="centos" 2026-02-13T03:50:42.655 INFO:teuthology.orchestra.run.trial099.stdout:ID_LIKE="rhel fedora" 2026-02-13T03:50:42.655 INFO:teuthology.orchestra.run.trial099.stdout:VERSION_ID="9" 2026-02-13T03:50:42.655 INFO:teuthology.orchestra.run.trial099.stdout:PLATFORM_ID="platform:el9" 2026-02-13T03:50:42.655 INFO:teuthology.orchestra.run.trial099.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T03:50:42.656 INFO:teuthology.orchestra.run.trial099.stdout:ANSI_COLOR="0;31" 2026-02-13T03:50:42.656 INFO:teuthology.orchestra.run.trial099.stdout:LOGO="fedora-logo-icon" 2026-02-13T03:50:42.656 INFO:teuthology.orchestra.run.trial099.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T03:50:42.656 INFO:teuthology.orchestra.run.trial099.stdout:HOME_URL="https://centos.org/" 2026-02-13T03:50:42.656 INFO:teuthology.orchestra.run.trial099.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T03:50:42.656 INFO:teuthology.orchestra.run.trial099.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T03:50:42.656 INFO:teuthology.orchestra.run.trial099.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T03:50:42.656 INFO:teuthology.lock.ops:Updating trial099.front.sepia.ceph.com on lock server 2026-02-13T03:50:42.731 DEBUG:teuthology.orchestra.run.trial158:> uname -m 2026-02-13T03:50:42.746 INFO:teuthology.orchestra.run.trial158.stdout:x86_64 2026-02-13T03:50:42.747 DEBUG:teuthology.orchestra.run.trial158:> cat /etc/os-release 2026-02-13T03:50:42.803 INFO:teuthology.orchestra.run.trial158.stdout:NAME="CentOS Stream" 2026-02-13T03:50:42.803 INFO:teuthology.orchestra.run.trial158.stdout:VERSION="9" 2026-02-13T03:50:42.803 INFO:teuthology.orchestra.run.trial158.stdout:ID="centos" 2026-02-13T03:50:42.803 INFO:teuthology.orchestra.run.trial158.stdout:ID_LIKE="rhel fedora" 2026-02-13T03:50:42.803 INFO:teuthology.orchestra.run.trial158.stdout:VERSION_ID="9" 2026-02-13T03:50:42.803 INFO:teuthology.orchestra.run.trial158.stdout:PLATFORM_ID="platform:el9" 2026-02-13T03:50:42.803 INFO:teuthology.orchestra.run.trial158.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-13T03:50:42.803 INFO:teuthology.orchestra.run.trial158.stdout:ANSI_COLOR="0;31" 2026-02-13T03:50:42.803 INFO:teuthology.orchestra.run.trial158.stdout:LOGO="fedora-logo-icon" 2026-02-13T03:50:42.803 INFO:teuthology.orchestra.run.trial158.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-13T03:50:42.803 INFO:teuthology.orchestra.run.trial158.stdout:HOME_URL="https://centos.org/" 2026-02-13T03:50:42.803 INFO:teuthology.orchestra.run.trial158.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-13T03:50:42.803 INFO:teuthology.orchestra.run.trial158.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-13T03:50:42.803 INFO:teuthology.orchestra.run.trial158.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-13T03:50:42.804 INFO:teuthology.lock.ops:Updating trial158.front.sepia.ceph.com on lock server 2026-02-13T03:50:42.879 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-13T03:50:42.891 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-13T03:50:42.902 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-13T03:50:42.902 DEBUG:teuthology.orchestra.run.trial092:> test '!' -e /home/ubuntu/cephtest 2026-02-13T03:50:42.903 DEBUG:teuthology.orchestra.run.trial099:> test '!' -e /home/ubuntu/cephtest 2026-02-13T03:50:42.905 DEBUG:teuthology.orchestra.run.trial158:> test '!' -e /home/ubuntu/cephtest 2026-02-13T03:50:42.920 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-13T03:50:42.931 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-13T03:50:42.931 DEBUG:teuthology.orchestra.run.trial092:> test -z $(ls -A /var/lib/ceph) 2026-02-13T03:50:42.958 DEBUG:teuthology.orchestra.run.trial099:> test -z $(ls -A /var/lib/ceph) 2026-02-13T03:50:42.960 DEBUG:teuthology.orchestra.run.trial158:> test -z $(ls -A /var/lib/ceph) 2026-02-13T03:50:42.977 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-13T03:50:43.191 INFO:teuthology.run_tasks:Running task kernel... 2026-02-13T03:50:43.210 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'sha1': 'distro'} 2026-02-13T03:50:43.210 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2026-02-13T03:50:43.211 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2026-02-13T03:50:43.211 DEBUG:teuthology.orchestra.run.trial092:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-13T03:50:43.225 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T03:50:43.226 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2026-02-13T03:50:43.390 DEBUG:teuthology.task.kernel:sha1 for client.0 is 8dec4b357aab872d3b63ec979924962a64be83dd 2026-02-13T03:50:43.390 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "8dec4b357aab872d3b63ec979924962a64be83dd"... 2026-02-13T03:50:43.391 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-13T03:50:43.406 INFO:teuthology.orchestra.run.trial092.stdout:5.14.0-645.el9.x86_64 2026-02-13T03:50:43.406 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-645.el9.x86_64 vs 8dec4b357aab872d3b63ec979924962a64be83dd 2026-02-13T03:50:43.406 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2026-02-13T03:50:43.407 DEBUG:teuthology.orchestra.run.trial092:> sudo yum upgrade -y linux-firmware 2026-02-13T03:50:44.067 INFO:teuthology.orchestra.run.trial092.stdout:CentOS Stream 9 - BaseOS 30 MB/s | 8.9 MB 00:00 2026-02-13T03:50:47.266 INFO:teuthology.orchestra.run.trial092.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-13T03:50:53.443 INFO:teuthology.orchestra.run.trial092.stdout:CentOS Stream 9 - CRB 2.0 MB/s | 7.8 MB 00:03 2026-02-13T03:50:54.534 INFO:teuthology.orchestra.run.trial092.stdout:CentOS Stream 9 - Extras packages 54 kB/s | 20 kB 00:00 2026-02-13T03:50:55.170 INFO:teuthology.orchestra.run.trial092.stdout:Extra Packages for Enterprise Linux 36 MB/s | 20 MB 00:00 2026-02-13T03:50:58.358 INFO:teuthology.orchestra.run.trial092.stdout:lab-extras 1.7 MB/s | 50 kB 00:00 2026-02-13T03:50:59.440 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-13T03:50:59.441 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-13T03:50:59.441 INFO:teuthology.orchestra.run.trial092.stdout: Package Architecture Version Repository Size 2026-02-13T03:50:59.442 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-13T03:50:59.442 INFO:teuthology.orchestra.run.trial092.stdout:Upgrading: 2026-02-13T03:50:59.442 INFO:teuthology.orchestra.run.trial092.stdout: linux-firmware noarch 20260130-160.el9 baseos 610 M 2026-02-13T03:50:59.442 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T03:50:59.442 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-13T03:50:59.442 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-13T03:50:59.442 INFO:teuthology.orchestra.run.trial092.stdout:Upgrade 1 Package 2026-02-13T03:50:59.442 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T03:50:59.442 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 610 M 2026-02-13T03:50:59.442 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-13T03:51:10.367 INFO:teuthology.orchestra.run.trial092.stdout:linux-firmware-20260130-160.el9.noarch.rpm 56 MB/s | 610 MB 00:10 2026-02-13T03:51:10.367 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-13T03:51:10.368 INFO:teuthology.orchestra.run.trial092.stdout:Total 56 MB/s | 610 MB 00:10 2026-02-13T03:51:11.467 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-13T03:51:11.484 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-13T03:51:11.484 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-13T03:51:13.344 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-13T03:51:13.345 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-13T03:51:15.166 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: linux-firmware-20260130-160.el9.noarch 1/1 2026-02-13T03:51:17.156 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-13T03:51:17.181 INFO:teuthology.orchestra.run.trial092.stdout: Upgrading : linux-firmware-20260130-160.el9.noarch 1/2 2026-02-13T03:51:17.205 INFO:teuthology.orchestra.run.trial092.stdout: Cleanup : linux-firmware-20251111-158.el9.noarch 2/2 2026-02-13T03:51:17.468 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: linux-firmware-20251111-158.el9.noarch 2/2 2026-02-13T03:51:17.469 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : linux-firmware-20260130-160.el9.noarch 1/2 2026-02-13T03:51:17.519 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : linux-firmware-20251111-158.el9.noarch 2/2 2026-02-13T03:51:17.520 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T03:51:17.520 INFO:teuthology.orchestra.run.trial092.stdout:Upgraded: 2026-02-13T03:51:17.520 INFO:teuthology.orchestra.run.trial092.stdout: linux-firmware-20260130-160.el9.noarch 2026-02-13T03:51:17.520 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T03:51:17.520 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-13T03:51:17.609 INFO:teuthology.task.kernel:Downloading kernel 8dec4b357aab872d3b63ec979924962a64be83dd on client.0... 2026-02-13T03:51:17.609 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8dec4b357aab872d3b63ec979924962a64be83dd 2026-02-13T03:51:17.781 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/8dec4b357aab872d3b63ec979924962a64be83dd/centos/9/flavors/default/x86_64/ 2026-02-13T03:51:17.782 DEBUG:teuthology.orchestra.run.trial092:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.19.0_g8dec4b357aab-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/8dec4b357aab872d3b63ec979924962a64be83dd/centos/9/flavors/default/x86_64/ --input-file=- 2026-02-13T03:51:17.784 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@trial092.front.sepia.ceph.com to complete... 2026-02-13T03:51:24.311 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13 03:51:24 URL:https://2.chacra.ceph.com/r/kernel/testing/8dec4b357aab872d3b63ec979924962a64be83dd/centos/9/flavors/default/x86_64/kernel-6.19.0_g8dec4b357aab-1.x86_64.rpm [387870085/387870085] -> "/tmp/kernel.x86_64.rpm" [1] 2026-02-13T03:51:24.311 INFO:teuthology.orchestra.run.trial092.stderr:FINISHED --2026-02-13 03:51:24-- 2026-02-13T03:51:24.312 INFO:teuthology.orchestra.run.trial092.stderr:Total wall clock time: 6.5s 2026-02-13T03:51:24.312 INFO:teuthology.orchestra.run.trial092.stderr:Downloaded: 1 files, 370M in 6.4s (57.9 MB/s) 2026-02-13T03:51:24.316 INFO:teuthology.task.kernel:Installing kernel 8dec4b357aab872d3b63ec979924962a64be83dd on client.0... 2026-02-13T03:51:24.316 DEBUG:teuthology.orchestra.run.trial092:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2026-02-13T03:51:25.442 INFO:teuthology.orchestra.run.trial092.stdout:Verifying... ######################################## 2026-02-13T03:51:25.470 INFO:teuthology.orchestra.run.trial092.stdout:Preparing... ######################################## 2026-02-13T03:51:25.482 INFO:teuthology.orchestra.run.trial092.stdout:Updating / installing... 2026-02-13T03:51:28.674 INFO:teuthology.orchestra.run.trial092.stdout:kernel-6.19.0_g8dec4b357aab-1 ######################################## 2026-02-13T03:51:44.222 INFO:teuthology.orchestra.run.trial092.stderr:sed: can't read /lib/modules/6.19.0-g8dec4b357aab/.vmlinuz.hmac: No such file or directory 2026-02-13T03:51:44.222 INFO:teuthology.orchestra.run.trial092.stderr:Can't create '/boot/.vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566.hmac' from '/lib/modules/6.19.0-g8dec4b357aab/.vmlinuz.hmac'! 2026-02-13T03:52:35.566 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial092.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2026-02-13T03:52:35.566 DEBUG:teuthology.orchestra.run.trial092:> rpm -qlp /tmp/kernel.x86_64.rpm 2026-02-13T03:52:35.613 INFO:teuthology.orchestra.run.trial092.stdout:/boot/System.map-6.19.0-g8dec4b357aab 2026-02-13T03:52:35.613 INFO:teuthology.orchestra.run.trial092.stdout:/boot/config-6.19.0-g8dec4b357aab 2026-02-13T03:52:35.613 INFO:teuthology.orchestra.run.trial092.stdout:/boot/vmlinuz-6.19.0-g8dec4b357aab 2026-02-13T03:52:35.613 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab 2026-02-13T03:52:35.614 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/System.map 2026-02-13T03:52:35.614 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/config 2026-02-13T03:52:35.614 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel 2026-02-13T03:52:35.614 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch 2026-02-13T03:52:35.614 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86 2026-02-13T03:52:35.614 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto 2026-02-13T03:52:35.614 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/blowfish-x86_64.ko 2026-02-13T03:52:35.614 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2026-02-13T03:52:35.614 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2026-02-13T03:52:35.614 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/camellia-x86_64.ko 2026-02-13T03:52:35.614 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2026-02-13T03:52:35.615 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2026-02-13T03:52:35.615 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2026-02-13T03:52:35.615 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2026-02-13T03:52:35.615 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2026-02-13T03:52:35.615 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/serpent-avx2.ko 2026-02-13T03:52:35.615 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2026-02-13T03:52:35.615 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2026-02-13T03:52:35.615 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2026-02-13T03:52:35.615 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/crypto/twofish-x86_64.ko 2026-02-13T03:52:35.615 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kernel 2026-02-13T03:52:35.615 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kernel/cpu 2026-02-13T03:52:35.615 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kernel/cpu/mce 2026-02-13T03:52:35.616 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2026-02-13T03:52:35.616 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kvm 2026-02-13T03:52:35.616 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kvm/kvm-amd.ko 2026-02-13T03:52:35.616 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kvm/kvm-intel.ko 2026-02-13T03:52:35.616 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/arch/x86/kvm/kvm.ko 2026-02-13T03:52:35.616 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto 2026-02-13T03:52:35.616 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/anubis.ko 2026-02-13T03:52:35.616 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/arc4.ko 2026-02-13T03:52:35.616 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx 2026-02-13T03:52:35.616 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_memcpy.ko 2026-02-13T03:52:35.616 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_pq.ko 2026-02-13T03:52:35.616 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_raid6_recov.ko 2026-02-13T03:52:35.617 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_tx.ko 2026-02-13T03:52:35.617 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/async_xor.ko 2026-02-13T03:52:35.617 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/async_tx/raid6test.ko 2026-02-13T03:52:35.617 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/authenc.ko 2026-02-13T03:52:35.617 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/authencesn.ko 2026-02-13T03:52:35.617 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/blake2b.ko 2026-02-13T03:52:35.617 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/blowfish_common.ko 2026-02-13T03:52:35.617 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/blowfish_generic.ko 2026-02-13T03:52:35.617 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/camellia_generic.ko 2026-02-13T03:52:35.617 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/cast5_generic.ko 2026-02-13T03:52:35.617 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/cast6_generic.ko 2026-02-13T03:52:35.617 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/cast_common.ko 2026-02-13T03:52:35.618 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/ccm.ko 2026-02-13T03:52:35.618 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/cmac.ko 2026-02-13T03:52:35.618 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/crc32-cryptoapi.ko 2026-02-13T03:52:35.618 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/crypto_engine.ko 2026-02-13T03:52:35.618 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/crypto_user.ko 2026-02-13T03:52:35.618 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/des_generic.ko 2026-02-13T03:52:35.618 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/dh_generic.ko 2026-02-13T03:52:35.618 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/echainiv.ko 2026-02-13T03:52:35.618 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/essiv.ko 2026-02-13T03:52:35.618 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/fcrypt.ko 2026-02-13T03:52:35.618 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/khazad.ko 2026-02-13T03:52:35.618 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/krb5 2026-02-13T03:52:35.618 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/krb5/krb5.ko 2026-02-13T03:52:35.619 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/krb5enc.ko 2026-02-13T03:52:35.619 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/lz4.ko 2026-02-13T03:52:35.619 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/lz4hc.ko 2026-02-13T03:52:35.619 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/md4.ko 2026-02-13T03:52:35.619 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/michael_mic.ko 2026-02-13T03:52:35.619 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/pcbc.ko 2026-02-13T03:52:35.619 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/pcrypt.ko 2026-02-13T03:52:35.619 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/rmd160.ko 2026-02-13T03:52:35.619 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/seed.ko 2026-02-13T03:52:35.619 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/serpent_generic.ko 2026-02-13T03:52:35.619 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/tea.ko 2026-02-13T03:52:35.619 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/twofish_common.ko 2026-02-13T03:52:35.619 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/twofish_generic.ko 2026-02-13T03:52:35.620 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/wp512.ko 2026-02-13T03:52:35.620 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/xcbc.ko 2026-02-13T03:52:35.620 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/xor.ko 2026-02-13T03:52:35.620 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/crypto/xxhash_generic.ko 2026-02-13T03:52:35.620 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers 2026-02-13T03:52:35.620 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi 2026-02-13T03:52:35.620 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/acpi_ipmi.ko 2026-02-13T03:52:35.620 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/acpi_pad.ko 2026-02-13T03:52:35.620 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/ec_sys.ko 2026-02-13T03:52:35.620 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/platform_profile.ko 2026-02-13T03:52:35.620 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/sbs.ko 2026-02-13T03:52:35.620 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/sbshc.ko 2026-02-13T03:52:35.621 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/acpi/video.ko 2026-02-13T03:52:35.621 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata 2026-02-13T03:52:35.621 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/acard-ahci.ko 2026-02-13T03:52:35.621 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/ahci_platform.ko 2026-02-13T03:52:35.621 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/ata_generic.ko 2026-02-13T03:52:35.621 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/libahci_platform.ko 2026-02-13T03:52:35.621 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_acpi.ko 2026-02-13T03:52:35.621 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_ali.ko 2026-02-13T03:52:35.621 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_amd.ko 2026-02-13T03:52:35.621 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_artop.ko 2026-02-13T03:52:35.621 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_atiixp.ko 2026-02-13T03:52:35.621 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_atp867x.ko 2026-02-13T03:52:35.621 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_cmd640.ko 2026-02-13T03:52:35.621 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_cmd64x.ko 2026-02-13T03:52:35.621 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_cypress.ko 2026-02-13T03:52:35.622 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_efar.ko 2026-02-13T03:52:35.622 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_hpt366.ko 2026-02-13T03:52:35.622 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_hpt37x.ko 2026-02-13T03:52:35.622 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_hpt3x2n.ko 2026-02-13T03:52:35.622 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_hpt3x3.ko 2026-02-13T03:52:35.622 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_it8213.ko 2026-02-13T03:52:35.622 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_it821x.ko 2026-02-13T03:52:35.622 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_jmicron.ko 2026-02-13T03:52:35.622 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_marvell.ko 2026-02-13T03:52:35.622 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_mpiix.ko 2026-02-13T03:52:35.622 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_netcell.ko 2026-02-13T03:52:35.622 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_ninja32.ko 2026-02-13T03:52:35.622 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_ns87410.ko 2026-02-13T03:52:35.623 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_ns87415.ko 2026-02-13T03:52:35.623 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_oldpiix.ko 2026-02-13T03:52:35.623 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_opti.ko 2026-02-13T03:52:35.623 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_optidma.ko 2026-02-13T03:52:35.623 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_pcmcia.ko 2026-02-13T03:52:35.623 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_pdc2027x.ko 2026-02-13T03:52:35.623 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_pdc202xx_old.ko 2026-02-13T03:52:35.623 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_piccolo.ko 2026-02-13T03:52:35.623 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_rdc.ko 2026-02-13T03:52:35.623 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_sch.ko 2026-02-13T03:52:35.623 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_serverworks.ko 2026-02-13T03:52:35.623 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_sil680.ko 2026-02-13T03:52:35.623 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_sis.ko 2026-02-13T03:52:35.623 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_sl82c105.ko 2026-02-13T03:52:35.624 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_triflex.ko 2026-02-13T03:52:35.624 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pata_via.ko 2026-02-13T03:52:35.624 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/pdc_adma.ko 2026-02-13T03:52:35.624 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_inic162x.ko 2026-02-13T03:52:35.624 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_mv.ko 2026-02-13T03:52:35.624 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_nv.ko 2026-02-13T03:52:35.624 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_promise.ko 2026-02-13T03:52:35.624 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_qstor.ko 2026-02-13T03:52:35.624 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_sil.ko 2026-02-13T03:52:35.624 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_sil24.ko 2026-02-13T03:52:35.624 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_sis.ko 2026-02-13T03:52:35.624 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_svw.ko 2026-02-13T03:52:35.624 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_sx4.ko 2026-02-13T03:52:35.624 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_uli.ko 2026-02-13T03:52:35.625 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_via.ko 2026-02-13T03:52:35.625 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ata/sata_vsc.ko 2026-02-13T03:52:35.625 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/auxdisplay 2026-02-13T03:52:35.625 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/auxdisplay/ks0108.ko 2026-02-13T03:52:35.625 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/base 2026-02-13T03:52:35.625 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/base/regmap 2026-02-13T03:52:35.625 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/base/regmap/regmap-i2c.ko 2026-02-13T03:52:35.625 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/base/regmap/regmap-mmio.ko 2026-02-13T03:52:35.625 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/bcma 2026-02-13T03:52:35.625 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/bcma/bcma.ko 2026-02-13T03:52:35.625 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block 2026-02-13T03:52:35.625 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/aoe 2026-02-13T03:52:35.625 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/aoe/aoe.ko 2026-02-13T03:52:35.625 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/brd.ko 2026-02-13T03:52:35.625 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/drbd 2026-02-13T03:52:35.626 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/drbd/drbd.ko 2026-02-13T03:52:35.626 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/floppy.ko 2026-02-13T03:52:35.626 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/loop.ko 2026-02-13T03:52:35.626 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/mtip32xx 2026-02-13T03:52:35.626 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/mtip32xx/mtip32xx.ko 2026-02-13T03:52:35.626 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/nbd.ko 2026-02-13T03:52:35.626 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/null_blk 2026-02-13T03:52:35.626 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/null_blk/null_blk.ko 2026-02-13T03:52:35.626 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/rbd.ko 2026-02-13T03:52:35.626 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/virtio_blk.ko 2026-02-13T03:52:35.626 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/xen-blkback 2026-02-13T03:52:35.626 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/xen-blkback/xen-blkback.ko 2026-02-13T03:52:35.626 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/xen-blkfront.ko 2026-02-13T03:52:35.626 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/zram 2026-02-13T03:52:35.626 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/block/zram/zram.ko 2026-02-13T03:52:35.626 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char 2026-02-13T03:52:35.627 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hangcheck-timer.ko 2026-02-13T03:52:35.627 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random 2026-02-13T03:52:35.627 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/amd-rng.ko 2026-02-13T03:52:35.627 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/intel-rng.ko 2026-02-13T03:52:35.627 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/timeriomem-rng.ko 2026-02-13T03:52:35.627 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/via-rng.ko 2026-02-13T03:52:35.627 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/hw_random/virtio-rng.ko 2026-02-13T03:52:35.627 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi 2026-02-13T03:52:35.627 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_devintf.ko 2026-02-13T03:52:35.627 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2026-02-13T03:52:35.627 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2026-02-13T03:52:35.627 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_si.ko 2026-02-13T03:52:35.627 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_ssif.ko 2026-02-13T03:52:35.627 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2026-02-13T03:52:35.627 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/lp.ko 2026-02-13T03:52:35.627 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/mwave 2026-02-13T03:52:35.627 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/mwave/mwave.ko 2026-02-13T03:52:35.628 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/ppdev.ko 2026-02-13T03:52:35.628 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tlclk.ko 2026-02-13T03:52:35.628 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm 2026-02-13T03:52:35.628 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm.ko 2026-02-13T03:52:35.628 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_atmel.ko 2026-02-13T03:52:35.628 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_infineon.ko 2026-02-13T03:52:35.628 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_nsc.ko 2026-02-13T03:52:35.628 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_tis.ko 2026-02-13T03:52:35.628 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/tpm/tpm_tis_core.ko 2026-02-13T03:52:35.628 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/uv_mmtimer.ko 2026-02-13T03:52:35.628 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/char/virtio_console.ko 2026-02-13T03:52:35.628 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq 2026-02-13T03:52:35.628 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/acpi-cpufreq.ko 2026-02-13T03:52:35.628 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2026-02-13T03:52:35.628 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/p4-clockmod.ko 2026-02-13T03:52:35.628 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/pcc-cpufreq.ko 2026-02-13T03:52:35.628 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/powernow-k8.ko 2026-02-13T03:52:35.629 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/cpufreq/speedstep-lib.ko 2026-02-13T03:52:35.629 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto 2026-02-13T03:52:35.629 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/ccp 2026-02-13T03:52:35.629 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/ccp/ccp-crypto.ko 2026-02-13T03:52:35.629 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/ccp/ccp.ko 2026-02-13T03:52:35.629 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel 2026-02-13T03:52:35.629 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat 2026-02-13T03:52:35.629 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat/qat_common 2026-02-13T03:52:35.629 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2026-02-13T03:52:35.629 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2026-02-13T03:52:35.629 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2026-02-13T03:52:35.629 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/padlock-aes.ko 2026-02-13T03:52:35.629 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/padlock-sha.ko 2026-02-13T03:52:35.629 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/virtio 2026-02-13T03:52:35.629 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/crypto/virtio/virtio_crypto.ko 2026-02-13T03:52:35.629 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dca 2026-02-13T03:52:35.629 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dca/dca.ko 2026-02-13T03:52:35.629 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/devfreq 2026-02-13T03:52:35.630 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/devfreq/governor_simpleondemand.ko 2026-02-13T03:52:35.630 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma 2026-02-13T03:52:35.630 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma/dw 2026-02-13T03:52:35.630 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma/dw/dw_dmac.ko 2026-02-13T03:52:35.630 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma/ioat 2026-02-13T03:52:35.630 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/dma/ioat/ioatdma.ko 2026-02-13T03:52:35.630 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac 2026-02-13T03:52:35.630 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/amd64_edac.ko 2026-02-13T03:52:35.630 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/e752x_edac.ko 2026-02-13T03:52:35.630 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/edac_mce_amd.ko 2026-02-13T03:52:35.630 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i3000_edac.ko 2026-02-13T03:52:35.630 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i3200_edac.ko 2026-02-13T03:52:35.630 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i5100_edac.ko 2026-02-13T03:52:35.630 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i5400_edac.ko 2026-02-13T03:52:35.630 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i7300_edac.ko 2026-02-13T03:52:35.630 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i7core_edac.ko 2026-02-13T03:52:35.630 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/i82975x_edac.ko 2026-02-13T03:52:35.630 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/ie31200_edac.ko 2026-02-13T03:52:35.631 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/sb_edac.ko 2026-02-13T03:52:35.631 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/edac/x38_edac.ko 2026-02-13T03:52:35.631 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/firmware 2026-02-13T03:52:35.631 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/firmware/edd.ko 2026-02-13T03:52:35.631 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/firmware/iscsi_ibft.ko 2026-02-13T03:52:35.631 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/gpio 2026-02-13T03:52:35.631 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/gpio/gpio-ich.ko 2026-02-13T03:52:35.631 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/gpio/gpio-viperboard.ko 2026-02-13T03:52:35.631 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid 2026-02-13T03:52:35.631 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-appleir.ko 2026-02-13T03:52:35.631 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-aureal.ko 2026-02-13T03:52:35.631 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-axff.ko 2026-02-13T03:52:35.631 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-dr.ko 2026-02-13T03:52:35.631 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-elecom.ko 2026-02-13T03:52:35.631 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-elo.ko 2026-02-13T03:52:35.631 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-emsff.ko 2026-02-13T03:52:35.631 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-gaff.ko 2026-02-13T03:52:35.631 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-gt683r.ko 2026-02-13T03:52:35.632 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-gyration.ko 2026-02-13T03:52:35.632 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-holtek-kbd.ko 2026-02-13T03:52:35.632 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-holtek-mouse.ko 2026-02-13T03:52:35.632 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-holtekff.ko 2026-02-13T03:52:35.632 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-icade.ko 2026-02-13T03:52:35.632 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-keytouch.ko 2026-02-13T03:52:35.632 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-kye.ko 2026-02-13T03:52:35.632 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-lcpower.ko 2026-02-13T03:52:35.632 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-led.ko 2026-02-13T03:52:35.632 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-lenovo.ko 2026-02-13T03:52:35.632 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-multitouch.ko 2026-02-13T03:52:35.632 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-ortek.ko 2026-02-13T03:52:35.632 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-penmount.ko 2026-02-13T03:52:35.632 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-petalynx.ko 2026-02-13T03:52:35.632 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-picolcd.ko 2026-02-13T03:52:35.632 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-pl.ko 2026-02-13T03:52:35.632 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-plantronics.ko 2026-02-13T03:52:35.632 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-primax.ko 2026-02-13T03:52:35.632 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-rmi.ko 2026-02-13T03:52:35.632 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-arvo.ko 2026-02-13T03:52:35.633 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-common.ko 2026-02-13T03:52:35.633 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-isku.ko 2026-02-13T03:52:35.633 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-kone.ko 2026-02-13T03:52:35.633 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-koneplus.ko 2026-02-13T03:52:35.633 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-konepure.ko 2026-02-13T03:52:35.633 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-kovaplus.ko 2026-02-13T03:52:35.633 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-lua.ko 2026-02-13T03:52:35.633 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-pyra.ko 2026-02-13T03:52:35.633 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-ryos.ko 2026-02-13T03:52:35.633 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat-savu.ko 2026-02-13T03:52:35.633 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-roccat.ko 2026-02-13T03:52:35.633 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-saitek.ko 2026-02-13T03:52:35.633 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-samsung.ko 2026-02-13T03:52:35.633 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-sensor-hub.ko 2026-02-13T03:52:35.633 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-sjoy.ko 2026-02-13T03:52:35.633 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-sony.ko 2026-02-13T03:52:35.633 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-speedlink.ko 2026-02-13T03:52:35.633 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-steelseries.ko 2026-02-13T03:52:35.633 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-sunplus.ko 2026-02-13T03:52:35.633 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-thrustmaster.ko 2026-02-13T03:52:35.634 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-tivo.ko 2026-02-13T03:52:35.634 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-tmff.ko 2026-02-13T03:52:35.634 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-topseed.ko 2026-02-13T03:52:35.634 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-twinhan.ko 2026-02-13T03:52:35.634 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-uclogic.ko 2026-02-13T03:52:35.634 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-waltop.ko 2026-02-13T03:52:35.634 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-wiimote.ko 2026-02-13T03:52:35.634 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-xinmo.ko 2026-02-13T03:52:35.634 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-zpff.ko 2026-02-13T03:52:35.634 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/hid-zydacron.ko 2026-02-13T03:52:35.634 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/uhid.ko 2026-02-13T03:52:35.634 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hid/wacom.ko 2026-02-13T03:52:35.634 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon 2026-02-13T03:52:35.634 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/abituguru.ko 2026-02-13T03:52:35.634 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/abituguru3.ko 2026-02-13T03:52:35.634 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/acpi_power_meter.ko 2026-02-13T03:52:35.634 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ad7414.ko 2026-02-13T03:52:35.634 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ad7418.ko 2026-02-13T03:52:35.634 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adc128d818.ko 2026-02-13T03:52:35.634 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm1025.ko 2026-02-13T03:52:35.634 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm1026.ko 2026-02-13T03:52:35.635 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm1029.ko 2026-02-13T03:52:35.635 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm1031.ko 2026-02-13T03:52:35.635 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adm9240.ko 2026-02-13T03:52:35.635 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ads7828.ko 2026-02-13T03:52:35.635 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7410.ko 2026-02-13T03:52:35.635 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7411.ko 2026-02-13T03:52:35.635 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7462.ko 2026-02-13T03:52:35.635 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7470.ko 2026-02-13T03:52:35.635 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7475.ko 2026-02-13T03:52:35.635 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/adt7x10.ko 2026-02-13T03:52:35.635 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/amc6821.ko 2026-02-13T03:52:35.635 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/applesmc.ko 2026-02-13T03:52:35.635 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/asb100.ko 2026-02-13T03:52:35.635 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/asc7621.ko 2026-02-13T03:52:35.635 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/asus_atk0110.ko 2026-02-13T03:52:35.635 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/atxp1.ko 2026-02-13T03:52:35.635 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/coretemp.ko 2026-02-13T03:52:35.635 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/dell-smm-hwmon.ko 2026-02-13T03:52:35.635 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/dme1737.ko 2026-02-13T03:52:35.635 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ds1621.ko 2026-02-13T03:52:35.635 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ds620.ko 2026-02-13T03:52:35.636 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/emc1403.ko 2026-02-13T03:52:35.636 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/emc6w201.ko 2026-02-13T03:52:35.636 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/f71805f.ko 2026-02-13T03:52:35.636 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/f71882fg.ko 2026-02-13T03:52:35.636 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/f75375s.ko 2026-02-13T03:52:35.636 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/fam15h_power.ko 2026-02-13T03:52:35.636 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/fschmd.ko 2026-02-13T03:52:35.636 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/g760a.ko 2026-02-13T03:52:35.636 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/g762.ko 2026-02-13T03:52:35.636 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/gl518sm.ko 2026-02-13T03:52:35.636 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/gl520sm.ko 2026-02-13T03:52:35.636 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/hwmon-vid.ko 2026-02-13T03:52:35.636 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/i5500_temp.ko 2026-02-13T03:52:35.636 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/i5k_amb.ko 2026-02-13T03:52:35.636 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ibmaem.ko 2026-02-13T03:52:35.636 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ibmpex.ko 2026-02-13T03:52:35.636 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ina209.ko 2026-02-13T03:52:35.636 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ina2xx.ko 2026-02-13T03:52:35.636 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/it87.ko 2026-02-13T03:52:35.636 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/k10temp.ko 2026-02-13T03:52:35.636 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/k8temp.ko 2026-02-13T03:52:35.636 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lineage-pem.ko 2026-02-13T03:52:35.637 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm63.ko 2026-02-13T03:52:35.637 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm73.ko 2026-02-13T03:52:35.637 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm75.ko 2026-02-13T03:52:35.637 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm77.ko 2026-02-13T03:52:35.637 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm78.ko 2026-02-13T03:52:35.637 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm80.ko 2026-02-13T03:52:35.637 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm83.ko 2026-02-13T03:52:35.637 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm85.ko 2026-02-13T03:52:35.637 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm87.ko 2026-02-13T03:52:35.637 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm90.ko 2026-02-13T03:52:35.637 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm92.ko 2026-02-13T03:52:35.637 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm93.ko 2026-02-13T03:52:35.637 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm95234.ko 2026-02-13T03:52:35.637 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm95241.ko 2026-02-13T03:52:35.637 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/lm95245.ko 2026-02-13T03:52:35.637 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc2945.ko 2026-02-13T03:52:35.637 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4151.ko 2026-02-13T03:52:35.637 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4215.ko 2026-02-13T03:52:35.637 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4222.ko 2026-02-13T03:52:35.637 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4245.ko 2026-02-13T03:52:35.638 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4260.ko 2026-02-13T03:52:35.638 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/ltc4261.ko 2026-02-13T03:52:35.638 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max16065.ko 2026-02-13T03:52:35.638 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max1619.ko 2026-02-13T03:52:35.638 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max1668.ko 2026-02-13T03:52:35.638 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max197.ko 2026-02-13T03:52:35.638 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max6639.ko 2026-02-13T03:52:35.638 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max6650.ko 2026-02-13T03:52:35.638 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/max6697.ko 2026-02-13T03:52:35.638 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/mcp3021.ko 2026-02-13T03:52:35.638 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/nct6683.ko 2026-02-13T03:52:35.638 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/nct6775-core.ko 2026-02-13T03:52:35.638 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/nct6775.ko 2026-02-13T03:52:35.638 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/nct7802.ko 2026-02-13T03:52:35.638 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pc87360.ko 2026-02-13T03:52:35.638 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pc87427.ko 2026-02-13T03:52:35.638 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pcf8591.ko 2026-02-13T03:52:35.638 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus 2026-02-13T03:52:35.638 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/adm1275.ko 2026-02-13T03:52:35.638 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/lm25066.ko 2026-02-13T03:52:35.638 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/ltc2978.ko 2026-02-13T03:52:35.639 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/max16064.ko 2026-02-13T03:52:35.639 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/max34440.ko 2026-02-13T03:52:35.639 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/max8688.ko 2026-02-13T03:52:35.639 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/pmbus.ko 2026-02-13T03:52:35.639 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2026-02-13T03:52:35.639 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/tps40422.ko 2026-02-13T03:52:35.639 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/ucd9000.ko 2026-02-13T03:52:35.639 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/ucd9200.ko 2026-02-13T03:52:35.639 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/pmbus/zl6100.ko 2026-02-13T03:52:35.639 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/powr1220.ko 2026-02-13T03:52:35.639 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sch5627.ko 2026-02-13T03:52:35.639 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sch5636.ko 2026-02-13T03:52:35.639 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sch56xx-common.ko 2026-02-13T03:52:35.639 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sht15.ko 2026-02-13T03:52:35.639 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sht21.ko 2026-02-13T03:52:35.639 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/shtc1.ko 2026-02-13T03:52:35.639 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/sis5595.ko 2026-02-13T03:52:35.639 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/smsc47b397.ko 2026-02-13T03:52:35.639 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/smsc47m1.ko 2026-02-13T03:52:35.639 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/smsc47m192.ko 2026-02-13T03:52:35.639 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/thmc50.ko 2026-02-13T03:52:35.639 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/tmp102.ko 2026-02-13T03:52:35.640 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/tmp103.ko 2026-02-13T03:52:35.640 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/tmp401.ko 2026-02-13T03:52:35.640 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/tmp421.ko 2026-02-13T03:52:35.640 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/via-cputemp.ko 2026-02-13T03:52:35.640 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/via686a.ko 2026-02-13T03:52:35.640 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/vt1211.ko 2026-02-13T03:52:35.640 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/vt8231.ko 2026-02-13T03:52:35.640 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83627ehf.ko 2026-02-13T03:52:35.640 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83627hf.ko 2026-02-13T03:52:35.640 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83781d.ko 2026-02-13T03:52:35.640 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83791d.ko 2026-02-13T03:52:35.640 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83792d.ko 2026-02-13T03:52:35.640 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83793.ko 2026-02-13T03:52:35.640 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83795.ko 2026-02-13T03:52:35.640 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83l785ts.ko 2026-02-13T03:52:35.640 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/hwmon/w83l786ng.ko 2026-02-13T03:52:35.640 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c 2026-02-13T03:52:35.640 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/algos 2026-02-13T03:52:35.640 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2026-02-13T03:52:35.640 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2026-02-13T03:52:35.640 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses 2026-02-13T03:52:35.640 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-amd756.ko 2026-02-13T03:52:35.640 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-amd8111.ko 2026-02-13T03:52:35.641 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2026-02-13T03:52:35.641 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-designware-core.ko 2026-02-13T03:52:35.641 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2026-02-13T03:52:35.641 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2026-02-13T03:52:35.641 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2026-02-13T03:52:35.641 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-i801.ko 2026-02-13T03:52:35.641 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-isch.ko 2026-02-13T03:52:35.641 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-ismt.ko 2026-02-13T03:52:35.641 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-nforce2.ko 2026-02-13T03:52:35.641 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-parport.ko 2026-02-13T03:52:35.641 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2026-02-13T03:52:35.641 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-piix4.ko 2026-02-13T03:52:35.641 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-scmi.ko 2026-02-13T03:52:35.641 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-simtec.ko 2026-02-13T03:52:35.641 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-sis96x.ko 2026-02-13T03:52:35.641 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2026-02-13T03:52:35.641 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-via.ko 2026-02-13T03:52:35.641 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-viapro.ko 2026-02-13T03:52:35.641 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/busses/i2c-viperboard.ko 2026-02-13T03:52:35.641 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-dev.ko 2026-02-13T03:52:35.641 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-mux.ko 2026-02-13T03:52:35.641 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-slave-eeprom.ko 2026-02-13T03:52:35.641 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-smbus.ko 2026-02-13T03:52:35.641 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/i2c/i2c-stub.ko 2026-02-13T03:52:35.642 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband 2026-02-13T03:52:35.642 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core 2026-02-13T03:52:35.642 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/ib_cm.ko 2026-02-13T03:52:35.642 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/ib_core.ko 2026-02-13T03:52:35.642 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/ib_umad.ko 2026-02-13T03:52:35.642 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/ib_uverbs.ko 2026-02-13T03:52:35.642 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/iw_cm.ko 2026-02-13T03:52:35.642 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/rdma_cm.ko 2026-02-13T03:52:35.642 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/core/rdma_ucm.ko 2026-02-13T03:52:35.642 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw 2026-02-13T03:52:35.642 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/cxgb4 2026-02-13T03:52:35.642 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2026-02-13T03:52:35.642 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mlx4 2026-02-13T03:52:35.642 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2026-02-13T03:52:35.642 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mlx5 2026-02-13T03:52:35.642 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2026-02-13T03:52:35.642 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mthca 2026-02-13T03:52:35.642 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2026-02-13T03:52:35.642 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp 2026-02-13T03:52:35.642 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/ipoib 2026-02-13T03:52:35.642 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2026-02-13T03:52:35.642 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/iser 2026-02-13T03:52:35.642 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2026-02-13T03:52:35.642 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/isert 2026-02-13T03:52:35.643 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2026-02-13T03:52:35.643 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/srp 2026-02-13T03:52:35.643 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2026-02-13T03:52:35.643 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/srpt 2026-02-13T03:52:35.643 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2026-02-13T03:52:35.643 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input 2026-02-13T03:52:35.643 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/gameport 2026-02-13T03:52:35.643 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/gameport/emu10k1-gp.ko 2026-02-13T03:52:35.643 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/gameport/fm801-gp.ko 2026-02-13T03:52:35.643 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/gameport/gameport.ko 2026-02-13T03:52:35.643 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/joydev.ko 2026-02-13T03:52:35.643 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/keyboard 2026-02-13T03:52:35.643 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/keyboard/gpio_keys.ko 2026-02-13T03:52:35.643 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse 2026-02-13T03:52:35.643 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/appletouch.ko 2026-02-13T03:52:35.643 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/bcm5974.ko 2026-02-13T03:52:35.643 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/cyapatp.ko 2026-02-13T03:52:35.643 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/elan_i2c.ko 2026-02-13T03:52:35.643 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/sermouse.ko 2026-02-13T03:52:35.643 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/synaptics_i2c.ko 2026-02-13T03:52:35.643 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/synaptics_usb.ko 2026-02-13T03:52:35.643 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/mouse/vsxxxaa.ko 2026-02-13T03:52:35.643 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/rmi4 2026-02-13T03:52:35.643 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/rmi4/rmi_core.ko 2026-02-13T03:52:35.643 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/serio 2026-02-13T03:52:35.644 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/serio/altera_ps2.ko 2026-02-13T03:52:35.644 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/serio/arc_ps2.ko 2026-02-13T03:52:35.644 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/serio/serio_raw.ko 2026-02-13T03:52:35.644 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/input/sparse-keymap.ko 2026-02-13T03:52:35.644 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds 2026-02-13T03:52:35.644 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/leds-blinkm.ko 2026-02-13T03:52:35.644 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/leds-lm3530.ko 2026-02-13T03:52:35.644 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/leds-lp3944.ko 2026-02-13T03:52:35.644 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/leds-ss4200.ko 2026-02-13T03:52:35.644 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger 2026-02-13T03:52:35.644 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2026-02-13T03:52:35.644 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-camera.ko 2026-02-13T03:52:35.644 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2026-02-13T03:52:35.644 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2026-02-13T03:52:35.644 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2026-02-13T03:52:35.644 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2026-02-13T03:52:35.644 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-timer.ko 2026-02-13T03:52:35.644 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/leds/trigger/ledtrig-transient.ko 2026-02-13T03:52:35.644 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md 2026-02-13T03:52:35.644 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/bcache 2026-02-13T03:52:35.644 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/bcache/bcache.ko 2026-02-13T03:52:35.644 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-bio-prison.ko 2026-02-13T03:52:35.644 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-cache-smq.ko 2026-02-13T03:52:35.644 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-cache.ko 2026-02-13T03:52:35.644 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-crypt.ko 2026-02-13T03:52:35.645 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-delay.ko 2026-02-13T03:52:35.645 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-flakey.ko 2026-02-13T03:52:35.645 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-log-userspace.ko 2026-02-13T03:52:35.645 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-multipath.ko 2026-02-13T03:52:35.645 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-queue-length.ko 2026-02-13T03:52:35.645 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-raid.ko 2026-02-13T03:52:35.645 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-round-robin.ko 2026-02-13T03:52:35.645 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-service-time.ko 2026-02-13T03:52:35.645 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-switch.ko 2026-02-13T03:52:35.645 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-thin-pool.ko 2026-02-13T03:52:35.645 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/dm-verity.ko 2026-02-13T03:52:35.645 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/linear.ko 2026-02-13T03:52:35.645 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/persistent-data 2026-02-13T03:52:35.645 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2026-02-13T03:52:35.645 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/raid0.ko 2026-02-13T03:52:35.645 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/raid1.ko 2026-02-13T03:52:35.645 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/raid10.ko 2026-02-13T03:52:35.645 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/md/raid456.ko 2026-02-13T03:52:35.645 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message 2026-02-13T03:52:35.645 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion 2026-02-13T03:52:35.645 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptbase.ko 2026-02-13T03:52:35.645 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptctl.ko 2026-02-13T03:52:35.645 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptfc.ko 2026-02-13T03:52:35.645 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptlan.ko 2026-02-13T03:52:35.645 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptsas.ko 2026-02-13T03:52:35.645 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptscsih.ko 2026-02-13T03:52:35.646 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/message/fusion/mptspi.ko 2026-02-13T03:52:35.646 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd 2026-02-13T03:52:35.646 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/lpc_ich.ko 2026-02-13T03:52:35.646 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/lpc_sch.ko 2026-02-13T03:52:35.646 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/mfd-core.ko 2026-02-13T03:52:35.646 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/sm501.ko 2026-02-13T03:52:35.646 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/viperboard.ko 2026-02-13T03:52:35.646 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/mfd/vx855.ko 2026-02-13T03:52:35.646 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc 2026-02-13T03:52:35.646 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/altera-stapl 2026-02-13T03:52:35.646 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2026-02-13T03:52:35.646 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/apds9802als.ko 2026-02-13T03:52:35.646 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/apds990x.ko 2026-02-13T03:52:35.646 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/bh1770glc.ko 2026-02-13T03:52:35.646 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/cb710 2026-02-13T03:52:35.646 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/cb710/cb710.ko 2026-02-13T03:52:35.646 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/eeprom 2026-02-13T03:52:35.646 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/eeprom/at24.ko 2026-02-13T03:52:35.646 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/eeprom/max6875.ko 2026-02-13T03:52:35.646 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/enclosure.ko 2026-02-13T03:52:35.646 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/hpilo.ko 2026-02-13T03:52:35.646 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/isl29003.ko 2026-02-13T03:52:35.646 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/isl29020.ko 2026-02-13T03:52:35.646 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/lis3lv02d 2026-02-13T03:52:35.646 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2026-02-13T03:52:35.646 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2026-02-13T03:52:35.646 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/mei 2026-02-13T03:52:35.647 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/mei/mei-me.ko 2026-02-13T03:52:35.647 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/mei/mei-txe.ko 2026-02-13T03:52:35.647 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/mei/mei.ko 2026-02-13T03:52:35.647 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-gru 2026-02-13T03:52:35.647 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-gru/gru.ko 2026-02-13T03:52:35.647 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-xp 2026-02-13T03:52:35.647 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-xp/xp.ko 2026-02-13T03:52:35.647 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-xp/xpc.ko 2026-02-13T03:52:35.647 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/sgi-xp/xpnet.ko 2026-02-13T03:52:35.647 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/tifm_7xx1.ko 2026-02-13T03:52:35.647 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/tifm_core.ko 2026-02-13T03:52:35.647 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/tsl2550.ko 2026-02-13T03:52:35.647 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/vmw_balloon.ko 2026-02-13T03:52:35.647 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/vmw_vmci 2026-02-13T03:52:35.647 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2026-02-13T03:52:35.647 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net 2026-02-13T03:52:35.647 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/bonding 2026-02-13T03:52:35.647 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/bonding/bonding.ko 2026-02-13T03:52:35.647 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa 2026-02-13T03:52:35.647 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/b53 2026-02-13T03:52:35.647 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/b53/b53_common.ko 2026-02-13T03:52:35.647 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/bcm-sf2.ko 2026-02-13T03:52:35.647 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/mv88e6060.ko 2026-02-13T03:52:35.647 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/mv88e6xxx 2026-02-13T03:52:35.647 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2026-02-13T03:52:35.648 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/dummy.ko 2026-02-13T03:52:35.648 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/eql.ko 2026-02-13T03:52:35.648 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet 2026-02-13T03:52:35.648 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com 2026-02-13T03:52:35.648 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2026-02-13T03:52:35.648 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2026-02-13T03:52:35.648 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com/3c59x.ko 2026-02-13T03:52:35.648 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/3com/typhoon.ko 2026-02-13T03:52:35.648 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390 2026-02-13T03:52:35.648 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390/8390.ko 2026-02-13T03:52:35.648 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2026-02-13T03:52:35.648 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2026-02-13T03:52:35.648 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2026-02-13T03:52:35.648 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/adaptec 2026-02-13T03:52:35.648 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/adaptec/starfire.ko 2026-02-13T03:52:35.648 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/agere 2026-02-13T03:52:35.648 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/agere/et131x.ko 2026-02-13T03:52:35.648 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/alteon 2026-02-13T03:52:35.648 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/alteon/acenic.ko 2026-02-13T03:52:35.648 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/altera 2026-02-13T03:52:35.648 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/altera/altera_tse.ko 2026-02-13T03:52:35.648 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/amd 2026-02-13T03:52:35.648 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/amd/amd8111e.ko 2026-02-13T03:52:35.648 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2026-02-13T03:52:35.648 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/amd/pcnet32.ko 2026-02-13T03:52:35.648 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros 2026-02-13T03:52:35.648 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/alx 2026-02-13T03:52:35.648 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2026-02-13T03:52:35.649 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atl1c 2026-02-13T03:52:35.649 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2026-02-13T03:52:35.649 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atl1e 2026-02-13T03:52:35.649 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2026-02-13T03:52:35.649 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atlx 2026-02-13T03:52:35.649 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2026-02-13T03:52:35.649 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2026-02-13T03:52:35.649 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom 2026-02-13T03:52:35.649 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/b44.ko 2026-02-13T03:52:35.649 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2026-02-13T03:52:35.649 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/bnx2x 2026-02-13T03:52:35.649 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2026-02-13T03:52:35.649 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/cnic.ko 2026-02-13T03:52:35.649 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/genet 2026-02-13T03:52:35.649 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2026-02-13T03:52:35.649 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/broadcom/tg3.ko 2026-02-13T03:52:35.649 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/brocade 2026-02-13T03:52:35.649 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/brocade/bna 2026-02-13T03:52:35.649 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2026-02-13T03:52:35.649 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio 2026-02-13T03:52:35.649 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb 2026-02-13T03:52:35.649 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2026-02-13T03:52:35.649 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb3 2026-02-13T03:52:35.649 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2026-02-13T03:52:35.649 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb4 2026-02-13T03:52:35.649 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2026-02-13T03:52:35.649 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2026-02-13T03:52:35.650 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2026-02-13T03:52:35.650 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/libcxgb 2026-02-13T03:52:35.650 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2026-02-13T03:52:35.650 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/cisco 2026-02-13T03:52:35.650 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/cisco/enic 2026-02-13T03:52:35.650 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2026-02-13T03:52:35.650 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec 2026-02-13T03:52:35.650 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip 2026-02-13T03:52:35.650 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2026-02-13T03:52:35.650 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2026-02-13T03:52:35.650 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2026-02-13T03:52:35.650 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2026-02-13T03:52:35.650 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2026-02-13T03:52:35.650 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2026-02-13T03:52:35.650 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dlink 2026-02-13T03:52:35.650 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dlink/dl2k.ko 2026-02-13T03:52:35.650 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dlink/sundance.ko 2026-02-13T03:52:35.650 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/dnet.ko 2026-02-13T03:52:35.650 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/emulex 2026-02-13T03:52:35.650 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/emulex/benet 2026-02-13T03:52:35.650 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2026-02-13T03:52:35.650 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/ethoc.ko 2026-02-13T03:52:35.650 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/fealnx.ko 2026-02-13T03:52:35.650 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel 2026-02-13T03:52:35.650 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e100.ko 2026-02-13T03:52:35.650 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e1000 2026-02-13T03:52:35.650 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2026-02-13T03:52:35.650 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e1000e 2026-02-13T03:52:35.650 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2026-02-13T03:52:35.650 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/fm10k 2026-02-13T03:52:35.651 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2026-02-13T03:52:35.651 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/i40e 2026-02-13T03:52:35.651 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2026-02-13T03:52:35.651 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/iavf 2026-02-13T03:52:35.651 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2026-02-13T03:52:35.651 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ice 2026-02-13T03:52:35.651 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ice/ice.ko 2026-02-13T03:52:35.651 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/igb 2026-02-13T03:52:35.651 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/igb/igb.ko 2026-02-13T03:52:35.651 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/igbvf 2026-02-13T03:52:35.651 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2026-02-13T03:52:35.651 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ixgbe 2026-02-13T03:52:35.651 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2026-02-13T03:52:35.651 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ixgbevf 2026-02-13T03:52:35.651 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2026-02-13T03:52:35.651 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libeth 2026-02-13T03:52:35.651 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2026-02-13T03:52:35.651 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libeth/libeth_xdp.ko 2026-02-13T03:52:35.651 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libie 2026-02-13T03:52:35.651 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libie/libie.ko 2026-02-13T03:52:35.651 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libie/libie_adminq.ko 2026-02-13T03:52:35.651 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/intel/libie/libie_fwlog.ko 2026-02-13T03:52:35.651 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/jme.ko 2026-02-13T03:52:35.651 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/marvell 2026-02-13T03:52:35.651 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2026-02-13T03:52:35.651 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/marvell/skge.ko 2026-02-13T03:52:35.651 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/marvell/sky2.ko 2026-02-13T03:52:35.651 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox 2026-02-13T03:52:35.651 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx4 2026-02-13T03:52:35.652 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2026-02-13T03:52:35.652 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2026-02-13T03:52:35.652 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx5 2026-02-13T03:52:35.652 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx5/core 2026-02-13T03:52:35.652 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2026-02-13T03:52:35.652 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/micrel 2026-02-13T03:52:35.652 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2026-02-13T03:52:35.652 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/myricom 2026-02-13T03:52:35.652 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/myricom/myri10ge 2026-02-13T03:52:35.652 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2026-02-13T03:52:35.652 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/natsemi 2026-02-13T03:52:35.652 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2026-02-13T03:52:35.652 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2026-02-13T03:52:35.652 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/neterion 2026-02-13T03:52:35.652 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/neterion/s2io.ko 2026-02-13T03:52:35.652 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/nvidia 2026-02-13T03:52:35.652 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2026-02-13T03:52:35.652 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/packetengines 2026-02-13T03:52:35.652 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2026-02-13T03:52:35.652 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2026-02-13T03:52:35.652 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic 2026-02-13T03:52:35.652 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/netxen 2026-02-13T03:52:35.652 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2026-02-13T03:52:35.652 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2026-02-13T03:52:35.652 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/qlcnic 2026-02-13T03:52:35.652 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2026-02-13T03:52:35.652 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/rdc 2026-02-13T03:52:35.652 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/rdc/r6040.ko 2026-02-13T03:52:35.652 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek 2026-02-13T03:52:35.652 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek/8139cp.ko 2026-02-13T03:52:35.653 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek/8139too.ko 2026-02-13T03:52:35.653 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek/atp.ko 2026-02-13T03:52:35.653 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/realtek/r8169.ko 2026-02-13T03:52:35.653 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/rocker 2026-02-13T03:52:35.653 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/rocker/rocker.ko 2026-02-13T03:52:35.653 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sfc 2026-02-13T03:52:35.653 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sfc/sfc.ko 2026-02-13T03:52:35.653 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/silan 2026-02-13T03:52:35.653 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/silan/sc92031.ko 2026-02-13T03:52:35.653 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sis 2026-02-13T03:52:35.653 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sis/sis190.ko 2026-02-13T03:52:35.653 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sis/sis900.ko 2026-02-13T03:52:35.653 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc 2026-02-13T03:52:35.653 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc/epic100.ko 2026-02-13T03:52:35.653 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2026-02-13T03:52:35.653 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2026-02-13T03:52:35.653 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2026-02-13T03:52:35.653 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/stmicro 2026-02-13T03:52:35.653 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/stmicro/stmmac 2026-02-13T03:52:35.653 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2026-02-13T03:52:35.653 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2026-02-13T03:52:35.653 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun 2026-02-13T03:52:35.653 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun/cassini.ko 2026-02-13T03:52:35.653 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun/niu.ko 2026-02-13T03:52:35.653 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun/sungem.ko 2026-02-13T03:52:35.653 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/sun/sunhme.ko 2026-02-13T03:52:35.653 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/tehuti 2026-02-13T03:52:35.653 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2026-02-13T03:52:35.653 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/ti 2026-02-13T03:52:35.653 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/ti/tlan.ko 2026-02-13T03:52:35.653 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/via 2026-02-13T03:52:35.654 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/via/via-rhine.ko 2026-02-13T03:52:35.654 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/via/via-velocity.ko 2026-02-13T03:52:35.654 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/wiznet 2026-02-13T03:52:35.654 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/wiznet/w5100.ko 2026-02-13T03:52:35.654 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/wiznet/w5300.ko 2026-02-13T03:52:35.654 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/xircom 2026-02-13T03:52:35.654 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2026-02-13T03:52:35.654 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/geneve.ko 2026-02-13T03:52:35.654 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ieee802154 2026-02-13T03:52:35.654 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ieee802154/fakelb.ko 2026-02-13T03:52:35.654 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ifb.ko 2026-02-13T03:52:35.654 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ipvlan 2026-02-13T03:52:35.654 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ipvlan/ipvlan.ko 2026-02-13T03:52:35.654 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/macvlan.ko 2026-02-13T03:52:35.654 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/macvtap.ko 2026-02-13T03:52:35.654 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio 2026-02-13T03:52:35.654 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio.ko 2026-02-13T03:52:35.654 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2026-02-13T03:52:35.654 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio/mdio-bitbang.ko 2026-02-13T03:52:35.654 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mdio/mdio-regmap.ko 2026-02-13T03:52:35.654 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/mii.ko 2026-02-13T03:52:35.654 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/net_failover.ko 2026-02-13T03:52:35.654 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/netconsole.ko 2026-02-13T03:52:35.654 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/nlmon.ko 2026-02-13T03:52:35.654 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/pcs 2026-02-13T03:52:35.654 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/pcs/pcs-lynx.ko 2026-02-13T03:52:35.654 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/pcs/pcs_xpcs.ko 2026-02-13T03:52:35.654 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy 2026-02-13T03:52:35.654 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/amd.ko 2026-02-13T03:52:35.654 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/bcm-phy-lib.ko 2026-02-13T03:52:35.655 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/bcm-phy-ptp.ko 2026-02-13T03:52:35.655 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/bcm7xxx.ko 2026-02-13T03:52:35.655 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/bcm87xx.ko 2026-02-13T03:52:35.655 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/broadcom.ko 2026-02-13T03:52:35.655 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/cicada.ko 2026-02-13T03:52:35.655 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/davicom.ko 2026-02-13T03:52:35.655 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/dp83640.ko 2026-02-13T03:52:35.655 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/et1011c.ko 2026-02-13T03:52:35.655 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/icplus.ko 2026-02-13T03:52:35.655 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/lxt.ko 2026-02-13T03:52:35.655 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/marvell.ko 2026-02-13T03:52:35.655 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/micrel.ko 2026-02-13T03:52:35.655 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/national.ko 2026-02-13T03:52:35.655 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/phy_package.ko 2026-02-13T03:52:35.655 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/phylink.ko 2026-02-13T03:52:35.655 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/qsemi.ko 2026-02-13T03:52:35.655 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/realtek 2026-02-13T03:52:35.655 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/realtek/realtek.ko 2026-02-13T03:52:35.655 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/smsc.ko 2026-02-13T03:52:35.655 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/ste10Xp.ko 2026-02-13T03:52:35.655 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/phy/vitesse.ko 2026-02-13T03:52:35.655 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp 2026-02-13T03:52:35.655 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/bsd_comp.ko 2026-02-13T03:52:35.655 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_async.ko 2026-02-13T03:52:35.655 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_deflate.ko 2026-02-13T03:52:35.655 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_generic.ko 2026-02-13T03:52:35.655 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_mppe.ko 2026-02-13T03:52:35.655 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/ppp_synctty.ko 2026-02-13T03:52:35.656 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/pppoe.ko 2026-02-13T03:52:35.656 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/pppox.ko 2026-02-13T03:52:35.656 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/ppp/pptp.ko 2026-02-13T03:52:35.656 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/slip 2026-02-13T03:52:35.656 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/slip/slhc.ko 2026-02-13T03:52:35.656 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/slip/slip.ko 2026-02-13T03:52:35.656 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/sungem_phy.ko 2026-02-13T03:52:35.656 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/tap.ko 2026-02-13T03:52:35.656 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team 2026-02-13T03:52:35.656 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team.ko 2026-02-13T03:52:35.656 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_activebackup.ko 2026-02-13T03:52:35.656 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_broadcast.ko 2026-02-13T03:52:35.656 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_loadbalance.ko 2026-02-13T03:52:35.656 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_random.ko 2026-02-13T03:52:35.656 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/team/team_mode_roundrobin.ko 2026-02-13T03:52:35.656 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/tun.ko 2026-02-13T03:52:35.656 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/veth.ko 2026-02-13T03:52:35.656 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/virtio_net.ko 2026-02-13T03:52:35.656 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/vmxnet3 2026-02-13T03:52:35.656 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/vmxnet3/vmxnet3.ko 2026-02-13T03:52:35.656 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/vxlan 2026-02-13T03:52:35.656 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/vxlan/vxlan.ko 2026-02-13T03:52:35.656 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/xen-netback 2026-02-13T03:52:35.656 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/xen-netback/xen-netback.ko 2026-02-13T03:52:35.656 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/net/xen-netfront.ko 2026-02-13T03:52:35.656 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ntb 2026-02-13T03:52:35.656 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ntb/ntb.ko 2026-02-13T03:52:35.656 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/nvme 2026-02-13T03:52:35.656 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/nvme/host 2026-02-13T03:52:35.656 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/nvme/host/nvme-core.ko 2026-02-13T03:52:35.656 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/nvme/host/nvme.ko 2026-02-13T03:52:35.656 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport 2026-02-13T03:52:35.657 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport/parport.ko 2026-02-13T03:52:35.657 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport/parport_cs.ko 2026-02-13T03:52:35.657 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport/parport_pc.ko 2026-02-13T03:52:35.657 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/parport/parport_serial.ko 2026-02-13T03:52:35.657 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci 2026-02-13T03:52:35.657 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/hotplug 2026-02-13T03:52:35.657 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2026-02-13T03:52:35.657 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/pcie 2026-02-13T03:52:35.657 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/pcie/aer_inject.ko 2026-02-13T03:52:35.657 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pci/xen-pcifront.ko 2026-02-13T03:52:35.657 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pcmcia 2026-02-13T03:52:35.657 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pcmcia/i82092.ko 2026-02-13T03:52:35.657 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pcmcia/pd6729.ko 2026-02-13T03:52:35.657 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pcmcia/yenta_socket.ko 2026-02-13T03:52:35.657 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pinctrl 2026-02-13T03:52:35.657 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pinctrl/intel 2026-02-13T03:52:35.657 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2026-02-13T03:52:35.657 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform 2026-02-13T03:52:35.657 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/wmi 2026-02-13T03:52:35.657 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/wmi/wmi.ko 2026-02-13T03:52:35.657 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86 2026-02-13T03:52:35.657 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/acer-wmi.ko 2026-02-13T03:52:35.657 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/acerhdf.ko 2026-02-13T03:52:35.657 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/apple-gmux.ko 2026-02-13T03:52:35.657 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/asus-laptop.ko 2026-02-13T03:52:35.657 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/asus-nb-wmi.ko 2026-02-13T03:52:35.657 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/asus-wmi.ko 2026-02-13T03:52:35.657 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/classmate-laptop.ko 2026-02-13T03:52:35.657 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/eeepc-laptop.ko 2026-02-13T03:52:35.657 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/eeepc-wmi.ko 2026-02-13T03:52:35.657 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/fujitsu-laptop.ko 2026-02-13T03:52:35.658 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/fujitsu-tablet.ko 2026-02-13T03:52:35.658 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/hdaps.ko 2026-02-13T03:52:35.658 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/intel 2026-02-13T03:52:35.658 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/intel/intel-rst.ko 2026-02-13T03:52:35.658 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/intel_ips.ko 2026-02-13T03:52:35.658 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/msi-wmi.ko 2026-02-13T03:52:35.658 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/mxm-wmi.ko 2026-02-13T03:52:35.658 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/panasonic-laptop.ko 2026-02-13T03:52:35.658 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/samsung-laptop.ko 2026-02-13T03:52:35.658 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/samsung-q10.ko 2026-02-13T03:52:35.658 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/topstar-laptop.ko 2026-02-13T03:52:35.658 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2026-02-13T03:52:35.658 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/toshiba_haps.ko 2026-02-13T03:52:35.658 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/platform/x86/wmi-bmof.ko 2026-02-13T03:52:35.658 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/powercap 2026-02-13T03:52:35.658 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/powercap/intel_rapl_common.ko 2026-02-13T03:52:35.658 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/powercap/intel_rapl_msr.ko 2026-02-13T03:52:35.658 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps 2026-02-13T03:52:35.658 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/clients 2026-02-13T03:52:35.658 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/clients/pps-gpio.ko 2026-02-13T03:52:35.658 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/clients/pps-ldisc.ko 2026-02-13T03:52:35.658 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/clients/pps_parport.ko 2026-02-13T03:52:35.658 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/pps/pps_core.ko 2026-02-13T03:52:35.658 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ptp 2026-02-13T03:52:35.658 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ptp/ptp.ko 2026-02-13T03:52:35.658 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ptp/ptp_kvm.ko 2026-02-13T03:52:35.658 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ptp/ptp_vmclock.ko 2026-02-13T03:52:35.658 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras 2026-02-13T03:52:35.658 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras/amd 2026-02-13T03:52:35.658 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras/amd/atl 2026-02-13T03:52:35.658 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras/amd/atl/amd_atl.ko 2026-02-13T03:52:35.658 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ras/amd/fmpm.ko 2026-02-13T03:52:35.659 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc 2026-02-13T03:52:35.659 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-bq32k.ko 2026-02-13T03:52:35.659 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1286.ko 2026-02-13T03:52:35.659 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1307.ko 2026-02-13T03:52:35.659 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1374.ko 2026-02-13T03:52:35.659 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1511.ko 2026-02-13T03:52:35.659 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1553.ko 2026-02-13T03:52:35.659 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1672.ko 2026-02-13T03:52:35.659 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds1742.ko 2026-02-13T03:52:35.659 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds2404.ko 2026-02-13T03:52:35.659 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-ds3232.ko 2026-02-13T03:52:35.659 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-em3027.ko 2026-02-13T03:52:35.659 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-fm3130.ko 2026-02-13T03:52:35.659 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-isl12022.ko 2026-02-13T03:52:35.659 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-isl1208.ko 2026-02-13T03:52:35.659 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-m41t80.ko 2026-02-13T03:52:35.659 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-m48t35.ko 2026-02-13T03:52:35.659 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-m48t59.ko 2026-02-13T03:52:35.659 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-max6900.ko 2026-02-13T03:52:35.659 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-msm6242.ko 2026-02-13T03:52:35.659 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf2127.ko 2026-02-13T03:52:35.659 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf85063.ko 2026-02-13T03:52:35.659 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf8523.ko 2026-02-13T03:52:35.659 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf8563.ko 2026-02-13T03:52:35.659 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-pcf8583.ko 2026-02-13T03:52:35.659 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rp5c01.ko 2026-02-13T03:52:35.659 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rs5c372.ko 2026-02-13T03:52:35.659 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rv3029c2.ko 2026-02-13T03:52:35.659 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rx8025.ko 2026-02-13T03:52:35.659 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-rx8581.ko 2026-02-13T03:52:35.659 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-stk17ta8.ko 2026-02-13T03:52:35.659 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/rtc/rtc-x1205.ko 2026-02-13T03:52:35.659 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi 2026-02-13T03:52:35.659 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/3w-9xxx.ko 2026-02-13T03:52:35.659 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/3w-sas.ko 2026-02-13T03:52:35.660 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/3w-xxxx.ko 2026-02-13T03:52:35.660 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/BusLogic.ko 2026-02-13T03:52:35.660 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/a100u2w.ko 2026-02-13T03:52:35.660 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aacraid 2026-02-13T03:52:35.660 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aacraid/aacraid.ko 2026-02-13T03:52:35.660 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/advansys.ko 2026-02-13T03:52:35.660 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aic7xxx 2026-02-13T03:52:35.660 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2026-02-13T03:52:35.660 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2026-02-13T03:52:35.660 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/am53c974.ko 2026-02-13T03:52:35.660 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/arcmsr 2026-02-13T03:52:35.660 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/arcmsr/arcmsr.ko 2026-02-13T03:52:35.660 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/atp870u.ko 2026-02-13T03:52:35.660 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/be2iscsi 2026-02-13T03:52:35.660 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2026-02-13T03:52:35.660 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bfa 2026-02-13T03:52:35.660 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bfa/bfa.ko 2026-02-13T03:52:35.660 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bnx2fc 2026-02-13T03:52:35.660 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2026-02-13T03:52:35.660 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bnx2i 2026-02-13T03:52:35.660 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/bnx2i/bnx2i.ko 2026-02-13T03:52:35.660 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/ch.ko 2026-02-13T03:52:35.660 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/csiostor 2026-02-13T03:52:35.660 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/csiostor/csiostor.ko 2026-02-13T03:52:35.660 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi 2026-02-13T03:52:35.660 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/cxgb3i 2026-02-13T03:52:35.660 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2026-02-13T03:52:35.660 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/cxgb4i 2026-02-13T03:52:35.660 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2026-02-13T03:52:35.660 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2026-02-13T03:52:35.660 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/dc395x.ko 2026-02-13T03:52:35.660 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler 2026-02-13T03:52:35.660 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2026-02-13T03:52:35.660 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2026-02-13T03:52:35.660 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2026-02-13T03:52:35.661 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2026-02-13T03:52:35.661 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/dmx3191d.ko 2026-02-13T03:52:35.661 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/esas2r 2026-02-13T03:52:35.661 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/esas2r/esas2r.ko 2026-02-13T03:52:35.661 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/esp_scsi.ko 2026-02-13T03:52:35.661 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fcoe 2026-02-13T03:52:35.661 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fcoe/fcoe.ko 2026-02-13T03:52:35.661 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fcoe/libfcoe.ko 2026-02-13T03:52:35.661 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fnic 2026-02-13T03:52:35.661 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/fnic/fnic.ko 2026-02-13T03:52:35.661 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/hpsa.ko 2026-02-13T03:52:35.661 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/hptiop.ko 2026-02-13T03:52:35.661 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/initio.ko 2026-02-13T03:52:35.661 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/ipr.ko 2026-02-13T03:52:35.661 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/ips.ko 2026-02-13T03:52:35.661 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/isci 2026-02-13T03:52:35.661 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/isci/isci.ko 2026-02-13T03:52:35.661 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2026-02-13T03:52:35.661 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/iscsi_tcp.ko 2026-02-13T03:52:35.661 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libfc 2026-02-13T03:52:35.661 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libfc/libfc.ko 2026-02-13T03:52:35.661 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libiscsi.ko 2026-02-13T03:52:35.661 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libiscsi_tcp.ko 2026-02-13T03:52:35.661 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libsas 2026-02-13T03:52:35.661 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/libsas/libsas.ko 2026-02-13T03:52:35.661 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/lpfc 2026-02-13T03:52:35.661 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/lpfc/lpfc.ko 2026-02-13T03:52:35.661 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid 2026-02-13T03:52:35.661 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid.ko 2026-02-13T03:52:35.661 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2026-02-13T03:52:35.661 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2026-02-13T03:52:35.661 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2026-02-13T03:52:35.661 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mpt3sas 2026-02-13T03:52:35.661 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2026-02-13T03:52:35.661 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mvsas 2026-02-13T03:52:35.661 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mvsas/mvsas.ko 2026-02-13T03:52:35.662 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/mvumi.ko 2026-02-13T03:52:35.662 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/pm8001 2026-02-13T03:52:35.662 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/pm8001/pm80xx.ko 2026-02-13T03:52:35.662 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/pmcraid.ko 2026-02-13T03:52:35.662 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla1280.ko 2026-02-13T03:52:35.662 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla2xxx 2026-02-13T03:52:35.662 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2026-02-13T03:52:35.662 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2026-02-13T03:52:35.662 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla4xxx 2026-02-13T03:52:35.662 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2026-02-13T03:52:35.662 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/raid_class.ko 2026-02-13T03:52:35.662 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_debug.ko 2026-02-13T03:52:35.662 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_fc.ko 2026-02-13T03:52:35.662 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_iscsi.ko 2026-02-13T03:52:35.662 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_sas.ko 2026-02-13T03:52:35.662 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_spi.ko 2026-02-13T03:52:35.662 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/scsi_transport_srp.ko 2026-02-13T03:52:35.662 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/ses.ko 2026-02-13T03:52:35.662 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/st.ko 2026-02-13T03:52:35.662 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/stex.ko 2026-02-13T03:52:35.662 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/sym53c8xx_2 2026-02-13T03:52:35.662 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2026-02-13T03:52:35.662 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/virtio_scsi.ko 2026-02-13T03:52:35.662 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/vmw_pvscsi.ko 2026-02-13T03:52:35.662 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/scsi/wd719x.ko 2026-02-13T03:52:35.662 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ssb 2026-02-13T03:52:35.662 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ssb/ssb.ko 2026-02-13T03:52:35.662 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target 2026-02-13T03:52:35.662 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/iscsi 2026-02-13T03:52:35.662 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2026-02-13T03:52:35.662 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/loopback 2026-02-13T03:52:35.662 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/loopback/tcm_loop.ko 2026-02-13T03:52:35.662 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_file.ko 2026-02-13T03:52:35.662 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_iblock.ko 2026-02-13T03:52:35.662 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_mod.ko 2026-02-13T03:52:35.663 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_pscsi.ko 2026-02-13T03:52:35.663 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/target_core_user.ko 2026-02-13T03:52:35.663 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/tcm_fc 2026-02-13T03:52:35.663 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/target/tcm_fc/tcm_fc.ko 2026-02-13T03:52:35.663 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal 2026-02-13T03:52:35.663 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel 2026-02-13T03:52:35.663 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal 2026-02-13T03:52:35.663 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2026-02-13T03:52:35.663 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2026-02-13T03:52:35.663 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2026-02-13T03:52:35.663 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2026-02-13T03:52:35.663 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2026-02-13T03:52:35.663 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2026-02-13T03:52:35.663 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/platform_temperature_control.ko 2026-02-13T03:52:35.663 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2026-02-13T03:52:35.663 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2026-02-13T03:52:35.663 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2026-02-13T03:52:35.663 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2026-02-13T03:52:35.663 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2026-02-13T03:52:35.663 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2026-02-13T03:52:35.663 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2026-02-13T03:52:35.663 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_soc_slider.ko 2026-02-13T03:52:35.663 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2026-02-13T03:52:35.663 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2026-02-13T03:52:35.663 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2026-02-13T03:52:35.663 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2026-02-13T03:52:35.663 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2026-02-13T03:52:35.663 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty 2026-02-13T03:52:35.663 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/ipwireless 2026-02-13T03:52:35.663 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/ipwireless/ipwireless.ko 2026-02-13T03:52:35.663 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/n_gsm.ko 2026-02-13T03:52:35.663 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/n_hdlc.ko 2026-02-13T03:52:35.663 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/nozomi.ko 2026-02-13T03:52:35.663 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial 2026-02-13T03:52:35.663 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/8250 2026-02-13T03:52:35.663 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/8250/serial_cs.ko 2026-02-13T03:52:35.663 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/arc_uart.ko 2026-02-13T03:52:35.664 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/jsm 2026-02-13T03:52:35.664 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/tty/serial/jsm/jsm.ko 2026-02-13T03:52:35.664 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs 2026-02-13T03:52:35.664 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs/core 2026-02-13T03:52:35.664 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs/core/ufshcd-core.ko 2026-02-13T03:52:35.664 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs/host 2026-02-13T03:52:35.664 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/ufs/host/ufshcd-pci.ko 2026-02-13T03:52:35.664 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio 2026-02-13T03:52:35.664 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio.ko 2026-02-13T03:52:35.664 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio_aec.ko 2026-02-13T03:52:35.664 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio_cif.ko 2026-02-13T03:52:35.664 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio_pci_generic.ko 2026-02-13T03:52:35.664 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/uio/uio_sercos3.ko 2026-02-13T03:52:35.664 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb 2026-02-13T03:52:35.664 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class 2026-02-13T03:52:35.664 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class/cdc-acm.ko 2026-02-13T03:52:35.664 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class/cdc-wdm.ko 2026-02-13T03:52:35.664 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class/usblp.ko 2026-02-13T03:52:35.664 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/class/usbtmc.ko 2026-02-13T03:52:35.664 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/host 2026-02-13T03:52:35.664 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/host/sl811-hcd.ko 2026-02-13T03:52:35.664 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/image 2026-02-13T03:52:35.664 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/image/mdc800.ko 2026-02-13T03:52:35.664 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/image/microtek.ko 2026-02-13T03:52:35.664 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc 2026-02-13T03:52:35.664 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/adutux.ko 2026-02-13T03:52:35.664 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/appledisplay.ko 2026-02-13T03:52:35.664 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/emi26.ko 2026-02-13T03:52:35.664 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/emi62.ko 2026-02-13T03:52:35.664 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/ezusb.ko 2026-02-13T03:52:35.664 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/idmouse.ko 2026-02-13T03:52:35.664 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/iowarrior.ko 2026-02-13T03:52:35.664 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/isight_firmware.ko 2026-02-13T03:52:35.664 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/ldusb.ko 2026-02-13T03:52:35.664 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/legousbtower.ko 2026-02-13T03:52:35.664 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/sisusbvga 2026-02-13T03:52:35.664 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2026-02-13T03:52:35.665 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/trancevibrator.ko 2026-02-13T03:52:35.665 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/usb3503.ko 2026-02-13T03:52:35.665 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/usblcd.ko 2026-02-13T03:52:35.665 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/usbsevseg.ko 2026-02-13T03:52:35.665 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/uss720.ko 2026-02-13T03:52:35.665 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/misc/yurex.ko 2026-02-13T03:52:35.665 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/phy 2026-02-13T03:52:35.665 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/phy/phy-generic.ko 2026-02-13T03:52:35.665 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial 2026-02-13T03:52:35.665 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/aircable.ko 2026-02-13T03:52:35.665 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ark3116.ko 2026-02-13T03:52:35.665 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/belkin_sa.ko 2026-02-13T03:52:35.665 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ch341.ko 2026-02-13T03:52:35.665 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/cp210x.ko 2026-02-13T03:52:35.665 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/cyberjack.ko 2026-02-13T03:52:35.665 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/cypress_m8.ko 2026-02-13T03:52:35.665 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/digi_acceleport.ko 2026-02-13T03:52:35.665 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/empeg.ko 2026-02-13T03:52:35.665 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ftdi_sio.ko 2026-02-13T03:52:35.665 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/garmin_gps.ko 2026-02-13T03:52:35.665 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/io_edgeport.ko 2026-02-13T03:52:35.665 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/io_ti.ko 2026-02-13T03:52:35.665 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ipaq.ko 2026-02-13T03:52:35.665 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ipw.ko 2026-02-13T03:52:35.665 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ir-usb.ko 2026-02-13T03:52:35.665 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/iuu_phoenix.ko 2026-02-13T03:52:35.665 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/keyspan.ko 2026-02-13T03:52:35.665 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/keyspan_pda.ko 2026-02-13T03:52:35.665 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/kl5kusb105.ko 2026-02-13T03:52:35.665 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/kobil_sct.ko 2026-02-13T03:52:35.665 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/mct_u232.ko 2026-02-13T03:52:35.665 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/mos7720.ko 2026-02-13T03:52:35.665 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/mos7840.ko 2026-02-13T03:52:35.665 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/navman.ko 2026-02-13T03:52:35.665 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/omninet.ko 2026-02-13T03:52:35.665 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/opticon.ko 2026-02-13T03:52:35.665 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/option.ko 2026-02-13T03:52:35.666 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/oti6858.ko 2026-02-13T03:52:35.666 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/pl2303.ko 2026-02-13T03:52:35.666 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/qcaux.ko 2026-02-13T03:52:35.666 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/qcserial.ko 2026-02-13T03:52:35.666 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/quatech2.ko 2026-02-13T03:52:35.666 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/safe_serial.ko 2026-02-13T03:52:35.666 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/sierra.ko 2026-02-13T03:52:35.666 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/spcp8x5.ko 2026-02-13T03:52:35.666 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ssu100.ko 2026-02-13T03:52:35.666 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/symbolserial.ko 2026-02-13T03:52:35.666 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2026-02-13T03:52:35.666 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/usb-serial-simple.ko 2026-02-13T03:52:35.666 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/usb_debug.ko 2026-02-13T03:52:35.666 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/usb_wwan.ko 2026-02-13T03:52:35.666 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/visor.ko 2026-02-13T03:52:35.666 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/whiteheat.ko 2026-02-13T03:52:35.666 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/serial/xsens_mt.ko 2026-02-13T03:52:35.666 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage 2026-02-13T03:52:35.666 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/uas.ko 2026-02-13T03:52:35.666 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-alauda.ko 2026-02-13T03:52:35.666 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-cypress.ko 2026-02-13T03:52:35.666 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-datafab.ko 2026-02-13T03:52:35.666 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-eneub6250.ko 2026-02-13T03:52:35.666 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-freecom.ko 2026-02-13T03:52:35.666 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-isd200.ko 2026-02-13T03:52:35.666 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-jumpshot.ko 2026-02-13T03:52:35.666 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-karma.ko 2026-02-13T03:52:35.666 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-onetouch.ko 2026-02-13T03:52:35.666 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-realtek.ko 2026-02-13T03:52:35.666 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-sddr09.ko 2026-02-13T03:52:35.666 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-sddr55.ko 2026-02-13T03:52:35.666 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/ums-usbat.ko 2026-02-13T03:52:35.666 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/storage/usb-storage.ko 2026-02-13T03:52:35.666 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/usbip 2026-02-13T03:52:35.666 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/usbip/usbip-core.ko 2026-02-13T03:52:35.666 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/usbip/usbip-host.ko 2026-02-13T03:52:35.666 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/usb/usbip/vhci-hcd.ko 2026-02-13T03:52:35.667 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio 2026-02-13T03:52:35.667 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/pci 2026-02-13T03:52:35.667 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/pci/vfio-pci-core.ko 2026-02-13T03:52:35.667 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/pci/vfio-pci.ko 2026-02-13T03:52:35.667 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/vfio.ko 2026-02-13T03:52:35.667 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vfio/vfio_iommu_type1.ko 2026-02-13T03:52:35.667 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost 2026-02-13T03:52:35.667 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost/vhost.ko 2026-02-13T03:52:35.667 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost/vhost_iotlb.ko 2026-02-13T03:52:35.667 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost/vhost_net.ko 2026-02-13T03:52:35.667 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/vhost/vhost_scsi.ko 2026-02-13T03:52:35.667 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video 2026-02-13T03:52:35.667 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video/backlight 2026-02-13T03:52:35.667 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video/backlight/apple_bl.ko 2026-02-13T03:52:35.667 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video/backlight/lcd.ko 2026-02-13T03:52:35.667 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/video/backlight/platform_lcd.ko 2026-02-13T03:52:35.667 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio 2026-02-13T03:52:35.667 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio.ko 2026-02-13T03:52:35.667 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_balloon.ko 2026-02-13T03:52:35.667 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_mmio.ko 2026-02-13T03:52:35.667 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_pci.ko 2026-02-13T03:52:35.667 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2026-02-13T03:52:35.667 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2026-02-13T03:52:35.667 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/virtio/virtio_ring.ko 2026-02-13T03:52:35.667 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1 2026-02-13T03:52:35.667 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/masters 2026-02-13T03:52:35.667 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/masters/ds2482.ko 2026-02-13T03:52:35.667 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/masters/ds2490.ko 2026-02-13T03:52:35.667 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves 2026-02-13T03:52:35.667 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2406.ko 2026-02-13T03:52:35.667 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2408.ko 2026-02-13T03:52:35.667 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2413.ko 2026-02-13T03:52:35.667 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2423.ko 2026-02-13T03:52:35.667 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2431.ko 2026-02-13T03:52:35.667 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2433.ko 2026-02-13T03:52:35.667 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2780.ko 2026-02-13T03:52:35.667 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds2781.ko 2026-02-13T03:52:35.667 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_ds28e04.ko 2026-02-13T03:52:35.667 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_smem.ko 2026-02-13T03:52:35.667 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/slaves/w1_therm.ko 2026-02-13T03:52:35.668 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/w1/wire.ko 2026-02-13T03:52:35.668 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog 2026-02-13T03:52:35.668 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/alim1535_wdt.ko 2026-02-13T03:52:35.668 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/alim7101_wdt.ko 2026-02-13T03:52:35.668 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/f71808e_wdt.ko 2026-02-13T03:52:35.668 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/hpwdt.ko 2026-02-13T03:52:35.668 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/i6300esb.ko 2026-02-13T03:52:35.668 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/iTCO_vendor_support.ko 2026-02-13T03:52:35.668 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/iTCO_wdt.ko 2026-02-13T03:52:35.668 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/ib700wdt.ko 2026-02-13T03:52:35.668 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/ibmasr.ko 2026-02-13T03:52:35.668 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/ie6xx_wdt.ko 2026-02-13T03:52:35.668 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/it8712f_wdt.ko 2026-02-13T03:52:35.668 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/it87_wdt.ko 2026-02-13T03:52:35.668 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/machzwd.ko 2026-02-13T03:52:35.668 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/nv_tco.ko 2026-02-13T03:52:35.668 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/pcwd_pci.ko 2026-02-13T03:52:35.668 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/pcwd_usb.ko 2026-02-13T03:52:35.668 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2026-02-13T03:52:35.668 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/sch311x_wdt.ko 2026-02-13T03:52:35.668 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/softdog.ko 2026-02-13T03:52:35.668 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/sp5100_tco.ko 2026-02-13T03:52:35.668 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/via_wdt.ko 2026-02-13T03:52:35.668 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/w83627hf_wdt.ko 2026-02-13T03:52:35.668 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/w83877f_wdt.ko 2026-02-13T03:52:35.668 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/w83977f_wdt.ko 2026-02-13T03:52:35.668 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/wdt_pci.ko 2026-02-13T03:52:35.668 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/watchdog/xen_wdt.ko 2026-02-13T03:52:35.668 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen 2026-02-13T03:52:35.668 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-acpi-processor.ko 2026-02-13T03:52:35.668 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-evtchn.ko 2026-02-13T03:52:35.668 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-gntalloc.ko 2026-02-13T03:52:35.668 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-gntdev.ko 2026-02-13T03:52:35.668 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-pciback 2026-02-13T03:52:35.668 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2026-02-13T03:52:35.668 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xen-privcmd.ko 2026-02-13T03:52:35.668 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xenfs 2026-02-13T03:52:35.668 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/drivers/xen/xenfs/xenfs.ko 2026-02-13T03:52:35.668 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs 2026-02-13T03:52:35.669 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/9p 2026-02-13T03:52:35.669 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/9p/9p.ko 2026-02-13T03:52:35.669 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/affs 2026-02-13T03:52:35.669 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/affs/affs.ko 2026-02-13T03:52:35.669 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/befs 2026-02-13T03:52:35.669 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/befs/befs.ko 2026-02-13T03:52:35.669 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/binfmt_misc.ko 2026-02-13T03:52:35.669 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/btrfs 2026-02-13T03:52:35.669 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/btrfs/btrfs.ko 2026-02-13T03:52:35.669 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/cachefiles 2026-02-13T03:52:35.669 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/cachefiles/cachefiles.ko 2026-02-13T03:52:35.669 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ceph 2026-02-13T03:52:35.669 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ceph/ceph.ko 2026-02-13T03:52:35.669 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/coda 2026-02-13T03:52:35.669 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/coda/coda.ko 2026-02-13T03:52:35.669 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/cramfs 2026-02-13T03:52:35.669 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/cramfs/cramfs.ko 2026-02-13T03:52:35.669 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/dlm 2026-02-13T03:52:35.669 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/dlm/dlm.ko 2026-02-13T03:52:35.669 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ecryptfs 2026-02-13T03:52:35.669 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ecryptfs/ecryptfs.ko 2026-02-13T03:52:35.669 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/f2fs 2026-02-13T03:52:35.669 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/f2fs/f2fs.ko 2026-02-13T03:52:35.669 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fat 2026-02-13T03:52:35.669 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fat/fat.ko 2026-02-13T03:52:35.669 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fat/msdos.ko 2026-02-13T03:52:35.669 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fat/vfat.ko 2026-02-13T03:52:35.669 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fuse 2026-02-13T03:52:35.669 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fuse/cuse.ko 2026-02-13T03:52:35.669 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/fuse/fuse.ko 2026-02-13T03:52:35.669 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/gfs2 2026-02-13T03:52:35.669 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/gfs2/gfs2.ko 2026-02-13T03:52:35.669 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/hfs 2026-02-13T03:52:35.669 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/hfs/hfs.ko 2026-02-13T03:52:35.669 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/hfsplus 2026-02-13T03:52:35.669 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/hfsplus/hfsplus.ko 2026-02-13T03:52:35.669 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/isofs 2026-02-13T03:52:35.669 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/isofs/isofs.ko 2026-02-13T03:52:35.669 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/jfs 2026-02-13T03:52:35.670 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/jfs/jfs.ko 2026-02-13T03:52:35.670 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/lockd 2026-02-13T03:52:35.670 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/lockd/lockd.ko 2026-02-13T03:52:35.670 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/minix 2026-02-13T03:52:35.670 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/minix/minix.ko 2026-02-13T03:52:35.670 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/netfs 2026-02-13T03:52:35.670 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/netfs/netfs.ko 2026-02-13T03:52:35.670 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs 2026-02-13T03:52:35.670 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/blocklayout 2026-02-13T03:52:35.670 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2026-02-13T03:52:35.670 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/filelayout 2026-02-13T03:52:35.670 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2026-02-13T03:52:35.670 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/flexfilelayout 2026-02-13T03:52:35.670 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2026-02-13T03:52:35.670 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/nfs.ko 2026-02-13T03:52:35.670 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/nfsv3.ko 2026-02-13T03:52:35.670 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs/nfsv4.ko 2026-02-13T03:52:35.670 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs_common 2026-02-13T03:52:35.670 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs_common/grace.ko 2026-02-13T03:52:35.670 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfs_common/nfs_acl.ko 2026-02-13T03:52:35.670 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfsd 2026-02-13T03:52:35.670 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nfsd/nfsd.ko 2026-02-13T03:52:35.670 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nilfs2 2026-02-13T03:52:35.670 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nilfs2/nilfs2.ko 2026-02-13T03:52:35.670 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls 2026-02-13T03:52:35.670 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-celtic.ko 2026-02-13T03:52:35.670 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-centeuro.ko 2026-02-13T03:52:35.670 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-croatian.ko 2026-02-13T03:52:35.670 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-cyrillic.ko 2026-02-13T03:52:35.670 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-gaelic.ko 2026-02-13T03:52:35.670 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-greek.ko 2026-02-13T03:52:35.670 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-iceland.ko 2026-02-13T03:52:35.670 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-inuit.ko 2026-02-13T03:52:35.670 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-roman.ko 2026-02-13T03:52:35.670 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-romanian.ko 2026-02-13T03:52:35.670 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/mac-turkish.ko 2026-02-13T03:52:35.670 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp1250.ko 2026-02-13T03:52:35.670 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp1251.ko 2026-02-13T03:52:35.670 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp1255.ko 2026-02-13T03:52:35.670 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp737.ko 2026-02-13T03:52:35.670 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp775.ko 2026-02-13T03:52:35.671 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp850.ko 2026-02-13T03:52:35.671 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp852.ko 2026-02-13T03:52:35.671 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp855.ko 2026-02-13T03:52:35.671 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp857.ko 2026-02-13T03:52:35.671 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp860.ko 2026-02-13T03:52:35.671 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp861.ko 2026-02-13T03:52:35.671 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp862.ko 2026-02-13T03:52:35.671 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp863.ko 2026-02-13T03:52:35.671 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp864.ko 2026-02-13T03:52:35.671 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp865.ko 2026-02-13T03:52:35.671 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp866.ko 2026-02-13T03:52:35.671 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp869.ko 2026-02-13T03:52:35.671 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp874.ko 2026-02-13T03:52:35.671 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp932.ko 2026-02-13T03:52:35.671 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp936.ko 2026-02-13T03:52:35.671 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp949.ko 2026-02-13T03:52:35.671 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_cp950.ko 2026-02-13T03:52:35.671 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_euc-jp.ko 2026-02-13T03:52:35.671 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-1.ko 2026-02-13T03:52:35.671 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-13.ko 2026-02-13T03:52:35.671 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-14.ko 2026-02-13T03:52:35.671 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-15.ko 2026-02-13T03:52:35.671 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-2.ko 2026-02-13T03:52:35.671 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-3.ko 2026-02-13T03:52:35.671 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-4.ko 2026-02-13T03:52:35.671 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-5.ko 2026-02-13T03:52:35.671 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-6.ko 2026-02-13T03:52:35.671 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-7.ko 2026-02-13T03:52:35.671 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_iso8859-9.ko 2026-02-13T03:52:35.671 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_koi8-r.ko 2026-02-13T03:52:35.671 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_koi8-ru.ko 2026-02-13T03:52:35.671 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_koi8-u.ko 2026-02-13T03:52:35.671 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_ucs2_utils.ko 2026-02-13T03:52:35.671 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/nls/nls_utf8.ko 2026-02-13T03:52:35.671 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2 2026-02-13T03:52:35.671 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/cluster 2026-02-13T03:52:35.671 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2026-02-13T03:52:35.671 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/dlm 2026-02-13T03:52:35.671 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2026-02-13T03:52:35.671 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/dlmfs 2026-02-13T03:52:35.671 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2026-02-13T03:52:35.671 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/ocfs2.ko 2026-02-13T03:52:35.672 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2026-02-13T03:52:35.672 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/ocfs2_stack_user.ko 2026-02-13T03:52:35.672 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ocfs2/ocfs2_stackglue.ko 2026-02-13T03:52:35.672 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/overlayfs 2026-02-13T03:52:35.672 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/overlayfs/overlay.ko 2026-02-13T03:52:35.672 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/pstore 2026-02-13T03:52:35.672 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/pstore/ramoops.ko 2026-02-13T03:52:35.672 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/romfs 2026-02-13T03:52:35.672 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/romfs/romfs.ko 2026-02-13T03:52:35.672 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb 2026-02-13T03:52:35.672 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb/client 2026-02-13T03:52:35.672 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb/client/cifs.ko 2026-02-13T03:52:35.672 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb/common 2026-02-13T03:52:35.672 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/smb/common/cifs_md4.ko 2026-02-13T03:52:35.672 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/squashfs 2026-02-13T03:52:35.672 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/squashfs/squashfs.ko 2026-02-13T03:52:35.672 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/udf 2026-02-13T03:52:35.672 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/udf/udf.ko 2026-02-13T03:52:35.672 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ufs 2026-02-13T03:52:35.672 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/ufs/ufs.ko 2026-02-13T03:52:35.672 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/xfs 2026-02-13T03:52:35.672 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/fs/xfs/xfs.ko 2026-02-13T03:52:35.672 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel 2026-02-13T03:52:35.672 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/rcu 2026-02-13T03:52:35.672 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/rcu/rcutorture.ko 2026-02-13T03:52:35.672 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/torture.ko 2026-02-13T03:52:35.672 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/trace 2026-02-13T03:52:35.672 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/kernel/trace/ring_buffer_benchmark.ko 2026-02-13T03:52:35.672 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib 2026-02-13T03:52:35.672 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/asn1_encoder.ko 2026-02-13T03:52:35.672 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crc 2026-02-13T03:52:35.672 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crc/crc-itu-t.ko 2026-02-13T03:52:35.672 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crc/crc8.ko 2026-02-13T03:52:35.672 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crypto 2026-02-13T03:52:35.672 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crypto/libarc4.ko 2026-02-13T03:52:35.672 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crypto/libblake2b.ko 2026-02-13T03:52:35.672 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/crypto/libdes.ko 2026-02-13T03:52:35.672 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/lru_cache.ko 2026-02-13T03:52:35.672 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/lz4 2026-02-13T03:52:35.672 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/lz4/lz4_compress.ko 2026-02-13T03:52:35.672 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/lz4/lz4hc_compress.ko 2026-02-13T03:52:35.672 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/math 2026-02-13T03:52:35.673 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/math/cordic.ko 2026-02-13T03:52:35.673 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/raid6 2026-02-13T03:52:35.673 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/raid6/raid6_pq.ko 2026-02-13T03:52:35.673 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/reed_solomon 2026-02-13T03:52:35.673 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/reed_solomon/reed_solomon.ko 2026-02-13T03:52:35.673 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/ts_bm.ko 2026-02-13T03:52:35.673 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/ts_fsm.ko 2026-02-13T03:52:35.673 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/ts_kmp.ko 2026-02-13T03:52:35.673 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/zstd 2026-02-13T03:52:35.673 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/lib/zstd/zstd_compress.ko 2026-02-13T03:52:35.673 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/mm 2026-02-13T03:52:35.673 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/mm/hwpoison-inject.ko 2026-02-13T03:52:35.673 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net 2026-02-13T03:52:35.673 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan 2026-02-13T03:52:35.673 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/6lowpan.ko 2026-02-13T03:52:35.673 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_dest.ko 2026-02-13T03:52:35.673 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_fragment.ko 2026-02-13T03:52:35.673 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_hop.ko 2026-02-13T03:52:35.673 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_ipv6.ko 2026-02-13T03:52:35.673 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_mobility.ko 2026-02-13T03:52:35.673 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_routing.ko 2026-02-13T03:52:35.673 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/6lowpan/nhc_udp.ko 2026-02-13T03:52:35.673 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802 2026-02-13T03:52:35.673 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802/garp.ko 2026-02-13T03:52:35.673 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802/mrp.ko 2026-02-13T03:52:35.673 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802/psnap.ko 2026-02-13T03:52:35.673 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/802/stp.ko 2026-02-13T03:52:35.673 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/8021q 2026-02-13T03:52:35.673 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/8021q/8021q.ko 2026-02-13T03:52:35.673 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p 2026-02-13T03:52:35.673 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p/9pnet.ko 2026-02-13T03:52:35.673 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p/9pnet_fd.ko 2026-02-13T03:52:35.673 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p/9pnet_rdma.ko 2026-02-13T03:52:35.673 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/9p/9pnet_virtio.ko 2026-02-13T03:52:35.673 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/batman-adv 2026-02-13T03:52:35.673 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/batman-adv/batman-adv.ko 2026-02-13T03:52:35.673 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge 2026-02-13T03:52:35.673 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/br_netfilter.ko 2026-02-13T03:52:35.673 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/bridge.ko 2026-02-13T03:52:35.673 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter 2026-02-13T03:52:35.673 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_802_3.ko 2026-02-13T03:52:35.673 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_among.ko 2026-02-13T03:52:35.674 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_arp.ko 2026-02-13T03:52:35.674 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_arpreply.ko 2026-02-13T03:52:35.674 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_dnat.ko 2026-02-13T03:52:35.674 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_ip.ko 2026-02-13T03:52:35.674 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_ip6.ko 2026-02-13T03:52:35.674 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_limit.ko 2026-02-13T03:52:35.674 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_log.ko 2026-02-13T03:52:35.674 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_mark.ko 2026-02-13T03:52:35.674 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_mark_m.ko 2026-02-13T03:52:35.674 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_nflog.ko 2026-02-13T03:52:35.674 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_pkttype.ko 2026-02-13T03:52:35.674 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_redirect.ko 2026-02-13T03:52:35.674 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_snat.ko 2026-02-13T03:52:35.674 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_stp.ko 2026-02-13T03:52:35.674 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/ebt_vlan.ko 2026-02-13T03:52:35.674 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2026-02-13T03:52:35.674 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2026-02-13T03:52:35.674 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2026-02-13T03:52:35.674 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ceph 2026-02-13T03:52:35.674 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ceph/libceph.ko 2026-02-13T03:52:35.674 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/core 2026-02-13T03:52:35.674 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/core/failover.ko 2026-02-13T03:52:35.674 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/core/pktgen.ko 2026-02-13T03:52:35.674 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dns_resolver 2026-02-13T03:52:35.674 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dns_resolver/dns_resolver.ko 2026-02-13T03:52:35.674 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa 2026-02-13T03:52:35.674 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/dsa_core.ko 2026-02-13T03:52:35.674 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/tag_brcm.ko 2026-02-13T03:52:35.674 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/tag_dsa.ko 2026-02-13T03:52:35.674 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/tag_none.ko 2026-02-13T03:52:35.674 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/dsa/tag_trailer.ko 2026-02-13T03:52:35.674 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154 2026-02-13T03:52:35.674 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154/6lowpan 2026-02-13T03:52:35.674 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2026-02-13T03:52:35.674 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154/ieee802154.ko 2026-02-13T03:52:35.674 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ieee802154/ieee802154_socket.ko 2026-02-13T03:52:35.674 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4 2026-02-13T03:52:35.674 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ah4.ko 2026-02-13T03:52:35.674 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/esp4.ko 2026-02-13T03:52:35.674 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/fou.ko 2026-02-13T03:52:35.674 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/gre.ko 2026-02-13T03:52:35.674 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/inet_diag.ko 2026-02-13T03:52:35.674 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ip_gre.ko 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ip_tunnel.ko 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ip_vti.ko 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ipcomp.ko 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/ipip.ko 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/arpt_mangle.ko 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_ECN.ko 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_ah.ko 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_bic.ko 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_dctcp.ko 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_diag.ko 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_highspeed.ko 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_htcp.ko 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_hybla.ko 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_illinois.ko 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_lp.ko 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_scalable.ko 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_vegas.ko 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_veno.ko 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_westwood.ko 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tcp_yeah.ko 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/tunnel4.ko 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/udp_diag.ko 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/udp_tunnel.ko 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv4/xfrm4_tunnel.ko 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ah6.ko 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/esp6.ko 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/fou6.ko 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ip6_tunnel.ko 2026-02-13T03:52:35.675 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ip6_udp_tunnel.ko 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ip6_vti.ko 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/ipcomp6.ko 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_ah.ko 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_frag.ko 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_mh.ko 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/ip6t_rt.ko 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/sit.ko 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/tunnel6.ko 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/ipv6/xfrm6_tunnel.ko 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/key 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/key/af_key.ko 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_core.ko 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_debugfs.ko 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_eth.ko 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_ip.ko 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_ip6.ko 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_netlink.ko 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/l2tp/l2tp_ppp.ko 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/llc 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/llc/llc.ko 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/mac802154 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/mac802154/mac802154.ko 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/mpls 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/mpls/mpls_gso.ko 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set.ko 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2026-02-13T03:52:35.676 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipset/ip_set_list_set.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conncount.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_amanda.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_broadcast.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_ftp.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_h323.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_irc.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_netlink.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_pptp.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_sane.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_sip.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_snmp.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_conntrack_tftp.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_dup_netdev.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_flow_table.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_flow_table_inet.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_log_syslog.ko 2026-02-13T03:52:35.677 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_amanda.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_ftp.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_irc.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_sip.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_nat_tftp.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_synproxy_core.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nf_tables.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink_acct.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink_log.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink_osf.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nfnetlink_queue.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_chain_nat.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_compat.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_ct.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_dup_netdev.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_fib.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_fwd_netdev.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_hash.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_limit.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_log.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_masq.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_nat.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_numgen.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_queue.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_quota.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_redir.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_reject.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_reject_inet.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_socket.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/nft_tunnel.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_AUDIT.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_CHECKSUM.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_CLASSIFY.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_CONNSECMARK.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_CT.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_DSCP.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_HL.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_HMARK.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_IDLETIMER.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_LED.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_LOG.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_MASQUERADE.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_NETMAP.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_NFLOG.ko 2026-02-13T03:52:35.678 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_NFQUEUE.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_RATEEST.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_REDIRECT.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_SECMARK.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_TCPMSS.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_TEE.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_TPROXY.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_addrtype.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_bpf.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_cgroup.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_cluster.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_comment.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_connbytes.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_connlabel.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_connlimit.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_connmark.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_conntrack.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_cpu.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_dccp.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_devgroup.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_dscp.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_ecn.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_esp.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_hashlimit.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_helper.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_hl.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_ipcomp.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_iprange.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_ipvs.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_l2tp.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_length.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_limit.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_mac.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_mark.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_multiport.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_nat.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_nfacct.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_osf.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_owner.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_physdev.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_pkttype.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_policy.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_quota.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_rateest.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_realm.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_recent.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_sctp.ko 2026-02-13T03:52:35.679 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_set.ko 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_socket.ko 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_state.ko 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_statistic.ko 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_string.ko 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_tcpmss.ko 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_time.ko 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netfilter/xt_u32.ko 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netlink 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/netlink/netlink_diag.ko 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/nsh 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/nsh/nsh.ko 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch/openvswitch.ko 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch/vport-geneve.ko 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch/vport-gre.ko 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/openvswitch/vport-vxlan.ko 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/packet 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/packet/af_packet_diag.ko 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/rds 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/rds/rds.ko 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/rds/rds_rdma.ko 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/rds/rds_tcp.ko 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_csum.ko 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_gact.ko 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_mirred.ko 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_nat.ko 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_pedit.ko 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_police.ko 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_simple.ko 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_skbedit.ko 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/act_vlan.ko 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_basic.ko 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_bpf.ko 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_flow.ko 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_fw.ko 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_route.ko 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/cls_u32.ko 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_cmp.ko 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_ipset.ko 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_meta.ko 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_nbyte.ko 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_text.ko 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/em_u32.ko 2026-02-13T03:52:35.680 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_choke.ko 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_codel.ko 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_drr.ko 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_fq.ko 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_gred.ko 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_hfsc.ko 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_hhf.ko 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_htb.ko 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_ingress.ko 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_mqprio.ko 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_mqprio_lib.ko 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_multiq.ko 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_netem.ko 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_pie.ko 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_plug.ko 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_prio.ko 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_qfq.ko 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_red.ko 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_sfb.ko 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_sfq.ko 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_tbf.ko 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sched/sch_teql.ko 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sctp 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sctp/sctp.ko 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sctp/sctp_diag.ko 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/auth_gss 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/sunrpc.ko 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/xprtrdma 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/tipc 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/tipc/tipc.ko 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/tipc/tipc_diag.ko 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/unix 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/unix/unix_diag.ko 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vsock.ko 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vsock_diag.ko 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/vmw_vsock/vsock_loopback.ko 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/xfrm 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/net/xfrm/xfrm_ipcomp.ko 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security 2026-02-13T03:52:35.681 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys 2026-02-13T03:52:35.682 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys/encrypted-keys 2026-02-13T03:52:35.682 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2026-02-13T03:52:35.682 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys/trusted-keys 2026-02-13T03:52:35.682 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/security/keys/trusted-keys/trusted.ko 2026-02-13T03:52:35.682 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/virt 2026-02-13T03:52:35.682 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/virt/lib 2026-02-13T03:52:35.682 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/kernel/virt/lib/irqbypass.ko 2026-02-13T03:52:35.682 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.alias 2026-02-13T03:52:35.682 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.alias.bin 2026-02-13T03:52:35.682 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.builtin 2026-02-13T03:52:35.682 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.builtin.alias.bin 2026-02-13T03:52:35.682 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.builtin.bin 2026-02-13T03:52:35.682 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.builtin.modinfo 2026-02-13T03:52:35.682 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.dep 2026-02-13T03:52:35.682 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.dep.bin 2026-02-13T03:52:35.682 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.devname 2026-02-13T03:52:35.682 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.order 2026-02-13T03:52:35.682 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.softdep 2026-02-13T03:52:35.682 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.symbols 2026-02-13T03:52:35.682 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.symbols.bin 2026-02-13T03:52:35.682 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/modules.weakdep 2026-02-13T03:52:35.682 INFO:teuthology.orchestra.run.trial092.stdout:/lib/modules/6.19.0-g8dec4b357aab/vmlinuz 2026-02-13T03:52:35.684 DEBUG:teuthology.task.kernel:get_image_version: 6.19.0-g8dec4b357aab 2026-02-13T03:52:35.684 DEBUG:teuthology.orchestra.run.trial092:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2026-02-13T03:52:35.702 INFO:teuthology.orchestra.run.trial092.stdout:postinstall scriptlet (using /bin/sh): 2026-02-13T03:52:35.702 INFO:teuthology.orchestra.run.trial092.stdout:if [ -x /usr/bin/kernel-install ]; then 2026-02-13T03:52:35.702 INFO:teuthology.orchestra.run.trial092.stdout: /usr/bin/kernel-install add 6.19.0-g8dec4b357aab /lib/modules/6.19.0-g8dec4b357aab/vmlinuz 2026-02-13T03:52:35.702 INFO:teuthology.orchestra.run.trial092.stdout:fi 2026-02-13T03:52:35.702 INFO:teuthology.orchestra.run.trial092.stdout:for file in vmlinuz System.map config; do 2026-02-13T03:52:35.702 INFO:teuthology.orchestra.run.trial092.stdout: if ! cmp --silent "/lib/modules/6.19.0-g8dec4b357aab/${file}" "/boot/${file}-6.19.0-g8dec4b357aab"; then 2026-02-13T03:52:35.702 INFO:teuthology.orchestra.run.trial092.stdout: cp "/lib/modules/6.19.0-g8dec4b357aab/${file}" "/boot/${file}-6.19.0-g8dec4b357aab" 2026-02-13T03:52:35.702 INFO:teuthology.orchestra.run.trial092.stdout: fi 2026-02-13T03:52:35.702 INFO:teuthology.orchestra.run.trial092.stdout:done 2026-02-13T03:52:35.703 INFO:teuthology.orchestra.run.trial092.stdout:if [ -d "/lib/modules/6.19.0-g8dec4b357aab/dtb" ] && \ 2026-02-13T03:52:35.703 INFO:teuthology.orchestra.run.trial092.stdout: ! diff -rq "/lib/modules/6.19.0-g8dec4b357aab/dtb" "/boot/dtb-6.19.0-g8dec4b357aab" >/dev/null 2>&1; then 2026-02-13T03:52:35.703 INFO:teuthology.orchestra.run.trial092.stdout: rm -rf "/boot/dtb-6.19.0-g8dec4b357aab" 2026-02-13T03:52:35.703 INFO:teuthology.orchestra.run.trial092.stdout: cp -r "/lib/modules/6.19.0-g8dec4b357aab/dtb" "/boot/dtb-6.19.0-g8dec4b357aab" 2026-02-13T03:52:35.703 INFO:teuthology.orchestra.run.trial092.stdout:fi 2026-02-13T03:52:35.703 INFO:teuthology.orchestra.run.trial092.stdout:if [ ! -e "/lib/modules/6.19.0-g8dec4b357aab/modules.dep" ]; then 2026-02-13T03:52:35.703 INFO:teuthology.orchestra.run.trial092.stdout: /usr/sbin/depmod 6.19.0-g8dec4b357aab 2026-02-13T03:52:35.703 INFO:teuthology.orchestra.run.trial092.stdout:fi 2026-02-13T03:52:35.703 INFO:teuthology.orchestra.run.trial092.stdout:preuninstall scriptlet (using /bin/sh): 2026-02-13T03:52:35.703 INFO:teuthology.orchestra.run.trial092.stdout:if [ -x /usr/bin/kernel-install ]; then 2026-02-13T03:52:35.703 INFO:teuthology.orchestra.run.trial092.stdout:kernel-install remove 6.19.0-g8dec4b357aab 2026-02-13T03:52:35.703 INFO:teuthology.orchestra.run.trial092.stdout:fi 2026-02-13T03:52:35.704 DEBUG:teuthology.orchestra.run.trial092:> sudo rpm -qi grub2-tools 2026-02-13T03:52:35.774 INFO:teuthology.orchestra.run.trial092.stdout:Name : grub2-tools 2026-02-13T03:52:35.774 INFO:teuthology.orchestra.run.trial092.stdout:Epoch : 1 2026-02-13T03:52:35.774 INFO:teuthology.orchestra.run.trial092.stdout:Version : 2.06 2026-02-13T03:52:35.774 INFO:teuthology.orchestra.run.trial092.stdout:Release : 118.el9 2026-02-13T03:52:35.774 INFO:teuthology.orchestra.run.trial092.stdout:Architecture: x86_64 2026-02-13T03:52:35.774 INFO:teuthology.orchestra.run.trial092.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-13T03:52:35.774 INFO:teuthology.orchestra.run.trial092.stdout:Group : Unspecified 2026-02-13T03:52:35.774 INFO:teuthology.orchestra.run.trial092.stdout:Size : 8393909 2026-02-13T03:52:35.774 INFO:teuthology.orchestra.run.trial092.stdout:License : GPLv3+ 2026-02-13T03:52:35.774 INFO:teuthology.orchestra.run.trial092.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-13T03:52:35.774 INFO:teuthology.orchestra.run.trial092.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-13T03:52:35.774 INFO:teuthology.orchestra.run.trial092.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-13T03:52:35.774 INFO:teuthology.orchestra.run.trial092.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-13T03:52:35.774 INFO:teuthology.orchestra.run.trial092.stdout:Packager : builder@centos.org 2026-02-13T03:52:35.775 INFO:teuthology.orchestra.run.trial092.stdout:Vendor : CentOS 2026-02-13T03:52:35.775 INFO:teuthology.orchestra.run.trial092.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-13T03:52:35.775 INFO:teuthology.orchestra.run.trial092.stdout:Summary : Support tools for GRUB. 2026-02-13T03:52:35.775 INFO:teuthology.orchestra.run.trial092.stdout:Description : 2026-02-13T03:52:35.775 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T03:52:35.775 INFO:teuthology.orchestra.run.trial092.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-13T03:52:35.775 INFO:teuthology.orchestra.run.trial092.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-13T03:52:35.775 INFO:teuthology.orchestra.run.trial092.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-13T03:52:35.775 INFO:teuthology.orchestra.run.trial092.stdout:hardware devices. 2026-02-13T03:52:35.775 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T03:52:35.775 INFO:teuthology.orchestra.run.trial092.stdout:This subpackage provides tools for support of all platforms. 2026-02-13T03:52:35.776 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-13T03:52:35.776 INFO:teuthology.task.kernel:Updating grub on trial092 to boot 6.19.0-g8dec4b357aab 2026-02-13T03:52:35.776 DEBUG:teuthology.orchestra.run.trial092:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-13T03:52:35.840 INFO:teuthology.orchestra.run.trial092.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-13T03:52:35.842 DEBUG:teuthology.orchestra.run.trial092:> sudo command -v grubby && echo yes || echo no 2026-02-13T03:52:35.905 INFO:teuthology.orchestra.run.trial092.stdout:/sbin/grubby 2026-02-13T03:52:35.906 INFO:teuthology.orchestra.run.trial092.stdout:yes 2026-02-13T03:52:35.907 DEBUG:teuthology.orchestra.run.trial092:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "6.19.0-g8dec4b357aab" | head -n 1 2026-02-13T03:52:35.972 INFO:teuthology.orchestra.run.trial092.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-6.19.0-g8dec4b357aab.conf 2026-02-13T03:52:35.973 DEBUG:teuthology.orchestra.run.trial092:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-6.19.0-g8dec4b357aab 2026-02-13T03:52:36.047 DEBUG:teuthology.orchestra.run.trial092:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-13T03:52:36.252 INFO:teuthology.orchestra.run.trial092.stderr:Generating grub configuration file ... 2026-02-13T03:52:36.315 INFO:teuthology.orchestra.run.trial092.stderr:Found linux image: /boot/vmlinuz-6.19.0-g8dec4b357aab 2026-02-13T03:52:36.322 INFO:teuthology.orchestra.run.trial092.stderr:Found initrd image: /boot/initramfs-6.19.0-g8dec4b357aab.img 2026-02-13T03:52:36.570 INFO:teuthology.orchestra.run.trial092.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-13T03:52:36.577 INFO:teuthology.orchestra.run.trial092.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-13T03:52:36.607 INFO:teuthology.orchestra.run.trial092.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-13T03:52:36.614 INFO:teuthology.orchestra.run.trial092.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-13T03:52:36.637 INFO:teuthology.orchestra.run.trial092.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-13T03:52:36.643 INFO:teuthology.orchestra.run.trial092.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-13T03:52:36.723 INFO:teuthology.orchestra.run.trial092.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-13T03:52:36.731 INFO:teuthology.orchestra.run.trial092.stderr:done 2026-02-13T03:52:36.733 DEBUG:teuthology.orchestra.run.trial092:> test -d /sys/firmware/efi 2026-02-13T03:52:36.749 DEBUG:teuthology.orchestra.run.trial092:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-13T03:52:36.813 INFO:teuthology.orchestra.run.trial092.stdout:/boot/efi/EFI/BOOT 2026-02-13T03:52:36.813 INFO:teuthology.orchestra.run.trial092.stdout:/boot/efi/EFI/centos 2026-02-13T03:52:36.815 DEBUG:teuthology.orchestra.run.trial092:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-13T03:52:36.880 INFO:teuthology.orchestra.run.trial092.stdout:no 2026-02-13T03:52:36.881 DEBUG:teuthology.orchestra.run.trial092:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-13T03:52:36.944 INFO:teuthology.orchestra.run.trial092.stdout:yes 2026-02-13T03:52:36.944 DEBUG:teuthology.orchestra.run.trial092:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-13T03:52:37.008 INFO:teuthology.task.kernel:Triggering safe hard reboot via SysRq on trial092 2026-02-13T03:52:37.009 DEBUG:teuthology.orchestra.run.trial092:> sudo bash -c 'echo pci > /sys/kernel/reboot/type && echo 1 > /sys/kernel/reboot/force && sync && echo s > /proc/sysrq-trigger && echo u > /proc/sysrq-trigger && sleep 2 && echo b > /proc/sysrq-trigger' 2026-02-13T03:53:07.052 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2026-02-13T03:53:07.053 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-13T03:53:07.053 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T03:54:07.055 DEBUG:teuthology.orchestra.remote:timed out 2026-02-13T03:54:16.056 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-13T03:54:16.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T03:54:16.199 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-13T03:54:16.441 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-13T03:54:16.441 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.19.0-g8dec4b357aab"... 2026-02-13T03:54:16.441 DEBUG:teuthology.orchestra.run.trial092:> uname -r 2026-02-13T03:54:16.518 INFO:teuthology.orchestra.run.trial092.stdout:6.19.0-g8dec4b357aab 2026-02-13T03:54:16.519 DEBUG:teuthology.task.kernel:current kernel version is 6.19.0-g8dec4b357aab vs 6.19.0-g8dec4b357aab 2026-02-13T03:54:16.519 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-13T03:54:16.519 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-13T03:54:17.523 DEBUG:teuthology.parallel:result is None 2026-02-13T03:54:17.523 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-13T03:54:17.535 INFO:teuthology.task.internal:Creating test directory... 2026-02-13T03:54:17.535 DEBUG:teuthology.orchestra.run.trial092:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-13T03:54:17.539 DEBUG:teuthology.orchestra.run.trial099:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-13T03:54:17.542 DEBUG:teuthology.orchestra.run.trial158:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-13T03:54:17.573 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-13T03:54:17.587 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-13T03:54:17.600 INFO:teuthology.task.internal:Creating archive directory... 2026-02-13T03:54:17.600 DEBUG:teuthology.orchestra.run.trial092:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-13T03:54:17.617 DEBUG:teuthology.orchestra.run.trial099:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-13T03:54:17.619 DEBUG:teuthology.orchestra.run.trial158:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-13T03:54:17.662 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-13T03:54:17.674 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-13T03:54:17.675 DEBUG:teuthology.orchestra.run.trial099:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-13T03:54:17.690 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T03:54:17.691 DEBUG:teuthology.orchestra.run.trial158:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-13T03:54:17.708 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T03:54:17.708 DEBUG:teuthology.orchestra.run.trial092:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-13T03:54:17.712 DEBUG:teuthology.orchestra.run.trial099:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-13T03:54:17.733 DEBUG:teuthology.orchestra.run.trial158:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-13T03:54:17.757 INFO:teuthology.orchestra.run.trial099.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T03:54:17.765 INFO:teuthology.orchestra.run.trial099.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T03:54:17.769 INFO:teuthology.orchestra.run.trial092.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T03:54:17.775 INFO:teuthology.orchestra.run.trial158.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T03:54:17.784 INFO:teuthology.orchestra.run.trial158.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T03:54:17.789 INFO:teuthology.orchestra.run.trial092.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-13T03:54:17.792 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-13T03:54:17.805 INFO:teuthology.task.internal:Configuring sudo... 2026-02-13T03:54:17.805 DEBUG:teuthology.orchestra.run.trial092:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-13T03:54:17.808 DEBUG:teuthology.orchestra.run.trial099:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-13T03:54:17.811 DEBUG:teuthology.orchestra.run.trial158:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-13T03:54:17.861 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-13T03:54:17.877 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-13T03:54:17.877 DEBUG:teuthology.orchestra.run.trial092:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-13T03:54:17.881 DEBUG:teuthology.orchestra.run.trial099:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-13T03:54:17.883 DEBUG:teuthology.orchestra.run.trial158:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-13T03:54:17.915 DEBUG:teuthology.orchestra.run.trial092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T03:54:18.097 DEBUG:teuthology.orchestra.run.trial092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T03:54:18.152 DEBUG:teuthology.orchestra.run.trial092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T03:54:18.290 DEBUG:teuthology.orchestra.run.trial092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T03:54:18.345 DEBUG:teuthology.orchestra.run.trial092:> set -ex 2026-02-13T03:54:18.345 DEBUG:teuthology.orchestra.run.trial092:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-13T03:54:18.400 DEBUG:teuthology.orchestra.run.trial099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T03:54:18.518 DEBUG:teuthology.orchestra.run.trial099:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T03:54:18.543 DEBUG:teuthology.orchestra.run.trial099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T03:54:18.689 DEBUG:teuthology.orchestra.run.trial099:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T03:54:18.714 DEBUG:teuthology.orchestra.run.trial099:> set -ex 2026-02-13T03:54:18.714 DEBUG:teuthology.orchestra.run.trial099:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-13T03:54:18.777 DEBUG:teuthology.orchestra.run.trial158:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T03:54:18.895 DEBUG:teuthology.orchestra.run.trial158:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T03:54:18.920 DEBUG:teuthology.orchestra.run.trial158:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T03:54:19.066 DEBUG:teuthology.orchestra.run.trial158:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T03:54:19.090 DEBUG:teuthology.orchestra.run.trial158:> set -ex 2026-02-13T03:54:19.090 DEBUG:teuthology.orchestra.run.trial158:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-13T03:54:19.155 DEBUG:teuthology.orchestra.run.trial092:> sudo service rsyslog restart 2026-02-13T03:54:19.158 DEBUG:teuthology.orchestra.run.trial099:> sudo service rsyslog restart 2026-02-13T03:54:19.161 DEBUG:teuthology.orchestra.run.trial158:> sudo service rsyslog restart 2026-02-13T03:54:19.187 INFO:teuthology.orchestra.run.trial099.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T03:54:19.219 INFO:teuthology.orchestra.run.trial092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T03:54:19.222 INFO:teuthology.orchestra.run.trial158.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T03:54:19.747 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-13T03:54:19.759 INFO:teuthology.task.internal:Starting timer... 2026-02-13T03:54:19.759 INFO:teuthology.run_tasks:Running task pcp... 2026-02-13T03:54:19.780 INFO:teuthology.run_tasks:Running task selinux... 2026-02-13T03:54:19.798 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2026-02-13T03:54:19.798 DEBUG:teuthology.orchestra.run.trial092:> sudo service auditd rotate 2026-02-13T03:54:19.863 INFO:teuthology.orchestra.run.trial092.stdout:Rotating logs: 2026-02-13T03:54:19.866 DEBUG:teuthology.orchestra.run.trial099:> sudo service auditd rotate 2026-02-13T03:54:19.896 INFO:teuthology.orchestra.run.trial099.stdout:Rotating logs: 2026-02-13T03:54:19.898 DEBUG:teuthology.orchestra.run.trial158:> sudo service auditd rotate 2026-02-13T03:54:19.928 INFO:teuthology.orchestra.run.trial158.stdout:Rotating logs: 2026-02-13T03:54:19.930 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-13T03:54:19.930 DEBUG:teuthology.orchestra.run.trial092:> /usr/sbin/getenforce 2026-02-13T03:54:19.966 INFO:teuthology.orchestra.run.trial092.stdout:Permissive 2026-02-13T03:54:19.966 DEBUG:teuthology.orchestra.run.trial099:> /usr/sbin/getenforce 2026-02-13T03:54:19.985 INFO:teuthology.orchestra.run.trial099.stdout:Permissive 2026-02-13T03:54:19.985 DEBUG:teuthology.orchestra.run.trial158:> /usr/sbin/getenforce 2026-02-13T03:54:20.002 INFO:teuthology.orchestra.run.trial158.stdout:Permissive 2026-02-13T03:54:20.002 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial092.front.sepia.ceph.com': 'permissive', 'ubuntu@trial099.front.sepia.ceph.com': 'permissive', 'ubuntu@trial158.front.sepia.ceph.com': 'permissive'} 2026-02-13T03:54:20.002 DEBUG:teuthology.orchestra.run.trial092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T03:54:20.062 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T03:54:20.063 DEBUG:teuthology.orchestra.run.trial099:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T03:54:20.090 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T03:54:20.091 DEBUG:teuthology.orchestra.run.trial158:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T03:54:20.116 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T03:54:20.117 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-13T03:54:20.117 DEBUG:teuthology.orchestra.run.trial092:> sudo /usr/sbin/setenforce permissive 2026-02-13T03:54:20.171 DEBUG:teuthology.orchestra.run.trial099:> sudo /usr/sbin/setenforce permissive 2026-02-13T03:54:20.197 DEBUG:teuthology.orchestra.run.trial158:> sudo /usr/sbin/setenforce permissive 2026-02-13T03:54:20.222 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-13T03:54:20.238 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2026-02-13T03:54:20.240 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2026-02-13T03:54:20.351 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-13T03:54:20.361 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-13T03:54:20.362 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial092.front.sepia.ceph.com,trial099.front.sepia.ceph.com,trial158.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-13T03:56:15.696 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial092.front.sepia.ceph.com'), Remote(name='ubuntu@trial099.front.sepia.ceph.com'), Remote(name='ubuntu@trial158.front.sepia.ceph.com')] 2026-02-13T03:56:15.697 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-13T03:56:15.698 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T03:56:15.815 DEBUG:teuthology.orchestra.run.trial092:> true 2026-02-13T03:56:15.917 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial092.front.sepia.ceph.com' 2026-02-13T03:56:15.917 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial099.front.sepia.ceph.com' 2026-02-13T03:56:15.918 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T03:56:16.019 DEBUG:teuthology.orchestra.run.trial099:> true 2026-02-13T03:56:16.099 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial099.front.sepia.ceph.com' 2026-02-13T03:56:16.099 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-13T03:56:16.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial158.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-13T03:56:16.198 DEBUG:teuthology.orchestra.run.trial158:> true 2026-02-13T03:56:16.271 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial158.front.sepia.ceph.com' 2026-02-13T03:56:16.271 INFO:teuthology.run_tasks:Running task clock... 2026-02-13T03:56:16.289 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-13T03:56:16.289 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-13T03:56:16.290 DEBUG:teuthology.orchestra.run.trial092:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T03:56:16.293 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-13T03:56:16.294 DEBUG:teuthology.orchestra.run.trial099:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T03:56:16.297 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-13T03:56:16.297 DEBUG:teuthology.orchestra.run.trial158:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T03:56:16.323 INFO:teuthology.orchestra.run.trial099.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-13T03:56:16.335 INFO:teuthology.orchestra.run.trial099.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-13T03:56:16.340 INFO:teuthology.orchestra.run.trial158.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-13T03:56:16.348 INFO:teuthology.orchestra.run.trial092.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-13T03:56:16.353 INFO:teuthology.orchestra.run.trial158.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-13T03:56:16.356 INFO:teuthology.orchestra.run.trial099.stderr:sudo: ntpd: command not found 2026-02-13T03:56:16.365 INFO:teuthology.orchestra.run.trial099.stdout:506 Cannot talk to daemon 2026-02-13T03:56:16.372 INFO:teuthology.orchestra.run.trial092.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-13T03:56:16.374 INFO:teuthology.orchestra.run.trial158.stderr:sudo: ntpd: command not found 2026-02-13T03:56:16.377 INFO:teuthology.orchestra.run.trial099.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-13T03:56:16.383 INFO:teuthology.orchestra.run.trial158.stdout:506 Cannot talk to daemon 2026-02-13T03:56:16.388 INFO:teuthology.orchestra.run.trial099.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-13T03:56:16.396 INFO:teuthology.orchestra.run.trial158.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-13T03:56:16.408 INFO:teuthology.orchestra.run.trial158.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-13T03:56:16.416 INFO:teuthology.orchestra.run.trial092.stderr:sudo: ntpd: command not found 2026-02-13T03:56:16.435 INFO:teuthology.orchestra.run.trial099.stderr:bash: line 1: ntpq: command not found 2026-02-13T03:56:16.438 INFO:teuthology.orchestra.run.trial092.stdout:506 Cannot talk to daemon 2026-02-13T03:56:16.455 INFO:teuthology.orchestra.run.trial158.stderr:bash: line 1: ntpq: command not found 2026-02-13T03:56:16.463 INFO:teuthology.orchestra.run.trial092.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-13T03:56:16.466 INFO:teuthology.orchestra.run.trial099.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T03:56:16.466 INFO:teuthology.orchestra.run.trial099.stdout:=============================================================================== 2026-02-13T03:56:16.466 INFO:teuthology.orchestra.run.trial099.stdout:^? tick.nowherenet.org 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T03:56:16.466 INFO:teuthology.orchestra.run.trial099.stdout:^? ip74-208-14-149.pbiaas.c> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T03:56:16.466 INFO:teuthology.orchestra.run.trial099.stdout:^? ntp2.wiktel.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T03:56:16.466 INFO:teuthology.orchestra.run.trial099.stdout:^? 23.186.168.132 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T03:56:16.474 INFO:teuthology.orchestra.run.trial158.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T03:56:16.474 INFO:teuthology.orchestra.run.trial158.stdout:=============================================================================== 2026-02-13T03:56:16.475 INFO:teuthology.orchestra.run.trial158.stdout:^? 50.205.57.38 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T03:56:16.475 INFO:teuthology.orchestra.run.trial158.stdout:^? perturb.org 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T03:56:16.475 INFO:teuthology.orchestra.run.trial158.stdout:^? 149.28.61.105.vultruserc> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T03:56:16.475 INFO:teuthology.orchestra.run.trial158.stdout:^? time3.lshiy.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T03:56:16.487 INFO:teuthology.orchestra.run.trial092.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-13T03:56:16.566 INFO:teuthology.orchestra.run.trial092.stderr:bash: line 1: ntpq: command not found 2026-02-13T03:56:18.407 INFO:teuthology.orchestra.run.trial092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T03:56:18.407 INFO:teuthology.orchestra.run.trial092.stdout:=============================================================================== 2026-02-13T03:56:18.407 INFO:teuthology.orchestra.run.trial092.stdout:^? 155.248.196.28 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T03:56:18.407 INFO:teuthology.orchestra.run.trial092.stdout:^? pi4.rellim.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T03:56:18.407 INFO:teuthology.orchestra.run.trial092.stdout:^? pool-96-231-54-40.washdc> 1 6 1 2 +757us[ +757us] +/- 6278us 2026-02-13T03:56:18.407 INFO:teuthology.orchestra.run.trial092.stdout:^? 23.186.168.129 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-13T03:56:18.409 INFO:teuthology.run_tasks:Running task pexec... 2026-02-13T03:56:18.426 INFO:teuthology.task.pexec:Executing custom commands... 2026-02-13T03:56:18.427 DEBUG:teuthology.orchestra.run.trial092:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-13T03:56:18.428 DEBUG:teuthology.orchestra.run.trial099:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-13T03:56:18.428 DEBUG:teuthology.orchestra.run.trial158:> TESTDIR=/home/ubuntu/cephtest bash -s 2026-02-13T03:56:18.431 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial099.front.sepia.ceph.com 2026-02-13T03:56:18.431 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-13T03:56:18.432 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-13T03:56:18.433 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial092.front.sepia.ceph.com 2026-02-13T03:56:18.433 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-13T03:56:18.433 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-13T03:56:18.434 INFO:teuthology.task.pexec:Running commands on host ubuntu@trial158.front.sepia.ceph.com 2026-02-13T03:56:18.434 INFO:teuthology.task.pexec:sudo dnf remove nvme-cli -y 2026-02-13T03:56:18.434 INFO:teuthology.task.pexec:sudo dnf install nvmetcli nvme-cli -y 2026-02-13T03:56:18.597 INFO:teuthology.orchestra.run.trial099.stdout:No match for argument: nvme-cli 2026-02-13T03:56:18.598 INFO:teuthology.orchestra.run.trial099.stderr:No packages marked for removal. 2026-02-13T03:56:18.600 INFO:teuthology.orchestra.run.trial158.stdout:No match for argument: nvme-cli 2026-02-13T03:56:18.600 INFO:teuthology.orchestra.run.trial158.stderr:No packages marked for removal. 2026-02-13T03:56:18.601 INFO:teuthology.orchestra.run.trial099.stdout:Dependencies resolved. 2026-02-13T03:56:18.601 INFO:teuthology.orchestra.run.trial099.stdout:Nothing to do. 2026-02-13T03:56:18.601 INFO:teuthology.orchestra.run.trial099.stdout:Complete! 2026-02-13T03:56:18.602 INFO:teuthology.orchestra.run.trial158.stdout:Dependencies resolved. 2026-02-13T03:56:18.603 INFO:teuthology.orchestra.run.trial158.stdout:Nothing to do. 2026-02-13T03:56:18.603 INFO:teuthology.orchestra.run.trial158.stdout:Complete! 2026-02-13T03:56:18.670 INFO:teuthology.orchestra.run.trial092.stdout:No match for argument: nvme-cli 2026-02-13T03:56:18.671 INFO:teuthology.orchestra.run.trial092.stderr:No packages marked for removal. 2026-02-13T03:56:18.674 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-13T03:56:18.674 INFO:teuthology.orchestra.run.trial092.stdout:Nothing to do. 2026-02-13T03:56:18.674 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-13T03:56:18.896 INFO:teuthology.orchestra.run.trial158.stdout:Last metadata expiration check: 0:00:46 ago on Fri 13 Feb 2026 03:55:32 AM UTC. 2026-02-13T03:56:18.896 INFO:teuthology.orchestra.run.trial099.stdout:Last metadata expiration check: 0:00:36 ago on Fri 13 Feb 2026 03:55:42 AM UTC. 2026-02-13T03:56:18.977 INFO:teuthology.orchestra.run.trial158.stdout:Dependencies resolved. 2026-02-13T03:56:18.977 INFO:teuthology.orchestra.run.trial099.stdout:Dependencies resolved. 2026-02-13T03:56:18.978 INFO:teuthology.orchestra.run.trial158.stdout:================================================================================ 2026-02-13T03:56:18.978 INFO:teuthology.orchestra.run.trial158.stdout: Package Architecture Version Repository Size 2026-02-13T03:56:18.978 INFO:teuthology.orchestra.run.trial158.stdout:================================================================================ 2026-02-13T03:56:18.978 INFO:teuthology.orchestra.run.trial158.stdout:Installing: 2026-02-13T03:56:18.978 INFO:teuthology.orchestra.run.trial158.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-13T03:56:18.978 INFO:teuthology.orchestra.run.trial158.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-13T03:56:18.978 INFO:teuthology.orchestra.run.trial158.stdout:Upgrading: 2026-02-13T03:56:18.978 INFO:teuthology.orchestra.run.trial158.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-13T03:56:18.979 INFO:teuthology.orchestra.run.trial158.stdout:Installing dependencies: 2026-02-13T03:56:18.979 INFO:teuthology.orchestra.run.trial158.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-13T03:56:18.979 INFO:teuthology.orchestra.run.trial158.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-13T03:56:18.979 INFO:teuthology.orchestra.run.trial158.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-13T03:56:18.979 INFO:teuthology.orchestra.run.trial158.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-13T03:56:18.979 INFO:teuthology.orchestra.run.trial158.stdout: 2026-02-13T03:56:18.979 INFO:teuthology.orchestra.run.trial158.stdout:Transaction Summary 2026-02-13T03:56:18.979 INFO:teuthology.orchestra.run.trial158.stdout:================================================================================ 2026-02-13T03:56:18.979 INFO:teuthology.orchestra.run.trial158.stdout:Install 6 Packages 2026-02-13T03:56:18.979 INFO:teuthology.orchestra.run.trial158.stdout:Upgrade 1 Package 2026-02-13T03:56:18.979 INFO:teuthology.orchestra.run.trial158.stdout: 2026-02-13T03:56:18.980 INFO:teuthology.orchestra.run.trial158.stdout:Total download size: 2.4 M 2026-02-13T03:56:18.980 INFO:teuthology.orchestra.run.trial158.stdout:Downloading Packages: 2026-02-13T03:56:18.980 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-13T03:56:18.980 INFO:teuthology.orchestra.run.trial099.stdout: Package Architecture Version Repository Size 2026-02-13T03:56:18.980 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-13T03:56:18.981 INFO:teuthology.orchestra.run.trial099.stdout:Installing: 2026-02-13T03:56:18.981 INFO:teuthology.orchestra.run.trial099.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-13T03:56:18.981 INFO:teuthology.orchestra.run.trial099.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-13T03:56:18.981 INFO:teuthology.orchestra.run.trial099.stdout:Upgrading: 2026-02-13T03:56:18.981 INFO:teuthology.orchestra.run.trial099.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-13T03:56:18.981 INFO:teuthology.orchestra.run.trial099.stdout:Installing dependencies: 2026-02-13T03:56:18.981 INFO:teuthology.orchestra.run.trial099.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-13T03:56:18.981 INFO:teuthology.orchestra.run.trial099.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-13T03:56:18.981 INFO:teuthology.orchestra.run.trial099.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-13T03:56:18.981 INFO:teuthology.orchestra.run.trial099.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-13T03:56:18.981 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-13T03:56:18.981 INFO:teuthology.orchestra.run.trial099.stdout:Transaction Summary 2026-02-13T03:56:18.982 INFO:teuthology.orchestra.run.trial099.stdout:================================================================================ 2026-02-13T03:56:18.982 INFO:teuthology.orchestra.run.trial099.stdout:Install 6 Packages 2026-02-13T03:56:18.982 INFO:teuthology.orchestra.run.trial099.stdout:Upgrade 1 Package 2026-02-13T03:56:18.982 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-13T03:56:18.982 INFO:teuthology.orchestra.run.trial099.stdout:Total download size: 2.4 M 2026-02-13T03:56:18.982 INFO:teuthology.orchestra.run.trial099.stdout:Downloading Packages: 2026-02-13T03:56:19.104 INFO:teuthology.orchestra.run.trial099.stdout:(1/7): nvmetcli-0.8-3.el9.noarch.rpm 1.2 MB/s | 44 kB 00:00 2026-02-13T03:56:19.112 INFO:teuthology.orchestra.run.trial099.stdout:(2/7): python3-configshell-1.1.30-1.el9.noarch. 1.6 MB/s | 72 kB 00:00 2026-02-13T03:56:19.121 INFO:teuthology.orchestra.run.trial099.stdout:(3/7): python3-kmod-0.9-32.el9.x86_64.rpm 4.9 MB/s | 84 kB 00:00 2026-02-13T03:56:19.134 INFO:teuthology.orchestra.run.trial099.stdout:(4/7): python3-pyparsing-2.4.7-9.el9.noarch.rpm 6.9 MB/s | 150 kB 00:00 2026-02-13T03:56:19.135 INFO:teuthology.orchestra.run.trial092.stdout:Last metadata expiration check: 0:01:04 ago on Fri 13 Feb 2026 03:55:14 AM UTC. 2026-02-13T03:56:19.138 INFO:teuthology.orchestra.run.trial099.stdout:(5/7): nvme-cli-2.16-1.el9.x86_64.rpm 17 MB/s | 1.2 MB 00:00 2026-02-13T03:56:19.145 INFO:teuthology.orchestra.run.trial099.stdout:(6/7): libnvme-1.16.1-2.el9.x86_64.rpm 10 MB/s | 116 kB 00:00 2026-02-13T03:56:19.153 INFO:teuthology.orchestra.run.trial099.stdout:(7/7): python3-urwid-2.1.2-4.el9.x86_64.rpm 26 MB/s | 837 kB 00:00 2026-02-13T03:56:19.153 INFO:teuthology.orchestra.run.trial099.stdout:-------------------------------------------------------------------------------- 2026-02-13T03:56:19.153 INFO:teuthology.orchestra.run.trial099.stdout:Total 14 MB/s | 2.4 MB 00:00 2026-02-13T03:56:19.216 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction check 2026-02-13T03:56:19.223 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-13T03:56:19.224 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-13T03:56:19.224 INFO:teuthology.orchestra.run.trial092.stdout: Package Architecture Version Repository Size 2026-02-13T03:56:19.224 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-13T03:56:19.224 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-13T03:56:19.224 INFO:teuthology.orchestra.run.trial092.stdout: nvme-cli x86_64 2.16-1.el9 baseos 1.2 M 2026-02-13T03:56:19.224 INFO:teuthology.orchestra.run.trial092.stdout: nvmetcli noarch 0.8-3.el9 baseos 44 k 2026-02-13T03:56:19.224 INFO:teuthology.orchestra.run.trial092.stdout:Upgrading: 2026-02-13T03:56:19.224 INFO:teuthology.orchestra.run.trial092.stdout: libnvme x86_64 1.16.1-2.el9 baseos 116 k 2026-02-13T03:56:19.225 INFO:teuthology.orchestra.run.trial092.stdout:Installing dependencies: 2026-02-13T03:56:19.225 INFO:teuthology.orchestra.run.trial092.stdout: python3-configshell noarch 1:1.1.30-1.el9 baseos 72 k 2026-02-13T03:56:19.225 INFO:teuthology.orchestra.run.trial092.stdout: python3-kmod x86_64 0.9-32.el9 baseos 84 k 2026-02-13T03:56:19.225 INFO:teuthology.orchestra.run.trial092.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-13T03:56:19.225 INFO:teuthology.orchestra.run.trial092.stdout: python3-urwid x86_64 2.1.2-4.el9 baseos 837 k 2026-02-13T03:56:19.225 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T03:56:19.225 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-13T03:56:19.225 INFO:teuthology.orchestra.run.trial092.stdout:================================================================================ 2026-02-13T03:56:19.225 INFO:teuthology.orchestra.run.trial092.stdout:Install 6 Packages 2026-02-13T03:56:19.225 INFO:teuthology.orchestra.run.trial092.stdout:Upgrade 1 Package 2026-02-13T03:56:19.225 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T03:56:19.226 INFO:teuthology.orchestra.run.trial099.stdout:Transaction check succeeded. 2026-02-13T03:56:19.226 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction test 2026-02-13T03:56:19.227 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 2.4 M 2026-02-13T03:56:19.227 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-13T03:56:19.285 INFO:teuthology.orchestra.run.trial099.stdout:Transaction test succeeded. 2026-02-13T03:56:19.285 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction 2026-02-13T03:56:19.352 INFO:teuthology.orchestra.run.trial158.stdout:(1/7): nvmetcli-0.8-3.el9.noarch.rpm 644 kB/s | 44 kB 00:00 2026-02-13T03:56:19.353 INFO:teuthology.orchestra.run.trial099.stdout: Preparing : 1/1 2026-02-13T03:56:19.353 INFO:teuthology.orchestra.run.trial158.stdout:(2/7): python3-configshell-1.1.30-1.el9.noarch. 1.0 MB/s | 72 kB 00:00 2026-02-13T03:56:19.395 INFO:teuthology.orchestra.run.trial158.stdout:(3/7): python3-kmod-0.9-32.el9.x86_64.rpm 1.9 MB/s | 84 kB 00:00 2026-02-13T03:56:19.397 INFO:teuthology.orchestra.run.trial158.stdout:(4/7): python3-pyparsing-2.4.7-9.el9.noarch.rpm 3.3 MB/s | 150 kB 00:00 2026-02-13T03:56:19.420 INFO:teuthology.orchestra.run.trial099.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/8 2026-02-13T03:56:19.421 INFO:teuthology.orchestra.run.trial158.stdout:(5/7): libnvme-1.16.1-2.el9.x86_64.rpm 4.9 MB/s | 116 kB 00:00 2026-02-13T03:56:19.424 INFO:teuthology.orchestra.run.trial092.stdout:(1/7): nvmetcli-0.8-3.el9.noarch.rpm 444 kB/s | 44 kB 00:00 2026-02-13T03:56:19.428 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 2/8 2026-02-13T03:56:19.436 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 3/8 2026-02-13T03:56:19.437 INFO:teuthology.orchestra.run.trial158.stdout:(6/7): nvme-cli-2.16-1.el9.x86_64.rpm 7.5 MB/s | 1.2 MB 00:00 2026-02-13T03:56:19.439 INFO:teuthology.orchestra.run.trial092.stdout:(2/7): python3-configshell-1.1.30-1.el9.noarch. 633 kB/s | 72 kB 00:00 2026-02-13T03:56:19.442 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 4/8 2026-02-13T03:56:19.447 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 5/8 2026-02-13T03:56:19.448 INFO:teuthology.orchestra.run.trial099.stdout: Installing : nvmetcli-0.8-3.el9.noarch 6/8 2026-02-13T03:56:19.462 INFO:teuthology.orchestra.run.trial158.stdout:(7/7): python3-urwid-2.1.2-4.el9.x86_64.rpm 12 MB/s | 837 kB 00:00 2026-02-13T03:56:19.462 INFO:teuthology.orchestra.run.trial158.stdout:-------------------------------------------------------------------------------- 2026-02-13T03:56:19.462 INFO:teuthology.orchestra.run.trial158.stdout:Total 5.0 MB/s | 2.4 MB 00:00 2026-02-13T03:56:19.480 INFO:teuthology.orchestra.run.trial092.stdout:(3/7): python3-kmod-0.9-32.el9.x86_64.rpm 1.5 MB/s | 84 kB 00:00 2026-02-13T03:56:19.505 INFO:teuthology.orchestra.run.trial092.stdout:(4/7): python3-pyparsing-2.4.7-9.el9.noarch.rpm 2.2 MB/s | 150 kB 00:00 2026-02-13T03:56:19.530 INFO:teuthology.orchestra.run.trial158.stdout:Running transaction check 2026-02-13T03:56:19.538 INFO:teuthology.orchestra.run.trial158.stdout:Transaction check succeeded. 2026-02-13T03:56:19.538 INFO:teuthology.orchestra.run.trial158.stdout:Running transaction test 2026-02-13T03:56:19.538 INFO:teuthology.orchestra.run.trial092.stdout:(5/7): nvme-cli-2.16-1.el9.x86_64.rpm 5.4 MB/s | 1.2 MB 00:00 2026-02-13T03:56:19.541 INFO:teuthology.orchestra.run.trial092.stdout:(6/7): libnvme-1.16.1-2.el9.x86_64.rpm 3.2 MB/s | 116 kB 00:00 2026-02-13T03:56:19.581 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 6/8 2026-02-13T03:56:19.583 INFO:teuthology.orchestra.run.trial092.stdout:(7/7): python3-urwid-2.1.2-4.el9.x86_64.rpm 8.0 MB/s | 837 kB 00:00 2026-02-13T03:56:19.584 INFO:teuthology.orchestra.run.trial099.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-13T03:56:19.584 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-13T03:56:19.584 INFO:teuthology.orchestra.run.trial092.stdout:Total 6.8 MB/s | 2.4 MB 00:00 2026-02-13T03:56:19.598 INFO:teuthology.orchestra.run.trial158.stdout:Transaction test succeeded. 2026-02-13T03:56:19.598 INFO:teuthology.orchestra.run.trial158.stdout:Running transaction 2026-02-13T03:56:19.666 INFO:teuthology.orchestra.run.trial158.stdout: Preparing : 1/1 2026-02-13T03:56:19.690 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-13T03:56:19.701 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-13T03:56:19.702 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-13T03:56:19.734 INFO:teuthology.orchestra.run.trial158.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/8 2026-02-13T03:56:19.741 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 2/8 2026-02-13T03:56:19.750 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 3/8 2026-02-13T03:56:19.755 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 4/8 2026-02-13T03:56:19.761 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 5/8 2026-02-13T03:56:19.762 INFO:teuthology.orchestra.run.trial158.stdout: Installing : nvmetcli-0.8-3.el9.noarch 6/8 2026-02-13T03:56:19.788 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-13T03:56:19.789 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-13T03:56:19.863 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-13T03:56:19.863 INFO:teuthology.orchestra.run.trial099.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-13T03:56:19.863 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-13T03:56:19.877 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-13T03:56:19.885 INFO:teuthology.orchestra.run.trial099.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T03:56:19.891 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 6/8 2026-02-13T03:56:19.893 INFO:teuthology.orchestra.run.trial158.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-13T03:56:19.972 INFO:teuthology.orchestra.run.trial092.stdout: Upgrading : libnvme-1.16.1-2.el9.x86_64 1/8 2026-02-13T03:56:19.987 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-urwid-2.1.2-4.el9.x86_64 2/8 2026-02-13T03:56:20.001 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 3/8 2026-02-13T03:56:20.011 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-configshell-1:1.1.30-1.el9.noarch 4/8 2026-02-13T03:56:20.020 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-kmod-0.9-32.el9.x86_64 5/8 2026-02-13T03:56:20.022 INFO:teuthology.orchestra.run.trial092.stdout: Installing : nvmetcli-0.8-3.el9.noarch 6/8 2026-02-13T03:56:20.096 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T03:56:20.096 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/8 2026-02-13T03:56:20.096 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/8 2026-02-13T03:56:20.096 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/8 2026-02-13T03:56:20.096 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/8 2026-02-13T03:56:20.096 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/8 2026-02-13T03:56:20.096 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/8 2026-02-13T03:56:20.096 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 7/8 2026-02-13T03:56:20.145 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T03:56:20.145 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-13T03:56:20.145 INFO:teuthology.orchestra.run.trial099.stdout:Upgraded: 2026-02-13T03:56:20.145 INFO:teuthology.orchestra.run.trial099.stdout: libnvme-1.16.1-2.el9.x86_64 2026-02-13T03:56:20.145 INFO:teuthology.orchestra.run.trial099.stdout:Installed: 2026-02-13T03:56:20.145 INFO:teuthology.orchestra.run.trial099.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-13T03:56:20.145 INFO:teuthology.orchestra.run.trial099.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-13T03:56:20.145 INFO:teuthology.orchestra.run.trial099.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-02-13T03:56:20.145 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-13T03:56:20.146 INFO:teuthology.orchestra.run.trial099.stdout:Complete! 2026-02-13T03:56:20.172 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-13T03:56:20.172 INFO:teuthology.orchestra.run.trial158.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-13T03:56:20.172 INFO:teuthology.orchestra.run.trial158.stdout: 2026-02-13T03:56:20.175 DEBUG:teuthology.parallel:result is None 2026-02-13T03:56:20.195 INFO:teuthology.orchestra.run.trial158.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T03:56:20.216 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: nvmetcli-0.8-3.el9.noarch 6/8 2026-02-13T03:56:20.222 INFO:teuthology.orchestra.run.trial092.stdout: Installing : nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-13T03:56:20.408 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T03:56:20.409 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/8 2026-02-13T03:56:20.409 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/8 2026-02-13T03:56:20.409 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/8 2026-02-13T03:56:20.409 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/8 2026-02-13T03:56:20.409 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/8 2026-02-13T03:56:20.409 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/8 2026-02-13T03:56:20.409 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 7/8 2026-02-13T03:56:20.456 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T03:56:20.456 INFO:teuthology.orchestra.run.trial158.stdout: 2026-02-13T03:56:20.456 INFO:teuthology.orchestra.run.trial158.stdout:Upgraded: 2026-02-13T03:56:20.457 INFO:teuthology.orchestra.run.trial158.stdout: libnvme-1.16.1-2.el9.x86_64 2026-02-13T03:56:20.457 INFO:teuthology.orchestra.run.trial158.stdout:Installed: 2026-02-13T03:56:20.457 INFO:teuthology.orchestra.run.trial158.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-13T03:56:20.457 INFO:teuthology.orchestra.run.trial158.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-13T03:56:20.457 INFO:teuthology.orchestra.run.trial158.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-02-13T03:56:20.457 INFO:teuthology.orchestra.run.trial158.stdout: 2026-02-13T03:56:20.457 INFO:teuthology.orchestra.run.trial158.stdout:Complete! 2026-02-13T03:56:20.490 DEBUG:teuthology.parallel:result is None 2026-02-13T03:56:20.781 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: nvme-cli-2.16-1.el9.x86_64 7/8 2026-02-13T03:56:20.781 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service → /usr/lib/systemd/system/nvmefc-boot-connections.service. 2026-02-13T03:56:20.782 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T03:56:20.802 INFO:teuthology.orchestra.run.trial092.stdout: Cleanup : libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T03:56:21.191 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T03:56:21.192 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : nvme-cli-2.16-1.el9.x86_64 1/8 2026-02-13T03:56:21.192 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : nvmetcli-0.8-3.el9.noarch 2/8 2026-02-13T03:56:21.192 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-configshell-1:1.1.30-1.el9.noarch 3/8 2026-02-13T03:56:21.192 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-kmod-0.9-32.el9.x86_64 4/8 2026-02-13T03:56:21.192 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 5/8 2026-02-13T03:56:21.192 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-urwid-2.1.2-4.el9.x86_64 6/8 2026-02-13T03:56:21.192 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libnvme-1.16.1-2.el9.x86_64 7/8 2026-02-13T03:56:21.253 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libnvme-1.13-1.el9.x86_64 8/8 2026-02-13T03:56:21.253 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T03:56:21.254 INFO:teuthology.orchestra.run.trial092.stdout:Upgraded: 2026-02-13T03:56:21.254 INFO:teuthology.orchestra.run.trial092.stdout: libnvme-1.16.1-2.el9.x86_64 2026-02-13T03:56:21.254 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-13T03:56:21.254 INFO:teuthology.orchestra.run.trial092.stdout: nvme-cli-2.16-1.el9.x86_64 nvmetcli-0.8-3.el9.noarch 2026-02-13T03:56:21.254 INFO:teuthology.orchestra.run.trial092.stdout: python3-configshell-1:1.1.30-1.el9.noarch python3-kmod-0.9-32.el9.x86_64 2026-02-13T03:56:21.254 INFO:teuthology.orchestra.run.trial092.stdout: python3-pyparsing-2.4.7-9.el9.noarch python3-urwid-2.1.2-4.el9.x86_64 2026-02-13T03:56:21.254 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T03:56:21.254 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-13T03:56:21.309 DEBUG:teuthology.parallel:result is None 2026-02-13T03:56:21.310 INFO:teuthology.run_tasks:Running task install... 2026-02-13T03:56:21.326 DEBUG:teuthology.task.install:project ceph 2026-02-13T03:56:21.326 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f'}} 2026-02-13T03:56:21.326 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f'} 2026-02-13T03:56:21.326 INFO:teuthology.task.install:Using flavor: default 2026-02-13T03:56:21.335 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-13T03:56:21.335 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2026-02-13T03:56:21.336 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f', 'tag': None, 'wait_for_package': False} 2026-02-13T03:56:21.336 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T03:56:21.339 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f', 'tag': None, 'wait_for_package': False} 2026-02-13T03:56:21.339 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T03:56:21.340 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f', 'tag': None, 'wait_for_package': False} 2026-02-13T03:56:21.341 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T03:56:21.580 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/ 2026-02-13T03:56:21.580 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5241.g8f8d3829 2026-02-13T03:56:21.582 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/ 2026-02-13T03:56:21.582 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5241.g8f8d3829 2026-02-13T03:56:21.590 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/ 2026-02-13T03:56:21.590 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5241.g8f8d3829 2026-02-13T03:56:21.778 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-13T03:56:21.778 DEBUG:teuthology.orchestra.run.trial099:> set -ex 2026-02-13T03:56:21.778 DEBUG:teuthology.orchestra.run.trial099:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-13T03:56:21.779 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-13T03:56:21.780 DEBUG:teuthology.orchestra.run.trial092:> set -ex 2026-02-13T03:56:21.780 DEBUG:teuthology.orchestra.run.trial092:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-13T03:56:21.792 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-13T03:56:21.792 DEBUG:teuthology.orchestra.run.trial158:> set -ex 2026-02-13T03:56:21.792 DEBUG:teuthology.orchestra.run.trial158:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-13T03:56:21.808 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2026-02-13T03:56:21.808 DEBUG:teuthology.orchestra.run.trial099:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f8d38294e4db8750b4b1649f62ce37caa63080f/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-13T03:56:21.821 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2026-02-13T03:56:21.821 DEBUG:teuthology.orchestra.run.trial158:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f8d38294e4db8750b4b1649f62ce37caa63080f/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-13T03:56:21.836 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2026-02-13T03:56:21.836 DEBUG:teuthology.orchestra.run.trial092:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/8f8d38294e4db8750b4b1649f62ce37caa63080f/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-13T03:56:21.873 DEBUG:teuthology.orchestra.run.trial099:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-13T03:56:21.888 DEBUG:teuthology.orchestra.run.trial158:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-13T03:56:21.934 DEBUG:teuthology.orchestra.run.trial092:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-13T03:56:21.948 DEBUG:teuthology.orchestra.run.trial099:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-13T03:56:21.961 DEBUG:teuthology.orchestra.run.trial158:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-13T03:56:22.011 DEBUG:teuthology.orchestra.run.trial092:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-13T03:56:22.012 INFO:teuthology.orchestra.run.trial099.stdout:check_obsoletes = 1 2026-02-13T03:56:22.013 DEBUG:teuthology.orchestra.run.trial099:> sudo yum clean all 2026-02-13T03:56:22.025 INFO:teuthology.orchestra.run.trial158.stdout:check_obsoletes = 1 2026-02-13T03:56:22.027 DEBUG:teuthology.orchestra.run.trial158:> sudo yum clean all 2026-02-13T03:56:22.090 INFO:teuthology.orchestra.run.trial092.stdout:check_obsoletes = 1 2026-02-13T03:56:22.093 DEBUG:teuthology.orchestra.run.trial092:> sudo yum clean all 2026-02-13T03:56:22.172 INFO:teuthology.orchestra.run.trial099.stdout:41 files removed 2026-02-13T03:56:22.184 INFO:teuthology.orchestra.run.trial158.stdout:41 files removed 2026-02-13T03:56:22.187 DEBUG:teuthology.orchestra.run.trial099:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2026-02-13T03:56:22.198 DEBUG:teuthology.orchestra.run.trial158:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2026-02-13T03:56:22.263 INFO:teuthology.orchestra.run.trial092.stdout:41 files removed 2026-02-13T03:56:22.281 DEBUG:teuthology.orchestra.run.trial092:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-osd ceph-osd-classic ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2026-02-13T03:56:22.453 INFO:teuthology.orchestra.run.trial099.stdout:ceph packages for x86_64 728 kB/s | 91 kB 00:00 2026-02-13T03:56:22.465 INFO:teuthology.orchestra.run.trial158.stdout:ceph packages for x86_64 715 kB/s | 91 kB 00:00 2026-02-13T03:56:22.589 INFO:teuthology.orchestra.run.trial099.stdout:ceph noarch packages 207 kB/s | 23 kB 00:00 2026-02-13T03:56:22.600 INFO:teuthology.orchestra.run.trial158.stdout:ceph noarch packages 204 kB/s | 23 kB 00:00 2026-02-13T03:56:22.642 INFO:teuthology.orchestra.run.trial092.stdout:ceph packages for x86_64 700 kB/s | 91 kB 00:00 2026-02-13T03:56:22.710 INFO:teuthology.orchestra.run.trial099.stdout:ceph source packages 20 kB/s | 2.1 kB 00:00 2026-02-13T03:56:22.723 INFO:teuthology.orchestra.run.trial158.stdout:ceph source packages 20 kB/s | 2.1 kB 00:00 2026-02-13T03:56:22.789 INFO:teuthology.orchestra.run.trial092.stdout:ceph noarch packages 190 kB/s | 23 kB 00:00 2026-02-13T03:56:22.923 INFO:teuthology.orchestra.run.trial092.stdout:ceph source packages 18 kB/s | 2.1 kB 00:00 2026-02-13T03:56:23.597 INFO:teuthology.orchestra.run.trial099.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.9 MB 00:00 2026-02-13T03:56:24.716 INFO:teuthology.orchestra.run.trial092.stdout:CentOS Stream 9 - BaseOS 5.0 MB/s | 8.9 MB 00:01 2026-02-13T03:56:26.236 INFO:teuthology.orchestra.run.trial099.stdout:CentOS Stream 9 - AppStream 13 MB/s | 27 MB 00:02 2026-02-13T03:56:27.415 INFO:teuthology.orchestra.run.trial092.stdout:CentOS Stream 9 - AppStream 13 MB/s | 27 MB 00:02 2026-02-13T03:56:28.595 INFO:teuthology.orchestra.run.trial158.stdout:CentOS Stream 9 - BaseOS 1.5 MB/s | 8.9 MB 00:05 2026-02-13T03:56:29.527 INFO:teuthology.orchestra.run.trial099.stdout:CentOS Stream 9 - CRB 8.7 MB/s | 7.8 MB 00:00 2026-02-13T03:56:31.084 INFO:teuthology.orchestra.run.trial092.stdout:CentOS Stream 9 - CRB 7.6 MB/s | 7.8 MB 00:01 2026-02-13T03:56:31.138 INFO:teuthology.orchestra.run.trial158.stdout:CentOS Stream 9 - AppStream 13 MB/s | 27 MB 00:02 2026-02-13T03:56:31.270 INFO:teuthology.orchestra.run.trial099.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 20 kB 00:01 2026-02-13T03:56:32.227 INFO:teuthology.orchestra.run.trial099.stdout:Extra Packages for Enterprise Linux 23 MB/s | 20 MB 00:00 2026-02-13T03:56:32.764 INFO:teuthology.orchestra.run.trial092.stdout:CentOS Stream 9 - Extras packages 22 kB/s | 20 kB 00:00 2026-02-13T03:56:33.453 INFO:teuthology.orchestra.run.trial092.stdout:Extra Packages for Enterprise Linux 33 MB/s | 20 MB 00:00 2026-02-13T03:56:35.256 INFO:teuthology.orchestra.run.trial158.stdout:CentOS Stream 9 - CRB 4.5 MB/s | 7.8 MB 00:01 2026-02-13T03:56:35.476 INFO:teuthology.orchestra.run.trial099.stdout:lab-extras 2.8 MB/s | 50 kB 00:00 2026-02-13T03:56:36.125 INFO:teuthology.orchestra.run.trial158.stdout:CentOS Stream 9 - Extras packages 139 kB/s | 20 kB 00:00 2026-02-13T03:56:36.734 INFO:teuthology.orchestra.run.trial099.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-13T03:56:36.734 INFO:teuthology.orchestra.run.trial099.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-13T03:56:36.740 INFO:teuthology.orchestra.run.trial099.stdout:Package NetworkManager-1:1.54.1-1.el9.x86_64 is already installed. 2026-02-13T03:56:36.740 INFO:teuthology.orchestra.run.trial099.stdout:Package iproute-6.17.0-1.el9.x86_64 is already installed. 2026-02-13T03:56:36.741 INFO:teuthology.orchestra.run.trial099.stdout:Package util-linux-2.37.4-21.el9.x86_64 is already installed. 2026-02-13T03:56:36.741 INFO:teuthology.orchestra.run.trial099.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2026-02-13T03:56:36.742 INFO:teuthology.orchestra.run.trial099.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2026-02-13T03:56:36.744 INFO:teuthology.orchestra.run.trial099.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2026-02-13T03:56:36.744 INFO:teuthology.orchestra.run.trial099.stdout:Package xfsprogs-6.4.0-7.el9.x86_64 is already installed. 2026-02-13T03:56:36.771 INFO:teuthology.orchestra.run.trial099.stdout:Dependencies resolved. 2026-02-13T03:56:36.776 INFO:teuthology.orchestra.run.trial099.stdout:======================================================================================= 2026-02-13T03:56:36.776 INFO:teuthology.orchestra.run.trial099.stdout: Package Arch Version Repository Size 2026-02-13T03:56:36.777 INFO:teuthology.orchestra.run.trial099.stdout:======================================================================================= 2026-02-13T03:56:36.777 INFO:teuthology.orchestra.run.trial099.stdout:Installing: 2026-02-13T03:56:36.777 INFO:teuthology.orchestra.run.trial099.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2026-02-13T03:56:36.777 INFO:teuthology.orchestra.run.trial099.stdout: ceph x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 6.5 k 2026-02-13T03:56:36.777 INFO:teuthology.orchestra.run.trial099.stdout: ceph-base x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 5.2 M 2026-02-13T03:56:36.777 INFO:teuthology.orchestra.run.trial099.stdout: ceph-fuse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 987 k 2026-02-13T03:56:36.777 INFO:teuthology.orchestra.run.trial099.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 147 k 2026-02-13T03:56:36.777 INFO:teuthology.orchestra.run.trial099.stdout: ceph-mgr x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 940 k 2026-02-13T03:56:36.777 INFO:teuthology.orchestra.run.trial099.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 183 k 2026-02-13T03:56:36.777 INFO:teuthology.orchestra.run.trial099.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 15 M 2026-02-13T03:56:36.778 INFO:teuthology.orchestra.run.trial099.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 7.4 M 2026-02-13T03:56:36.778 INFO:teuthology.orchestra.run.trial099.stdout: ceph-mgr-rook noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 50 k 2026-02-13T03:56:36.778 INFO:teuthology.orchestra.run.trial099.stdout: ceph-osd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 166 k 2026-02-13T03:56:36.778 INFO:teuthology.orchestra.run.trial099.stdout: ceph-osd-classic x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 16 M 2026-02-13T03:56:36.778 INFO:teuthology.orchestra.run.trial099.stdout: ceph-radosgw x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 13 M 2026-02-13T03:56:36.778 INFO:teuthology.orchestra.run.trial099.stdout: ceph-test x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 78 M 2026-02-13T03:56:36.778 INFO:teuthology.orchestra.run.trial099.stdout: ceph-volume noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 299 k 2026-02-13T03:56:36.778 INFO:teuthology.orchestra.run.trial099.stdout: cephadm noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 1.0 M 2026-02-13T03:56:36.778 INFO:teuthology.orchestra.run.trial099.stdout: cephfs-mirror x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 243 k 2026-02-13T03:56:36.778 INFO:teuthology.orchestra.run.trial099.stdout: cephfs-shell x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 27 k 2026-02-13T03:56:36.778 INFO:teuthology.orchestra.run.trial099.stdout: cephfs-top noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 18 k 2026-02-13T03:56:36.778 INFO:teuthology.orchestra.run.trial099.stdout: elfutils-libelf-devel x86_64 0.194-1.el9 appstream 79 k 2026-02-13T03:56:36.779 INFO:teuthology.orchestra.run.trial099.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2026-02-13T03:56:36.779 INFO:teuthology.orchestra.run.trial099.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2026-02-13T03:56:36.779 INFO:teuthology.orchestra.run.trial099.stdout: libcephfs-devel x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 37 k 2026-02-13T03:56:36.779 INFO:teuthology.orchestra.run.trial099.stdout: libcephfs2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 909 k 2026-02-13T03:56:36.779 INFO:teuthology.orchestra.run.trial099.stdout: librados-devel x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 123 k 2026-02-13T03:56:36.779 INFO:teuthology.orchestra.run.trial099.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2026-02-13T03:56:36.779 INFO:teuthology.orchestra.run.trial099.stdout: libuuid-devel x86_64 2.37.4-21.el9 appstream 25 k 2026-02-13T03:56:36.779 INFO:teuthology.orchestra.run.trial099.stdout: openssl-devel x86_64 1:3.5.5-1.el9 appstream 4.8 M 2026-02-13T03:56:36.779 INFO:teuthology.orchestra.run.trial099.stdout: postgresql x86_64 13.23-1.el9 appstream 1.6 M 2026-02-13T03:56:36.779 INFO:teuthology.orchestra.run.trial099.stdout: postgresql-contrib x86_64 13.23-1.el9 appstream 903 k 2026-02-13T03:56:36.779 INFO:teuthology.orchestra.run.trial099.stdout: postgresql-server x86_64 13.23-1.el9 appstream 5.8 M 2026-02-13T03:56:36.779 INFO:teuthology.orchestra.run.trial099.stdout: python3-cephfs x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 204 k 2026-02-13T03:56:36.780 INFO:teuthology.orchestra.run.trial099.stdout: python3-rados x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 324 k 2026-02-13T03:56:36.780 INFO:teuthology.orchestra.run.trial099.stdout: python3-rbd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 306 k 2026-02-13T03:56:36.780 INFO:teuthology.orchestra.run.trial099.stdout: python3-rgw x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 100 k 2026-02-13T03:56:36.780 INFO:teuthology.orchestra.run.trial099.stdout: rbd-fuse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 84 k 2026-02-13T03:56:36.780 INFO:teuthology.orchestra.run.trial099.stdout: rbd-mirror x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.9 M 2026-02-13T03:56:36.780 INFO:teuthology.orchestra.run.trial099.stdout: rbd-nbd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 172 k 2026-02-13T03:56:36.780 INFO:teuthology.orchestra.run.trial099.stdout: xfsprogs-devel x86_64 6.4.0-7.el9 appstream 96 k 2026-02-13T03:56:36.780 INFO:teuthology.orchestra.run.trial099.stdout:Upgrading: 2026-02-13T03:56:36.780 INFO:teuthology.orchestra.run.trial099.stdout: NetworkManager x86_64 1:1.54.3-2.el9 baseos 2.4 M 2026-02-13T03:56:36.780 INFO:teuthology.orchestra.run.trial099.stdout: NetworkManager-libnm x86_64 1:1.54.3-2.el9 baseos 1.9 M 2026-02-13T03:56:36.780 INFO:teuthology.orchestra.run.trial099.stdout: NetworkManager-team x86_64 1:1.54.3-2.el9 baseos 37 k 2026-02-13T03:56:36.780 INFO:teuthology.orchestra.run.trial099.stdout: NetworkManager-tui x86_64 1:1.54.3-2.el9 baseos 248 k 2026-02-13T03:56:36.781 INFO:teuthology.orchestra.run.trial099.stdout: iproute x86_64 6.17.0-2.el9 baseos 866 k 2026-02-13T03:56:36.781 INFO:teuthology.orchestra.run.trial099.stdout: iproute-tc x86_64 6.17.0-2.el9 baseos 454 k 2026-02-13T03:56:36.781 INFO:teuthology.orchestra.run.trial099.stdout: librados2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 3.5 M 2026-02-13T03:56:36.781 INFO:teuthology.orchestra.run.trial099.stdout: librbd1 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.8 M 2026-02-13T03:56:36.781 INFO:teuthology.orchestra.run.trial099.stdout: openssl x86_64 1:3.5.5-1.el9 baseos 1.5 M 2026-02-13T03:56:36.781 INFO:teuthology.orchestra.run.trial099.stdout: openssl-fips-provider x86_64 1:3.5.5-1.el9 baseos 814 k 2026-02-13T03:56:36.781 INFO:teuthology.orchestra.run.trial099.stdout: openssl-libs x86_64 1:3.5.5-1.el9 baseos 2.3 M 2026-02-13T03:56:36.781 INFO:teuthology.orchestra.run.trial099.stdout:Installing dependencies: 2026-02-13T03:56:36.781 INFO:teuthology.orchestra.run.trial099.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-13T03:56:36.781 INFO:teuthology.orchestra.run.trial099.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2026-02-13T03:56:36.781 INFO:teuthology.orchestra.run.trial099.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-13T03:56:36.781 INFO:teuthology.orchestra.run.trial099.stdout: ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 24 M 2026-02-13T03:56:36.782 INFO:teuthology.orchestra.run.trial099.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 57 k 2026-02-13T03:56:36.782 INFO:teuthology.orchestra.run.trial099.stdout: ceph-mds x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.4 M 2026-02-13T03:56:36.782 INFO:teuthology.orchestra.run.trial099.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 297 k 2026-02-13T03:56:36.782 INFO:teuthology.orchestra.run.trial099.stdout: ceph-mon x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 5.0 M 2026-02-13T03:56:36.782 INFO:teuthology.orchestra.run.trial099.stdout: ceph-osd-crimson x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 19 M 2026-02-13T03:56:36.782 INFO:teuthology.orchestra.run.trial099.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 17 k 2026-02-13T03:56:36.782 INFO:teuthology.orchestra.run.trial099.stdout: ceph-selinux x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 25 k 2026-02-13T03:56:36.782 INFO:teuthology.orchestra.run.trial099.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-13T03:56:36.782 INFO:teuthology.orchestra.run.trial099.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-13T03:56:36.782 INFO:teuthology.orchestra.run.trial099.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-13T03:56:36.782 INFO:teuthology.orchestra.run.trial099.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-13T03:56:36.783 INFO:teuthology.orchestra.run.trial099.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-13T03:56:36.783 INFO:teuthology.orchestra.run.trial099.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-13T03:56:36.783 INFO:teuthology.orchestra.run.trial099.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-13T03:56:36.783 INFO:teuthology.orchestra.run.trial099.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-13T03:56:36.783 INFO:teuthology.orchestra.run.trial099.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-13T03:56:36.783 INFO:teuthology.orchestra.run.trial099.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-13T03:56:36.783 INFO:teuthology.orchestra.run.trial099.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-13T03:56:36.783 INFO:teuthology.orchestra.run.trial099.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 24 k 2026-02-13T03:56:36.783 INFO:teuthology.orchestra.run.trial099.stdout: libcephsqlite x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 159 k 2026-02-13T03:56:36.783 INFO:teuthology.orchestra.run.trial099.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-13T03:56:36.783 INFO:teuthology.orchestra.run.trial099.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-13T03:56:36.783 INFO:teuthology.orchestra.run.trial099.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-13T03:56:36.784 INFO:teuthology.orchestra.run.trial099.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-13T03:56:36.784 INFO:teuthology.orchestra.run.trial099.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-13T03:56:36.784 INFO:teuthology.orchestra.run.trial099.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-13T03:56:36.784 INFO:teuthology.orchestra.run.trial099.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-13T03:56:36.784 INFO:teuthology.orchestra.run.trial099.stdout: libradosstriper1 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 248 k 2026-02-13T03:56:36.784 INFO:teuthology.orchestra.run.trial099.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-13T03:56:36.784 INFO:teuthology.orchestra.run.trial099.stdout: librgw2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 6.5 M 2026-02-13T03:56:36.784 INFO:teuthology.orchestra.run.trial099.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-13T03:56:36.784 INFO:teuthology.orchestra.run.trial099.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-13T03:56:36.784 INFO:teuthology.orchestra.run.trial099.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-13T03:56:36.784 INFO:teuthology.orchestra.run.trial099.stdout: libzstd-devel x86_64 1.5.5-1.el9 appstream 51 k 2026-02-13T03:56:36.784 INFO:teuthology.orchestra.run.trial099.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-13T03:56:36.785 INFO:teuthology.orchestra.run.trial099.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-13T03:56:36.785 INFO:teuthology.orchestra.run.trial099.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-13T03:56:36.785 INFO:teuthology.orchestra.run.trial099.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-13T03:56:36.785 INFO:teuthology.orchestra.run.trial099.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-13T03:56:36.785 INFO:teuthology.orchestra.run.trial099.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-13T03:56:36.785 INFO:teuthology.orchestra.run.trial099.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-13T03:56:36.785 INFO:teuthology.orchestra.run.trial099.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-13T03:56:36.785 INFO:teuthology.orchestra.run.trial099.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-13T03:56:36.785 INFO:teuthology.orchestra.run.trial099.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-13T03:56:36.785 INFO:teuthology.orchestra.run.trial099.stdout: perl-Thread-Queue noarch 3.14-460.el9 appstream 22 k 2026-02-13T03:56:36.785 INFO:teuthology.orchestra.run.trial099.stdout: perl-threads x86_64 1:2.25-460.el9 appstream 58 k 2026-02-13T03:56:36.785 INFO:teuthology.orchestra.run.trial099.stdout: perl-threads-shared x86_64 1.61-460.el9 appstream 45 k 2026-02-13T03:56:36.786 INFO:teuthology.orchestra.run.trial099.stdout: postgresql-private-libs x86_64 13.23-1.el9 appstream 138 k 2026-02-13T03:56:36.786 INFO:teuthology.orchestra.run.trial099.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-13T03:56:36.786 INFO:teuthology.orchestra.run.trial099.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-13T03:56:36.786 INFO:teuthology.orchestra.run.trial099.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-13T03:56:36.786 INFO:teuthology.orchestra.run.trial099.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-13T03:56:36.786 INFO:teuthology.orchestra.run.trial099.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-13T03:56:36.786 INFO:teuthology.orchestra.run.trial099.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-13T03:56:36.786 INFO:teuthology.orchestra.run.trial099.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-13T03:56:36.786 INFO:teuthology.orchestra.run.trial099.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-13T03:56:36.786 INFO:teuthology.orchestra.run.trial099.stdout: python3-ceph-argparse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 45 k 2026-02-13T03:56:36.786 INFO:teuthology.orchestra.run.trial099.stdout: python3-ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 185 k 2026-02-13T03:56:36.786 INFO:teuthology.orchestra.run.trial099.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-13T03:56:36.787 INFO:teuthology.orchestra.run.trial099.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-13T03:56:36.787 INFO:teuthology.orchestra.run.trial099.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-13T03:56:36.787 INFO:teuthology.orchestra.run.trial099.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-13T03:56:36.787 INFO:teuthology.orchestra.run.trial099.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2026-02-13T03:56:36.787 INFO:teuthology.orchestra.run.trial099.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2026-02-13T03:56:36.787 INFO:teuthology.orchestra.run.trial099.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-13T03:56:36.787 INFO:teuthology.orchestra.run.trial099.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-13T03:56:36.787 INFO:teuthology.orchestra.run.trial099.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-13T03:56:36.788 INFO:teuthology.orchestra.run.trial099.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-13T03:56:36.788 INFO:teuthology.orchestra.run.trial099.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-13T03:56:36.788 INFO:teuthology.orchestra.run.trial099.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-13T03:56:36.788 INFO:teuthology.orchestra.run.trial099.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-13T03:56:36.788 INFO:teuthology.orchestra.run.trial099.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-13T03:56:36.788 INFO:teuthology.orchestra.run.trial099.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-13T03:56:36.788 INFO:teuthology.orchestra.run.trial099.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-13T03:56:36.788 INFO:teuthology.orchestra.run.trial099.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-13T03:56:36.788 INFO:teuthology.orchestra.run.trial099.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-13T03:56:36.788 INFO:teuthology.orchestra.run.trial099.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-13T03:56:36.788 INFO:teuthology.orchestra.run.trial099.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-13T03:56:36.789 INFO:teuthology.orchestra.run.trial099.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-13T03:56:36.789 INFO:teuthology.orchestra.run.trial099.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-13T03:56:36.789 INFO:teuthology.orchestra.run.trial099.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-13T03:56:36.789 INFO:teuthology.orchestra.run.trial099.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-13T03:56:36.789 INFO:teuthology.orchestra.run.trial099.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-13T03:56:36.789 INFO:teuthology.orchestra.run.trial099.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-13T03:56:36.789 INFO:teuthology.orchestra.run.trial099.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-13T03:56:36.789 INFO:teuthology.orchestra.run.trial099.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-13T03:56:36.789 INFO:teuthology.orchestra.run.trial099.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-13T03:56:36.789 INFO:teuthology.orchestra.run.trial099.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-13T03:56:36.790 INFO:teuthology.orchestra.run.trial099.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-13T03:56:36.790 INFO:teuthology.orchestra.run.trial099.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-13T03:56:36.790 INFO:teuthology.orchestra.run.trial099.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-13T03:56:36.790 INFO:teuthology.orchestra.run.trial099.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-13T03:56:36.790 INFO:teuthology.orchestra.run.trial099.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2026-02-13T03:56:36.790 INFO:teuthology.orchestra.run.trial099.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-13T03:56:36.790 INFO:teuthology.orchestra.run.trial099.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-13T03:56:36.790 INFO:teuthology.orchestra.run.trial099.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-13T03:56:36.790 INFO:teuthology.orchestra.run.trial099.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-13T03:56:36.790 INFO:teuthology.orchestra.run.trial099.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-13T03:56:36.790 INFO:teuthology.orchestra.run.trial099.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-13T03:56:36.790 INFO:teuthology.orchestra.run.trial099.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-13T03:56:36.790 INFO:teuthology.orchestra.run.trial099.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-13T03:56:36.791 INFO:teuthology.orchestra.run.trial099.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-13T03:56:36.791 INFO:teuthology.orchestra.run.trial099.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-13T03:56:36.791 INFO:teuthology.orchestra.run.trial099.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2026-02-13T03:56:36.791 INFO:teuthology.orchestra.run.trial099.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-13T03:56:36.791 INFO:teuthology.orchestra.run.trial099.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-13T03:56:36.791 INFO:teuthology.orchestra.run.trial099.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-13T03:56:36.791 INFO:teuthology.orchestra.run.trial099.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-13T03:56:36.791 INFO:teuthology.orchestra.run.trial099.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-13T03:56:36.791 INFO:teuthology.orchestra.run.trial099.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-13T03:56:36.791 INFO:teuthology.orchestra.run.trial099.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-13T03:56:36.791 INFO:teuthology.orchestra.run.trial099.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-13T03:56:36.791 INFO:teuthology.orchestra.run.trial099.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-13T03:56:36.791 INFO:teuthology.orchestra.run.trial099.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2026-02-13T03:56:36.792 INFO:teuthology.orchestra.run.trial099.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-13T03:56:36.792 INFO:teuthology.orchestra.run.trial099.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-13T03:56:36.792 INFO:teuthology.orchestra.run.trial099.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-13T03:56:36.792 INFO:teuthology.orchestra.run.trial099.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2026-02-13T03:56:36.792 INFO:teuthology.orchestra.run.trial099.stdout:Installing weak dependencies: 2026-02-13T03:56:36.792 INFO:teuthology.orchestra.run.trial099.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-13T03:56:36.792 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-13T03:56:36.792 INFO:teuthology.orchestra.run.trial099.stdout:Transaction Summary 2026-02-13T03:56:36.792 INFO:teuthology.orchestra.run.trial099.stdout:======================================================================================= 2026-02-13T03:56:36.792 INFO:teuthology.orchestra.run.trial099.stdout:Install 162 Packages 2026-02-13T03:56:36.792 INFO:teuthology.orchestra.run.trial099.stdout:Upgrade 11 Packages 2026-02-13T03:56:36.793 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-13T03:56:36.793 INFO:teuthology.orchestra.run.trial099.stdout:Total download size: 302 M 2026-02-13T03:56:36.793 INFO:teuthology.orchestra.run.trial099.stdout:Downloading Packages: 2026-02-13T03:56:37.292 INFO:teuthology.orchestra.run.trial158.stdout:Extra Packages for Enterprise Linux 19 MB/s | 20 MB 00:01 2026-02-13T03:56:37.556 INFO:teuthology.orchestra.run.trial099.stdout:(1/173): ceph-20.3.0-5241.g8f8d3829.el9.x86_64. 34 kB/s | 6.5 kB 00:00 2026-02-13T03:56:37.620 INFO:teuthology.orchestra.run.trial092.stdout:lab-extras 1.8 MB/s | 50 kB 00:00 2026-02-13T03:56:38.211 INFO:teuthology.orchestra.run.trial099.stdout:(2/173): ceph-fuse-20.3.0-5241.g8f8d3829.el9.x8 1.5 MB/s | 987 kB 00:00 2026-02-13T03:56:38.266 INFO:teuthology.orchestra.run.trial099.stdout:(3/173): ceph-immutable-object-cache-20.3.0-524 2.6 MB/s | 147 kB 00:00 2026-02-13T03:56:38.945 INFO:teuthology.orchestra.run.trial099.stdout:(4/173): ceph-mds-20.3.0-5241.g8f8d3829.el9.x86 3.5 MB/s | 2.4 MB 00:00 2026-02-13T03:56:38.961 INFO:teuthology.orchestra.run.trial092.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-13T03:56:38.961 INFO:teuthology.orchestra.run.trial092.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-13T03:56:38.967 INFO:teuthology.orchestra.run.trial092.stdout:Package NetworkManager-1:1.54.1-1.el9.x86_64 is already installed. 2026-02-13T03:56:38.968 INFO:teuthology.orchestra.run.trial092.stdout:Package iproute-6.17.0-1.el9.x86_64 is already installed. 2026-02-13T03:56:38.968 INFO:teuthology.orchestra.run.trial092.stdout:Package util-linux-2.37.4-21.el9.x86_64 is already installed. 2026-02-13T03:56:38.969 INFO:teuthology.orchestra.run.trial092.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2026-02-13T03:56:38.969 INFO:teuthology.orchestra.run.trial092.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2026-02-13T03:56:38.971 INFO:teuthology.orchestra.run.trial092.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2026-02-13T03:56:38.971 INFO:teuthology.orchestra.run.trial092.stdout:Package xfsprogs-6.4.0-7.el9.x86_64 is already installed. 2026-02-13T03:56:39.001 INFO:teuthology.orchestra.run.trial092.stdout:Dependencies resolved. 2026-02-13T03:56:39.006 INFO:teuthology.orchestra.run.trial092.stdout:======================================================================================= 2026-02-13T03:56:39.006 INFO:teuthology.orchestra.run.trial092.stdout: Package Arch Version Repository Size 2026-02-13T03:56:39.006 INFO:teuthology.orchestra.run.trial092.stdout:======================================================================================= 2026-02-13T03:56:39.007 INFO:teuthology.orchestra.run.trial092.stdout:Installing: 2026-02-13T03:56:39.007 INFO:teuthology.orchestra.run.trial092.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2026-02-13T03:56:39.007 INFO:teuthology.orchestra.run.trial092.stdout: ceph x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 6.5 k 2026-02-13T03:56:39.007 INFO:teuthology.orchestra.run.trial092.stdout: ceph-base x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 5.2 M 2026-02-13T03:56:39.007 INFO:teuthology.orchestra.run.trial092.stdout: ceph-fuse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 987 k 2026-02-13T03:56:39.007 INFO:teuthology.orchestra.run.trial092.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 147 k 2026-02-13T03:56:39.007 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mgr x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 940 k 2026-02-13T03:56:39.007 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 183 k 2026-02-13T03:56:39.007 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 15 M 2026-02-13T03:56:39.007 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 7.4 M 2026-02-13T03:56:39.007 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mgr-rook noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 50 k 2026-02-13T03:56:39.007 INFO:teuthology.orchestra.run.trial092.stdout: ceph-osd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 166 k 2026-02-13T03:56:39.008 INFO:teuthology.orchestra.run.trial092.stdout: ceph-osd-classic x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 16 M 2026-02-13T03:56:39.008 INFO:teuthology.orchestra.run.trial092.stdout: ceph-radosgw x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 13 M 2026-02-13T03:56:39.008 INFO:teuthology.orchestra.run.trial092.stdout: ceph-test x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 78 M 2026-02-13T03:56:39.008 INFO:teuthology.orchestra.run.trial092.stdout: ceph-volume noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 299 k 2026-02-13T03:56:39.008 INFO:teuthology.orchestra.run.trial092.stdout: cephadm noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 1.0 M 2026-02-13T03:56:39.008 INFO:teuthology.orchestra.run.trial092.stdout: cephfs-mirror x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 243 k 2026-02-13T03:56:39.008 INFO:teuthology.orchestra.run.trial092.stdout: cephfs-shell x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 27 k 2026-02-13T03:56:39.008 INFO:teuthology.orchestra.run.trial092.stdout: cephfs-top noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 18 k 2026-02-13T03:56:39.008 INFO:teuthology.orchestra.run.trial092.stdout: elfutils-libelf-devel x86_64 0.194-1.el9 appstream 79 k 2026-02-13T03:56:39.008 INFO:teuthology.orchestra.run.trial092.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2026-02-13T03:56:39.008 INFO:teuthology.orchestra.run.trial092.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2026-02-13T03:56:39.008 INFO:teuthology.orchestra.run.trial092.stdout: libcephfs-devel x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 37 k 2026-02-13T03:56:39.009 INFO:teuthology.orchestra.run.trial092.stdout: libcephfs2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 909 k 2026-02-13T03:56:39.009 INFO:teuthology.orchestra.run.trial092.stdout: librados-devel x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 123 k 2026-02-13T03:56:39.009 INFO:teuthology.orchestra.run.trial092.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2026-02-13T03:56:39.009 INFO:teuthology.orchestra.run.trial092.stdout: libuuid-devel x86_64 2.37.4-21.el9 appstream 25 k 2026-02-13T03:56:39.009 INFO:teuthology.orchestra.run.trial092.stdout: openssl-devel x86_64 1:3.5.5-1.el9 appstream 4.8 M 2026-02-13T03:56:39.009 INFO:teuthology.orchestra.run.trial092.stdout: postgresql x86_64 13.23-1.el9 appstream 1.6 M 2026-02-13T03:56:39.009 INFO:teuthology.orchestra.run.trial092.stdout: postgresql-contrib x86_64 13.23-1.el9 appstream 903 k 2026-02-13T03:56:39.009 INFO:teuthology.orchestra.run.trial092.stdout: postgresql-server x86_64 13.23-1.el9 appstream 5.8 M 2026-02-13T03:56:39.009 INFO:teuthology.orchestra.run.trial092.stdout: python3-cephfs x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 204 k 2026-02-13T03:56:39.009 INFO:teuthology.orchestra.run.trial092.stdout: python3-rados x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 324 k 2026-02-13T03:56:39.009 INFO:teuthology.orchestra.run.trial092.stdout: python3-rbd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 306 k 2026-02-13T03:56:39.009 INFO:teuthology.orchestra.run.trial092.stdout: python3-rgw x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 100 k 2026-02-13T03:56:39.009 INFO:teuthology.orchestra.run.trial092.stdout: rbd-fuse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 84 k 2026-02-13T03:56:39.010 INFO:teuthology.orchestra.run.trial092.stdout: rbd-mirror x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.9 M 2026-02-13T03:56:39.010 INFO:teuthology.orchestra.run.trial092.stdout: rbd-nbd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 172 k 2026-02-13T03:56:39.010 INFO:teuthology.orchestra.run.trial092.stdout: xfsprogs-devel x86_64 6.4.0-7.el9 appstream 96 k 2026-02-13T03:56:39.010 INFO:teuthology.orchestra.run.trial092.stdout:Upgrading: 2026-02-13T03:56:39.010 INFO:teuthology.orchestra.run.trial092.stdout: NetworkManager x86_64 1:1.54.3-2.el9 baseos 2.4 M 2026-02-13T03:56:39.010 INFO:teuthology.orchestra.run.trial092.stdout: NetworkManager-libnm x86_64 1:1.54.3-2.el9 baseos 1.9 M 2026-02-13T03:56:39.010 INFO:teuthology.orchestra.run.trial092.stdout: NetworkManager-team x86_64 1:1.54.3-2.el9 baseos 37 k 2026-02-13T03:56:39.010 INFO:teuthology.orchestra.run.trial092.stdout: NetworkManager-tui x86_64 1:1.54.3-2.el9 baseos 248 k 2026-02-13T03:56:39.010 INFO:teuthology.orchestra.run.trial092.stdout: iproute x86_64 6.17.0-2.el9 baseos 866 k 2026-02-13T03:56:39.010 INFO:teuthology.orchestra.run.trial092.stdout: iproute-tc x86_64 6.17.0-2.el9 baseos 454 k 2026-02-13T03:56:39.010 INFO:teuthology.orchestra.run.trial092.stdout: librados2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 3.5 M 2026-02-13T03:56:39.010 INFO:teuthology.orchestra.run.trial092.stdout: librbd1 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.8 M 2026-02-13T03:56:39.011 INFO:teuthology.orchestra.run.trial092.stdout: openssl x86_64 1:3.5.5-1.el9 baseos 1.5 M 2026-02-13T03:56:39.011 INFO:teuthology.orchestra.run.trial092.stdout: openssl-fips-provider x86_64 1:3.5.5-1.el9 baseos 814 k 2026-02-13T03:56:39.011 INFO:teuthology.orchestra.run.trial092.stdout: openssl-libs x86_64 1:3.5.5-1.el9 baseos 2.3 M 2026-02-13T03:56:39.011 INFO:teuthology.orchestra.run.trial092.stdout:Installing dependencies: 2026-02-13T03:56:39.011 INFO:teuthology.orchestra.run.trial092.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-13T03:56:39.011 INFO:teuthology.orchestra.run.trial092.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2026-02-13T03:56:39.011 INFO:teuthology.orchestra.run.trial092.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-13T03:56:39.011 INFO:teuthology.orchestra.run.trial092.stdout: ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 24 M 2026-02-13T03:56:39.011 INFO:teuthology.orchestra.run.trial092.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 57 k 2026-02-13T03:56:39.011 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mds x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.4 M 2026-02-13T03:56:39.011 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 297 k 2026-02-13T03:56:39.011 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mon x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 5.0 M 2026-02-13T03:56:39.012 INFO:teuthology.orchestra.run.trial092.stdout: ceph-osd-crimson x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 19 M 2026-02-13T03:56:39.012 INFO:teuthology.orchestra.run.trial092.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 17 k 2026-02-13T03:56:39.012 INFO:teuthology.orchestra.run.trial092.stdout: ceph-selinux x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 25 k 2026-02-13T03:56:39.012 INFO:teuthology.orchestra.run.trial092.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-13T03:56:39.012 INFO:teuthology.orchestra.run.trial092.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-13T03:56:39.012 INFO:teuthology.orchestra.run.trial092.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-13T03:56:39.012 INFO:teuthology.orchestra.run.trial092.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-13T03:56:39.012 INFO:teuthology.orchestra.run.trial092.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-13T03:56:39.012 INFO:teuthology.orchestra.run.trial092.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-13T03:56:39.012 INFO:teuthology.orchestra.run.trial092.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-13T03:56:39.012 INFO:teuthology.orchestra.run.trial092.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-13T03:56:39.012 INFO:teuthology.orchestra.run.trial092.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-13T03:56:39.012 INFO:teuthology.orchestra.run.trial092.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-13T03:56:39.013 INFO:teuthology.orchestra.run.trial092.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-13T03:56:39.013 INFO:teuthology.orchestra.run.trial092.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 24 k 2026-02-13T03:56:39.013 INFO:teuthology.orchestra.run.trial092.stdout: libcephsqlite x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 159 k 2026-02-13T03:56:39.013 INFO:teuthology.orchestra.run.trial092.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-13T03:56:39.013 INFO:teuthology.orchestra.run.trial092.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-13T03:56:39.013 INFO:teuthology.orchestra.run.trial092.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-13T03:56:39.013 INFO:teuthology.orchestra.run.trial092.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-13T03:56:39.013 INFO:teuthology.orchestra.run.trial092.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-13T03:56:39.013 INFO:teuthology.orchestra.run.trial092.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-13T03:56:39.013 INFO:teuthology.orchestra.run.trial092.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-13T03:56:39.013 INFO:teuthology.orchestra.run.trial092.stdout: libradosstriper1 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 248 k 2026-02-13T03:56:39.013 INFO:teuthology.orchestra.run.trial092.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-13T03:56:39.013 INFO:teuthology.orchestra.run.trial092.stdout: librgw2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 6.5 M 2026-02-13T03:56:39.014 INFO:teuthology.orchestra.run.trial092.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-13T03:56:39.014 INFO:teuthology.orchestra.run.trial092.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-13T03:56:39.014 INFO:teuthology.orchestra.run.trial092.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-13T03:56:39.014 INFO:teuthology.orchestra.run.trial092.stdout: libzstd-devel x86_64 1.5.5-1.el9 appstream 51 k 2026-02-13T03:56:39.014 INFO:teuthology.orchestra.run.trial092.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-13T03:56:39.014 INFO:teuthology.orchestra.run.trial092.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-13T03:56:39.014 INFO:teuthology.orchestra.run.trial092.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-13T03:56:39.014 INFO:teuthology.orchestra.run.trial092.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-13T03:56:39.014 INFO:teuthology.orchestra.run.trial092.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-13T03:56:39.014 INFO:teuthology.orchestra.run.trial092.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-13T03:56:39.014 INFO:teuthology.orchestra.run.trial092.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-13T03:56:39.014 INFO:teuthology.orchestra.run.trial092.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-13T03:56:39.015 INFO:teuthology.orchestra.run.trial092.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-13T03:56:39.015 INFO:teuthology.orchestra.run.trial092.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-13T03:56:39.015 INFO:teuthology.orchestra.run.trial092.stdout: perl-Thread-Queue noarch 3.14-460.el9 appstream 22 k 2026-02-13T03:56:39.015 INFO:teuthology.orchestra.run.trial092.stdout: perl-threads x86_64 1:2.25-460.el9 appstream 58 k 2026-02-13T03:56:39.015 INFO:teuthology.orchestra.run.trial092.stdout: perl-threads-shared x86_64 1.61-460.el9 appstream 45 k 2026-02-13T03:56:39.015 INFO:teuthology.orchestra.run.trial092.stdout: postgresql-private-libs x86_64 13.23-1.el9 appstream 138 k 2026-02-13T03:56:39.015 INFO:teuthology.orchestra.run.trial092.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-13T03:56:39.015 INFO:teuthology.orchestra.run.trial092.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-13T03:56:39.015 INFO:teuthology.orchestra.run.trial092.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-13T03:56:39.015 INFO:teuthology.orchestra.run.trial092.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-13T03:56:39.015 INFO:teuthology.orchestra.run.trial092.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-13T03:56:39.015 INFO:teuthology.orchestra.run.trial092.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-13T03:56:39.015 INFO:teuthology.orchestra.run.trial092.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-13T03:56:39.016 INFO:teuthology.orchestra.run.trial092.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-13T03:56:39.016 INFO:teuthology.orchestra.run.trial092.stdout: python3-ceph-argparse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 45 k 2026-02-13T03:56:39.016 INFO:teuthology.orchestra.run.trial092.stdout: python3-ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 185 k 2026-02-13T03:56:39.016 INFO:teuthology.orchestra.run.trial092.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-13T03:56:39.016 INFO:teuthology.orchestra.run.trial092.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-13T03:56:39.016 INFO:teuthology.orchestra.run.trial092.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-13T03:56:39.016 INFO:teuthology.orchestra.run.trial092.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-13T03:56:39.016 INFO:teuthology.orchestra.run.trial092.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2026-02-13T03:56:39.016 INFO:teuthology.orchestra.run.trial092.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2026-02-13T03:56:39.016 INFO:teuthology.orchestra.run.trial092.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-13T03:56:39.016 INFO:teuthology.orchestra.run.trial092.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-13T03:56:39.016 INFO:teuthology.orchestra.run.trial092.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-13T03:56:39.016 INFO:teuthology.orchestra.run.trial092.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-13T03:56:39.017 INFO:teuthology.orchestra.run.trial092.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-13T03:56:39.017 INFO:teuthology.orchestra.run.trial092.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-13T03:56:39.017 INFO:teuthology.orchestra.run.trial092.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-13T03:56:39.017 INFO:teuthology.orchestra.run.trial092.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-13T03:56:39.017 INFO:teuthology.orchestra.run.trial092.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-13T03:56:39.017 INFO:teuthology.orchestra.run.trial092.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-13T03:56:39.017 INFO:teuthology.orchestra.run.trial092.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-13T03:56:39.017 INFO:teuthology.orchestra.run.trial092.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-13T03:56:39.017 INFO:teuthology.orchestra.run.trial092.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-13T03:56:39.017 INFO:teuthology.orchestra.run.trial092.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-13T03:56:39.017 INFO:teuthology.orchestra.run.trial092.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-13T03:56:39.017 INFO:teuthology.orchestra.run.trial092.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-13T03:56:39.017 INFO:teuthology.orchestra.run.trial092.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-13T03:56:39.018 INFO:teuthology.orchestra.run.trial092.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-13T03:56:39.018 INFO:teuthology.orchestra.run.trial092.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-13T03:56:39.018 INFO:teuthology.orchestra.run.trial092.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-13T03:56:39.018 INFO:teuthology.orchestra.run.trial092.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-13T03:56:39.018 INFO:teuthology.orchestra.run.trial092.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-13T03:56:39.018 INFO:teuthology.orchestra.run.trial092.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-13T03:56:39.018 INFO:teuthology.orchestra.run.trial092.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-13T03:56:39.018 INFO:teuthology.orchestra.run.trial092.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-13T03:56:39.018 INFO:teuthology.orchestra.run.trial092.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-13T03:56:39.018 INFO:teuthology.orchestra.run.trial092.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-13T03:56:39.018 INFO:teuthology.orchestra.run.trial092.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-13T03:56:39.018 INFO:teuthology.orchestra.run.trial092.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2026-02-13T03:56:39.019 INFO:teuthology.orchestra.run.trial092.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-13T03:56:39.019 INFO:teuthology.orchestra.run.trial092.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-13T03:56:39.019 INFO:teuthology.orchestra.run.trial092.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-13T03:56:39.019 INFO:teuthology.orchestra.run.trial092.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-13T03:56:39.019 INFO:teuthology.orchestra.run.trial092.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-13T03:56:39.019 INFO:teuthology.orchestra.run.trial092.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-13T03:56:39.019 INFO:teuthology.orchestra.run.trial092.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-13T03:56:39.019 INFO:teuthology.orchestra.run.trial092.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-13T03:56:39.019 INFO:teuthology.orchestra.run.trial092.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-13T03:56:39.019 INFO:teuthology.orchestra.run.trial092.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-13T03:56:39.020 INFO:teuthology.orchestra.run.trial092.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2026-02-13T03:56:39.020 INFO:teuthology.orchestra.run.trial092.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-13T03:56:39.020 INFO:teuthology.orchestra.run.trial092.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-13T03:56:39.020 INFO:teuthology.orchestra.run.trial092.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-13T03:56:39.020 INFO:teuthology.orchestra.run.trial092.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-13T03:56:39.020 INFO:teuthology.orchestra.run.trial092.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-13T03:56:39.020 INFO:teuthology.orchestra.run.trial092.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-13T03:56:39.020 INFO:teuthology.orchestra.run.trial092.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-13T03:56:39.020 INFO:teuthology.orchestra.run.trial092.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-13T03:56:39.020 INFO:teuthology.orchestra.run.trial092.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-13T03:56:39.020 INFO:teuthology.orchestra.run.trial092.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2026-02-13T03:56:39.020 INFO:teuthology.orchestra.run.trial092.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-13T03:56:39.020 INFO:teuthology.orchestra.run.trial092.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-13T03:56:39.021 INFO:teuthology.orchestra.run.trial092.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-13T03:56:39.021 INFO:teuthology.orchestra.run.trial092.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2026-02-13T03:56:39.021 INFO:teuthology.orchestra.run.trial092.stdout:Installing weak dependencies: 2026-02-13T03:56:39.021 INFO:teuthology.orchestra.run.trial092.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-13T03:56:39.021 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T03:56:39.021 INFO:teuthology.orchestra.run.trial092.stdout:Transaction Summary 2026-02-13T03:56:39.021 INFO:teuthology.orchestra.run.trial092.stdout:======================================================================================= 2026-02-13T03:56:39.021 INFO:teuthology.orchestra.run.trial092.stdout:Install 162 Packages 2026-02-13T03:56:39.021 INFO:teuthology.orchestra.run.trial092.stdout:Upgrade 11 Packages 2026-02-13T03:56:39.021 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T03:56:39.022 INFO:teuthology.orchestra.run.trial092.stdout:Total download size: 302 M 2026-02-13T03:56:39.022 INFO:teuthology.orchestra.run.trial092.stdout:Downloading Packages: 2026-02-13T03:56:39.182 INFO:teuthology.orchestra.run.trial099.stdout:(5/173): ceph-mgr-20.3.0-5241.g8f8d3829.el9.x86 3.9 MB/s | 940 kB 00:00 2026-02-13T03:56:39.659 INFO:teuthology.orchestra.run.trial092.stdout:(1/173): ceph-20.3.0-5241.g8f8d3829.el9.x86_64. 23 kB/s | 6.5 kB 00:00 2026-02-13T03:56:39.792 INFO:teuthology.orchestra.run.trial099.stdout:(6/173): ceph-base-20.3.0-5241.g8f8d3829.el9.x8 2.1 MB/s | 5.2 MB 00:02 2026-02-13T03:56:39.848 INFO:teuthology.orchestra.run.trial099.stdout:(7/173): ceph-osd-20.3.0-5241.g8f8d3829.el9.x86 2.9 MB/s | 166 kB 00:00 2026-02-13T03:56:40.079 INFO:teuthology.orchestra.run.trial099.stdout:(8/173): ceph-mon-20.3.0-5241.g8f8d3829.el9.x86 5.5 MB/s | 5.0 MB 00:00 2026-02-13T03:56:40.082 INFO:teuthology.orchestra.run.trial092.stdout:(2/173): ceph-fuse-20.3.0-5241.g8f8d3829.el9.x8 2.3 MB/s | 987 kB 00:00 2026-02-13T03:56:40.148 INFO:teuthology.orchestra.run.trial092.stdout:(3/173): ceph-immutable-object-cache-20.3.0-524 2.2 MB/s | 147 kB 00:00 2026-02-13T03:56:40.536 INFO:teuthology.orchestra.run.trial158.stdout:lab-extras 2.6 MB/s | 50 kB 00:00 2026-02-13T03:56:40.546 INFO:teuthology.orchestra.run.trial092.stdout:(4/173): ceph-mds-20.3.0-5241.g8f8d3829.el9.x86 6.0 MB/s | 2.4 MB 00:00 2026-02-13T03:56:40.716 INFO:teuthology.orchestra.run.trial092.stdout:(5/173): ceph-mgr-20.3.0-5241.g8f8d3829.el9.x86 5.4 MB/s | 940 kB 00:00 2026-02-13T03:56:41.593 INFO:teuthology.orchestra.run.trial092.stdout:(6/173): ceph-mon-20.3.0-5241.g8f8d3829.el9.x86 5.7 MB/s | 5.0 MB 00:00 2026-02-13T03:56:41.657 INFO:teuthology.orchestra.run.trial092.stdout:(7/173): ceph-osd-20.3.0-5241.g8f8d3829.el9.x86 2.5 MB/s | 166 kB 00:00 2026-02-13T03:56:41.788 INFO:teuthology.orchestra.run.trial158.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-13T03:56:41.789 INFO:teuthology.orchestra.run.trial158.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2026-02-13T03:56:41.795 INFO:teuthology.orchestra.run.trial158.stdout:Package NetworkManager-1:1.54.1-1.el9.x86_64 is already installed. 2026-02-13T03:56:41.795 INFO:teuthology.orchestra.run.trial158.stdout:Package iproute-6.17.0-1.el9.x86_64 is already installed. 2026-02-13T03:56:41.795 INFO:teuthology.orchestra.run.trial158.stdout:Package util-linux-2.37.4-21.el9.x86_64 is already installed. 2026-02-13T03:56:41.796 INFO:teuthology.orchestra.run.trial158.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2026-02-13T03:56:41.797 INFO:teuthology.orchestra.run.trial158.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2026-02-13T03:56:41.798 INFO:teuthology.orchestra.run.trial158.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2026-02-13T03:56:41.798 INFO:teuthology.orchestra.run.trial158.stdout:Package xfsprogs-6.4.0-7.el9.x86_64 is already installed. 2026-02-13T03:56:41.826 INFO:teuthology.orchestra.run.trial158.stdout:Dependencies resolved. 2026-02-13T03:56:41.831 INFO:teuthology.orchestra.run.trial158.stdout:======================================================================================= 2026-02-13T03:56:41.831 INFO:teuthology.orchestra.run.trial158.stdout: Package Arch Version Repository Size 2026-02-13T03:56:41.831 INFO:teuthology.orchestra.run.trial158.stdout:======================================================================================= 2026-02-13T03:56:41.831 INFO:teuthology.orchestra.run.trial158.stdout:Installing: 2026-02-13T03:56:41.831 INFO:teuthology.orchestra.run.trial158.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2026-02-13T03:56:41.831 INFO:teuthology.orchestra.run.trial158.stdout: ceph x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 6.5 k 2026-02-13T03:56:41.831 INFO:teuthology.orchestra.run.trial158.stdout: ceph-base x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 5.2 M 2026-02-13T03:56:41.831 INFO:teuthology.orchestra.run.trial158.stdout: ceph-fuse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 987 k 2026-02-13T03:56:41.831 INFO:teuthology.orchestra.run.trial158.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 147 k 2026-02-13T03:56:41.831 INFO:teuthology.orchestra.run.trial158.stdout: ceph-mgr x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 940 k 2026-02-13T03:56:41.831 INFO:teuthology.orchestra.run.trial158.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 183 k 2026-02-13T03:56:41.832 INFO:teuthology.orchestra.run.trial158.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 15 M 2026-02-13T03:56:41.832 INFO:teuthology.orchestra.run.trial158.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 7.4 M 2026-02-13T03:56:41.832 INFO:teuthology.orchestra.run.trial158.stdout: ceph-mgr-rook noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 50 k 2026-02-13T03:56:41.832 INFO:teuthology.orchestra.run.trial158.stdout: ceph-osd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 166 k 2026-02-13T03:56:41.832 INFO:teuthology.orchestra.run.trial158.stdout: ceph-osd-classic x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 16 M 2026-02-13T03:56:41.832 INFO:teuthology.orchestra.run.trial158.stdout: ceph-radosgw x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 13 M 2026-02-13T03:56:41.832 INFO:teuthology.orchestra.run.trial158.stdout: ceph-test x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 78 M 2026-02-13T03:56:41.832 INFO:teuthology.orchestra.run.trial158.stdout: ceph-volume noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 299 k 2026-02-13T03:56:41.832 INFO:teuthology.orchestra.run.trial158.stdout: cephadm noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 1.0 M 2026-02-13T03:56:41.832 INFO:teuthology.orchestra.run.trial158.stdout: cephfs-mirror x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 243 k 2026-02-13T03:56:41.832 INFO:teuthology.orchestra.run.trial158.stdout: cephfs-shell x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 27 k 2026-02-13T03:56:41.832 INFO:teuthology.orchestra.run.trial158.stdout: cephfs-top noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 18 k 2026-02-13T03:56:41.833 INFO:teuthology.orchestra.run.trial158.stdout: elfutils-libelf-devel x86_64 0.194-1.el9 appstream 79 k 2026-02-13T03:56:41.833 INFO:teuthology.orchestra.run.trial158.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2026-02-13T03:56:41.833 INFO:teuthology.orchestra.run.trial158.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2026-02-13T03:56:41.833 INFO:teuthology.orchestra.run.trial158.stdout: libcephfs-devel x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 37 k 2026-02-13T03:56:41.833 INFO:teuthology.orchestra.run.trial158.stdout: libcephfs2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 909 k 2026-02-13T03:56:41.833 INFO:teuthology.orchestra.run.trial158.stdout: librados-devel x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 123 k 2026-02-13T03:56:41.833 INFO:teuthology.orchestra.run.trial158.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2026-02-13T03:56:41.833 INFO:teuthology.orchestra.run.trial158.stdout: libuuid-devel x86_64 2.37.4-21.el9 appstream 25 k 2026-02-13T03:56:41.833 INFO:teuthology.orchestra.run.trial158.stdout: openssl-devel x86_64 1:3.5.5-1.el9 appstream 4.8 M 2026-02-13T03:56:41.833 INFO:teuthology.orchestra.run.trial158.stdout: postgresql x86_64 13.23-1.el9 appstream 1.6 M 2026-02-13T03:56:41.833 INFO:teuthology.orchestra.run.trial158.stdout: postgresql-contrib x86_64 13.23-1.el9 appstream 903 k 2026-02-13T03:56:41.833 INFO:teuthology.orchestra.run.trial158.stdout: postgresql-server x86_64 13.23-1.el9 appstream 5.8 M 2026-02-13T03:56:41.834 INFO:teuthology.orchestra.run.trial158.stdout: python3-cephfs x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 204 k 2026-02-13T03:56:41.834 INFO:teuthology.orchestra.run.trial158.stdout: python3-rados x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 324 k 2026-02-13T03:56:41.834 INFO:teuthology.orchestra.run.trial158.stdout: python3-rbd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 306 k 2026-02-13T03:56:41.834 INFO:teuthology.orchestra.run.trial158.stdout: python3-rgw x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 100 k 2026-02-13T03:56:41.834 INFO:teuthology.orchestra.run.trial158.stdout: rbd-fuse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 84 k 2026-02-13T03:56:41.834 INFO:teuthology.orchestra.run.trial158.stdout: rbd-mirror x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.9 M 2026-02-13T03:56:41.834 INFO:teuthology.orchestra.run.trial158.stdout: rbd-nbd x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 172 k 2026-02-13T03:56:41.834 INFO:teuthology.orchestra.run.trial158.stdout: xfsprogs-devel x86_64 6.4.0-7.el9 appstream 96 k 2026-02-13T03:56:41.834 INFO:teuthology.orchestra.run.trial158.stdout:Upgrading: 2026-02-13T03:56:41.834 INFO:teuthology.orchestra.run.trial158.stdout: NetworkManager x86_64 1:1.54.3-2.el9 baseos 2.4 M 2026-02-13T03:56:41.834 INFO:teuthology.orchestra.run.trial158.stdout: NetworkManager-libnm x86_64 1:1.54.3-2.el9 baseos 1.9 M 2026-02-13T03:56:41.834 INFO:teuthology.orchestra.run.trial158.stdout: NetworkManager-team x86_64 1:1.54.3-2.el9 baseos 37 k 2026-02-13T03:56:41.835 INFO:teuthology.orchestra.run.trial158.stdout: NetworkManager-tui x86_64 1:1.54.3-2.el9 baseos 248 k 2026-02-13T03:56:41.835 INFO:teuthology.orchestra.run.trial158.stdout: iproute x86_64 6.17.0-2.el9 baseos 866 k 2026-02-13T03:56:41.835 INFO:teuthology.orchestra.run.trial158.stdout: iproute-tc x86_64 6.17.0-2.el9 baseos 454 k 2026-02-13T03:56:41.835 INFO:teuthology.orchestra.run.trial158.stdout: librados2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 3.5 M 2026-02-13T03:56:41.835 INFO:teuthology.orchestra.run.trial158.stdout: librbd1 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.8 M 2026-02-13T03:56:41.835 INFO:teuthology.orchestra.run.trial158.stdout: openssl x86_64 1:3.5.5-1.el9 baseos 1.5 M 2026-02-13T03:56:41.835 INFO:teuthology.orchestra.run.trial158.stdout: openssl-fips-provider x86_64 1:3.5.5-1.el9 baseos 814 k 2026-02-13T03:56:41.835 INFO:teuthology.orchestra.run.trial158.stdout: openssl-libs x86_64 1:3.5.5-1.el9 baseos 2.3 M 2026-02-13T03:56:41.835 INFO:teuthology.orchestra.run.trial158.stdout:Installing dependencies: 2026-02-13T03:56:41.835 INFO:teuthology.orchestra.run.trial158.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-13T03:56:41.835 INFO:teuthology.orchestra.run.trial158.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2026-02-13T03:56:41.835 INFO:teuthology.orchestra.run.trial158.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-13T03:56:41.836 INFO:teuthology.orchestra.run.trial158.stdout: ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 24 M 2026-02-13T03:56:41.836 INFO:teuthology.orchestra.run.trial158.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 57 k 2026-02-13T03:56:41.836 INFO:teuthology.orchestra.run.trial158.stdout: ceph-mds x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 2.4 M 2026-02-13T03:56:41.836 INFO:teuthology.orchestra.run.trial158.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 297 k 2026-02-13T03:56:41.836 INFO:teuthology.orchestra.run.trial158.stdout: ceph-mon x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 5.0 M 2026-02-13T03:56:41.836 INFO:teuthology.orchestra.run.trial158.stdout: ceph-osd-crimson x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 19 M 2026-02-13T03:56:41.836 INFO:teuthology.orchestra.run.trial158.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5241.g8f8d3829.el9 ceph-noarch 17 k 2026-02-13T03:56:41.836 INFO:teuthology.orchestra.run.trial158.stdout: ceph-selinux x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 25 k 2026-02-13T03:56:41.836 INFO:teuthology.orchestra.run.trial158.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-13T03:56:41.836 INFO:teuthology.orchestra.run.trial158.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-13T03:56:41.836 INFO:teuthology.orchestra.run.trial158.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-13T03:56:41.836 INFO:teuthology.orchestra.run.trial158.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-13T03:56:41.836 INFO:teuthology.orchestra.run.trial158.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-13T03:56:41.837 INFO:teuthology.orchestra.run.trial158.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-13T03:56:41.837 INFO:teuthology.orchestra.run.trial158.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-13T03:56:41.837 INFO:teuthology.orchestra.run.trial158.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-13T03:56:41.837 INFO:teuthology.orchestra.run.trial158.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-13T03:56:41.837 INFO:teuthology.orchestra.run.trial158.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-13T03:56:41.837 INFO:teuthology.orchestra.run.trial158.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-13T03:56:41.837 INFO:teuthology.orchestra.run.trial158.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 24 k 2026-02-13T03:56:41.837 INFO:teuthology.orchestra.run.trial158.stdout: libcephsqlite x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 159 k 2026-02-13T03:56:41.837 INFO:teuthology.orchestra.run.trial158.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-13T03:56:41.837 INFO:teuthology.orchestra.run.trial158.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-13T03:56:41.837 INFO:teuthology.orchestra.run.trial158.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-13T03:56:41.837 INFO:teuthology.orchestra.run.trial158.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-13T03:56:41.837 INFO:teuthology.orchestra.run.trial158.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-13T03:56:41.838 INFO:teuthology.orchestra.run.trial158.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-13T03:56:41.838 INFO:teuthology.orchestra.run.trial158.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-13T03:56:41.838 INFO:teuthology.orchestra.run.trial158.stdout: libradosstriper1 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 248 k 2026-02-13T03:56:41.838 INFO:teuthology.orchestra.run.trial158.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-13T03:56:41.838 INFO:teuthology.orchestra.run.trial158.stdout: librgw2 x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 6.5 M 2026-02-13T03:56:41.838 INFO:teuthology.orchestra.run.trial158.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-13T03:56:41.838 INFO:teuthology.orchestra.run.trial158.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-13T03:56:41.838 INFO:teuthology.orchestra.run.trial158.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-13T03:56:41.838 INFO:teuthology.orchestra.run.trial158.stdout: libzstd-devel x86_64 1.5.5-1.el9 appstream 51 k 2026-02-13T03:56:41.838 INFO:teuthology.orchestra.run.trial158.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-13T03:56:41.838 INFO:teuthology.orchestra.run.trial158.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-13T03:56:41.838 INFO:teuthology.orchestra.run.trial158.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-13T03:56:41.839 INFO:teuthology.orchestra.run.trial158.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-13T03:56:41.839 INFO:teuthology.orchestra.run.trial158.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-13T03:56:41.839 INFO:teuthology.orchestra.run.trial158.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-13T03:56:41.839 INFO:teuthology.orchestra.run.trial158.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-13T03:56:41.839 INFO:teuthology.orchestra.run.trial158.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-13T03:56:41.839 INFO:teuthology.orchestra.run.trial158.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-13T03:56:41.839 INFO:teuthology.orchestra.run.trial158.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-13T03:56:41.839 INFO:teuthology.orchestra.run.trial158.stdout: perl-Thread-Queue noarch 3.14-460.el9 appstream 22 k 2026-02-13T03:56:41.839 INFO:teuthology.orchestra.run.trial158.stdout: perl-threads x86_64 1:2.25-460.el9 appstream 58 k 2026-02-13T03:56:41.839 INFO:teuthology.orchestra.run.trial158.stdout: perl-threads-shared x86_64 1.61-460.el9 appstream 45 k 2026-02-13T03:56:41.839 INFO:teuthology.orchestra.run.trial158.stdout: postgresql-private-libs x86_64 13.23-1.el9 appstream 138 k 2026-02-13T03:56:41.839 INFO:teuthology.orchestra.run.trial158.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-13T03:56:41.839 INFO:teuthology.orchestra.run.trial158.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-13T03:56:41.840 INFO:teuthology.orchestra.run.trial158.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-13T03:56:41.840 INFO:teuthology.orchestra.run.trial158.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-13T03:56:41.840 INFO:teuthology.orchestra.run.trial158.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-13T03:56:41.840 INFO:teuthology.orchestra.run.trial158.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-13T03:56:41.840 INFO:teuthology.orchestra.run.trial158.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-13T03:56:41.840 INFO:teuthology.orchestra.run.trial158.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-13T03:56:41.840 INFO:teuthology.orchestra.run.trial158.stdout: python3-ceph-argparse x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 45 k 2026-02-13T03:56:41.840 INFO:teuthology.orchestra.run.trial158.stdout: python3-ceph-common x86_64 2:20.3.0-5241.g8f8d3829.el9 ceph 185 k 2026-02-13T03:56:41.840 INFO:teuthology.orchestra.run.trial158.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-13T03:56:41.840 INFO:teuthology.orchestra.run.trial158.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-13T03:56:41.840 INFO:teuthology.orchestra.run.trial158.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-13T03:56:41.840 INFO:teuthology.orchestra.run.trial158.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-13T03:56:41.840 INFO:teuthology.orchestra.run.trial158.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2026-02-13T03:56:41.841 INFO:teuthology.orchestra.run.trial158.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2026-02-13T03:56:41.841 INFO:teuthology.orchestra.run.trial158.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-13T03:56:41.841 INFO:teuthology.orchestra.run.trial158.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-13T03:56:41.841 INFO:teuthology.orchestra.run.trial158.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-13T03:56:41.841 INFO:teuthology.orchestra.run.trial158.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-13T03:56:41.841 INFO:teuthology.orchestra.run.trial158.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-13T03:56:41.841 INFO:teuthology.orchestra.run.trial158.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-13T03:56:41.841 INFO:teuthology.orchestra.run.trial158.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-13T03:56:41.841 INFO:teuthology.orchestra.run.trial158.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2026-02-13T03:56:41.841 INFO:teuthology.orchestra.run.trial158.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-13T03:56:41.841 INFO:teuthology.orchestra.run.trial158.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-13T03:56:41.841 INFO:teuthology.orchestra.run.trial158.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-13T03:56:41.841 INFO:teuthology.orchestra.run.trial158.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-13T03:56:41.842 INFO:teuthology.orchestra.run.trial158.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-13T03:56:41.842 INFO:teuthology.orchestra.run.trial158.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-13T03:56:41.842 INFO:teuthology.orchestra.run.trial158.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-13T03:56:41.842 INFO:teuthology.orchestra.run.trial158.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-13T03:56:41.842 INFO:teuthology.orchestra.run.trial158.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-13T03:56:41.842 INFO:teuthology.orchestra.run.trial158.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-13T03:56:41.842 INFO:teuthology.orchestra.run.trial158.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-13T03:56:41.842 INFO:teuthology.orchestra.run.trial158.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-13T03:56:41.842 INFO:teuthology.orchestra.run.trial158.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-13T03:56:41.842 INFO:teuthology.orchestra.run.trial158.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-13T03:56:41.842 INFO:teuthology.orchestra.run.trial158.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-13T03:56:41.842 INFO:teuthology.orchestra.run.trial158.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-13T03:56:41.842 INFO:teuthology.orchestra.run.trial158.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-13T03:56:41.843 INFO:teuthology.orchestra.run.trial158.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-13T03:56:41.843 INFO:teuthology.orchestra.run.trial158.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-13T03:56:41.843 INFO:teuthology.orchestra.run.trial158.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-13T03:56:41.843 INFO:teuthology.orchestra.run.trial158.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2026-02-13T03:56:41.843 INFO:teuthology.orchestra.run.trial158.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-13T03:56:41.843 INFO:teuthology.orchestra.run.trial158.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-13T03:56:41.843 INFO:teuthology.orchestra.run.trial158.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-13T03:56:41.843 INFO:teuthology.orchestra.run.trial158.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-13T03:56:41.843 INFO:teuthology.orchestra.run.trial158.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-13T03:56:41.843 INFO:teuthology.orchestra.run.trial158.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-13T03:56:41.843 INFO:teuthology.orchestra.run.trial158.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-13T03:56:41.843 INFO:teuthology.orchestra.run.trial158.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-13T03:56:41.844 INFO:teuthology.orchestra.run.trial158.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-13T03:56:41.844 INFO:teuthology.orchestra.run.trial158.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-13T03:56:41.844 INFO:teuthology.orchestra.run.trial158.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2026-02-13T03:56:41.844 INFO:teuthology.orchestra.run.trial158.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-13T03:56:41.844 INFO:teuthology.orchestra.run.trial158.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-13T03:56:41.844 INFO:teuthology.orchestra.run.trial158.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-13T03:56:41.844 INFO:teuthology.orchestra.run.trial158.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-13T03:56:41.844 INFO:teuthology.orchestra.run.trial158.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-13T03:56:41.844 INFO:teuthology.orchestra.run.trial158.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-13T03:56:41.844 INFO:teuthology.orchestra.run.trial158.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-13T03:56:41.844 INFO:teuthology.orchestra.run.trial158.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-13T03:56:41.844 INFO:teuthology.orchestra.run.trial158.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-13T03:56:41.844 INFO:teuthology.orchestra.run.trial158.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2026-02-13T03:56:41.845 INFO:teuthology.orchestra.run.trial158.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-13T03:56:41.845 INFO:teuthology.orchestra.run.trial158.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-13T03:56:41.845 INFO:teuthology.orchestra.run.trial158.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-13T03:56:41.845 INFO:teuthology.orchestra.run.trial158.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2026-02-13T03:56:41.845 INFO:teuthology.orchestra.run.trial158.stdout:Installing weak dependencies: 2026-02-13T03:56:41.845 INFO:teuthology.orchestra.run.trial158.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-13T03:56:41.845 INFO:teuthology.orchestra.run.trial158.stdout: 2026-02-13T03:56:41.845 INFO:teuthology.orchestra.run.trial158.stdout:Transaction Summary 2026-02-13T03:56:41.845 INFO:teuthology.orchestra.run.trial158.stdout:======================================================================================= 2026-02-13T03:56:41.845 INFO:teuthology.orchestra.run.trial158.stdout:Install 162 Packages 2026-02-13T03:56:41.845 INFO:teuthology.orchestra.run.trial158.stdout:Upgrade 11 Packages 2026-02-13T03:56:41.845 INFO:teuthology.orchestra.run.trial158.stdout: 2026-02-13T03:56:41.846 INFO:teuthology.orchestra.run.trial158.stdout:Total download size: 302 M 2026-02-13T03:56:41.846 INFO:teuthology.orchestra.run.trial158.stdout:Downloading Packages: 2026-02-13T03:56:42.635 INFO:teuthology.orchestra.run.trial092.stdout:(8/173): ceph-common-20.3.0-5241.g8f8d3829.el9. 7.4 MB/s | 24 MB 00:03 2026-02-13T03:56:42.675 INFO:teuthology.orchestra.run.trial158.stdout:(1/173): ceph-20.3.0-5241.g8f8d3829.el9.x86_64. 26 kB/s | 6.5 kB 00:00 2026-02-13T03:56:43.093 INFO:teuthology.orchestra.run.trial099.stdout:(9/173): ceph-osd-crimson-20.3.0-5241.g8f8d3829 6.3 MB/s | 19 MB 00:03 2026-02-13T03:56:43.954 INFO:teuthology.orchestra.run.trial158.stdout:(2/173): ceph-fuse-20.3.0-5241.g8f8d3829.el9.x8 772 kB/s | 987 kB 00:01 2026-02-13T03:56:44.087 INFO:teuthology.orchestra.run.trial158.stdout:(3/173): ceph-immutable-object-cache-20.3.0-524 1.1 MB/s | 147 kB 00:00 2026-02-13T03:56:44.690 INFO:teuthology.orchestra.run.trial092.stdout:(9/173): ceph-osd-crimson-20.3.0-5241.g8f8d3829 9.3 MB/s | 19 MB 00:02 2026-02-13T03:56:44.720 INFO:teuthology.orchestra.run.trial092.stdout:(10/173): ceph-osd-classic-20.3.0-5241.g8f8d382 5.1 MB/s | 16 MB 00:03 2026-02-13T03:56:44.792 INFO:teuthology.orchestra.run.trial092.stdout:(11/173): ceph-selinux-20.3.0-5241.g8f8d3829.el 350 kB/s | 25 kB 00:00 2026-02-13T03:56:45.077 INFO:teuthology.orchestra.run.trial158.stdout:(4/173): ceph-base-20.3.0-5241.g8f8d3829.el9.x8 2.0 MB/s | 5.2 MB 00:02 2026-02-13T03:56:45.340 INFO:teuthology.orchestra.run.trial158.stdout:(5/173): ceph-mgr-20.3.0-5241.g8f8d3829.el9.x86 3.5 MB/s | 940 kB 00:00 2026-02-13T03:56:45.515 INFO:teuthology.orchestra.run.trial099.stdout:(10/173): ceph-radosgw-20.3.0-5241.g8f8d3829.el 5.5 MB/s | 13 MB 00:02 2026-02-13T03:56:45.529 INFO:teuthology.orchestra.run.trial158.stdout:(6/173): ceph-mds-20.3.0-5241.g8f8d3829.el9.x86 1.6 MB/s | 2.4 MB 00:01 2026-02-13T03:56:45.566 INFO:teuthology.orchestra.run.trial099.stdout:(11/173): ceph-selinux-20.3.0-5241.g8f8d3829.el 486 kB/s | 25 kB 00:00 2026-02-13T03:56:45.610 INFO:teuthology.orchestra.run.trial099.stdout:(12/173): ceph-osd-classic-20.3.0-5241.g8f8d382 2.7 MB/s | 16 MB 00:05 2026-02-13T03:56:45.638 INFO:teuthology.orchestra.run.trial158.stdout:(7/173): ceph-osd-20.3.0-5241.g8f8d3829.el9.x86 1.5 MB/s | 166 kB 00:00 2026-02-13T03:56:45.724 INFO:teuthology.orchestra.run.trial099.stdout:(13/173): cephfs-mirror-20.3.0-5241.g8f8d3829.e 2.1 MB/s | 243 kB 00:00 2026-02-13T03:56:45.781 INFO:teuthology.orchestra.run.trial099.stdout:(14/173): cephfs-shell-20.3.0-5241.g8f8d3829.el 485 kB/s | 27 kB 00:00 2026-02-13T03:56:45.838 INFO:teuthology.orchestra.run.trial099.stdout:(15/173): libcephfs-devel-20.3.0-5241.g8f8d3829 652 kB/s | 37 kB 00:00 2026-02-13T03:56:45.895 INFO:teuthology.orchestra.run.trial099.stdout:(16/173): libcephfs-proxy2-20.3.0-5241.g8f8d382 430 kB/s | 24 kB 00:00 2026-02-13T03:56:46.206 INFO:teuthology.orchestra.run.trial092.stdout:(12/173): ceph-radosgw-20.3.0-5241.g8f8d3829.el 8.8 MB/s | 13 MB 00:01 2026-02-13T03:56:46.263 INFO:teuthology.orchestra.run.trial092.stdout:(13/173): cephfs-mirror-20.3.0-5241.g8f8d3829.e 4.2 MB/s | 243 kB 00:00 2026-02-13T03:56:46.314 INFO:teuthology.orchestra.run.trial092.stdout:(14/173): cephfs-shell-20.3.0-5241.g8f8d3829.el 535 kB/s | 27 kB 00:00 2026-02-13T03:56:46.337 INFO:teuthology.orchestra.run.trial099.stdout:(17/173): libcephfs2-20.3.0-5241.g8f8d3829.el9. 2.0 MB/s | 909 kB 00:00 2026-02-13T03:56:46.363 INFO:teuthology.orchestra.run.trial092.stdout:(15/173): libcephfs-devel-20.3.0-5241.g8f8d3829 760 kB/s | 37 kB 00:00 2026-02-13T03:56:46.414 INFO:teuthology.orchestra.run.trial092.stdout:(16/173): libcephfs-proxy2-20.3.0-5241.g8f8d382 480 kB/s | 24 kB 00:00 2026-02-13T03:56:46.437 INFO:teuthology.orchestra.run.trial099.stdout:(18/173): libcephsqlite-20.3.0-5241.g8f8d3829.e 1.6 MB/s | 159 kB 00:00 2026-02-13T03:56:46.496 INFO:teuthology.orchestra.run.trial099.stdout:(19/173): librados-devel-20.3.0-5241.g8f8d3829. 2.0 MB/s | 123 kB 00:00 2026-02-13T03:56:46.530 INFO:teuthology.orchestra.run.trial092.stdout:(17/173): libcephfs2-20.3.0-5241.g8f8d3829.el9. 7.7 MB/s | 909 kB 00:00 2026-02-13T03:56:46.582 INFO:teuthology.orchestra.run.trial092.stdout:(18/173): libcephsqlite-20.3.0-5241.g8f8d3829.e 3.0 MB/s | 159 kB 00:00 2026-02-13T03:56:46.592 INFO:teuthology.orchestra.run.trial158.stdout:(8/173): ceph-mon-20.3.0-5241.g8f8d3829.el9.x86 4.0 MB/s | 5.0 MB 00:01 2026-02-13T03:56:46.599 INFO:teuthology.orchestra.run.trial099.stdout:(20/173): libradosstriper1-20.3.0-5241.g8f8d382 2.3 MB/s | 248 kB 00:00 2026-02-13T03:56:46.633 INFO:teuthology.orchestra.run.trial092.stdout:(19/173): librados-devel-20.3.0-5241.g8f8d3829. 2.4 MB/s | 123 kB 00:00 2026-02-13T03:56:46.689 INFO:teuthology.orchestra.run.trial092.stdout:(20/173): libradosstriper1-20.3.0-5241.g8f8d382 4.3 MB/s | 248 kB 00:00 2026-02-13T03:56:47.400 INFO:teuthology.orchestra.run.trial092.stdout:(21/173): librgw2-20.3.0-5241.g8f8d3829.el9.x86 9.1 MB/s | 6.5 MB 00:00 2026-02-13T03:56:47.450 INFO:teuthology.orchestra.run.trial092.stdout:(22/173): python3-ceph-argparse-20.3.0-5241.g8f 913 kB/s | 45 kB 00:00 2026-02-13T03:56:47.503 INFO:teuthology.orchestra.run.trial092.stdout:(23/173): python3-ceph-common-20.3.0-5241.g8f8d 3.4 MB/s | 185 kB 00:00 2026-02-13T03:56:47.556 INFO:teuthology.orchestra.run.trial092.stdout:(24/173): python3-cephfs-20.3.0-5241.g8f8d3829. 3.7 MB/s | 204 kB 00:00 2026-02-13T03:56:47.612 INFO:teuthology.orchestra.run.trial092.stdout:(25/173): python3-rados-20.3.0-5241.g8f8d3829.e 5.7 MB/s | 324 kB 00:00 2026-02-13T03:56:47.667 INFO:teuthology.orchestra.run.trial092.stdout:(26/173): python3-rbd-20.3.0-5241.g8f8d3829.el9 5.4 MB/s | 306 kB 00:00 2026-02-13T03:56:47.719 INFO:teuthology.orchestra.run.trial092.stdout:(27/173): python3-rgw-20.3.0-5241.g8f8d3829.el9 1.9 MB/s | 100 kB 00:00 2026-02-13T03:56:47.770 INFO:teuthology.orchestra.run.trial092.stdout:(28/173): rbd-fuse-20.3.0-5241.g8f8d3829.el9.x8 1.6 MB/s | 84 kB 00:00 2026-02-13T03:56:47.797 INFO:teuthology.orchestra.run.trial092.stdout:(29/173): ceph-base-20.3.0-5241.g8f8d3829.el9.x 632 kB/s | 5.2 MB 00:08 2026-02-13T03:56:47.972 INFO:teuthology.orchestra.run.trial092.stdout:(30/173): rbd-nbd-20.3.0-5241.g8f8d3829.el9.x86 983 kB/s | 172 kB 00:00 2026-02-13T03:56:48.033 INFO:teuthology.orchestra.run.trial092.stdout:(31/173): ceph-grafana-dashboards-20.3.0-5241.g 949 kB/s | 57 kB 00:00 2026-02-13T03:56:48.121 INFO:teuthology.orchestra.run.trial092.stdout:(32/173): rbd-mirror-20.3.0-5241.g8f8d3829.el9. 8.2 MB/s | 2.9 MB 00:00 2026-02-13T03:56:48.204 INFO:teuthology.orchestra.run.trial092.stdout:(33/173): ceph-mgr-cephadm-20.3.0-5241.g8f8d382 1.0 MB/s | 183 kB 00:00 2026-02-13T03:56:48.223 INFO:teuthology.orchestra.run.trial099.stdout:(21/173): ceph-common-20.3.0-5241.g8f8d3829.el9 2.2 MB/s | 24 MB 00:10 2026-02-13T03:56:48.280 INFO:teuthology.orchestra.run.trial099.stdout:(22/173): python3-ceph-argparse-20.3.0-5241.g8f 788 kB/s | 45 kB 00:00 2026-02-13T03:56:48.400 INFO:teuthology.orchestra.run.trial099.stdout:(23/173): python3-ceph-common-20.3.0-5241.g8f8d 1.5 MB/s | 185 kB 00:00 2026-02-13T03:56:48.520 INFO:teuthology.orchestra.run.trial099.stdout:(24/173): python3-cephfs-20.3.0-5241.g8f8d3829. 1.7 MB/s | 204 kB 00:00 2026-02-13T03:56:48.704 INFO:teuthology.orchestra.run.trial099.stdout:(25/173): python3-rados-20.3.0-5241.g8f8d3829.e 1.7 MB/s | 324 kB 00:00 2026-02-13T03:56:48.887 INFO:teuthology.orchestra.run.trial099.stdout:(26/173): python3-rbd-20.3.0-5241.g8f8d3829.el9 1.6 MB/s | 306 kB 00:00 2026-02-13T03:56:48.948 INFO:teuthology.orchestra.run.trial099.stdout:(27/173): python3-rgw-20.3.0-5241.g8f8d3829.el9 1.6 MB/s | 100 kB 00:00 2026-02-13T03:56:49.010 INFO:teuthology.orchestra.run.trial099.stdout:(28/173): rbd-fuse-20.3.0-5241.g8f8d3829.el9.x8 1.3 MB/s | 84 kB 00:00 2026-02-13T03:56:49.188 INFO:teuthology.orchestra.run.trial099.stdout:(29/173): librgw2-20.3.0-5241.g8f8d3829.el9.x86 2.5 MB/s | 6.5 MB 00:02 2026-02-13T03:56:49.312 INFO:teuthology.orchestra.run.trial099.stdout:(30/173): rbd-nbd-20.3.0-5241.g8f8d3829.el9.x86 1.4 MB/s | 172 kB 00:00 2026-02-13T03:56:49.369 INFO:teuthology.orchestra.run.trial099.stdout:(31/173): ceph-grafana-dashboards-20.3.0-5241.g 1.0 MB/s | 57 kB 00:00 2026-02-13T03:56:49.489 INFO:teuthology.orchestra.run.trial099.stdout:(32/173): ceph-mgr-cephadm-20.3.0-5241.g8f8d382 1.5 MB/s | 183 kB 00:00 2026-02-13T03:56:49.546 INFO:teuthology.orchestra.run.trial158.stdout:(9/173): ceph-common-20.3.0-5241.g8f8d3829.el9. 3.4 MB/s | 24 MB 00:07 2026-02-13T03:56:49.760 INFO:teuthology.orchestra.run.trial092.stdout:(34/173): ceph-mgr-dashboard-20.3.0-5241.g8f8d3 9.1 MB/s | 15 MB 00:01 2026-02-13T03:56:49.826 INFO:teuthology.orchestra.run.trial092.stdout:(35/173): ceph-mgr-modules-core-20.3.0-5241.g8f 4.4 MB/s | 297 kB 00:00 2026-02-13T03:56:49.883 INFO:teuthology.orchestra.run.trial092.stdout:(36/173): ceph-mgr-rook-20.3.0-5241.g8f8d3829.e 880 kB/s | 50 kB 00:00 2026-02-13T03:56:49.936 INFO:teuthology.orchestra.run.trial092.stdout:(37/173): ceph-prometheus-alerts-20.3.0-5241.g8 330 kB/s | 17 kB 00:00 2026-02-13T03:56:49.990 INFO:teuthology.orchestra.run.trial092.stdout:(38/173): ceph-volume-20.3.0-5241.g8f8d3829.el9 5.4 MB/s | 299 kB 00:00 2026-02-13T03:56:50.105 INFO:teuthology.orchestra.run.trial092.stdout:(39/173): cephadm-20.3.0-5241.g8f8d3829.el9.noa 8.8 MB/s | 1.0 MB 00:00 2026-02-13T03:56:50.153 INFO:teuthology.orchestra.run.trial092.stdout:(40/173): cephfs-top-20.3.0-5241.g8f8d3829.el9. 385 kB/s | 18 kB 00:00 2026-02-13T03:56:50.162 INFO:teuthology.orchestra.run.trial099.stdout:(33/173): rbd-mirror-20.3.0-5241.g8f8d3829.el9. 2.5 MB/s | 2.9 MB 00:01 2026-02-13T03:56:50.746 INFO:teuthology.orchestra.run.trial158.stdout:(10/173): ceph-osd-crimson-20.3.0-5241.g8f8d382 4.6 MB/s | 19 MB 00:04 2026-02-13T03:56:50.791 INFO:teuthology.orchestra.run.trial158.stdout:(11/173): ceph-selinux-20.3.0-5241.g8f8d3829.el 555 kB/s | 25 kB 00:00 2026-02-13T03:56:50.953 INFO:teuthology.orchestra.run.trial092.stdout:(41/173): cryptsetup-2.8.1-2.el9.x86_64.rpm 438 kB/s | 350 kB 00:00 2026-02-13T03:56:51.430 INFO:teuthology.orchestra.run.trial092.stdout:(42/173): hwloc-libs-2.4.1-6.el9.x86_64.rpm 4.4 MB/s | 2.1 MB 00:00 2026-02-13T03:56:51.589 INFO:teuthology.orchestra.run.trial092.stdout:(43/173): ledmon-libs-1.1.0-3.el9.x86_64.rpm 254 kB/s | 40 kB 00:00 2026-02-13T03:56:51.747 INFO:teuthology.orchestra.run.trial092.stdout:(44/173): libatomic-11.5.0-14.el9.x86_64.rpm 144 kB/s | 23 kB 00:00 2026-02-13T03:56:51.755 INFO:teuthology.orchestra.run.trial158.stdout:(12/173): ceph-osd-classic-20.3.0-5241.g8f8d382 2.6 MB/s | 16 MB 00:06 2026-02-13T03:56:51.855 INFO:teuthology.orchestra.run.trial158.stdout:(13/173): cephfs-mirror-20.3.0-5241.g8f8d3829.e 2.4 MB/s | 243 kB 00:00 2026-02-13T03:56:51.902 INFO:teuthology.orchestra.run.trial158.stdout:(14/173): cephfs-shell-20.3.0-5241.g8f8d3829.el 573 kB/s | 27 kB 00:00 2026-02-13T03:56:51.907 INFO:teuthology.orchestra.run.trial092.stdout:(45/173): libconfig-1.7.2-9.el9.x86_64.rpm 452 kB/s | 72 kB 00:00 2026-02-13T03:56:51.949 INFO:teuthology.orchestra.run.trial158.stdout:(15/173): libcephfs-devel-20.3.0-5241.g8f8d3829 788 kB/s | 37 kB 00:00 2026-02-13T03:56:51.997 INFO:teuthology.orchestra.run.trial158.stdout:(16/173): libcephfs-proxy2-20.3.0-5241.g8f8d382 518 kB/s | 24 kB 00:00 2026-02-13T03:56:52.074 INFO:teuthology.orchestra.run.trial092.stdout:(46/173): libgfortran-11.5.0-14.el9.x86_64.rpm 4.7 MB/s | 794 kB 00:00 2026-02-13T03:56:52.103 INFO:teuthology.orchestra.run.trial158.stdout:(17/173): ceph-radosgw-20.3.0-5241.g8f8d3829.el 5.2 MB/s | 13 MB 00:02 2026-02-13T03:56:52.152 INFO:teuthology.orchestra.run.trial158.stdout:(18/173): libcephsqlite-20.3.0-5241.g8f8d3829.e 3.2 MB/s | 159 kB 00:00 2026-02-13T03:56:52.186 INFO:teuthology.orchestra.run.trial092.stdout:(47/173): ceph-mgr-diskprediction-local-20.3.0- 1.9 MB/s | 7.4 MB 00:03 2026-02-13T03:56:52.199 INFO:teuthology.orchestra.run.trial158.stdout:(19/173): librados-devel-20.3.0-5241.g8f8d3829. 2.6 MB/s | 123 kB 00:00 2026-02-13T03:56:52.233 INFO:teuthology.orchestra.run.trial092.stdout:(48/173): libquadmath-11.5.0-14.el9.x86_64.rpm 1.1 MB/s | 184 kB 00:00 2026-02-13T03:56:52.236 INFO:teuthology.orchestra.run.trial158.stdout:(20/173): libcephfs2-20.3.0-5241.g8f8d3829.el9. 3.7 MB/s | 909 kB 00:00 2026-02-13T03:56:52.247 INFO:teuthology.orchestra.run.trial158.stdout:(21/173): libradosstriper1-20.3.0-5241.g8f8d382 5.0 MB/s | 248 kB 00:00 2026-02-13T03:56:52.287 INFO:teuthology.orchestra.run.trial099.stdout:(34/173): ceph-mgr-diskprediction-local-20.3.0- 3.5 MB/s | 7.4 MB 00:02 2026-02-13T03:56:52.289 INFO:teuthology.orchestra.run.trial158.stdout:(22/173): python3-ceph-argparse-20.3.0-5241.g8f 1.1 MB/s | 45 kB 00:00 2026-02-13T03:56:52.337 INFO:teuthology.orchestra.run.trial158.stdout:(23/173): python3-ceph-common-20.3.0-5241.g8f8d 3.8 MB/s | 185 kB 00:00 2026-02-13T03:56:52.345 INFO:teuthology.orchestra.run.trial092.stdout:(49/173): lksctp-tools-1.0.19-2.el9.x86_64.rpm 591 kB/s | 94 kB 00:00 2026-02-13T03:56:52.377 INFO:teuthology.orchestra.run.trial099.stdout:(35/173): ceph-mgr-modules-core-20.3.0-5241.g8f 3.2 MB/s | 297 kB 00:00 2026-02-13T03:56:52.383 INFO:teuthology.orchestra.run.trial158.stdout:(24/173): python3-cephfs-20.3.0-5241.g8f8d3829. 4.3 MB/s | 204 kB 00:00 2026-02-13T03:56:52.422 INFO:teuthology.orchestra.run.trial099.stdout:(36/173): ceph-mgr-rook-20.3.0-5241.g8f8d3829.e 1.1 MB/s | 50 kB 00:00 2026-02-13T03:56:52.469 INFO:teuthology.orchestra.run.trial099.stdout:(37/173): ceph-prometheus-alerts-20.3.0-5241.g8 377 kB/s | 17 kB 00:00 2026-02-13T03:56:52.471 INFO:teuthology.orchestra.run.trial092.stdout:(50/173): mailcap-2.1.49-5.el9.noarch.rpm 139 kB/s | 33 kB 00:00 2026-02-13T03:56:52.472 INFO:teuthology.orchestra.run.trial158.stdout:(25/173): python3-rados-20.3.0-5241.g8f8d3829.e 3.6 MB/s | 324 kB 00:00 2026-02-13T03:56:52.559 INFO:teuthology.orchestra.run.trial099.stdout:(38/173): ceph-volume-20.3.0-5241.g8f8d3829.el9 3.2 MB/s | 299 kB 00:00 2026-02-13T03:56:52.562 INFO:teuthology.orchestra.run.trial158.stdout:(26/173): python3-rbd-20.3.0-5241.g8f8d3829.el9 3.3 MB/s | 306 kB 00:00 2026-02-13T03:56:52.608 INFO:teuthology.orchestra.run.trial158.stdout:(27/173): python3-rgw-20.3.0-5241.g8f8d3829.el9 2.1 MB/s | 100 kB 00:00 2026-02-13T03:56:52.632 INFO:teuthology.orchestra.run.trial092.stdout:(51/173): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.5 MB/s | 253 kB 00:00 2026-02-13T03:56:52.655 INFO:teuthology.orchestra.run.trial158.stdout:(28/173): rbd-fuse-20.3.0-5241.g8f8d3829.el9.x8 1.8 MB/s | 84 kB 00:00 2026-02-13T03:56:52.801 INFO:teuthology.orchestra.run.trial092.stdout:(52/173): python3-cryptography-36.0.1-5.el9.x86 7.4 MB/s | 1.2 MB 00:00 2026-02-13T03:56:52.838 INFO:teuthology.orchestra.run.trial099.stdout:(39/173): cephadm-20.3.0-5241.g8f8d3829.el9.noa 3.6 MB/s | 1.0 MB 00:00 2026-02-13T03:56:52.883 INFO:teuthology.orchestra.run.trial099.stdout:(40/173): cephfs-top-20.3.0-5241.g8f8d3829.el9. 406 kB/s | 18 kB 00:00 2026-02-13T03:56:52.961 INFO:teuthology.orchestra.run.trial092.stdout:(53/173): python3-ply-3.11-14.el9.noarch.rpm 668 kB/s | 106 kB 00:00 2026-02-13T03:56:52.980 INFO:teuthology.orchestra.run.trial092.stdout:(54/173): pciutils-3.7.0-7.el9.x86_64.rpm 147 kB/s | 93 kB 00:00 2026-02-13T03:56:53.122 INFO:teuthology.orchestra.run.trial092.stdout:(55/173): python3-pycparser-2.20-6.el9.noarch.r 840 kB/s | 135 kB 00:00 2026-02-13T03:56:53.141 INFO:teuthology.orchestra.run.trial158.stdout:(29/173): rbd-mirror-20.3.0-5241.g8f8d3829.el9. 5.9 MB/s | 2.9 MB 00:00 2026-02-13T03:56:53.181 INFO:teuthology.orchestra.run.trial158.stdout:(30/173): rbd-nbd-20.3.0-5241.g8f8d3829.el9.x86 4.2 MB/s | 172 kB 00:00 2026-02-13T03:56:53.217 INFO:teuthology.orchestra.run.trial092.stdout:(56/173): python3-requests-2.25.1-10.el9.noarch 533 kB/s | 126 kB 00:00 2026-02-13T03:56:53.218 INFO:teuthology.orchestra.run.trial158.stdout:(31/173): ceph-grafana-dashboards-20.3.0-5241.g 1.5 MB/s | 57 kB 00:00 2026-02-13T03:56:53.258 INFO:teuthology.orchestra.run.trial158.stdout:(32/173): ceph-mgr-cephadm-20.3.0-5241.g8f8d382 4.6 MB/s | 183 kB 00:00 2026-02-13T03:56:53.281 INFO:teuthology.orchestra.run.trial099.stdout:(41/173): ceph-mgr-dashboard-20.3.0-5241.g8f8d3 3.9 MB/s | 15 MB 00:03 2026-02-13T03:56:53.283 INFO:teuthology.orchestra.run.trial092.stdout:(57/173): python3-urllib3-1.26.5-7.el9.noarch.r 1.3 MB/s | 218 kB 00:00 2026-02-13T03:56:53.377 INFO:teuthology.orchestra.run.trial092.stdout:(58/173): unzip-6.0-59.el9.x86_64.rpm 1.1 MB/s | 182 kB 00:00 2026-02-13T03:56:53.414 INFO:teuthology.orchestra.run.trial092.stdout:(59/173): automake-1.16.2-8.el9.noarch.rpm 18 MB/s | 689 kB 00:00 2026-02-13T03:56:53.427 INFO:teuthology.orchestra.run.trial092.stdout:(60/173): bison-3.7.4-5.el9.x86_64.rpm 72 MB/s | 943 kB 00:00 2026-02-13T03:56:53.433 INFO:teuthology.orchestra.run.trial092.stdout:(61/173): boost-program-options-1.75.0-13.el9.x 18 MB/s | 104 kB 00:00 2026-02-13T03:56:53.438 INFO:teuthology.orchestra.run.trial092.stdout:(62/173): elfutils-libelf-devel-0.194-1.el9.x86 16 MB/s | 79 kB 00:00 2026-02-13T03:56:53.446 INFO:teuthology.orchestra.run.trial092.stdout:(63/173): flex-2.6.4-9.el9.x86_64.rpm 41 MB/s | 313 kB 00:00 2026-02-13T03:56:53.450 INFO:teuthology.orchestra.run.trial092.stdout:(64/173): flexiblas-3.0.4-8.el9.x86_64.rpm 7.3 MB/s | 33 kB 00:00 2026-02-13T03:56:53.519 INFO:teuthology.orchestra.run.trial092.stdout:(65/173): flexiblas-netlib-3.0.4-8.el9.x86_64.r 44 MB/s | 3.0 MB 00:00 2026-02-13T03:56:53.522 INFO:teuthology.orchestra.run.trial092.stdout:(66/173): zip-3.0-35.el9.x86_64.rpm 1.1 MB/s | 266 kB 00:00 2026-02-13T03:56:53.524 INFO:teuthology.orchestra.run.trial092.stdout:(67/173): flexiblas-openblas-openmp-3.0.4-8.el9 4.0 MB/s | 18 kB 00:00 2026-02-13T03:56:53.529 INFO:teuthology.orchestra.run.trial092.stdout:(68/173): libaio-devel-0.3.111-13.el9.x86_64.rp 1.4 MB/s | 11 kB 00:00 2026-02-13T03:56:53.531 INFO:teuthology.orchestra.run.trial092.stdout:(69/173): libnbd-1.20.3-4.el9.x86_64.rpm 25 MB/s | 164 kB 00:00 2026-02-13T03:56:53.536 INFO:teuthology.orchestra.run.trial092.stdout:(70/173): librabbitmq-0.11.0-7.el9.x86_64.rpm 9.2 MB/s | 45 kB 00:00 2026-02-13T03:56:53.543 INFO:teuthology.orchestra.run.trial092.stdout:(71/173): libpmemobj-1.12.1-1.el9.x86_64.rpm 12 MB/s | 160 kB 00:00 2026-02-13T03:56:53.547 INFO:teuthology.orchestra.run.trial092.stdout:(72/173): librdkafka-1.6.1-102.el9.x86_64.rpm 58 MB/s | 662 kB 00:00 2026-02-13T03:56:53.555 INFO:teuthology.orchestra.run.trial092.stdout:(73/173): libstoragemgmt-1.10.1-1.el9.x86_64.rp 20 MB/s | 246 kB 00:00 2026-02-13T03:56:53.558 INFO:teuthology.orchestra.run.trial092.stdout:(74/173): libtool-2.4.6-46.el9.x86_64.rpm 52 MB/s | 581 kB 00:00 2026-02-13T03:56:53.560 INFO:teuthology.orchestra.run.trial092.stdout:(75/173): libuuid-devel-2.37.4-21.el9.x86_64.rp 5.5 MB/s | 25 kB 00:00 2026-02-13T03:56:53.565 INFO:teuthology.orchestra.run.trial092.stdout:(76/173): libzstd-devel-1.5.5-1.el9.x86_64.rpm 10 MB/s | 51 kB 00:00 2026-02-13T03:56:53.566 INFO:teuthology.orchestra.run.trial092.stdout:(77/173): libxslt-1.1.34-12.el9.x86_64.rpm 30 MB/s | 233 kB 00:00 2026-02-13T03:56:53.572 INFO:teuthology.orchestra.run.trial092.stdout:(78/173): lttng-ust-2.12.0-6.el9.x86_64.rpm 37 MB/s | 292 kB 00:00 2026-02-13T03:56:53.574 INFO:teuthology.orchestra.run.trial092.stdout:(79/173): lua-5.4.4-4.el9.x86_64.rpm 25 MB/s | 188 kB 00:00 2026-02-13T03:56:53.578 INFO:teuthology.orchestra.run.trial092.stdout:(80/173): openblas-0.3.29-1.el9.x86_64.rpm 8.4 MB/s | 42 kB 00:00 2026-02-13T03:56:53.622 INFO:teuthology.orchestra.run.trial092.stdout:(81/173): openssl-devel-3.5.5-1.el9.x86_64.rpm 110 MB/s | 4.8 MB 00:00 2026-02-13T03:56:53.626 INFO:teuthology.orchestra.run.trial092.stdout:(82/173): perl-Thread-Queue-3.14-460.el9.noarch 4.9 MB/s | 22 kB 00:00 2026-02-13T03:56:53.632 INFO:teuthology.orchestra.run.trial092.stdout:(83/173): perl-threads-2.25-460.el9.x86_64.rpm 12 MB/s | 58 kB 00:00 2026-02-13T03:56:53.637 INFO:teuthology.orchestra.run.trial092.stdout:(84/173): perl-threads-shared-1.61-460.el9.x86_ 9.1 MB/s | 45 kB 00:00 2026-02-13T03:56:53.639 INFO:teuthology.orchestra.run.trial158.stdout:(33/173): librgw2-20.3.0-5241.g8f8d3829.el9.x86 4.6 MB/s | 6.5 MB 00:01 2026-02-13T03:56:53.655 INFO:teuthology.orchestra.run.trial092.stdout:(85/173): postgresql-13.23-1.el9.x86_64.rpm 89 MB/s | 1.6 MB 00:00 2026-02-13T03:56:53.669 INFO:teuthology.orchestra.run.trial092.stdout:(86/173): postgresql-contrib-13.23-1.el9.x86_64 66 MB/s | 903 kB 00:00 2026-02-13T03:56:53.676 INFO:teuthology.orchestra.run.trial092.stdout:(87/173): postgresql-private-libs-13.23-1.el9.x 21 MB/s | 138 kB 00:00 2026-02-13T03:56:53.692 INFO:teuthology.orchestra.run.trial092.stdout:(88/173): openblas-openmp-0.3.29-1.el9.x86_64.r 45 MB/s | 5.3 MB 00:00 2026-02-13T03:56:53.708 INFO:teuthology.orchestra.run.trial099.stdout:(42/173): cryptsetup-2.8.1-2.el9.x86_64.rpm 425 kB/s | 350 kB 00:00 2026-02-13T03:56:53.708 INFO:teuthology.orchestra.run.trial092.stdout:(89/173): protobuf-3.14.0-17.el9.x86_64.rpm 63 MB/s | 1.0 MB 00:00 2026-02-13T03:56:53.747 INFO:teuthology.orchestra.run.trial092.stdout:(90/173): postgresql-server-13.23-1.el9.x86_64. 81 MB/s | 5.8 MB 00:00 2026-02-13T03:56:53.753 INFO:teuthology.orchestra.run.trial092.stdout:(91/173): python3-colorama-0.4.6-3.el9.noarch.r 10 MB/s | 61 kB 00:00 2026-02-13T03:56:53.761 INFO:teuthology.orchestra.run.trial092.stdout:(92/173): python3-devel-3.9.25-2.el9.x86_64.rpm 34 MB/s | 244 kB 00:00 2026-02-13T03:56:53.774 INFO:teuthology.orchestra.run.trial092.stdout:(93/173): python3-babel-2.9.1-2.el9.noarch.rpm 90 MB/s | 6.0 MB 00:00 2026-02-13T03:56:53.777 INFO:teuthology.orchestra.run.trial092.stdout:(94/173): python3-jinja2-2.11.3-8.el9.noarch.rp 15 MB/s | 249 kB 00:00 2026-02-13T03:56:53.780 INFO:teuthology.orchestra.run.trial092.stdout:(95/173): python3-jmespath-1.0.1-1.el9.noarch.r 8.6 MB/s | 48 kB 00:00 2026-02-13T03:56:53.784 INFO:teuthology.orchestra.run.trial092.stdout:(96/173): python3-libstoragemgmt-1.10.1-1.el9.x 23 MB/s | 177 kB 00:00 2026-02-13T03:56:53.785 INFO:teuthology.orchestra.run.trial092.stdout:(97/173): python3-markupsafe-1.1.1-12.el9.x86_6 6.7 MB/s | 35 kB 00:00 2026-02-13T03:56:53.796 INFO:teuthology.orchestra.run.trial092.stdout:(98/173): python3-numpy-f2py-1.23.5-2.el9.x86_6 41 MB/s | 442 kB 00:00 2026-02-13T03:56:53.803 INFO:teuthology.orchestra.run.trial092.stdout:(99/173): python3-packaging-20.9-5.el9.noarch.r 12 MB/s | 77 kB 00:00 2026-02-13T03:56:53.811 INFO:teuthology.orchestra.run.trial092.stdout:(100/173): python3-protobuf-3.14.0-17.el9.noarc 34 MB/s | 267 kB 00:00 2026-02-13T03:56:53.818 INFO:teuthology.orchestra.run.trial092.stdout:(101/173): python3-pyasn1-0.4.8-6.el9.noarch.rp 23 MB/s | 159 kB 00:00 2026-02-13T03:56:53.836 INFO:teuthology.orchestra.run.trial092.stdout:(102/173): python3-numpy-1.23.5-2.el9.x86_64.rp 121 MB/s | 6.1 MB 00:00 2026-02-13T03:56:53.837 INFO:teuthology.orchestra.run.trial092.stdout:(103/173): python3-pyasn1-modules-0.4.8-6.el9.n 14 MB/s | 279 kB 00:00 2026-02-13T03:56:53.842 INFO:teuthology.orchestra.run.trial092.stdout:(104/173): python3-requests-oauthlib-1.3.0-12.e 9.3 MB/s | 54 kB 00:00 2026-02-13T03:56:53.848 INFO:teuthology.orchestra.run.trial092.stdout:(105/173): python3-toml-0.10.2-6.el9.noarch.rpm 6.4 MB/s | 42 kB 00:00 2026-02-13T03:56:53.854 INFO:teuthology.orchestra.run.trial092.stdout:(106/173): python3-wcwidth-0.2.5-8.el9.noarch.r 7.6 MB/s | 44 kB 00:00 2026-02-13T03:56:53.862 INFO:teuthology.orchestra.run.trial092.stdout:(107/173): qatlib-25.08.0-2.el9.x86_64.rpm 33 MB/s | 240 kB 00:00 2026-02-13T03:56:53.867 INFO:teuthology.orchestra.run.trial092.stdout:(108/173): qatlib-service-25.08.0-2.el9.x86_64. 7.0 MB/s | 37 kB 00:00 2026-02-13T03:56:53.873 INFO:teuthology.orchestra.run.trial092.stdout:(109/173): qatzip-libs-1.3.1-1.el9.x86_64.rpm 12 MB/s | 66 kB 00:00 2026-02-13T03:56:53.879 INFO:teuthology.orchestra.run.trial092.stdout:(110/173): socat-1.7.4.1-8.el9.x86_64.rpm 46 MB/s | 303 kB 00:00 2026-02-13T03:56:53.884 INFO:teuthology.orchestra.run.trial092.stdout:(111/173): uuid-1.6.2-55.el9.x86_64.rpm 11 MB/s | 58 kB 00:00 2026-02-13T03:56:53.890 INFO:teuthology.orchestra.run.trial092.stdout:(112/173): xfsprogs-devel-6.4.0-7.el9.x86_64.rp 17 MB/s | 96 kB 00:00 2026-02-13T03:56:53.895 INFO:teuthology.orchestra.run.trial092.stdout:(113/173): xmlstarlet-1.6.1-20.el9.x86_64.rpm 12 MB/s | 64 kB 00:00 2026-02-13T03:56:53.900 INFO:teuthology.orchestra.run.trial092.stdout:(114/173): zlib-devel-1.2.11-41.el9.x86_64.rpm 9.7 MB/s | 45 kB 00:00 2026-02-13T03:56:53.968 INFO:teuthology.orchestra.run.trial092.stdout:(115/173): python3-scipy-1.9.3-2.el9.x86_64.rpm 147 MB/s | 19 MB 00:00 2026-02-13T03:56:54.284 INFO:teuthology.orchestra.run.trial099.stdout:(43/173): hwloc-libs-2.4.1-6.el9.x86_64.rpm 2.1 MB/s | 2.1 MB 00:01 2026-02-13T03:56:54.285 INFO:teuthology.orchestra.run.trial099.stdout:(44/173): ledmon-libs-1.1.0-3.el9.x86_64.rpm 70 kB/s | 40 kB 00:00 2026-02-13T03:56:54.450 INFO:teuthology.orchestra.run.trial092.stdout:(116/173): lua-devel-5.4.4-4.el9.x86_64.rpm 41 kB/s | 22 kB 00:00 2026-02-13T03:56:54.773 INFO:teuthology.orchestra.run.trial158.stdout:(34/173): ceph-mgr-diskprediction-local-20.3.0- 6.5 MB/s | 7.4 MB 00:01 2026-02-13T03:56:54.824 INFO:teuthology.orchestra.run.trial099.stdout:(45/173): libatomic-11.5.0-14.el9.x86_64.rpm 42 kB/s | 23 kB 00:00 2026-02-13T03:56:54.838 INFO:teuthology.orchestra.run.trial158.stdout:(35/173): ceph-mgr-modules-core-20.3.0-5241.g8f 4.5 MB/s | 297 kB 00:00 2026-02-13T03:56:54.869 INFO:teuthology.orchestra.run.trial158.stdout:(36/173): ceph-mgr-rook-20.3.0-5241.g8f8d3829.e 1.6 MB/s | 50 kB 00:00 2026-02-13T03:56:54.875 INFO:teuthology.orchestra.run.trial092.stdout:(117/173): protobuf-compiler-3.14.0-17.el9.x86_ 950 kB/s | 862 kB 00:00 2026-02-13T03:56:54.900 INFO:teuthology.orchestra.run.trial158.stdout:(37/173): ceph-prometheus-alerts-20.3.0-5241.g8 565 kB/s | 17 kB 00:00 2026-02-13T03:56:54.915 INFO:teuthology.orchestra.run.trial099.stdout:(46/173): libconfig-1.7.2-9.el9.x86_64.rpm 114 kB/s | 72 kB 00:00 2026-02-13T03:56:54.953 INFO:teuthology.orchestra.run.trial158.stdout:(38/173): ceph-mgr-dashboard-20.3.0-5241.g8f8d3 8.8 MB/s | 15 MB 00:01 2026-02-13T03:56:54.976 INFO:teuthology.orchestra.run.trial158.stdout:(39/173): ceph-volume-20.3.0-5241.g8f8d3829.el9 3.8 MB/s | 299 kB 00:00 2026-02-13T03:56:55.007 INFO:teuthology.orchestra.run.trial158.stdout:(40/173): cephfs-top-20.3.0-5241.g8f8d3829.el9. 600 kB/s | 18 kB 00:00 2026-02-13T03:56:55.056 INFO:teuthology.orchestra.run.trial158.stdout:(41/173): cryptsetup-2.8.1-2.el9.x86_64.rpm 7.0 MB/s | 350 kB 00:00 2026-02-13T03:56:55.073 INFO:teuthology.orchestra.run.trial158.stdout:(42/173): cephadm-20.3.0-5241.g8f8d3829.el9.noa 8.5 MB/s | 1.0 MB 00:00 2026-02-13T03:56:55.087 INFO:teuthology.orchestra.run.trial158.stdout:(43/173): hwloc-libs-2.4.1-6.el9.x86_64.rpm 69 MB/s | 2.1 MB 00:00 2026-02-13T03:56:55.095 INFO:teuthology.orchestra.run.trial158.stdout:(44/173): libatomic-11.5.0-14.el9.x86_64.rpm 2.7 MB/s | 23 kB 00:00 2026-02-13T03:56:55.099 INFO:teuthology.orchestra.run.trial158.stdout:(45/173): ledmon-libs-1.1.0-3.el9.x86_64.rpm 1.5 MB/s | 40 kB 00:00 2026-02-13T03:56:55.105 INFO:teuthology.orchestra.run.trial158.stdout:(46/173): libconfig-1.7.2-9.el9.x86_64.rpm 7.7 MB/s | 72 kB 00:00 2026-02-13T03:56:55.115 INFO:teuthology.orchestra.run.trial158.stdout:(47/173): libquadmath-11.5.0-14.el9.x86_64.rpm 17 MB/s | 184 kB 00:00 2026-02-13T03:56:55.125 INFO:teuthology.orchestra.run.trial158.stdout:(48/173): lksctp-tools-1.0.19-2.el9.x86_64.rpm 9.5 MB/s | 94 kB 00:00 2026-02-13T03:56:55.134 INFO:teuthology.orchestra.run.trial158.stdout:(49/173): mailcap-2.1.49-5.el9.noarch.rpm 3.8 MB/s | 33 kB 00:00 2026-02-13T03:56:55.135 INFO:teuthology.orchestra.run.trial158.stdout:(50/173): libgfortran-11.5.0-14.el9.x86_64.rpm 22 MB/s | 794 kB 00:00 2026-02-13T03:56:55.143 INFO:teuthology.orchestra.run.trial158.stdout:(51/173): pciutils-3.7.0-7.el9.x86_64.rpm 9.8 MB/s | 93 kB 00:00 2026-02-13T03:56:55.146 INFO:teuthology.orchestra.run.trial158.stdout:(52/173): python3-cffi-1.14.5-5.el9.x86_64.rpm 22 MB/s | 253 kB 00:00 2026-02-13T03:56:55.156 INFO:teuthology.orchestra.run.trial158.stdout:(53/173): python3-ply-3.11-14.el9.noarch.rpm 11 MB/s | 106 kB 00:00 2026-02-13T03:56:55.158 INFO:teuthology.orchestra.run.trial158.stdout:(54/173): python3-cryptography-36.0.1-5.el9.x86 85 MB/s | 1.2 MB 00:00 2026-02-13T03:56:55.165 INFO:teuthology.orchestra.run.trial158.stdout:(55/173): python3-pycparser-2.20-6.el9.noarch.r 15 MB/s | 135 kB 00:00 2026-02-13T03:56:55.168 INFO:teuthology.orchestra.run.trial158.stdout:(56/173): python3-requests-2.25.1-10.el9.noarch 12 MB/s | 126 kB 00:00 2026-02-13T03:56:55.176 INFO:teuthology.orchestra.run.trial158.stdout:(57/173): python3-urllib3-1.26.5-7.el9.noarch.r 20 MB/s | 218 kB 00:00 2026-02-13T03:56:55.177 INFO:teuthology.orchestra.run.trial158.stdout:(58/173): unzip-6.0-59.el9.x86_64.rpm 21 MB/s | 182 kB 00:00 2026-02-13T03:56:55.186 INFO:teuthology.orchestra.run.trial158.stdout:(59/173): zip-3.0-35.el9.x86_64.rpm 26 MB/s | 266 kB 00:00 2026-02-13T03:56:55.239 INFO:teuthology.orchestra.run.trial092.stdout:(118/173): abseil-cpp-20211102.0-4.el9.x86_64.r 700 kB/s | 551 kB 00:00 2026-02-13T03:56:55.256 INFO:teuthology.orchestra.run.trial158.stdout:(60/173): bison-3.7.4-5.el9.x86_64.rpm 13 MB/s | 943 kB 00:00 2026-02-13T03:56:55.260 INFO:teuthology.orchestra.run.trial158.stdout:(61/173): automake-1.16.2-8.el9.noarch.rpm 8.1 MB/s | 689 kB 00:00 2026-02-13T03:56:55.265 INFO:teuthology.orchestra.run.trial158.stdout:(62/173): boost-program-options-1.75.0-13.el9.x 11 MB/s | 104 kB 00:00 2026-02-13T03:56:55.270 INFO:teuthology.orchestra.run.trial158.stdout:(63/173): elfutils-libelf-devel-0.194-1.el9.x86 8.0 MB/s | 79 kB 00:00 2026-02-13T03:56:55.275 INFO:teuthology.orchestra.run.trial158.stdout:(64/173): flex-2.6.4-9.el9.x86_64.rpm 34 MB/s | 313 kB 00:00 2026-02-13T03:56:55.279 INFO:teuthology.orchestra.run.trial158.stdout:(65/173): flexiblas-3.0.4-8.el9.x86_64.rpm 3.6 MB/s | 33 kB 00:00 2026-02-13T03:56:55.287 INFO:teuthology.orchestra.run.trial158.stdout:(66/173): flexiblas-openblas-openmp-3.0.4-8.el9 2.1 MB/s | 18 kB 00:00 2026-02-13T03:56:55.296 INFO:teuthology.orchestra.run.trial158.stdout:(67/173): libaio-devel-0.3.111-13.el9.x86_64.rp 1.2 MB/s | 11 kB 00:00 2026-02-13T03:56:55.301 INFO:teuthology.orchestra.run.trial158.stdout:(68/173): flexiblas-netlib-3.0.4-8.el9.x86_64.r 113 MB/s | 3.0 MB 00:00 2026-02-13T03:56:55.307 INFO:teuthology.orchestra.run.trial158.stdout:(69/173): libnbd-1.20.3-4.el9.x86_64.rpm 15 MB/s | 164 kB 00:00 2026-02-13T03:56:55.311 INFO:teuthology.orchestra.run.trial158.stdout:(70/173): libpmemobj-1.12.1-1.el9.x86_64.rpm 16 MB/s | 160 kB 00:00 2026-02-13T03:56:55.316 INFO:teuthology.orchestra.run.trial158.stdout:(71/173): librabbitmq-0.11.0-7.el9.x86_64.rpm 4.8 MB/s | 45 kB 00:00 2026-02-13T03:56:55.322 INFO:teuthology.orchestra.run.trial158.stdout:(72/173): librdkafka-1.6.1-102.el9.x86_64.rpm 58 MB/s | 662 kB 00:00 2026-02-13T03:56:55.327 INFO:teuthology.orchestra.run.trial158.stdout:(73/173): libstoragemgmt-1.10.1-1.el9.x86_64.rp 23 MB/s | 246 kB 00:00 2026-02-13T03:56:55.329 INFO:teuthology.orchestra.run.trial092.stdout:(119/173): gperftools-libs-2.9.1-3.el9.x86_64.r 678 kB/s | 308 kB 00:00 2026-02-13T03:56:55.333 INFO:teuthology.orchestra.run.trial158.stdout:(74/173): libtool-2.4.6-46.el9.x86_64.rpm 52 MB/s | 581 kB 00:00 2026-02-13T03:56:55.336 INFO:teuthology.orchestra.run.trial158.stdout:(75/173): libuuid-devel-2.37.4-21.el9.x86_64.rp 2.7 MB/s | 25 kB 00:00 2026-02-13T03:56:55.345 INFO:teuthology.orchestra.run.trial158.stdout:(76/173): libxslt-1.1.34-12.el9.x86_64.rpm 19 MB/s | 233 kB 00:00 2026-02-13T03:56:55.346 INFO:teuthology.orchestra.run.trial158.stdout:(77/173): libzstd-devel-1.5.5-1.el9.x86_64.rpm 5.2 MB/s | 51 kB 00:00 2026-02-13T03:56:55.356 INFO:teuthology.orchestra.run.trial158.stdout:(78/173): lua-5.4.4-4.el9.x86_64.rpm 19 MB/s | 188 kB 00:00 2026-02-13T03:56:55.359 INFO:teuthology.orchestra.run.trial158.stdout:(79/173): lttng-ust-2.12.0-6.el9.x86_64.rpm 20 MB/s | 292 kB 00:00 2026-02-13T03:56:55.364 INFO:teuthology.orchestra.run.trial158.stdout:(80/173): openblas-0.3.29-1.el9.x86_64.rpm 5.0 MB/s | 42 kB 00:00 2026-02-13T03:56:55.364 INFO:teuthology.orchestra.run.trial092.stdout:(120/173): grpc-data-1.46.7-10.el9.noarch.rpm 155 kB/s | 19 kB 00:00 2026-02-13T03:56:55.409 INFO:teuthology.orchestra.run.trial158.stdout:(81/173): openblas-openmp-0.3.29-1.el9.x86_64.r 107 MB/s | 5.3 MB 00:00 2026-02-13T03:56:55.420 INFO:teuthology.orchestra.run.trial158.stdout:(82/173): perl-Thread-Queue-3.14-460.el9.noarch 2.1 MB/s | 22 kB 00:00 2026-02-13T03:56:55.432 INFO:teuthology.orchestra.run.trial158.stdout:(83/173): perl-threads-2.25-460.el9.x86_64.rpm 4.7 MB/s | 58 kB 00:00 2026-02-13T03:56:55.443 INFO:teuthology.orchestra.run.trial158.stdout:(84/173): perl-threads-shared-1.61-460.el9.x86_ 3.8 MB/s | 45 kB 00:00 2026-02-13T03:56:55.458 INFO:teuthology.orchestra.run.trial158.stdout:(85/173): postgresql-13.23-1.el9.x86_64.rpm 111 MB/s | 1.6 MB 00:00 2026-02-13T03:56:55.468 INFO:teuthology.orchestra.run.trial158.stdout:(86/173): openssl-devel-3.5.5-1.el9.x86_64.rpm 46 MB/s | 4.8 MB 00:00 2026-02-13T03:56:55.475 INFO:teuthology.orchestra.run.trial158.stdout:(87/173): postgresql-contrib-13.23-1.el9.x86_64 53 MB/s | 903 kB 00:00 2026-02-13T03:56:55.478 INFO:teuthology.orchestra.run.trial158.stdout:(88/173): postgresql-private-libs-13.23-1.el9.x 14 MB/s | 138 kB 00:00 2026-02-13T03:56:55.491 INFO:teuthology.orchestra.run.trial158.stdout:(89/173): protobuf-3.14.0-17.el9.x86_64.rpm 78 MB/s | 1.0 MB 00:00 2026-02-13T03:56:55.508 INFO:teuthology.orchestra.run.trial158.stdout:(90/173): postgresql-server-13.23-1.el9.x86_64. 176 MB/s | 5.8 MB 00:00 2026-02-13T03:56:55.511 INFO:teuthology.orchestra.run.trial092.stdout:(121/173): libarrow-doc-9.0.0-15.el9.noarch.rpm 169 kB/s | 25 kB 00:00 2026-02-13T03:56:55.518 INFO:teuthology.orchestra.run.trial158.stdout:(91/173): python3-colorama-0.4.6-3.el9.noarch.r 5.9 MB/s | 61 kB 00:00 2026-02-13T03:56:55.526 INFO:teuthology.orchestra.run.trial158.stdout:(92/173): python3-babel-2.9.1-2.el9.noarch.rpm 170 MB/s | 6.0 MB 00:00 2026-02-13T03:56:55.529 INFO:teuthology.orchestra.run.trial158.stdout:(93/173): python3-devel-3.9.25-2.el9.x86_64.rpm 22 MB/s | 244 kB 00:00 2026-02-13T03:56:55.537 INFO:teuthology.orchestra.run.trial158.stdout:(94/173): python3-jinja2-2.11.3-8.el9.noarch.rp 23 MB/s | 249 kB 00:00 2026-02-13T03:56:55.539 INFO:teuthology.orchestra.run.trial158.stdout:(95/173): python3-jmespath-1.0.1-1.el9.noarch.r 4.8 MB/s | 48 kB 00:00 2026-02-13T03:56:55.548 INFO:teuthology.orchestra.run.trial158.stdout:(96/173): python3-libstoragemgmt-1.10.1-1.el9.x 17 MB/s | 177 kB 00:00 2026-02-13T03:56:55.548 INFO:teuthology.orchestra.run.trial158.stdout:(97/173): python3-markupsafe-1.1.1-12.el9.x86_6 3.6 MB/s | 35 kB 00:00 2026-02-13T03:56:55.560 INFO:teuthology.orchestra.run.trial158.stdout:(98/173): python3-numpy-f2py-1.23.5-2.el9.x86_6 38 MB/s | 442 kB 00:00 2026-02-13T03:56:55.572 INFO:teuthology.orchestra.run.trial158.stdout:(99/173): python3-packaging-20.9-5.el9.noarch.r 6.2 MB/s | 77 kB 00:00 2026-02-13T03:56:55.581 INFO:teuthology.orchestra.run.trial158.stdout:(100/173): python3-numpy-1.23.5-2.el9.x86_64.rp 186 MB/s | 6.1 MB 00:00 2026-02-13T03:56:55.583 INFO:teuthology.orchestra.run.trial158.stdout:(101/173): python3-protobuf-3.14.0-17.el9.noarc 24 MB/s | 267 kB 00:00 2026-02-13T03:56:55.591 INFO:teuthology.orchestra.run.trial158.stdout:(102/173): python3-pyasn1-0.4.8-6.el9.noarch.rp 15 MB/s | 159 kB 00:00 2026-02-13T03:56:55.595 INFO:teuthology.orchestra.run.trial158.stdout:(103/173): python3-pyasn1-modules-0.4.8-6.el9.n 23 MB/s | 279 kB 00:00 2026-02-13T03:56:55.601 INFO:teuthology.orchestra.run.trial158.stdout:(104/173): python3-requests-oauthlib-1.3.0-12.e 5.8 MB/s | 54 kB 00:00 2026-02-13T03:56:55.610 INFO:teuthology.orchestra.run.trial158.stdout:(105/173): python3-toml-0.10.2-6.el9.noarch.rpm 4.6 MB/s | 42 kB 00:00 2026-02-13T03:56:55.618 INFO:teuthology.orchestra.run.trial158.stdout:(106/173): python3-wcwidth-0.2.5-8.el9.noarch.r 4.9 MB/s | 44 kB 00:00 2026-02-13T03:56:55.627 INFO:teuthology.orchestra.run.trial158.stdout:(107/173): qatlib-25.08.0-2.el9.x86_64.rpm 28 MB/s | 240 kB 00:00 2026-02-13T03:56:55.635 INFO:teuthology.orchestra.run.trial158.stdout:(108/173): qatlib-service-25.08.0-2.el9.x86_64. 4.4 MB/s | 37 kB 00:00 2026-02-13T03:56:55.643 INFO:teuthology.orchestra.run.trial099.stdout:(47/173): libquadmath-11.5.0-14.el9.x86_64.rpm 253 kB/s | 184 kB 00:00 2026-02-13T03:56:55.644 INFO:teuthology.orchestra.run.trial158.stdout:(109/173): qatzip-libs-1.3.1-1.el9.x86_64.rpm 7.4 MB/s | 66 kB 00:00 2026-02-13T03:56:55.649 INFO:teuthology.orchestra.run.trial092.stdout:(122/173): liboath-2.6.12-1.el9.x86_64.rpm 356 kB/s | 49 kB 00:00 2026-02-13T03:56:55.655 INFO:teuthology.orchestra.run.trial158.stdout:(110/173): socat-1.7.4.1-8.el9.x86_64.rpm 28 MB/s | 303 kB 00:00 2026-02-13T03:56:55.685 INFO:teuthology.orchestra.run.trial158.stdout:(111/173): python3-scipy-1.9.3-2.el9.x86_64.rpm 215 MB/s | 19 MB 00:00 2026-02-13T03:56:55.685 INFO:teuthology.orchestra.run.trial158.stdout:(112/173): uuid-1.6.2-55.el9.x86_64.rpm 1.9 MB/s | 58 kB 00:00 2026-02-13T03:56:55.694 INFO:teuthology.orchestra.run.trial158.stdout:(113/173): xmlstarlet-1.6.1-20.el9.x86_64.rpm 7.3 MB/s | 64 kB 00:00 2026-02-13T03:56:55.695 INFO:teuthology.orchestra.run.trial158.stdout:(114/173): xfsprogs-devel-6.4.0-7.el9.x86_64.rp 9.2 MB/s | 96 kB 00:00 2026-02-13T03:56:55.702 INFO:teuthology.orchestra.run.trial158.stdout:(115/173): zlib-devel-1.2.11-41.el9.x86_64.rpm 5.5 MB/s | 45 kB 00:00 2026-02-13T03:56:55.703 INFO:teuthology.orchestra.run.trial158.stdout:(116/173): lua-devel-5.4.4-4.el9.x86_64.rpm 2.6 MB/s | 22 kB 00:00 2026-02-13T03:56:55.719 INFO:teuthology.orchestra.run.trial099.stdout:(48/173): libgfortran-11.5.0-14.el9.x86_64.rpm 888 kB/s | 794 kB 00:00 2026-02-13T03:56:55.733 INFO:teuthology.orchestra.run.trial158.stdout:(117/173): protobuf-compiler-3.14.0-17.el9.x86_ 27 MB/s | 862 kB 00:00 2026-02-13T03:56:55.781 INFO:teuthology.orchestra.run.trial092.stdout:(123/173): libunwind-1.6.2-1.el9.x86_64.rpm 511 kB/s | 67 kB 00:00 2026-02-13T03:56:55.923 INFO:teuthology.orchestra.run.trial092.stdout:(124/173): libarrow-9.0.0-15.el9.x86_64.rpm 7.4 MB/s | 4.4 MB 00:00 2026-02-13T03:56:55.964 INFO:teuthology.orchestra.run.trial099.stdout:(49/173): ceph-test-20.3.0-5241.g8f8d3829.el9.x 7.5 MB/s | 78 MB 00:10 2026-02-13T03:56:56.046 INFO:teuthology.orchestra.run.trial092.stdout:(125/173): luarocks-3.9.2-5.el9.noarch.rpm 572 kB/s | 151 kB 00:00 2026-02-13T03:56:56.055 INFO:teuthology.orchestra.run.trial092.stdout:(126/173): parquet-libs-9.0.0-15.el9.x86_64.rpm 6.2 MB/s | 838 kB 00:00 2026-02-13T03:56:56.143 INFO:teuthology.orchestra.run.trial092.stdout:(127/173): python3-autocommand-2.2.2-8.el9.noar 338 kB/s | 29 kB 00:00 2026-02-13T03:56:56.186 INFO:teuthology.orchestra.run.trial158.stdout:(118/173): gperftools-libs-2.9.1-3.el9.x86_64.r 679 kB/s | 308 kB 00:00 2026-02-13T03:56:56.220 INFO:teuthology.orchestra.run.trial158.stdout:(119/173): abseil-cpp-20211102.0-4.el9.x86_64.r 1.0 MB/s | 551 kB 00:00 2026-02-13T03:56:56.249 INFO:teuthology.orchestra.run.trial158.stdout:(120/173): grpc-data-1.46.7-10.el9.noarch.rpm 309 kB/s | 19 kB 00:00 2026-02-13T03:56:56.313 INFO:teuthology.orchestra.run.trial158.stdout:(121/173): libarrow-doc-9.0.0-15.el9.noarch.rpm 389 kB/s | 25 kB 00:00 2026-02-13T03:56:56.373 INFO:teuthology.orchestra.run.trial099.stdout:(50/173): mailcap-2.1.49-5.el9.noarch.rpm 51 kB/s | 33 kB 00:00 2026-02-13T03:56:56.380 INFO:teuthology.orchestra.run.trial158.stdout:(122/173): liboath-2.6.12-1.el9.x86_64.rpm 731 kB/s | 49 kB 00:00 2026-02-13T03:56:56.418 INFO:teuthology.orchestra.run.trial099.stdout:(51/173): lksctp-tools-1.0.19-2.el9.x86_64.rpm 121 kB/s | 94 kB 00:00 2026-02-13T03:56:56.449 INFO:teuthology.orchestra.run.trial158.stdout:(123/173): libunwind-1.6.2-1.el9.x86_64.rpm 973 kB/s | 67 kB 00:00 2026-02-13T03:56:56.495 INFO:teuthology.orchestra.run.trial158.stdout:(124/173): libarrow-9.0.0-15.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2026-02-13T03:56:56.531 INFO:teuthology.orchestra.run.trial158.stdout:(125/173): luarocks-3.9.2-5.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2026-02-13T03:56:56.556 INFO:teuthology.orchestra.run.trial092.stdout:(128/173): ceph-test-20.3.0-5241.g8f8d3829.el9. 6.6 MB/s | 78 MB 00:11 2026-02-13T03:56:56.557 INFO:teuthology.orchestra.run.trial092.stdout:(129/173): python3-backports-tarfile-1.2.0-1.el 145 kB/s | 60 kB 00:00 2026-02-13T03:56:56.564 INFO:teuthology.orchestra.run.trial158.stdout:(126/173): parquet-libs-9.0.0-15.el9.x86_64.rpm 12 MB/s | 838 kB 00:00 2026-02-13T03:56:56.619 INFO:teuthology.orchestra.run.trial092.stdout:(130/173): python3-asyncssh-2.13.2-5.el9.noarch 957 kB/s | 548 kB 00:00 2026-02-13T03:56:56.624 INFO:teuthology.orchestra.run.trial099.stdout:(52/173): pciutils-3.7.0-7.el9.x86_64.rpm 142 kB/s | 93 kB 00:00 2026-02-13T03:56:56.625 INFO:teuthology.orchestra.run.trial158.stdout:(127/173): python3-autocommand-2.2.2-8.el9.noar 483 kB/s | 29 kB 00:00 2026-02-13T03:56:56.669 INFO:teuthology.orchestra.run.trial158.stdout:(128/173): python3-asyncssh-2.13.2-5.el9.noarch 3.9 MB/s | 548 kB 00:00 2026-02-13T03:56:56.669 INFO:teuthology.orchestra.run.trial092.stdout:(131/173): python3-cachetools-4.2.4-1.el9.noarc 288 kB/s | 32 kB 00:00 2026-02-13T03:56:56.687 INFO:teuthology.orchestra.run.trial158.stdout:(129/173): python3-backports-tarfile-1.2.0-1.el 983 kB/s | 60 kB 00:00 2026-02-13T03:56:56.711 INFO:teuthology.orchestra.run.trial092.stdout:(132/173): python3-certifi-2023.05.07-4.el9.noa 152 kB/s | 14 kB 00:00 2026-02-13T03:56:56.731 INFO:teuthology.orchestra.run.trial158.stdout:(130/173): python3-bcrypt-3.2.2-1.el9.x86_64.rp 697 kB/s | 43 kB 00:00 2026-02-13T03:56:56.748 INFO:teuthology.orchestra.run.trial158.stdout:(131/173): python3-cachetools-4.2.4-1.el9.noarc 526 kB/s | 32 kB 00:00 2026-02-13T03:56:56.773 INFO:teuthology.orchestra.run.trial092.stdout:(133/173): python3-bcrypt-3.2.2-1.el9.x86_64.rp 200 kB/s | 43 kB 00:00 2026-02-13T03:56:56.792 INFO:teuthology.orchestra.run.trial158.stdout:(132/173): python3-certifi-2023.05.07-4.el9.noa 231 kB/s | 14 kB 00:00 2026-02-13T03:56:56.810 INFO:teuthology.orchestra.run.trial158.stdout:(133/173): python3-cheroot-10.0.1-4.el9.noarch. 2.7 MB/s | 173 kB 00:00 2026-02-13T03:56:56.870 INFO:teuthology.orchestra.run.trial158.stdout:(134/173): python3-cherrypy-18.6.1-2.el9.noarch 4.5 MB/s | 358 kB 00:00 2026-02-13T03:56:56.876 INFO:teuthology.orchestra.run.trial158.stdout:(135/173): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.5 MB/s | 303 kB 00:00 2026-02-13T03:56:56.910 INFO:teuthology.orchestra.run.trial092.stdout:(134/173): python3-cherrypy-18.6.1-2.el9.noarch 1.8 MB/s | 358 kB 00:00 2026-02-13T03:56:56.943 INFO:teuthology.orchestra.run.trial158.stdout:(136/173): python3-google-auth-2.45.0-1.el9.noa 3.4 MB/s | 254 kB 00:00 2026-02-13T03:56:56.957 INFO:teuthology.orchestra.run.trial158.stdout:(137/173): python3-grpcio-1.46.7-10.el9.x86_64. 25 MB/s | 2.0 MB 00:00 2026-02-13T03:56:57.011 INFO:teuthology.orchestra.run.trial158.stdout:(138/173): python3-grpcio-tools-1.46.7-10.el9.x 2.1 MB/s | 144 kB 00:00 2026-02-13T03:56:57.018 INFO:teuthology.orchestra.run.trial158.stdout:(139/173): python3-jaraco-8.2.1-3.el9.noarch.rp 175 kB/s | 11 kB 00:00 2026-02-13T03:56:57.042 INFO:teuthology.orchestra.run.trial092.stdout:(135/173): python3-cheroot-10.0.1-4.el9.noarch. 465 kB/s | 173 kB 00:00 2026-02-13T03:56:57.072 INFO:teuthology.orchestra.run.trial158.stdout:(140/173): python3-jaraco-classes-3.2.1-5.el9.n 288 kB/s | 18 kB 00:00 2026-02-13T03:56:57.079 INFO:teuthology.orchestra.run.trial158.stdout:(141/173): python3-jaraco-collections-3.0.0-8.e 379 kB/s | 23 kB 00:00 2026-02-13T03:56:57.134 INFO:teuthology.orchestra.run.trial158.stdout:(142/173): python3-jaraco-context-6.0.1-3.el9.n 320 kB/s | 20 kB 00:00 2026-02-13T03:56:57.138 INFO:teuthology.orchestra.run.trial099.stdout:(53/173): python3-cffi-1.14.5-5.el9.x86_64.rpm 331 kB/s | 253 kB 00:00 2026-02-13T03:56:57.141 INFO:teuthology.orchestra.run.trial158.stdout:(143/173): python3-jaraco-functools-3.5.0-2.el9 318 kB/s | 19 kB 00:00 2026-02-13T03:56:57.147 INFO:teuthology.orchestra.run.trial092.stdout:(136/173): python3-cmd2-2.4.2-2.el9.noarch.rpm 810 kB/s | 303 kB 00:00 2026-02-13T03:56:57.157 INFO:teuthology.orchestra.run.trial092.stdout:(137/173): python3-google-auth-2.45.0-1.el9.noa 1.0 MB/s | 254 kB 00:00 2026-02-13T03:56:57.195 INFO:teuthology.orchestra.run.trial158.stdout:(144/173): python3-jaraco-text-4.0.0-2.el9.noar 430 kB/s | 26 kB 00:00 2026-02-13T03:56:57.207 INFO:teuthology.orchestra.run.trial092.stdout:(138/173): python3-jaraco-8.2.1-3.el9.noarch.rp 215 kB/s | 11 kB 00:00 2026-02-13T03:56:57.212 INFO:teuthology.orchestra.run.trial158.stdout:(145/173): python3-kubernetes-26.1.0-3.el9.noar 14 MB/s | 1.0 MB 00:00 2026-02-13T03:56:57.260 INFO:teuthology.orchestra.run.trial158.stdout:(146/173): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2026-02-13T03:56:57.273 INFO:teuthology.orchestra.run.trial158.stdout:(147/173): python3-natsort-7.1.1-5.el9.noarch.r 944 kB/s | 58 kB 00:00 2026-02-13T03:56:57.294 INFO:teuthology.orchestra.run.trial099.stdout:(54/173): python3-ply-3.11-14.el9.noarch.rpm 159 kB/s | 106 kB 00:00 2026-02-13T03:56:57.316 INFO:teuthology.orchestra.run.trial092.stdout:(139/173): python3-jaraco-classes-3.2.1-5.el9.n 163 kB/s | 18 kB 00:00 2026-02-13T03:56:57.321 INFO:teuthology.orchestra.run.trial158.stdout:(148/173): python3-portend-3.1.0-2.el9.noarch.r 268 kB/s | 16 kB 00:00 2026-02-13T03:56:57.335 INFO:teuthology.orchestra.run.trial158.stdout:(149/173): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.4 MB/s | 90 kB 00:00 2026-02-13T03:56:57.363 INFO:teuthology.orchestra.run.trial099.stdout:(55/173): python3-cryptography-36.0.1-5.el9.x86 1.3 MB/s | 1.2 MB 00:00 2026-02-13T03:56:57.382 INFO:teuthology.orchestra.run.trial158.stdout:(150/173): python3-pyperclip-1.8.2-2.el9.noarch 460 kB/s | 28 kB 00:00 2026-02-13T03:56:57.396 INFO:teuthology.orchestra.run.trial158.stdout:(151/173): python3-repoze-lru-0.7-16.el9.noarch 504 kB/s | 31 kB 00:00 2026-02-13T03:56:57.452 INFO:teuthology.orchestra.run.trial158.stdout:(152/173): python3-routes-2.5.1-5.el9.noarch.rp 2.6 MB/s | 188 kB 00:00 2026-02-13T03:56:57.457 INFO:teuthology.orchestra.run.trial158.stdout:(153/173): python3-rsa-4.9-2.el9.noarch.rpm 965 kB/s | 59 kB 00:00 2026-02-13T03:56:57.463 INFO:teuthology.orchestra.run.trial092.stdout:(140/173): python3-jaraco-collections-3.0.0-8.e 157 kB/s | 23 kB 00:00 2026-02-13T03:56:57.478 INFO:teuthology.orchestra.run.trial092.stdout:(141/173): python3-grpcio-tools-1.46.7-10.el9.x 437 kB/s | 144 kB 00:00 2026-02-13T03:56:57.514 INFO:teuthology.orchestra.run.trial158.stdout:(154/173): python3-tempora-5.0.0-2.el9.noarch.r 574 kB/s | 36 kB 00:00 2026-02-13T03:56:57.519 INFO:teuthology.orchestra.run.trial158.stdout:(155/173): python3-typing-extensions-4.15.0-1.e 1.4 MB/s | 86 kB 00:00 2026-02-13T03:56:57.579 INFO:teuthology.orchestra.run.trial158.stdout:(156/173): python3-websocket-client-1.2.3-2.el9 1.4 MB/s | 90 kB 00:00 2026-02-13T03:56:57.581 INFO:teuthology.orchestra.run.trial158.stdout:(157/173): python3-xmltodict-0.12.0-15.el9.noar 357 kB/s | 22 kB 00:00 2026-02-13T03:56:57.711 INFO:teuthology.orchestra.run.trial092.stdout:(142/173): python3-grpcio-1.46.7-10.el9.x86_64. 3.0 MB/s | 2.0 MB 00:00 2026-02-13T03:56:57.712 INFO:teuthology.orchestra.run.trial092.stdout:(143/173): python3-jaraco-context-6.0.1-3.el9.n 79 kB/s | 20 kB 00:00 2026-02-13T03:56:57.742 INFO:teuthology.orchestra.run.trial092.stdout:(144/173): python3-jaraco-functools-3.5.0-2.el9 74 kB/s | 19 kB 00:00 2026-02-13T03:56:57.744 INFO:teuthology.orchestra.run.trial158.stdout:(158/173): ceph-test-20.3.0-5241.g8f8d3829.el9. 11 MB/s | 78 MB 00:06 2026-02-13T03:56:57.744 INFO:teuthology.orchestra.run.trial158.stdout:(159/173): python3-zc-lockfile-2.0-10.el9.noarc 121 kB/s | 20 kB 00:00 2026-02-13T03:56:57.745 INFO:teuthology.orchestra.run.trial158.stdout:(160/173): re2-20211101-20.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2026-02-13T03:56:57.811 INFO:teuthology.orchestra.run.trial158.stdout:(161/173): yaml-cpp-0.6.3-5.el9.x86_64.rpm 1.8 MB/s | 122 kB 00:00 2026-02-13T03:56:57.843 INFO:teuthology.orchestra.run.trial099.stdout:(56/173): python3-pycparser-2.20-6.el9.noarch.r 192 kB/s | 135 kB 00:00 2026-02-13T03:56:57.882 INFO:teuthology.orchestra.run.trial092.stdout:(145/173): python3-more-itertools-8.12.0-2.el9. 565 kB/s | 79 kB 00:00 2026-02-13T03:56:57.893 INFO:teuthology.orchestra.run.trial092.stdout:(146/173): python3-jaraco-text-4.0.0-2.el9.noar 145 kB/s | 26 kB 00:00 2026-02-13T03:56:57.901 INFO:teuthology.orchestra.run.trial158.stdout:(162/173): librbd1-20.3.0-5241.g8f8d3829.el9.x8 31 MB/s | 2.8 MB 00:00 2026-02-13T03:56:57.955 INFO:teuthology.orchestra.run.trial158.stdout:(163/173): librados2-20.3.0-5241.g8f8d3829.el9. 17 MB/s | 3.5 MB 00:00 2026-02-13T03:56:57.968 INFO:teuthology.orchestra.run.trial158.stdout:(164/173): NetworkManager-1.54.3-2.el9.x86_64.r 36 MB/s | 2.4 MB 00:00 2026-02-13T03:56:57.976 INFO:teuthology.orchestra.run.trial158.stdout:(165/173): NetworkManager-team-1.54.3-2.el9.x86 4.3 MB/s | 37 kB 00:00 2026-02-13T03:56:57.986 INFO:teuthology.orchestra.run.trial158.stdout:(166/173): NetworkManager-tui-1.54.3-2.el9.x86_ 25 MB/s | 248 kB 00:00 2026-02-13T03:56:57.991 INFO:teuthology.orchestra.run.trial099.stdout:(57/173): python3-requests-2.25.1-10.el9.noarch 181 kB/s | 126 kB 00:00 2026-02-13T03:56:57.998 INFO:teuthology.orchestra.run.trial158.stdout:(167/173): iproute-6.17.0-2.el9.x86_64.rpm 69 MB/s | 866 kB 00:00 2026-02-13T03:56:58.009 INFO:teuthology.orchestra.run.trial158.stdout:(168/173): iproute-tc-6.17.0-2.el9.x86_64.rpm 40 MB/s | 454 kB 00:00 2026-02-13T03:56:58.019 INFO:teuthology.orchestra.run.trial158.stdout:(169/173): NetworkManager-libnm-1.54.3-2.el9.x8 30 MB/s | 1.9 MB 00:00 2026-02-13T03:56:58.024 INFO:teuthology.orchestra.run.trial158.stdout:(170/173): openssl-3.5.5-1.el9.x86_64.rpm 103 MB/s | 1.5 MB 00:00 2026-02-13T03:56:58.031 INFO:teuthology.orchestra.run.trial158.stdout:(171/173): openssl-fips-provider-3.5.5-1.el9.x8 67 MB/s | 814 kB 00:00 2026-02-13T03:56:58.032 INFO:teuthology.orchestra.run.trial092.stdout:(147/173): python3-portend-3.1.0-2.el9.noarch.r 118 kB/s | 16 kB 00:00 2026-02-13T03:56:58.040 INFO:teuthology.orchestra.run.trial158.stdout:(172/173): openssl-libs-3.5.5-1.el9.x86_64.rpm 141 MB/s | 2.3 MB 00:00 2026-02-13T03:56:58.065 INFO:teuthology.orchestra.run.trial092.stdout:(148/173): python3-natsort-7.1.1-5.el9.noarch.r 315 kB/s | 58 kB 00:00 2026-02-13T03:56:58.110 INFO:teuthology.orchestra.run.trial099.stdout:(58/173): python3-urllib3-1.26.5-7.el9.noarch.r 292 kB/s | 218 kB 00:00 2026-02-13T03:56:58.167 INFO:teuthology.orchestra.run.trial092.stdout:(149/173): python3-pyOpenSSL-21.0.0-1.el9.noarc 669 kB/s | 90 kB 00:00 2026-02-13T03:56:58.232 INFO:teuthology.orchestra.run.trial092.stdout:(150/173): python3-repoze-lru-0.7-16.el9.noarch 478 kB/s | 31 kB 00:00 2026-02-13T03:56:58.248 INFO:teuthology.orchestra.run.trial092.stdout:(151/173): python3-pyperclip-1.8.2-2.el9.noarch 154 kB/s | 28 kB 00:00 2026-02-13T03:56:58.338 INFO:teuthology.orchestra.run.trial092.stdout:(152/173): python3-kubernetes-26.1.0-3.el9.noar 1.6 MB/s | 1.0 MB 00:00 2026-02-13T03:56:58.342 INFO:teuthology.orchestra.run.trial158.stdout:(173/173): thrift-0.15.0-4.el9.x86_64.rpm 2.6 MB/s | 1.6 MB 00:00 2026-02-13T03:56:58.346 INFO:teuthology.orchestra.run.trial158.stdout:-------------------------------------------------------------------------------- 2026-02-13T03:56:58.346 INFO:teuthology.orchestra.run.trial158.stdout:Total 18 MB/s | 302 MB 00:16 2026-02-13T03:56:58.493 INFO:teuthology.orchestra.run.trial092.stdout:(153/173): python3-tempora-5.0.0-2.el9.noarch.r 230 kB/s | 36 kB 00:00 2026-02-13T03:56:58.510 INFO:teuthology.orchestra.run.trial092.stdout:(154/173): python3-rsa-4.9-2.el9.noarch.rpm 226 kB/s | 59 kB 00:00 2026-02-13T03:56:58.562 INFO:teuthology.orchestra.run.trial092.stdout:(155/173): python3-routes-2.5.1-5.el9.noarch.rp 570 kB/s | 188 kB 00:00 2026-02-13T03:56:58.570 INFO:teuthology.orchestra.run.trial092.stdout:(156/173): python3-typing-extensions-4.15.0-1.e 1.1 MB/s | 86 kB 00:00 2026-02-13T03:56:58.573 INFO:teuthology.orchestra.run.trial099.stdout:(59/173): unzip-6.0-59.el9.x86_64.rpm 249 kB/s | 182 kB 00:00 2026-02-13T03:56:58.644 INFO:teuthology.orchestra.run.trial092.stdout:(157/173): python3-websocket-client-1.2.3-2.el9 668 kB/s | 90 kB 00:00 2026-02-13T03:56:58.646 INFO:teuthology.orchestra.run.trial092.stdout:(158/173): python3-zc-lockfile-2.0-10.el9.noarc 262 kB/s | 20 kB 00:00 2026-02-13T03:56:58.700 INFO:teuthology.orchestra.run.trial092.stdout:(159/173): python3-xmltodict-0.12.0-15.el9.noar 161 kB/s | 22 kB 00:00 2026-02-13T03:56:58.762 INFO:teuthology.orchestra.run.trial099.stdout:(60/173): zip-3.0-35.el9.x86_64.rpm 345 kB/s | 266 kB 00:00 2026-02-13T03:56:58.885 INFO:teuthology.orchestra.run.trial092.stdout:(160/173): re2-20211101-20.el9.x86_64.rpm 796 kB/s | 191 kB 00:00 2026-02-13T03:56:58.949 INFO:teuthology.orchestra.run.trial092.stdout:(161/173): yaml-cpp-0.6.3-5.el9.x86_64.rpm 489 kB/s | 122 kB 00:00 2026-02-13T03:56:58.977 INFO:teuthology.orchestra.run.trial099.stdout:(61/173): automake-1.16.2-8.el9.noarch.rpm 795 kB/s | 689 kB 00:00 2026-02-13T03:56:59.027 INFO:teuthology.orchestra.run.trial092.stdout:(162/173): librados2-20.3.0-5241.g8f8d3829.el9. 25 MB/s | 3.5 MB 00:00 2026-02-13T03:56:59.134 INFO:teuthology.orchestra.run.trial099.stdout:(62/173): elfutils-libelf-devel-0.194-1.el9.x86 503 kB/s | 79 kB 00:00 2026-02-13T03:56:59.147 INFO:teuthology.orchestra.run.trial158.stdout:Running transaction check 2026-02-13T03:56:59.217 INFO:teuthology.orchestra.run.trial092.stdout:(163/173): librbd1-20.3.0-5241.g8f8d3829.el9.x8 11 MB/s | 2.8 MB 00:00 2026-02-13T03:56:59.218 INFO:teuthology.orchestra.run.trial158.stdout:Transaction check succeeded. 2026-02-13T03:56:59.218 INFO:teuthology.orchestra.run.trial158.stdout:Running transaction test 2026-02-13T03:56:59.294 INFO:teuthology.orchestra.run.trial099.stdout:(63/173): flex-2.6.4-9.el9.x86_64.rpm 1.9 MB/s | 313 kB 00:00 2026-02-13T03:56:59.393 INFO:teuthology.orchestra.run.trial099.stdout:(64/173): boost-program-options-1.75.0-13.el9.x 165 kB/s | 104 kB 00:00 2026-02-13T03:56:59.437 INFO:teuthology.orchestra.run.trial092.stdout:(164/173): thrift-0.15.0-4.el9.x86_64.rpm 2.0 MB/s | 1.6 MB 00:00 2026-02-13T03:56:59.440 INFO:teuthology.orchestra.run.trial099.stdout:(65/173): bison-3.7.4-5.el9.x86_64.rpm 1.1 MB/s | 943 kB 00:00 2026-02-13T03:56:59.451 INFO:teuthology.orchestra.run.trial099.stdout:(66/173): flexiblas-3.0.4-8.el9.x86_64.rpm 207 kB/s | 33 kB 00:00 2026-02-13T03:56:59.677 INFO:teuthology.orchestra.run.trial099.stdout:(67/173): flexiblas-openblas-openmp-3.0.4-8.el9 77 kB/s | 18 kB 00:00 2026-02-13T03:56:59.714 INFO:teuthology.orchestra.run.trial099.stdout:(68/173): flexiblas-netlib-3.0.4-8.el9.x86_64.r 9.3 MB/s | 3.0 MB 00:00 2026-02-13T03:56:59.716 INFO:teuthology.orchestra.run.trial099.stdout:(69/173): libaio-devel-0.3.111-13.el9.x86_64.rp 42 kB/s | 11 kB 00:00 2026-02-13T03:56:59.835 INFO:teuthology.orchestra.run.trial099.stdout:(70/173): libnbd-1.20.3-4.el9.x86_64.rpm 1.0 MB/s | 164 kB 00:00 2026-02-13T03:56:59.872 INFO:teuthology.orchestra.run.trial099.stdout:(71/173): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.0 MB/s | 160 kB 00:00 2026-02-13T03:56:59.874 INFO:teuthology.orchestra.run.trial099.stdout:(72/173): librabbitmq-0.11.0-7.el9.x86_64.rpm 286 kB/s | 45 kB 00:00 2026-02-13T03:56:59.919 INFO:teuthology.orchestra.run.trial092.stdout:(165/173): NetworkManager-team-1.54.3-2.el9.x86 77 kB/s | 37 kB 00:00 2026-02-13T03:56:59.996 INFO:teuthology.orchestra.run.trial099.stdout:(73/173): librdkafka-1.6.1-102.el9.x86_64.rpm 4.0 MB/s | 662 kB 00:00 2026-02-13T03:57:00.033 INFO:teuthology.orchestra.run.trial099.stdout:(74/173): libstoragemgmt-1.10.1-1.el9.x86_64.rp 1.5 MB/s | 246 kB 00:00 2026-02-13T03:57:00.172 INFO:teuthology.orchestra.run.trial092.stdout:(166/173): NetworkManager-libnm-1.54.3-2.el9.x8 2.0 MB/s | 1.9 MB 00:00 2026-02-13T03:57:00.178 INFO:teuthology.orchestra.run.trial099.stdout:(75/173): libuuid-devel-2.37.4-21.el9.x86_64.rp 135 kB/s | 25 kB 00:00 2026-02-13T03:57:00.190 INFO:teuthology.orchestra.run.trial099.stdout:(76/173): libtool-2.4.6-46.el9.x86_64.rpm 1.8 MB/s | 581 kB 00:00 2026-02-13T03:57:00.192 INFO:teuthology.orchestra.run.trial099.stdout:(77/173): libxslt-1.1.34-12.el9.x86_64.rpm 1.4 MB/s | 233 kB 00:00 2026-02-13T03:57:00.217 INFO:teuthology.orchestra.run.trial092.stdout:(167/173): NetworkManager-1.54.3-2.el9.x86_64.r 2.0 MB/s | 2.4 MB 00:01 2026-02-13T03:57:00.304 INFO:teuthology.orchestra.run.trial158.stdout:Transaction test succeeded. 2026-02-13T03:57:00.304 INFO:teuthology.orchestra.run.trial158.stdout:Running transaction 2026-02-13T03:57:00.314 INFO:teuthology.orchestra.run.trial092.stdout:(168/173): NetworkManager-tui-1.54.3-2.el9.x86_ 627 kB/s | 248 kB 00:00 2026-02-13T03:57:00.336 INFO:teuthology.orchestra.run.trial099.stdout:(78/173): libzstd-devel-1.5.5-1.el9.x86_64.rpm 322 kB/s | 51 kB 00:00 2026-02-13T03:57:00.339 INFO:teuthology.orchestra.run.trial092.stdout:(169/173): iproute-6.17.0-2.el9.x86_64.rpm 5.1 MB/s | 866 kB 00:00 2026-02-13T03:57:00.350 INFO:teuthology.orchestra.run.trial099.stdout:(79/173): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.8 MB/s | 292 kB 00:00 2026-02-13T03:57:00.351 INFO:teuthology.orchestra.run.trial099.stdout:(80/173): lua-5.4.4-4.el9.x86_64.rpm 1.2 MB/s | 188 kB 00:00 2026-02-13T03:57:00.459 INFO:teuthology.orchestra.run.trial092.stdout:(170/173): iproute-tc-6.17.0-2.el9.x86_64.rpm 1.8 MB/s | 454 kB 00:00 2026-02-13T03:57:00.494 INFO:teuthology.orchestra.run.trial099.stdout:(81/173): openblas-0.3.29-1.el9.x86_64.rpm 267 kB/s | 42 kB 00:00 2026-02-13T03:57:00.557 INFO:teuthology.orchestra.run.trial092.stdout:(171/173): openssl-3.5.5-1.el9.x86_64.rpm 6.1 MB/s | 1.5 MB 00:00 2026-02-13T03:57:00.583 INFO:teuthology.orchestra.run.trial092.stdout:(172/173): openssl-fips-provider-3.5.5-1.el9.x8 3.3 MB/s | 814 kB 00:00 2026-02-13T03:57:00.652 INFO:teuthology.orchestra.run.trial099.stdout:(82/173): perl-Thread-Queue-3.14-460.el9.noarch 141 kB/s | 22 kB 00:00 2026-02-13T03:57:00.679 INFO:teuthology.orchestra.run.trial099.stdout:(83/173): openblas-openmp-0.3.29-1.el9.x86_64.r 16 MB/s | 5.3 MB 00:00 2026-02-13T03:57:00.749 INFO:teuthology.orchestra.run.trial099.stdout:(84/173): openssl-devel-3.5.5-1.el9.x86_64.rpm 12 MB/s | 4.8 MB 00:00 2026-02-13T03:57:00.810 INFO:teuthology.orchestra.run.trial099.stdout:(85/173): perl-threads-2.25-460.el9.x86_64.rpm 370 kB/s | 58 kB 00:00 2026-02-13T03:57:00.837 INFO:teuthology.orchestra.run.trial099.stdout:(86/173): perl-threads-shared-1.61-460.el9.x86_ 283 kB/s | 45 kB 00:00 2026-02-13T03:57:00.915 INFO:teuthology.orchestra.run.trial099.stdout:(87/173): postgresql-13.23-1.el9.x86_64.rpm 9.8 MB/s | 1.6 MB 00:00 2026-02-13T03:57:00.941 INFO:teuthology.orchestra.run.trial092.stdout:(173/173): openssl-libs-3.5.5-1.el9.x86_64.rpm 4.8 MB/s | 2.3 MB 00:00 2026-02-13T03:57:00.944 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-13T03:57:00.945 INFO:teuthology.orchestra.run.trial092.stdout:Total 14 MB/s | 302 MB 00:21 2026-02-13T03:57:01.002 INFO:teuthology.orchestra.run.trial099.stdout:(88/173): postgresql-private-libs-13.23-1.el9.x 836 kB/s | 138 kB 00:00 2026-02-13T03:57:01.035 INFO:teuthology.orchestra.run.trial099.stdout:(89/173): postgresql-contrib-13.23-1.el9.x86_64 3.9 MB/s | 903 kB 00:00 2026-02-13T03:57:01.165 INFO:teuthology.orchestra.run.trial099.stdout:(90/173): protobuf-3.14.0-17.el9.x86_64.rpm 6.2 MB/s | 1.0 MB 00:00 2026-02-13T03:57:01.286 INFO:teuthology.orchestra.run.trial099.stdout:(91/173): python3-babel-2.9.1-2.el9.noarch.rpm 24 MB/s | 6.0 MB 00:00 2026-02-13T03:57:01.312 INFO:teuthology.orchestra.run.trial099.stdout:(92/173): postgresql-server-13.23-1.el9.x86_64. 15 MB/s | 5.8 MB 00:00 2026-02-13T03:57:01.347 INFO:teuthology.orchestra.run.trial099.stdout:(93/173): python3-colorama-0.4.6-3.el9.noarch.r 337 kB/s | 61 kB 00:00 2026-02-13T03:57:01.466 INFO:teuthology.orchestra.run.trial158.stdout: Preparing : 1/1 2026-02-13T03:57:01.469 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/184 2026-02-13T03:57:01.472 INFO:teuthology.orchestra.run.trial099.stdout:(94/173): python3-jinja2-2.11.3-8.el9.noarch.rp 1.5 MB/s | 249 kB 00:00 2026-02-13T03:57:01.477 INFO:teuthology.orchestra.run.trial158.stdout: Installing : liboath-2.6.12-1.el9.x86_64 2/184 2026-02-13T03:57:01.480 INFO:teuthology.orchestra.run.trial099.stdout:(95/173): python3-devel-3.9.25-2.el9.x86_64.rpm 1.2 MB/s | 244 kB 00:00 2026-02-13T03:57:01.488 INFO:teuthology.orchestra.run.trial158.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/184 2026-02-13T03:57:01.492 INFO:teuthology.orchestra.run.trial158.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/184 2026-02-13T03:57:01.493 INFO:teuthology.orchestra.run.trial158.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 5/184 2026-02-13T03:57:01.498 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/184 2026-02-13T03:57:01.505 INFO:teuthology.orchestra.run.trial099.stdout:(96/173): python3-jmespath-1.0.1-1.el9.noarch.r 300 kB/s | 48 kB 00:00 2026-02-13T03:57:01.538 INFO:teuthology.orchestra.run.trial158.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 7/184 2026-02-13T03:57:01.544 INFO:teuthology.orchestra.run.trial158.stdout: Upgrading : NetworkManager-libnm-1:1.54.3-2.el9.x86_64 8/184 2026-02-13T03:57:01.579 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T03:57:01.582 INFO:teuthology.orchestra.run.trial158.stdout: Upgrading : NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T03:57:01.631 INFO:teuthology.orchestra.run.trial099.stdout:(97/173): python3-libstoragemgmt-1.10.1-1.el9.x 1.1 MB/s | 177 kB 00:00 2026-02-13T03:57:01.639 INFO:teuthology.orchestra.run.trial099.stdout:(98/173): python3-markupsafe-1.1.1-12.el9.x86_6 219 kB/s | 35 kB 00:00 2026-02-13T03:57:01.684 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T03:57:01.688 INFO:teuthology.orchestra.run.trial158.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 10/184 2026-02-13T03:57:01.720 INFO:teuthology.orchestra.run.trial158.stdout: Installing : re2-1:20211101-20.el9.x86_64 11/184 2026-02-13T03:57:01.741 INFO:teuthology.orchestra.run.trial158.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 12/184 2026-02-13T03:57:01.752 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 13/184 2026-02-13T03:57:01.756 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-packaging-20.9-5.el9.noarch 14/184 2026-02-13T03:57:01.757 INFO:teuthology.orchestra.run.trial099.stdout:(99/173): python3-numpy-1.23.5-2.el9.x86_64.rpm 24 MB/s | 6.1 MB 00:00 2026-02-13T03:57:01.761 INFO:teuthology.orchestra.run.trial158.stdout: Installing : perl-threads-1:2.25-460.el9.x86_64 15/184 2026-02-13T03:57:01.766 INFO:teuthology.orchestra.run.trial158.stdout: Installing : lua-5.4.4-4.el9.x86_64 16/184 2026-02-13T03:57:01.769 INFO:teuthology.orchestra.run.trial158.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 17/184 2026-02-13T03:57:01.774 INFO:teuthology.orchestra.run.trial158.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 18/184 2026-02-13T03:57:01.792 INFO:teuthology.orchestra.run.trial099.stdout:(100/173): python3-numpy-f2py-1.23.5-2.el9.x86_ 2.7 MB/s | 442 kB 00:00 2026-02-13T03:57:01.797 INFO:teuthology.orchestra.run.trial158.stdout: Installing : unzip-6.0-59.el9.x86_64 19/184 2026-02-13T03:57:01.797 INFO:teuthology.orchestra.run.trial099.stdout:(101/173): python3-packaging-20.9-5.el9.noarch. 486 kB/s | 77 kB 00:00 2026-02-13T03:57:01.810 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/184 2026-02-13T03:57:01.815 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/184 2026-02-13T03:57:01.820 INFO:teuthology.orchestra.run.trial158.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 22/184 2026-02-13T03:57:01.826 INFO:teuthology.orchestra.run.trial158.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 23/184 2026-02-13T03:57:01.828 INFO:teuthology.orchestra.run.trial158.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 24/184 2026-02-13T03:57:01.831 INFO:teuthology.orchestra.run.trial158.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 25/184 2026-02-13T03:57:01.841 INFO:teuthology.orchestra.run.trial158.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 26/184 2026-02-13T03:57:01.875 INFO:teuthology.orchestra.run.trial158.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 27/184 2026-02-13T03:57:01.880 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9. 28/184 2026-02-13T03:57:01.882 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 29/184 2026-02-13T03:57:01.882 INFO:teuthology.orchestra.run.trial158.stdout: Installing : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 30/184 2026-02-13T03:57:01.904 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 30/184 2026-02-13T03:57:01.911 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 31/184 2026-02-13T03:57:01.917 INFO:teuthology.orchestra.run.trial099.stdout:(102/173): python3-protobuf-3.14.0-17.el9.noarc 1.6 MB/s | 267 kB 00:00 2026-02-13T03:57:01.934 INFO:teuthology.orchestra.run.trial158.stdout: Installing : zip-3.0-35.el9.x86_64 32/184 2026-02-13T03:57:01.939 INFO:teuthology.orchestra.run.trial158.stdout: Installing : luarocks-3.9.2-5.el9.noarch 33/184 2026-02-13T03:57:01.941 INFO:teuthology.orchestra.run.trial158.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 34/184 2026-02-13T03:57:01.944 INFO:teuthology.orchestra.run.trial158.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/184 2026-02-13T03:57:01.947 INFO:teuthology.orchestra.run.trial158.stdout: Installing : perl-threads-shared-1.61-460.el9.x86_64 36/184 2026-02-13T03:57:01.951 INFO:teuthology.orchestra.run.trial099.stdout:(103/173): python3-pyasn1-0.4.8-6.el9.noarch.rp 998 kB/s | 159 kB 00:00 2026-02-13T03:57:01.957 INFO:teuthology.orchestra.run.trial099.stdout:(104/173): python3-pyasn1-modules-0.4.8-6.el9.n 1.7 MB/s | 279 kB 00:00 2026-02-13T03:57:01.974 INFO:teuthology.orchestra.run.trial158.stdout: Installing : perl-Thread-Queue-3.14-460.el9.noarch 37/184 2026-02-13T03:57:02.025 INFO:teuthology.orchestra.run.trial158.stdout: Installing : automake-1.16.2-8.el9.noarch 38/184 2026-02-13T03:57:02.037 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/184 2026-02-13T03:57:02.043 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/184 2026-02-13T03:57:02.050 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 41/184 2026-02-13T03:57:02.067 INFO:teuthology.orchestra.run.trial158.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 42/184 2026-02-13T03:57:02.073 INFO:teuthology.orchestra.run.trial158.stdout: Upgrading : openssl-libs-1:3.5.5-1.el9.x86_64 43/184 2026-02-13T03:57:02.075 INFO:teuthology.orchestra.run.trial099.stdout:(105/173): python3-requests-oauthlib-1.3.0-12.e 338 kB/s | 54 kB 00:00 2026-02-13T03:57:02.116 INFO:teuthology.orchestra.run.trial099.stdout:(106/173): python3-toml-0.10.2-6.el9.noarch.rpm 262 kB/s | 42 kB 00:00 2026-02-13T03:57:02.225 INFO:teuthology.orchestra.run.trial158.stdout: Upgrading : openssl-fips-provider-1:3.5.5-1.el9.x86_64 44/184 2026-02-13T03:57:02.230 INFO:teuthology.orchestra.run.trial158.stdout: Upgrading : librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 45/184 2026-02-13T03:57:02.261 INFO:teuthology.orchestra.run.trial099.stdout:(107/173): python3-wcwidth-0.2.5-8.el9.noarch.r 238 kB/s | 44 kB 00:00 2026-02-13T03:57:02.275 INFO:teuthology.orchestra.run.trial099.stdout:(108/173): qatlib-25.08.0-2.el9.x86_64.rpm 1.5 MB/s | 240 kB 00:00 2026-02-13T03:57:02.367 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 45/184 2026-02-13T03:57:02.368 INFO:teuthology.orchestra.run.trial158.stdout: Upgrading : librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 46/184 2026-02-13T03:57:02.417 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 46/184 2026-02-13T03:57:02.418 INFO:teuthology.orchestra.run.trial158.stdout: Installing : libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 47/184 2026-02-13T03:57:02.419 INFO:teuthology.orchestra.run.trial099.stdout:(109/173): qatlib-service-25.08.0-2.el9.x86_64. 235 kB/s | 37 kB 00:00 2026-02-13T03:57:02.434 INFO:teuthology.orchestra.run.trial099.stdout:(110/173): qatzip-libs-1.3.1-1.el9.x86_64.rpm 420 kB/s | 66 kB 00:00 2026-02-13T03:57:02.447 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 47/184 2026-02-13T03:57:02.449 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 48/184 2026-02-13T03:57:02.457 INFO:teuthology.orchestra.run.trial158.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 49/184 2026-02-13T03:57:02.460 INFO:teuthology.orchestra.run.trial158.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 50/184 2026-02-13T03:57:02.467 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction check 2026-02-13T03:57:02.520 INFO:teuthology.orchestra.run.trial158.stdout: Installing : postgresql-private-libs-13.23-1.el9.x86_64 51/184 2026-02-13T03:57:02.529 INFO:teuthology.orchestra.run.trial099.stdout:(111/173): python3-scipy-1.9.3-2.el9.x86_64.rpm 33 MB/s | 19 MB 00:00 2026-02-13T03:57:02.533 INFO:teuthology.orchestra.run.trial158.stdout: Installing : postgresql-13.23-1.el9.x86_64 52/184 2026-02-13T03:57:02.542 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_6 53/184 2026-02-13T03:57:02.543 INFO:teuthology.orchestra.run.trial158.stdout: Installing : libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 54/184 2026-02-13T03:57:02.563 INFO:teuthology.orchestra.run.trial092.stdout:Transaction check succeeded. 2026-02-13T03:57:02.563 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction test 2026-02-13T03:57:02.567 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 54/184 2026-02-13T03:57:02.568 INFO:teuthology.orchestra.run.trial158.stdout: Installing : libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 55/184 2026-02-13T03:57:02.578 INFO:teuthology.orchestra.run.trial099.stdout:(112/173): socat-1.7.4.1-8.el9.x86_64.rpm 1.9 MB/s | 303 kB 00:00 2026-02-13T03:57:02.594 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 55/184 2026-02-13T03:57:02.601 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 56/184 2026-02-13T03:57:02.610 INFO:teuthology.orchestra.run.trial158.stdout: Installing : librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_6 57/184 2026-02-13T03:57:02.622 INFO:teuthology.orchestra.run.trial158.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 58/184 2026-02-13T03:57:02.625 INFO:teuthology.orchestra.run.trial099.stdout:(113/173): uuid-1.6.2-55.el9.x86_64.rpm 301 kB/s | 58 kB 00:00 2026-02-13T03:57:02.678 INFO:teuthology.orchestra.run.trial158.stdout: Installing : thrift-0.15.0-4.el9.x86_64 59/184 2026-02-13T03:57:02.708 INFO:teuthology.orchestra.run.trial158.stdout: Upgrading : openssl-1:3.5.5-1.el9.x86_64 60/184 2026-02-13T03:57:02.714 INFO:teuthology.orchestra.run.trial158.stdout: Upgrading : iproute-6.17.0-2.el9.x86_64 61/184 2026-02-13T03:57:02.717 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/184 2026-02-13T03:57:02.732 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 63/184 2026-02-13T03:57:02.735 INFO:teuthology.orchestra.run.trial099.stdout:(114/173): xfsprogs-devel-6.4.0-7.el9.x86_64.rp 465 kB/s | 96 kB 00:00 2026-02-13T03:57:02.736 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 64/184 2026-02-13T03:57:02.737 INFO:teuthology.orchestra.run.trial099.stdout:(115/173): xmlstarlet-1.6.1-20.el9.x86_64.rpm 401 kB/s | 64 kB 00:00 2026-02-13T03:57:02.741 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 65/184 2026-02-13T03:57:02.753 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/184 2026-02-13T03:57:02.757 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/184 2026-02-13T03:57:02.766 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/184 2026-02-13T03:57:02.770 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/184 2026-02-13T03:57:02.778 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 70/184 2026-02-13T03:57:02.783 INFO:teuthology.orchestra.run.trial099.stdout:(116/173): zlib-devel-1.2.11-41.el9.x86_64.rpm 283 kB/s | 45 kB 00:00 2026-02-13T03:57:02.818 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 71/184 2026-02-13T03:57:03.117 INFO:teuthology.orchestra.run.trial099.stdout:(117/173): lua-devel-5.4.4-4.el9.x86_64.rpm 58 kB/s | 22 kB 00:00 2026-02-13T03:57:03.142 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 72/184 2026-02-13T03:57:03.147 INFO:teuthology.orchestra.run.trial099.stdout:(118/173): abseil-cpp-20211102.0-4.el9.x86_64.r 1.5 MB/s | 551 kB 00:00 2026-02-13T03:57:03.152 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 73/184 2026-02-13T03:57:03.156 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 74/184 2026-02-13T03:57:03.161 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 75/184 2026-02-13T03:57:03.165 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 76/184 2026-02-13T03:57:03.171 INFO:teuthology.orchestra.run.trial158.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 77/184 2026-02-13T03:57:03.173 INFO:teuthology.orchestra.run.trial158.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 78/184 2026-02-13T03:57:03.174 INFO:teuthology.orchestra.run.trial158.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 79/184 2026-02-13T03:57:03.192 INFO:teuthology.orchestra.run.trial099.stdout:(119/173): grpc-data-1.46.7-10.el9.noarch.rpm 433 kB/s | 19 kB 00:00 2026-02-13T03:57:03.202 INFO:teuthology.orchestra.run.trial099.stdout:(120/173): protobuf-compiler-3.14.0-17.el9.x86_ 1.8 MB/s | 862 kB 00:00 2026-02-13T03:57:03.203 INFO:teuthology.orchestra.run.trial158.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 80/184 2026-02-13T03:57:03.246 INFO:teuthology.orchestra.run.trial158.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 81/184 2026-02-13T03:57:03.249 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 82/184 2026-02-13T03:57:03.253 INFO:teuthology.orchestra.run.trial158.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 83/184 2026-02-13T03:57:03.259 INFO:teuthology.orchestra.run.trial158.stdout: Installing : uuid-1.6.2-55.el9.x86_64 84/184 2026-02-13T03:57:03.287 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 85/184 2026-02-13T03:57:03.293 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/184 2026-02-13T03:57:03.297 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 87/184 2026-02-13T03:57:03.303 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 88/184 2026-02-13T03:57:03.306 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 89/184 2026-02-13T03:57:03.313 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 90/184 2026-02-13T03:57:03.317 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 91/184 2026-02-13T03:57:03.344 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 92/184 2026-02-13T03:57:03.354 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 93/184 2026-02-13T03:57:03.360 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 94/184 2026-02-13T03:57:03.367 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 95/184 2026-02-13T03:57:03.379 INFO:teuthology.orchestra.run.trial099.stdout:(121/173): libarrow-9.0.0-15.el9.x86_64.rpm 24 MB/s | 4.4 MB 00:00 2026-02-13T03:57:03.380 INFO:teuthology.orchestra.run.trial099.stdout:(122/173): libarrow-doc-9.0.0-15.el9.noarch.rpm 139 kB/s | 25 kB 00:00 2026-02-13T03:57:03.401 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 96/184 2026-02-13T03:57:03.412 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 97/184 2026-02-13T03:57:03.423 INFO:teuthology.orchestra.run.trial099.stdout:(123/173): liboath-2.6.12-1.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2026-02-13T03:57:03.440 INFO:teuthology.orchestra.run.trial099.stdout:(124/173): gperftools-libs-2.9.1-3.el9.x86_64.r 951 kB/s | 308 kB 00:00 2026-02-13T03:57:03.466 INFO:teuthology.orchestra.run.trial099.stdout:(125/173): luarocks-3.9.2-5.el9.noarch.rpm 3.4 MB/s | 151 kB 00:00 2026-02-13T03:57:03.481 INFO:teuthology.orchestra.run.trial099.stdout:(126/173): libunwind-1.6.2-1.el9.x86_64.rpm 668 kB/s | 67 kB 00:00 2026-02-13T03:57:03.512 INFO:teuthology.orchestra.run.trial099.stdout:(127/173): python3-asyncssh-2.13.2-5.el9.noarch 12 MB/s | 548 kB 00:00 2026-02-13T03:57:03.531 INFO:teuthology.orchestra.run.trial099.stdout:(128/173): python3-autocommand-2.2.2-8.el9.noar 587 kB/s | 29 kB 00:00 2026-02-13T03:57:03.554 INFO:teuthology.orchestra.run.trial099.stdout:(129/173): python3-backports-tarfile-1.2.0-1.el 1.4 MB/s | 60 kB 00:00 2026-02-13T03:57:03.569 INFO:teuthology.orchestra.run.trial099.stdout:(130/173): parquet-libs-9.0.0-15.el9.x86_64.rpm 6.4 MB/s | 838 kB 00:00 2026-02-13T03:57:03.586 INFO:teuthology.orchestra.run.trial099.stdout:(131/173): python3-bcrypt-3.2.2-1.el9.x86_64.rp 795 kB/s | 43 kB 00:00 2026-02-13T03:57:03.598 INFO:teuthology.orchestra.run.trial099.stdout:(132/173): python3-cachetools-4.2.4-1.el9.noarc 739 kB/s | 32 kB 00:00 2026-02-13T03:57:03.612 INFO:teuthology.orchestra.run.trial099.stdout:(133/173): python3-certifi-2023.05.07-4.el9.noa 331 kB/s | 14 kB 00:00 2026-02-13T03:57:03.634 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 98/184 2026-02-13T03:57:03.642 INFO:teuthology.orchestra.run.trial099.stdout:(134/173): python3-cherrypy-18.6.1-2.el9.noarch 8.0 MB/s | 358 kB 00:00 2026-02-13T03:57:03.658 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 99/184 2026-02-13T03:57:03.662 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 100/184 2026-02-13T03:57:03.663 INFO:teuthology.orchestra.run.trial099.stdout:(135/173): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.8 MB/s | 303 kB 00:00 2026-02-13T03:57:03.682 INFO:teuthology.orchestra.run.trial099.stdout:(136/173): python3-cheroot-10.0.1-4.el9.noarch. 1.8 MB/s | 173 kB 00:00 2026-02-13T03:57:03.685 INFO:teuthology.orchestra.run.trial099.stdout:(137/173): python3-google-auth-2.45.0-1.el9.noa 5.8 MB/s | 254 kB 00:00 2026-02-13T03:57:03.720 INFO:teuthology.orchestra.run.trial158.stdout: Installing : openblas-0.3.29-1.el9.x86_64 101/184 2026-02-13T03:57:03.722 INFO:teuthology.orchestra.run.trial158.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 102/184 2026-02-13T03:57:03.726 INFO:teuthology.orchestra.run.trial099.stdout:(138/173): python3-jaraco-8.2.1-3.el9.noarch.rp 259 kB/s | 11 kB 00:00 2026-02-13T03:57:03.740 INFO:teuthology.orchestra.run.trial099.stdout:(139/173): python3-grpcio-tools-1.46.7-10.el9.x 2.5 MB/s | 144 kB 00:00 2026-02-13T03:57:03.743 INFO:teuthology.orchestra.run.trial158.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 103/184 2026-02-13T03:57:03.769 INFO:teuthology.orchestra.run.trial099.stdout:(140/173): python3-jaraco-classes-3.2.1-5.el9.n 414 kB/s | 18 kB 00:00 2026-02-13T03:57:03.774 INFO:teuthology.orchestra.run.trial099.stdout:(141/173): python3-grpcio-1.46.7-10.el9.x86_64. 18 MB/s | 2.0 MB 00:00 2026-02-13T03:57:03.783 INFO:teuthology.orchestra.run.trial099.stdout:(142/173): python3-jaraco-collections-3.0.0-8.e 537 kB/s | 23 kB 00:00 2026-02-13T03:57:03.811 INFO:teuthology.orchestra.run.trial099.stdout:(143/173): python3-jaraco-context-6.0.1-3.el9.n 462 kB/s | 20 kB 00:00 2026-02-13T03:57:03.818 INFO:teuthology.orchestra.run.trial099.stdout:(144/173): python3-jaraco-functools-3.5.0-2.el9 447 kB/s | 19 kB 00:00 2026-02-13T03:57:03.820 INFO:teuthology.orchestra.run.trial092.stdout:Transaction test succeeded. 2026-02-13T03:57:03.820 INFO:teuthology.orchestra.run.trial092.stdout:Running transaction 2026-02-13T03:57:03.827 INFO:teuthology.orchestra.run.trial099.stdout:(145/173): python3-jaraco-text-4.0.0-2.el9.noar 602 kB/s | 26 kB 00:00 2026-02-13T03:57:03.861 INFO:teuthology.orchestra.run.trial099.stdout:(146/173): python3-kubernetes-26.1.0-3.el9.noar 20 MB/s | 1.0 MB 00:00 2026-02-13T03:57:03.874 INFO:teuthology.orchestra.run.trial099.stdout:(147/173): python3-natsort-7.1.1-5.el9.noarch.r 1.2 MB/s | 58 kB 00:00 2026-02-13T03:57:03.904 INFO:teuthology.orchestra.run.trial099.stdout:(148/173): python3-portend-3.1.0-2.el9.noarch.r 385 kB/s | 16 kB 00:00 2026-02-13T03:57:03.913 INFO:teuthology.orchestra.run.trial099.stdout:(149/173): python3-more-itertools-8.12.0-2.el9. 827 kB/s | 79 kB 00:00 2026-02-13T03:57:03.926 INFO:teuthology.orchestra.run.trial099.stdout:(150/173): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2026-02-13T03:57:03.947 INFO:teuthology.orchestra.run.trial099.stdout:(151/173): python3-pyperclip-1.8.2-2.el9.noarch 662 kB/s | 28 kB 00:00 2026-02-13T03:57:03.982 INFO:teuthology.orchestra.run.trial099.stdout:(152/173): python3-repoze-lru-0.7-16.el9.noarch 449 kB/s | 31 kB 00:00 2026-02-13T03:57:03.989 INFO:teuthology.orchestra.run.trial099.stdout:(153/173): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2026-02-13T03:57:03.990 INFO:teuthology.orchestra.run.trial099.stdout:(154/173): python3-routes-2.5.1-5.el9.noarch.rp 2.9 MB/s | 188 kB 00:00 2026-02-13T03:57:04.026 INFO:teuthology.orchestra.run.trial099.stdout:(155/173): python3-tempora-5.0.0-2.el9.noarch.r 814 kB/s | 36 kB 00:00 2026-02-13T03:57:04.030 INFO:teuthology.orchestra.run.trial099.stdout:(156/173): python3-typing-extensions-4.15.0-1.e 2.0 MB/s | 86 kB 00:00 2026-02-13T03:57:04.041 INFO:teuthology.orchestra.run.trial099.stdout:(157/173): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2026-02-13T03:57:04.068 INFO:teuthology.orchestra.run.trial158.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 104/184 2026-02-13T03:57:04.069 INFO:teuthology.orchestra.run.trial099.stdout:(158/173): python3-xmltodict-0.12.0-15.el9.noar 517 kB/s | 22 kB 00:00 2026-02-13T03:57:04.072 INFO:teuthology.orchestra.run.trial099.stdout:(159/173): python3-zc-lockfile-2.0-10.el9.noarc 482 kB/s | 20 kB 00:00 2026-02-13T03:57:04.104 INFO:teuthology.orchestra.run.trial099.stdout:(160/173): re2-20211101-20.el9.x86_64.rpm 3.0 MB/s | 191 kB 00:00 2026-02-13T03:57:04.115 INFO:teuthology.orchestra.run.trial099.stdout:(161/173): yaml-cpp-0.6.3-5.el9.x86_64.rpm 2.7 MB/s | 122 kB 00:00 2026-02-13T03:57:04.134 INFO:teuthology.orchestra.run.trial099.stdout:(162/173): thrift-0.15.0-4.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2026-02-13T03:57:04.141 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 105/184 2026-02-13T03:57:04.280 INFO:teuthology.orchestra.run.trial099.stdout:(163/173): librados2-20.3.0-5241.g8f8d3829.el9. 20 MB/s | 3.5 MB 00:00 2026-02-13T03:57:04.287 INFO:teuthology.orchestra.run.trial099.stdout:(164/173): librbd1-20.3.0-5241.g8f8d3829.el9.x8 16 MB/s | 2.8 MB 00:00 2026-02-13T03:57:04.810 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 106/184 2026-02-13T03:57:04.825 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 107/184 2026-02-13T03:57:04.828 INFO:teuthology.orchestra.run.trial158.stdout: Installing : libzstd-devel-1.5.5-1.el9.x86_64 108/184 2026-02-13T03:57:04.830 INFO:teuthology.orchestra.run.trial158.stdout: Installing : libuuid-devel-2.37.4-21.el9.x86_64 109/184 2026-02-13T03:57:04.836 INFO:teuthology.orchestra.run.trial158.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 110/184 2026-02-13T03:57:04.857 INFO:teuthology.orchestra.run.trial099.stdout:(165/173): NetworkManager-team-1.54.3-2.el9.x86 65 kB/s | 37 kB 00:00 2026-02-13T03:57:05.122 INFO:teuthology.orchestra.run.trial158.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 111/184 2026-02-13T03:57:05.124 INFO:teuthology.orchestra.run.trial158.stdout: Installing : librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 112/184 2026-02-13T03:57:05.144 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 112/184 2026-02-13T03:57:05.145 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 113/184 2026-02-13T03:57:05.152 INFO:teuthology.orchestra.run.trial099.stdout:(166/173): NetworkManager-1.54.3-2.el9.x86_64.r 2.3 MB/s | 2.4 MB 00:01 2026-02-13T03:57:05.155 INFO:teuthology.orchestra.run.trial092.stdout: Preparing : 1/1 2026-02-13T03:57:05.160 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/184 2026-02-13T03:57:05.171 INFO:teuthology.orchestra.run.trial092.stdout: Installing : liboath-2.6.12-1.el9.x86_64 2/184 2026-02-13T03:57:05.189 INFO:teuthology.orchestra.run.trial092.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/184 2026-02-13T03:57:05.196 INFO:teuthology.orchestra.run.trial092.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/184 2026-02-13T03:57:05.200 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 5/184 2026-02-13T03:57:05.207 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/184 2026-02-13T03:57:05.268 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 7/184 2026-02-13T03:57:05.273 INFO:teuthology.orchestra.run.trial092.stdout: Upgrading : NetworkManager-libnm-1:1.54.3-2.el9.x86_64 8/184 2026-02-13T03:57:05.277 INFO:teuthology.orchestra.run.trial099.stdout:(167/173): NetworkManager-libnm-1.54.3-2.el9.x8 1.9 MB/s | 1.9 MB 00:00 2026-02-13T03:57:05.333 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T03:57:05.339 INFO:teuthology.orchestra.run.trial092.stdout: Upgrading : NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T03:57:05.496 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T03:57:05.503 INFO:teuthology.orchestra.run.trial092.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 10/184 2026-02-13T03:57:05.543 INFO:teuthology.orchestra.run.trial092.stdout: Installing : re2-1:20211101-20.el9.x86_64 11/184 2026-02-13T03:57:05.578 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 12/184 2026-02-13T03:57:05.595 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 13/184 2026-02-13T03:57:05.604 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-packaging-20.9-5.el9.noarch 14/184 2026-02-13T03:57:05.612 INFO:teuthology.orchestra.run.trial092.stdout: Installing : perl-threads-1:2.25-460.el9.x86_64 15/184 2026-02-13T03:57:05.619 INFO:teuthology.orchestra.run.trial099.stdout:(168/173): NetworkManager-tui-1.54.3-2.el9.x86_ 325 kB/s | 248 kB 00:00 2026-02-13T03:57:05.622 INFO:teuthology.orchestra.run.trial092.stdout: Installing : lua-5.4.4-4.el9.x86_64 16/184 2026-02-13T03:57:05.628 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 17/184 2026-02-13T03:57:05.635 INFO:teuthology.orchestra.run.trial092.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 18/184 2026-02-13T03:57:05.670 INFO:teuthology.orchestra.run.trial092.stdout: Installing : unzip-6.0-59.el9.x86_64 19/184 2026-02-13T03:57:05.691 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/184 2026-02-13T03:57:05.701 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/184 2026-02-13T03:57:05.706 INFO:teuthology.orchestra.run.trial092.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 22/184 2026-02-13T03:57:05.715 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 23/184 2026-02-13T03:57:05.718 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 24/184 2026-02-13T03:57:05.720 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 25/184 2026-02-13T03:57:05.735 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 26/184 2026-02-13T03:57:05.785 INFO:teuthology.orchestra.run.trial092.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 27/184 2026-02-13T03:57:05.793 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9. 28/184 2026-02-13T03:57:05.796 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 29/184 2026-02-13T03:57:05.797 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 30/184 2026-02-13T03:57:05.837 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 30/184 2026-02-13T03:57:05.849 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 31/184 2026-02-13T03:57:05.886 INFO:teuthology.orchestra.run.trial092.stdout: Installing : zip-3.0-35.el9.x86_64 32/184 2026-02-13T03:57:05.895 INFO:teuthology.orchestra.run.trial092.stdout: Installing : luarocks-3.9.2-5.el9.noarch 33/184 2026-02-13T03:57:05.899 INFO:teuthology.orchestra.run.trial092.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 34/184 2026-02-13T03:57:05.904 INFO:teuthology.orchestra.run.trial092.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/184 2026-02-13T03:57:05.909 INFO:teuthology.orchestra.run.trial092.stdout: Installing : perl-threads-shared-1.61-460.el9.x86_64 36/184 2026-02-13T03:57:05.949 INFO:teuthology.orchestra.run.trial092.stdout: Installing : perl-Thread-Queue-3.14-460.el9.noarch 37/184 2026-02-13T03:57:06.023 INFO:teuthology.orchestra.run.trial092.stdout: Installing : automake-1.16.2-8.el9.noarch 38/184 2026-02-13T03:57:06.043 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/184 2026-02-13T03:57:06.052 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/184 2026-02-13T03:57:06.057 INFO:teuthology.orchestra.run.trial099.stdout:(169/173): iproute-6.17.0-2.el9.x86_64.rpm 958 kB/s | 866 kB 00:00 2026-02-13T03:57:06.064 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 41/184 2026-02-13T03:57:06.092 INFO:teuthology.orchestra.run.trial092.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 42/184 2026-02-13T03:57:06.099 INFO:teuthology.orchestra.run.trial092.stdout: Upgrading : openssl-libs-1:3.5.5-1.el9.x86_64 43/184 2026-02-13T03:57:06.128 INFO:teuthology.orchestra.run.trial099.stdout:(170/173): iproute-tc-6.17.0-2.el9.x86_64.rpm 533 kB/s | 454 kB 00:00 2026-02-13T03:57:06.260 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T03:57:06.262 INFO:teuthology.orchestra.run.trial092.stdout: Upgrading : openssl-fips-provider-1:3.5.5-1.el9.x86_64 44/184 2026-02-13T03:57:06.262 INFO:teuthology.orchestra.run.trial158.stdout: Installing : ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T03:57:06.266 INFO:teuthology.orchestra.run.trial092.stdout: Upgrading : librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 45/184 2026-02-13T03:57:06.281 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T03:57:06.295 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/184 2026-02-13T03:57:06.311 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/184 2026-02-13T03:57:06.386 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/184 2026-02-13T03:57:06.395 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 118/184 2026-02-13T03:57:06.419 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/184 2026-02-13T03:57:06.421 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 45/184 2026-02-13T03:57:06.425 INFO:teuthology.orchestra.run.trial092.stdout: Upgrading : librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 46/184 2026-02-13T03:57:06.448 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 120/184 2026-02-13T03:57:06.488 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 46/184 2026-02-13T03:57:06.490 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 47/184 2026-02-13T03:57:06.499 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/184 2026-02-13T03:57:06.505 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/184 2026-02-13T03:57:06.508 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/184 2026-02-13T03:57:06.513 INFO:teuthology.orchestra.run.trial158.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 124/184 2026-02-13T03:57:06.515 INFO:teuthology.orchestra.run.trial158.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 125/184 2026-02-13T03:57:06.516 INFO:teuthology.orchestra.run.trial158.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 126/184 2026-02-13T03:57:06.531 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 47/184 2026-02-13T03:57:06.533 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 126/184 2026-02-13T03:57:06.535 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 48/184 2026-02-13T03:57:06.546 INFO:teuthology.orchestra.run.trial092.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 49/184 2026-02-13T03:57:06.551 INFO:teuthology.orchestra.run.trial092.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 50/184 2026-02-13T03:57:06.593 INFO:teuthology.orchestra.run.trial099.stdout:(171/173): openssl-3.5.5-1.el9.x86_64.rpm 1.5 MB/s | 1.5 MB 00:00 2026-02-13T03:57:06.640 INFO:teuthology.orchestra.run.trial092.stdout: Installing : postgresql-private-libs-13.23-1.el9.x86_64 51/184 2026-02-13T03:57:06.658 INFO:teuthology.orchestra.run.trial092.stdout: Installing : postgresql-13.23-1.el9.x86_64 52/184 2026-02-13T03:57:06.667 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_6 53/184 2026-02-13T03:57:06.669 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 54/184 2026-02-13T03:57:06.704 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 54/184 2026-02-13T03:57:06.707 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 55/184 2026-02-13T03:57:06.746 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 55/184 2026-02-13T03:57:06.756 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 56/184 2026-02-13T03:57:06.770 INFO:teuthology.orchestra.run.trial092.stdout: Installing : librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_6 57/184 2026-02-13T03:57:06.785 INFO:teuthology.orchestra.run.trial158.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 127/184 2026-02-13T03:57:06.788 INFO:teuthology.orchestra.run.trial092.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 58/184 2026-02-13T03:57:06.789 INFO:teuthology.orchestra.run.trial158.stdout: Installing : ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 128/184 2026-02-13T03:57:06.829 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 128/184 2026-02-13T03:57:06.829 INFO:teuthology.orchestra.run.trial158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-13T03:57:06.829 INFO:teuthology.orchestra.run.trial158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-13T03:57:06.829 INFO:teuthology.orchestra.run.trial158.stdout: 2026-02-13T03:57:06.833 INFO:teuthology.orchestra.run.trial158.stdout: Installing : ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 129/184 2026-02-13T03:57:06.886 INFO:teuthology.orchestra.run.trial092.stdout: Installing : thrift-0.15.0-4.el9.x86_64 59/184 2026-02-13T03:57:06.936 INFO:teuthology.orchestra.run.trial092.stdout: Upgrading : openssl-1:3.5.5-1.el9.x86_64 60/184 2026-02-13T03:57:06.948 INFO:teuthology.orchestra.run.trial092.stdout: Upgrading : iproute-6.17.0-2.el9.x86_64 61/184 2026-02-13T03:57:06.954 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/184 2026-02-13T03:57:06.957 INFO:teuthology.orchestra.run.trial099.stdout:(172/173): openssl-fips-provider-3.5.5-1.el9.x8 904 kB/s | 814 kB 00:00 2026-02-13T03:57:06.976 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 63/184 2026-02-13T03:57:06.983 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 64/184 2026-02-13T03:57:06.992 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 65/184 2026-02-13T03:57:07.009 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/184 2026-02-13T03:57:07.018 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/184 2026-02-13T03:57:07.032 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/184 2026-02-13T03:57:07.040 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/184 2026-02-13T03:57:07.052 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 70/184 2026-02-13T03:57:07.111 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 71/184 2026-02-13T03:57:07.150 INFO:teuthology.orchestra.run.trial099.stdout:(173/173): openssl-libs-3.5.5-1.el9.x86_64.rpm 2.3 MB/s | 2.3 MB 00:01 2026-02-13T03:57:07.153 INFO:teuthology.orchestra.run.trial099.stdout:-------------------------------------------------------------------------------- 2026-02-13T03:57:07.153 INFO:teuthology.orchestra.run.trial099.stdout:Total 9.9 MB/s | 302 MB 00:30 2026-02-13T03:57:07.572 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 72/184 2026-02-13T03:57:07.590 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 73/184 2026-02-13T03:57:07.597 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 74/184 2026-02-13T03:57:07.607 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 75/184 2026-02-13T03:57:07.613 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 76/184 2026-02-13T03:57:07.623 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 77/184 2026-02-13T03:57:07.627 INFO:teuthology.orchestra.run.trial092.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 78/184 2026-02-13T03:57:07.630 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 79/184 2026-02-13T03:57:07.676 INFO:teuthology.orchestra.run.trial092.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 80/184 2026-02-13T03:57:07.741 INFO:teuthology.orchestra.run.trial092.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 81/184 2026-02-13T03:57:07.749 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 82/184 2026-02-13T03:57:07.755 INFO:teuthology.orchestra.run.trial092.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 83/184 2026-02-13T03:57:07.765 INFO:teuthology.orchestra.run.trial092.stdout: Installing : uuid-1.6.2-55.el9.x86_64 84/184 2026-02-13T03:57:07.806 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 85/184 2026-02-13T03:57:07.817 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/184 2026-02-13T03:57:07.823 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 87/184 2026-02-13T03:57:07.833 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 88/184 2026-02-13T03:57:07.839 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 89/184 2026-02-13T03:57:07.850 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 90/184 2026-02-13T03:57:07.857 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 91/184 2026-02-13T03:57:07.897 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 92/184 2026-02-13T03:57:07.913 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 93/184 2026-02-13T03:57:07.924 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 94/184 2026-02-13T03:57:07.935 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 95/184 2026-02-13T03:57:07.950 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction check 2026-02-13T03:57:07.986 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 96/184 2026-02-13T03:57:08.004 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 97/184 2026-02-13T03:57:08.022 INFO:teuthology.orchestra.run.trial099.stdout:Transaction check succeeded. 2026-02-13T03:57:08.022 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction test 2026-02-13T03:57:08.305 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 98/184 2026-02-13T03:57:08.343 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 99/184 2026-02-13T03:57:08.351 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 100/184 2026-02-13T03:57:08.424 INFO:teuthology.orchestra.run.trial092.stdout: Installing : openblas-0.3.29-1.el9.x86_64 101/184 2026-02-13T03:57:08.427 INFO:teuthology.orchestra.run.trial092.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 102/184 2026-02-13T03:57:08.454 INFO:teuthology.orchestra.run.trial092.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 103/184 2026-02-13T03:57:08.914 INFO:teuthology.orchestra.run.trial092.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 104/184 2026-02-13T03:57:09.027 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 105/184 2026-02-13T03:57:09.107 INFO:teuthology.orchestra.run.trial099.stdout:Transaction test succeeded. 2026-02-13T03:57:09.107 INFO:teuthology.orchestra.run.trial099.stdout:Running transaction 2026-02-13T03:57:09.979 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 106/184 2026-02-13T03:57:10.012 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 107/184 2026-02-13T03:57:10.017 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libzstd-devel-1.5.5-1.el9.x86_64 108/184 2026-02-13T03:57:10.021 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libuuid-devel-2.37.4-21.el9.x86_64 109/184 2026-02-13T03:57:10.029 INFO:teuthology.orchestra.run.trial092.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 110/184 2026-02-13T03:57:10.271 INFO:teuthology.orchestra.run.trial099.stdout: Preparing : 1/1 2026-02-13T03:57:10.274 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/184 2026-02-13T03:57:10.282 INFO:teuthology.orchestra.run.trial099.stdout: Installing : liboath-2.6.12-1.el9.x86_64 2/184 2026-02-13T03:57:10.293 INFO:teuthology.orchestra.run.trial099.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/184 2026-02-13T03:57:10.297 INFO:teuthology.orchestra.run.trial099.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/184 2026-02-13T03:57:10.299 INFO:teuthology.orchestra.run.trial099.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 5/184 2026-02-13T03:57:10.304 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/184 2026-02-13T03:57:10.330 INFO:teuthology.orchestra.run.trial092.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 111/184 2026-02-13T03:57:10.334 INFO:teuthology.orchestra.run.trial092.stdout: Installing : librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 112/184 2026-02-13T03:57:10.345 INFO:teuthology.orchestra.run.trial099.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 7/184 2026-02-13T03:57:10.351 INFO:teuthology.orchestra.run.trial099.stdout: Upgrading : NetworkManager-libnm-1:1.54.3-2.el9.x86_64 8/184 2026-02-13T03:57:10.369 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 112/184 2026-02-13T03:57:10.371 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 113/184 2026-02-13T03:57:10.386 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T03:57:10.389 INFO:teuthology.orchestra.run.trial099.stdout: Upgrading : NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T03:57:10.495 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: NetworkManager-1:1.54.3-2.el9.x86_64 9/184 2026-02-13T03:57:10.499 INFO:teuthology.orchestra.run.trial099.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 10/184 2026-02-13T03:57:10.531 INFO:teuthology.orchestra.run.trial099.stdout: Installing : re2-1:20211101-20.el9.x86_64 11/184 2026-02-13T03:57:10.554 INFO:teuthology.orchestra.run.trial099.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 12/184 2026-02-13T03:57:10.565 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 13/184 2026-02-13T03:57:10.569 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-packaging-20.9-5.el9.noarch 14/184 2026-02-13T03:57:10.574 INFO:teuthology.orchestra.run.trial099.stdout: Installing : perl-threads-1:2.25-460.el9.x86_64 15/184 2026-02-13T03:57:10.581 INFO:teuthology.orchestra.run.trial099.stdout: Installing : lua-5.4.4-4.el9.x86_64 16/184 2026-02-13T03:57:10.584 INFO:teuthology.orchestra.run.trial099.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 17/184 2026-02-13T03:57:10.588 INFO:teuthology.orchestra.run.trial099.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 18/184 2026-02-13T03:57:10.612 INFO:teuthology.orchestra.run.trial099.stdout: Installing : unzip-6.0-59.el9.x86_64 19/184 2026-02-13T03:57:10.625 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/184 2026-02-13T03:57:10.631 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/184 2026-02-13T03:57:10.634 INFO:teuthology.orchestra.run.trial099.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 22/184 2026-02-13T03:57:10.640 INFO:teuthology.orchestra.run.trial099.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 23/184 2026-02-13T03:57:10.642 INFO:teuthology.orchestra.run.trial099.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 24/184 2026-02-13T03:57:10.643 INFO:teuthology.orchestra.run.trial099.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 25/184 2026-02-13T03:57:10.654 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 26/184 2026-02-13T03:57:10.689 INFO:teuthology.orchestra.run.trial099.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 27/184 2026-02-13T03:57:10.693 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9. 28/184 2026-02-13T03:57:10.696 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 29/184 2026-02-13T03:57:10.696 INFO:teuthology.orchestra.run.trial099.stdout: Installing : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 30/184 2026-02-13T03:57:10.720 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 30/184 2026-02-13T03:57:10.728 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 31/184 2026-02-13T03:57:10.752 INFO:teuthology.orchestra.run.trial099.stdout: Installing : zip-3.0-35.el9.x86_64 32/184 2026-02-13T03:57:10.757 INFO:teuthology.orchestra.run.trial099.stdout: Installing : luarocks-3.9.2-5.el9.noarch 33/184 2026-02-13T03:57:10.759 INFO:teuthology.orchestra.run.trial099.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 34/184 2026-02-13T03:57:10.762 INFO:teuthology.orchestra.run.trial099.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/184 2026-02-13T03:57:10.765 INFO:teuthology.orchestra.run.trial099.stdout: Installing : perl-threads-shared-1.61-460.el9.x86_64 36/184 2026-02-13T03:57:10.793 INFO:teuthology.orchestra.run.trial099.stdout: Installing : perl-Thread-Queue-3.14-460.el9.noarch 37/184 2026-02-13T03:57:10.846 INFO:teuthology.orchestra.run.trial099.stdout: Installing : automake-1.16.2-8.el9.noarch 38/184 2026-02-13T03:57:10.859 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/184 2026-02-13T03:57:10.864 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/184 2026-02-13T03:57:10.872 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 41/184 2026-02-13T03:57:10.890 INFO:teuthology.orchestra.run.trial099.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 42/184 2026-02-13T03:57:10.897 INFO:teuthology.orchestra.run.trial099.stdout: Upgrading : openssl-libs-1:3.5.5-1.el9.x86_64 43/184 2026-02-13T03:57:11.047 INFO:teuthology.orchestra.run.trial099.stdout: Upgrading : openssl-fips-provider-1:3.5.5-1.el9.x86_64 44/184 2026-02-13T03:57:11.051 INFO:teuthology.orchestra.run.trial099.stdout: Upgrading : librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 45/184 2026-02-13T03:57:11.182 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 45/184 2026-02-13T03:57:11.183 INFO:teuthology.orchestra.run.trial099.stdout: Upgrading : librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 46/184 2026-02-13T03:57:11.231 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 46/184 2026-02-13T03:57:11.232 INFO:teuthology.orchestra.run.trial099.stdout: Installing : libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 47/184 2026-02-13T03:57:11.258 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 47/184 2026-02-13T03:57:11.260 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 48/184 2026-02-13T03:57:11.268 INFO:teuthology.orchestra.run.trial099.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 49/184 2026-02-13T03:57:11.271 INFO:teuthology.orchestra.run.trial099.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 50/184 2026-02-13T03:57:11.331 INFO:teuthology.orchestra.run.trial099.stdout: Installing : postgresql-private-libs-13.23-1.el9.x86_64 51/184 2026-02-13T03:57:11.344 INFO:teuthology.orchestra.run.trial099.stdout: Installing : postgresql-13.23-1.el9.x86_64 52/184 2026-02-13T03:57:11.351 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_6 53/184 2026-02-13T03:57:11.352 INFO:teuthology.orchestra.run.trial099.stdout: Installing : libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 54/184 2026-02-13T03:57:11.372 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 54/184 2026-02-13T03:57:11.373 INFO:teuthology.orchestra.run.trial099.stdout: Installing : libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 55/184 2026-02-13T03:57:11.398 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 55/184 2026-02-13T03:57:11.406 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 56/184 2026-02-13T03:57:11.414 INFO:teuthology.orchestra.run.trial099.stdout: Installing : librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_6 57/184 2026-02-13T03:57:11.426 INFO:teuthology.orchestra.run.trial099.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 58/184 2026-02-13T03:57:11.483 INFO:teuthology.orchestra.run.trial099.stdout: Installing : thrift-0.15.0-4.el9.x86_64 59/184 2026-02-13T03:57:11.515 INFO:teuthology.orchestra.run.trial099.stdout: Upgrading : openssl-1:3.5.5-1.el9.x86_64 60/184 2026-02-13T03:57:11.521 INFO:teuthology.orchestra.run.trial099.stdout: Upgrading : iproute-6.17.0-2.el9.x86_64 61/184 2026-02-13T03:57:11.525 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 62/184 2026-02-13T03:57:11.539 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 63/184 2026-02-13T03:57:11.544 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 64/184 2026-02-13T03:57:11.545 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 129/184 2026-02-13T03:57:11.545 INFO:teuthology.orchestra.run.trial158.stdout:skipping the directory /sys 2026-02-13T03:57:11.545 INFO:teuthology.orchestra.run.trial158.stdout:skipping the directory /proc 2026-02-13T03:57:11.545 INFO:teuthology.orchestra.run.trial158.stdout:skipping the directory /mnt 2026-02-13T03:57:11.545 INFO:teuthology.orchestra.run.trial158.stdout:skipping the directory /var/tmp 2026-02-13T03:57:11.545 INFO:teuthology.orchestra.run.trial158.stdout:skipping the directory /home 2026-02-13T03:57:11.546 INFO:teuthology.orchestra.run.trial158.stdout:skipping the directory /root 2026-02-13T03:57:11.546 INFO:teuthology.orchestra.run.trial158.stdout:skipping the directory /tmp 2026-02-13T03:57:11.546 INFO:teuthology.orchestra.run.trial158.stdout: 2026-02-13T03:57:11.549 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 65/184 2026-02-13T03:57:11.560 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 66/184 2026-02-13T03:57:11.565 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 67/184 2026-02-13T03:57:11.568 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T03:57:11.574 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 68/184 2026-02-13T03:57:11.575 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T03:57:11.578 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 69/184 2026-02-13T03:57:11.586 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 70/184 2026-02-13T03:57:11.613 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T03:57:11.627 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 71/184 2026-02-13T03:57:11.633 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/184 2026-02-13T03:57:11.648 INFO:teuthology.orchestra.run.trial158.stdout: Installing : ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 130/184 2026-02-13T03:57:11.657 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/184 2026-02-13T03:57:11.672 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 130/184 2026-02-13T03:57:11.672 INFO:teuthology.orchestra.run.trial158.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:57:11.672 INFO:teuthology.orchestra.run.trial158.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-13T03:57:11.672 INFO:teuthology.orchestra.run.trial158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T03:57:11.672 INFO:teuthology.orchestra.run.trial158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T03:57:11.672 INFO:teuthology.orchestra.run.trial158.stdout: 2026-02-13T03:57:11.770 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/184 2026-02-13T03:57:11.787 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 118/184 2026-02-13T03:57:11.822 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/184 2026-02-13T03:57:11.866 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 120/184 2026-02-13T03:57:11.889 INFO:teuthology.orchestra.run.trial158.stdout: Installing : ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 131/184 2026-02-13T03:57:11.910 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 131/184 2026-02-13T03:57:11.910 INFO:teuthology.orchestra.run.trial158.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:57:11.910 INFO:teuthology.orchestra.run.trial158.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-13T03:57:11.911 INFO:teuthology.orchestra.run.trial158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T03:57:11.911 INFO:teuthology.orchestra.run.trial158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T03:57:11.911 INFO:teuthology.orchestra.run.trial158.stdout: 2026-02-13T03:57:11.916 INFO:teuthology.orchestra.run.trial158.stdout: Installing : mailcap-2.1.49-5.el9.noarch 132/184 2026-02-13T03:57:11.917 INFO:teuthology.orchestra.run.trial158.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 133/184 2026-02-13T03:57:11.935 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T03:57:11.936 INFO:teuthology.orchestra.run.trial158.stdout:Creating group 'qat' with GID 992. 2026-02-13T03:57:11.936 INFO:teuthology.orchestra.run.trial158.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-13T03:57:11.936 INFO:teuthology.orchestra.run.trial158.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-13T03:57:11.936 INFO:teuthology.orchestra.run.trial158.stdout: 2026-02-13T03:57:11.939 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/184 2026-02-13T03:57:11.944 INFO:teuthology.orchestra.run.trial158.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T03:57:11.951 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/184 2026-02-13T03:57:11.957 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 72/184 2026-02-13T03:57:11.957 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/184 2026-02-13T03:57:11.965 INFO:teuthology.orchestra.run.trial092.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 124/184 2026-02-13T03:57:11.967 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 73/184 2026-02-13T03:57:11.968 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T03:57:11.968 INFO:teuthology.orchestra.run.trial158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-13T03:57:11.968 INFO:teuthology.orchestra.run.trial158.stdout: 2026-02-13T03:57:11.969 INFO:teuthology.orchestra.run.trial092.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 125/184 2026-02-13T03:57:11.971 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 74/184 2026-02-13T03:57:11.971 INFO:teuthology.orchestra.run.trial092.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 126/184 2026-02-13T03:57:11.976 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 75/184 2026-02-13T03:57:11.980 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 76/184 2026-02-13T03:57:11.986 INFO:teuthology.orchestra.run.trial099.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 77/184 2026-02-13T03:57:11.988 INFO:teuthology.orchestra.run.trial099.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 78/184 2026-02-13T03:57:11.989 INFO:teuthology.orchestra.run.trial099.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 79/184 2026-02-13T03:57:12.003 INFO:teuthology.orchestra.run.trial158.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 135/184 2026-02-13T03:57:12.009 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 126/184 2026-02-13T03:57:12.018 INFO:teuthology.orchestra.run.trial099.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 80/184 2026-02-13T03:57:12.062 INFO:teuthology.orchestra.run.trial099.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 81/184 2026-02-13T03:57:12.065 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 82/184 2026-02-13T03:57:12.069 INFO:teuthology.orchestra.run.trial099.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 83/184 2026-02-13T03:57:12.076 INFO:teuthology.orchestra.run.trial099.stdout: Installing : uuid-1.6.2-55.el9.x86_64 84/184 2026-02-13T03:57:12.104 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 85/184 2026-02-13T03:57:12.110 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/184 2026-02-13T03:57:12.114 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 87/184 2026-02-13T03:57:12.120 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 88/184 2026-02-13T03:57:12.123 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 89/184 2026-02-13T03:57:12.130 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 90/184 2026-02-13T03:57:12.134 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 91/184 2026-02-13T03:57:12.162 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 92/184 2026-02-13T03:57:12.172 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 93/184 2026-02-13T03:57:12.178 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 94/184 2026-02-13T03:57:12.185 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 95/184 2026-02-13T03:57:12.221 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 96/184 2026-02-13T03:57:12.231 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 97/184 2026-02-13T03:57:12.291 INFO:teuthology.orchestra.run.trial092.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 127/184 2026-02-13T03:57:12.300 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 128/184 2026-02-13T03:57:12.371 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 128/184 2026-02-13T03:57:12.371 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-13T03:57:12.371 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-13T03:57:12.372 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T03:57:12.378 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 129/184 2026-02-13T03:57:12.458 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 98/184 2026-02-13T03:57:12.482 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 99/184 2026-02-13T03:57:12.486 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 100/184 2026-02-13T03:57:12.544 INFO:teuthology.orchestra.run.trial099.stdout: Installing : openblas-0.3.29-1.el9.x86_64 101/184 2026-02-13T03:57:12.546 INFO:teuthology.orchestra.run.trial099.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 102/184 2026-02-13T03:57:12.567 INFO:teuthology.orchestra.run.trial099.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 103/184 2026-02-13T03:57:12.634 INFO:teuthology.orchestra.run.trial158.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 136/184 2026-02-13T03:57:12.899 INFO:teuthology.orchestra.run.trial099.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 104/184 2026-02-13T03:57:12.973 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 105/184 2026-02-13T03:57:13.403 INFO:teuthology.orchestra.run.trial158.stdout: Installing : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 137/184 2026-02-13T03:57:13.466 INFO:teuthology.orchestra.run.trial158.stdout: Installing : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 138/184 2026-02-13T03:57:13.468 INFO:teuthology.orchestra.run.trial158.stdout: Installing : ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 139/184 2026-02-13T03:57:13.483 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 139/184 2026-02-13T03:57:13.483 INFO:teuthology.orchestra.run.trial158.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:57:13.483 INFO:teuthology.orchestra.run.trial158.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-13T03:57:13.483 INFO:teuthology.orchestra.run.trial158.stdout: 2026-02-13T03:57:13.493 INFO:teuthology.orchestra.run.trial158.stdout: Installing : ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 140/184 2026-02-13T03:57:13.517 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 140/184 2026-02-13T03:57:13.517 INFO:teuthology.orchestra.run.trial158.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:57:13.517 INFO:teuthology.orchestra.run.trial158.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-13T03:57:13.518 INFO:teuthology.orchestra.run.trial158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T03:57:13.518 INFO:teuthology.orchestra.run.trial158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T03:57:13.518 INFO:teuthology.orchestra.run.trial158.stdout: 2026-02-13T03:57:13.576 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 141/184 2026-02-13T03:57:13.578 INFO:teuthology.orchestra.run.trial158.stdout: Installing : cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 141/184 2026-02-13T03:57:13.587 INFO:teuthology.orchestra.run.trial158.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 142/184 2026-02-13T03:57:13.611 INFO:teuthology.orchestra.run.trial158.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 143/184 2026-02-13T03:57:13.612 INFO:teuthology.orchestra.run.trial158.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 144/184 2026-02-13T03:57:13.655 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 106/184 2026-02-13T03:57:13.670 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 107/184 2026-02-13T03:57:13.673 INFO:teuthology.orchestra.run.trial099.stdout: Installing : libzstd-devel-1.5.5-1.el9.x86_64 108/184 2026-02-13T03:57:13.675 INFO:teuthology.orchestra.run.trial099.stdout: Installing : libuuid-devel-2.37.4-21.el9.x86_64 109/184 2026-02-13T03:57:13.681 INFO:teuthology.orchestra.run.trial099.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 110/184 2026-02-13T03:57:13.965 INFO:teuthology.orchestra.run.trial099.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 111/184 2026-02-13T03:57:13.966 INFO:teuthology.orchestra.run.trial099.stdout: Installing : librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 112/184 2026-02-13T03:57:13.985 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 112/184 2026-02-13T03:57:13.986 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 113/184 2026-02-13T03:57:15.083 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T03:57:15.086 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T03:57:15.107 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 114/184 2026-02-13T03:57:15.122 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/184 2026-02-13T03:57:15.139 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/184 2026-02-13T03:57:15.184 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 144/184 2026-02-13T03:57:15.192 INFO:teuthology.orchestra.run.trial158.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 145/184 2026-02-13T03:57:15.216 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/184 2026-02-13T03:57:15.225 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 118/184 2026-02-13T03:57:15.249 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/184 2026-02-13T03:57:15.279 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 120/184 2026-02-13T03:57:15.330 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/184 2026-02-13T03:57:15.336 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/184 2026-02-13T03:57:15.340 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/184 2026-02-13T03:57:15.345 INFO:teuthology.orchestra.run.trial099.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 124/184 2026-02-13T03:57:15.347 INFO:teuthology.orchestra.run.trial099.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 125/184 2026-02-13T03:57:15.348 INFO:teuthology.orchestra.run.trial099.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 126/184 2026-02-13T03:57:15.366 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 126/184 2026-02-13T03:57:15.613 INFO:teuthology.orchestra.run.trial099.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 127/184 2026-02-13T03:57:15.616 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 128/184 2026-02-13T03:57:15.649 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 145/184 2026-02-13T03:57:15.650 INFO:teuthology.orchestra.run.trial158.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 146/184 2026-02-13T03:57:15.661 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 128/184 2026-02-13T03:57:15.661 INFO:teuthology.orchestra.run.trial099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-13T03:57:15.661 INFO:teuthology.orchestra.run.trial099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-13T03:57:15.661 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-13T03:57:15.665 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 129/184 2026-02-13T03:57:15.712 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 146/184 2026-02-13T03:57:15.754 INFO:teuthology.orchestra.run.trial158.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 147/184 2026-02-13T03:57:15.756 INFO:teuthology.orchestra.run.trial158.stdout: Installing : ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 148/184 2026-02-13T03:57:15.777 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 148/184 2026-02-13T03:57:15.778 INFO:teuthology.orchestra.run.trial158.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:57:15.778 INFO:teuthology.orchestra.run.trial158.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-13T03:57:15.778 INFO:teuthology.orchestra.run.trial158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T03:57:15.778 INFO:teuthology.orchestra.run.trial158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T03:57:15.778 INFO:teuthology.orchestra.run.trial158.stdout: 2026-02-13T03:57:15.789 INFO:teuthology.orchestra.run.trial158.stdout: Installing : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 149/184 2026-02-13T03:57:15.799 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 149/184 2026-02-13T03:57:16.382 INFO:teuthology.orchestra.run.trial158.stdout: Installing : ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 150/184 2026-02-13T03:57:16.383 INFO:teuthology.orchestra.run.trial158.stdout: Installing : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 151/184 2026-02-13T03:57:16.406 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 151/184 2026-02-13T03:57:16.406 INFO:teuthology.orchestra.run.trial158.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:57:16.406 INFO:teuthology.orchestra.run.trial158.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-13T03:57:16.406 INFO:teuthology.orchestra.run.trial158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T03:57:16.406 INFO:teuthology.orchestra.run.trial158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T03:57:16.406 INFO:teuthology.orchestra.run.trial158.stdout: 2026-02-13T03:57:16.415 INFO:teuthology.orchestra.run.trial158.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 152/184 2026-02-13T03:57:16.436 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 152/184 2026-02-13T03:57:16.436 INFO:teuthology.orchestra.run.trial158.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:57:16.437 INFO:teuthology.orchestra.run.trial158.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-13T03:57:16.437 INFO:teuthology.orchestra.run.trial158.stdout: 2026-02-13T03:57:16.449 INFO:teuthology.orchestra.run.trial158.stdout: Installing : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 153/184 2026-02-13T03:57:16.470 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 153/184 2026-02-13T03:57:16.470 INFO:teuthology.orchestra.run.trial158.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:57:16.470 INFO:teuthology.orchestra.run.trial158.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2026-02-13T03:57:16.471 INFO:teuthology.orchestra.run.trial158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-13T03:57:16.471 INFO:teuthology.orchestra.run.trial158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-13T03:57:16.471 INFO:teuthology.orchestra.run.trial158.stdout: 2026-02-13T03:57:16.597 INFO:teuthology.orchestra.run.trial158.stdout: Installing : rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 154/184 2026-02-13T03:57:16.618 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 154/184 2026-02-13T03:57:16.618 INFO:teuthology.orchestra.run.trial158.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:57:16.618 INFO:teuthology.orchestra.run.trial158.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-13T03:57:16.618 INFO:teuthology.orchestra.run.trial158.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T03:57:16.618 INFO:teuthology.orchestra.run.trial158.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T03:57:16.618 INFO:teuthology.orchestra.run.trial158.stdout: 2026-02-13T03:57:18.424 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 129/184 2026-02-13T03:57:18.425 INFO:teuthology.orchestra.run.trial092.stdout:skipping the directory /sys 2026-02-13T03:57:18.425 INFO:teuthology.orchestra.run.trial092.stdout:skipping the directory /proc 2026-02-13T03:57:18.425 INFO:teuthology.orchestra.run.trial092.stdout:skipping the directory /mnt 2026-02-13T03:57:18.425 INFO:teuthology.orchestra.run.trial092.stdout:skipping the directory /var/tmp 2026-02-13T03:57:18.425 INFO:teuthology.orchestra.run.trial092.stdout:skipping the directory /home 2026-02-13T03:57:18.425 INFO:teuthology.orchestra.run.trial092.stdout:skipping the directory /root 2026-02-13T03:57:18.425 INFO:teuthology.orchestra.run.trial092.stdout:skipping the directory /tmp 2026-02-13T03:57:18.425 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T03:57:18.539 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 130/184 2026-02-13T03:57:18.587 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 130/184 2026-02-13T03:57:18.587 INFO:teuthology.orchestra.run.trial092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:57:18.587 INFO:teuthology.orchestra.run.trial092.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-13T03:57:18.587 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T03:57:18.587 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T03:57:18.587 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T03:57:18.817 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 131/184 2026-02-13T03:57:18.864 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 131/184 2026-02-13T03:57:18.864 INFO:teuthology.orchestra.run.trial092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:57:18.864 INFO:teuthology.orchestra.run.trial092.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-13T03:57:18.864 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T03:57:18.864 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T03:57:18.864 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T03:57:18.874 INFO:teuthology.orchestra.run.trial092.stdout: Installing : mailcap-2.1.49-5.el9.noarch 132/184 2026-02-13T03:57:18.877 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 133/184 2026-02-13T03:57:18.914 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T03:57:18.914 INFO:teuthology.orchestra.run.trial092.stdout:Creating group 'qat' with GID 992. 2026-02-13T03:57:18.915 INFO:teuthology.orchestra.run.trial092.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-13T03:57:18.915 INFO:teuthology.orchestra.run.trial092.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-13T03:57:18.915 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T03:57:18.928 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T03:57:18.980 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T03:57:18.980 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-13T03:57:18.980 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T03:57:19.031 INFO:teuthology.orchestra.run.trial092.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 135/184 2026-02-13T03:57:19.679 INFO:teuthology.orchestra.run.trial092.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 136/184 2026-02-13T03:57:20.102 INFO:teuthology.orchestra.run.trial158.stdout: Installing : ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 155/184 2026-02-13T03:57:20.115 INFO:teuthology.orchestra.run.trial158.stdout: Installing : xfsprogs-devel-6.4.0-7.el9.x86_64 156/184 2026-02-13T03:57:20.119 INFO:teuthology.orchestra.run.trial158.stdout: Installing : elfutils-libelf-devel-0.194-1.el9.x86_64 157/184 2026-02-13T03:57:20.194 INFO:teuthology.orchestra.run.trial158.stdout: Installing : cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 158/184 2026-02-13T03:57:20.212 INFO:teuthology.orchestra.run.trial158.stdout: Installing : postgresql-contrib-13.23-1.el9.x86_64 159/184 2026-02-13T03:57:20.216 INFO:teuthology.orchestra.run.trial158.stdout: Upgrading : iproute-tc-6.17.0-2.el9.x86_64 160/184 2026-02-13T03:57:20.218 INFO:teuthology.orchestra.run.trial158.stdout: Installing : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_ 161/184 2026-02-13T03:57:20.342 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T03:57:20.346 INFO:teuthology.orchestra.run.trial158.stdout: Installing : postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T03:57:20.363 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T03:57:20.368 INFO:teuthology.orchestra.run.trial158.stdout: Installing : cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 163/184 2026-02-13T03:57:20.377 INFO:teuthology.orchestra.run.trial158.stdout: Installing : rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 164/184 2026-02-13T03:57:20.414 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 129/184 2026-02-13T03:57:20.414 INFO:teuthology.orchestra.run.trial099.stdout:skipping the directory /sys 2026-02-13T03:57:20.414 INFO:teuthology.orchestra.run.trial099.stdout:skipping the directory /proc 2026-02-13T03:57:20.414 INFO:teuthology.orchestra.run.trial099.stdout:skipping the directory /mnt 2026-02-13T03:57:20.414 INFO:teuthology.orchestra.run.trial099.stdout:skipping the directory /var/tmp 2026-02-13T03:57:20.414 INFO:teuthology.orchestra.run.trial099.stdout:skipping the directory /home 2026-02-13T03:57:20.414 INFO:teuthology.orchestra.run.trial099.stdout:skipping the directory /root 2026-02-13T03:57:20.414 INFO:teuthology.orchestra.run.trial099.stdout:skipping the directory /tmp 2026-02-13T03:57:20.415 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-13T03:57:20.420 INFO:teuthology.orchestra.run.trial158.stdout: Installing : rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 165/184 2026-02-13T03:57:20.465 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 137/184 2026-02-13T03:57:20.515 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 130/184 2026-02-13T03:57:20.538 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 130/184 2026-02-13T03:57:20.538 INFO:teuthology.orchestra.run.trial099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:57:20.539 INFO:teuthology.orchestra.run.trial099.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-13T03:57:20.539 INFO:teuthology.orchestra.run.trial099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T03:57:20.539 INFO:teuthology.orchestra.run.trial099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-13T03:57:20.539 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-13T03:57:20.555 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 138/184 2026-02-13T03:57:20.560 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 139/184 2026-02-13T03:57:20.592 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 139/184 2026-02-13T03:57:20.592 INFO:teuthology.orchestra.run.trial092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:57:20.592 INFO:teuthology.orchestra.run.trial092.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-13T03:57:20.592 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T03:57:20.606 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 140/184 2026-02-13T03:57:20.658 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 140/184 2026-02-13T03:57:20.658 INFO:teuthology.orchestra.run.trial092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:57:20.658 INFO:teuthology.orchestra.run.trial092.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-13T03:57:20.658 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T03:57:20.658 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T03:57:20.658 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T03:57:20.750 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 131/184 2026-02-13T03:57:20.772 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 131/184 2026-02-13T03:57:20.772 INFO:teuthology.orchestra.run.trial099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:57:20.772 INFO:teuthology.orchestra.run.trial099.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-13T03:57:20.772 INFO:teuthology.orchestra.run.trial099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T03:57:20.772 INFO:teuthology.orchestra.run.trial099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-13T03:57:20.772 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-13T03:57:20.778 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 141/184 2026-02-13T03:57:20.778 INFO:teuthology.orchestra.run.trial099.stdout: Installing : mailcap-2.1.49-5.el9.noarch 132/184 2026-02-13T03:57:20.780 INFO:teuthology.orchestra.run.trial099.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 133/184 2026-02-13T03:57:20.781 INFO:teuthology.orchestra.run.trial092.stdout: Installing : cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 141/184 2026-02-13T03:57:20.794 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 142/184 2026-02-13T03:57:20.798 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T03:57:20.798 INFO:teuthology.orchestra.run.trial099.stdout:Creating group 'qat' with GID 992. 2026-02-13T03:57:20.798 INFO:teuthology.orchestra.run.trial099.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-13T03:57:20.798 INFO:teuthology.orchestra.run.trial099.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-13T03:57:20.798 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-13T03:57:20.807 INFO:teuthology.orchestra.run.trial099.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T03:57:20.827 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 143/184 2026-02-13T03:57:20.830 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 144/184 2026-02-13T03:57:20.832 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 134/184 2026-02-13T03:57:20.832 INFO:teuthology.orchestra.run.trial099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-13T03:57:20.832 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-13T03:57:20.867 INFO:teuthology.orchestra.run.trial099.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 135/184 2026-02-13T03:57:20.870 INFO:teuthology.orchestra.run.trial158.stdout: Installing : ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 166/184 2026-02-13T03:57:20.895 INFO:teuthology.orchestra.run.trial158.stdout: Installing : openssl-devel-1:3.5.5-1.el9.x86_64 167/184 2026-02-13T03:57:20.897 INFO:teuthology.orchestra.run.trial158.stdout: Installing : libtool-2.4.6-46.el9.x86_64 168/184 2026-02-13T03:57:20.900 INFO:teuthology.orchestra.run.trial158.stdout: Upgrading : NetworkManager-team-1:1.54.3-2.el9.x86_64 169/184 2026-02-13T03:57:20.902 INFO:teuthology.orchestra.run.trial158.stdout: Upgrading : NetworkManager-tui-1:1.54.3-2.el9.x86_64 170/184 2026-02-13T03:57:20.911 INFO:teuthology.orchestra.run.trial158.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 171/184 2026-02-13T03:57:20.938 INFO:teuthology.orchestra.run.trial158.stdout: Installing : flex-2.6.4-9.el9.x86_64 172/184 2026-02-13T03:57:20.941 INFO:teuthology.orchestra.run.trial158.stdout: Installing : bison-3.7.4-5.el9.x86_64 173/184 2026-02-13T03:57:20.943 INFO:teuthology.orchestra.run.trial158.stdout: Cleanup : NetworkManager-tui-1:1.54.1-1.el9.x86_64 174/184 2026-02-13T03:57:20.946 INFO:teuthology.orchestra.run.trial158.stdout: Cleanup : openssl-1:3.5.1-6.el9.x86_64 175/184 2026-02-13T03:57:20.946 INFO:teuthology.orchestra.run.trial158.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 176/184 2026-02-13T03:57:20.960 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 176/184 2026-02-13T03:57:20.960 INFO:teuthology.orchestra.run.trial158.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 177/184 2026-02-13T03:57:20.973 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 177/184 2026-02-13T03:57:20.975 INFO:teuthology.orchestra.run.trial158.stdout: Cleanup : openssl-fips-provider-1:3.5.1-6.el9.x86_64 178/184 2026-02-13T03:57:20.977 INFO:teuthology.orchestra.run.trial158.stdout: Cleanup : iproute-tc-6.17.0-1.el9.x86_64 179/184 2026-02-13T03:57:20.978 INFO:teuthology.orchestra.run.trial158.stdout: Cleanup : NetworkManager-team-1:1.54.1-1.el9.x86_64 180/184 2026-02-13T03:57:20.985 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T03:57:20.985 INFO:teuthology.orchestra.run.trial158.stdout: Cleanup : NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T03:57:21.078 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T03:57:21.081 INFO:teuthology.orchestra.run.trial158.stdout: Cleanup : NetworkManager-libnm-1:1.54.1-1.el9.x86_64 182/184 2026-02-13T03:57:21.084 INFO:teuthology.orchestra.run.trial158.stdout: Cleanup : iproute-6.17.0-1.el9.x86_64 183/184 2026-02-13T03:57:21.086 INFO:teuthology.orchestra.run.trial158.stdout: Cleanup : openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T03:57:21.091 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: iproute-6.17.0-2.el9.x86_64 184/184 2026-02-13T03:57:21.098 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 184/184 2026-02-13T03:57:21.121 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 184/184 2026-02-13T03:57:21.485 INFO:teuthology.orchestra.run.trial099.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 136/184 2026-02-13T03:57:22.071 INFO:teuthology.orchestra.run.trial158.stdout: Running scriptlet: openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T03:57:22.071 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 1/184 2026-02-13T03:57:22.071 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 2/184 2026-02-13T03:57:22.071 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 3/184 2026-02-13T03:57:22.071 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 4/184 2026-02-13T03:57:22.071 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 5/184 2026-02-13T03:57:22.072 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 6/184 2026-02-13T03:57:22.072 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 7/184 2026-02-13T03:57:22.072 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 8/184 2026-02-13T03:57:22.072 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 9/184 2026-02-13T03:57:22.072 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 10/184 2026-02-13T03:57:22.072 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 11/184 2026-02-13T03:57:22.072 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 12/184 2026-02-13T03:57:22.072 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 13/184 2026-02-13T03:57:22.072 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 14/184 2026-02-13T03:57:22.072 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 15/184 2026-02-13T03:57:22.072 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 16/184 2026-02-13T03:57:22.073 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_ 17/184 2026-02-13T03:57:22.073 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 18/184 2026-02-13T03:57:22.073 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 19/184 2026-02-13T03:57:22.073 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 20/184 2026-02-13T03:57:22.073 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_6 21/184 2026-02-13T03:57:22.073 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 22/184 2026-02-13T03:57:22.073 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 23/184 2026-02-13T03:57:22.073 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 24/184 2026-02-13T03:57:22.073 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9. 25/184 2026-02-13T03:57:22.073 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_6 26/184 2026-02-13T03:57:22.073 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 27/184 2026-02-13T03:57:22.073 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 28/184 2026-02-13T03:57:22.073 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 29/184 2026-02-13T03:57:22.074 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 30/184 2026-02-13T03:57:22.074 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 31/184 2026-02-13T03:57:22.074 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 32/184 2026-02-13T03:57:22.074 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 33/184 2026-02-13T03:57:22.074 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 34/184 2026-02-13T03:57:22.074 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 35/184 2026-02-13T03:57:22.074 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 36/184 2026-02-13T03:57:22.074 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 37/184 2026-02-13T03:57:22.074 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 38/184 2026-02-13T03:57:22.074 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 39/184 2026-02-13T03:57:22.074 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 40/184 2026-02-13T03:57:22.074 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 41/184 2026-02-13T03:57:22.075 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 42/184 2026-02-13T03:57:22.075 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 43/184 2026-02-13T03:57:22.075 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 44/184 2026-02-13T03:57:22.075 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 45/184 2026-02-13T03:57:22.075 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 46/184 2026-02-13T03:57:22.075 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 47/184 2026-02-13T03:57:22.075 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 48/184 2026-02-13T03:57:22.075 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 49/184 2026-02-13T03:57:22.075 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 50/184 2026-02-13T03:57:22.075 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 51/184 2026-02-13T03:57:22.075 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 52/184 2026-02-13T03:57:22.075 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 53/184 2026-02-13T03:57:22.075 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 54/184 2026-02-13T03:57:22.076 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-ply-3.11-14.el9.noarch 55/184 2026-02-13T03:57:22.076 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 56/184 2026-02-13T03:57:22.076 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 57/184 2026-02-13T03:57:22.076 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 58/184 2026-02-13T03:57:22.076 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : unzip-6.0-59.el9.x86_64 59/184 2026-02-13T03:57:22.076 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : zip-3.0-35.el9.x86_64 60/184 2026-02-13T03:57:22.076 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : automake-1.16.2-8.el9.noarch 61/184 2026-02-13T03:57:22.076 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : bison-3.7.4-5.el9.x86_64 62/184 2026-02-13T03:57:22.076 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 63/184 2026-02-13T03:57:22.076 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : elfutils-libelf-devel-0.194-1.el9.x86_64 64/184 2026-02-13T03:57:22.076 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : flex-2.6.4-9.el9.x86_64 65/184 2026-02-13T03:57:22.076 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 66/184 2026-02-13T03:57:22.076 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 67/184 2026-02-13T03:57:22.077 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 68/184 2026-02-13T03:57:22.077 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 69/184 2026-02-13T03:57:22.077 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 70/184 2026-02-13T03:57:22.077 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 71/184 2026-02-13T03:57:22.077 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 72/184 2026-02-13T03:57:22.077 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 73/184 2026-02-13T03:57:22.077 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 74/184 2026-02-13T03:57:22.077 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 75/184 2026-02-13T03:57:22.077 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : libuuid-devel-2.37.4-21.el9.x86_64 76/184 2026-02-13T03:57:22.077 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 77/184 2026-02-13T03:57:22.077 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : libzstd-devel-1.5.5-1.el9.x86_64 78/184 2026-02-13T03:57:22.077 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 79/184 2026-02-13T03:57:22.077 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : lua-5.4.4-4.el9.x86_64 80/184 2026-02-13T03:57:22.078 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 81/184 2026-02-13T03:57:22.078 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 82/184 2026-02-13T03:57:22.078 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : openssl-devel-1:3.5.5-1.el9.x86_64 83/184 2026-02-13T03:57:22.078 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : perl-Thread-Queue-3.14-460.el9.noarch 84/184 2026-02-13T03:57:22.078 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : perl-threads-1:2.25-460.el9.x86_64 85/184 2026-02-13T03:57:22.078 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : perl-threads-shared-1.61-460.el9.x86_64 86/184 2026-02-13T03:57:22.078 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : postgresql-13.23-1.el9.x86_64 87/184 2026-02-13T03:57:22.078 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : postgresql-contrib-13.23-1.el9.x86_64 88/184 2026-02-13T03:57:22.078 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : postgresql-private-libs-13.23-1.el9.x86_64 89/184 2026-02-13T03:57:22.078 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : postgresql-server-13.23-1.el9.x86_64 90/184 2026-02-13T03:57:22.078 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 91/184 2026-02-13T03:57:22.078 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 92/184 2026-02-13T03:57:22.079 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 93/184 2026-02-13T03:57:22.079 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 94/184 2026-02-13T03:57:22.079 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 95/184 2026-02-13T03:57:22.079 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 96/184 2026-02-13T03:57:22.079 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 97/184 2026-02-13T03:57:22.079 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 98/184 2026-02-13T03:57:22.079 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 99/184 2026-02-13T03:57:22.079 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 100/184 2026-02-13T03:57:22.079 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 101/184 2026-02-13T03:57:22.079 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 102/184 2026-02-13T03:57:22.079 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 103/184 2026-02-13T03:57:22.079 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 104/184 2026-02-13T03:57:22.080 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 105/184 2026-02-13T03:57:22.080 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 106/184 2026-02-13T03:57:22.080 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 107/184 2026-02-13T03:57:22.080 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 108/184 2026-02-13T03:57:22.080 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 109/184 2026-02-13T03:57:22.080 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 110/184 2026-02-13T03:57:22.080 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 111/184 2026-02-13T03:57:22.080 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 112/184 2026-02-13T03:57:22.080 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 113/184 2026-02-13T03:57:22.080 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : xfsprogs-devel-6.4.0-7.el9.x86_64 114/184 2026-02-13T03:57:22.080 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 115/184 2026-02-13T03:57:22.080 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 116/184 2026-02-13T03:57:22.080 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 117/184 2026-02-13T03:57:22.081 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 118/184 2026-02-13T03:57:22.081 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 119/184 2026-02-13T03:57:22.081 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 120/184 2026-02-13T03:57:22.081 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 121/184 2026-02-13T03:57:22.081 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 122/184 2026-02-13T03:57:22.081 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 123/184 2026-02-13T03:57:22.081 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 124/184 2026-02-13T03:57:22.081 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 125/184 2026-02-13T03:57:22.081 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 126/184 2026-02-13T03:57:22.081 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 127/184 2026-02-13T03:57:22.081 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 128/184 2026-02-13T03:57:22.081 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 129/184 2026-02-13T03:57:22.081 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 130/184 2026-02-13T03:57:22.082 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 131/184 2026-02-13T03:57:22.082 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 132/184 2026-02-13T03:57:22.082 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 133/184 2026-02-13T03:57:22.082 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 134/184 2026-02-13T03:57:22.082 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 135/184 2026-02-13T03:57:22.082 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 136/184 2026-02-13T03:57:22.082 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 137/184 2026-02-13T03:57:22.082 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 138/184 2026-02-13T03:57:22.082 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 139/184 2026-02-13T03:57:22.082 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 140/184 2026-02-13T03:57:22.082 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 141/184 2026-02-13T03:57:22.082 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 142/184 2026-02-13T03:57:22.082 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 143/184 2026-02-13T03:57:22.083 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 144/184 2026-02-13T03:57:22.083 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 145/184 2026-02-13T03:57:22.083 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 146/184 2026-02-13T03:57:22.083 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 147/184 2026-02-13T03:57:22.083 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 148/184 2026-02-13T03:57:22.083 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 149/184 2026-02-13T03:57:22.083 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 150/184 2026-02-13T03:57:22.083 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 151/184 2026-02-13T03:57:22.083 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 152/184 2026-02-13T03:57:22.083 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 153/184 2026-02-13T03:57:22.083 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 154/184 2026-02-13T03:57:22.083 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 155/184 2026-02-13T03:57:22.083 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 156/184 2026-02-13T03:57:22.084 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 157/184 2026-02-13T03:57:22.084 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 158/184 2026-02-13T03:57:22.084 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 159/184 2026-02-13T03:57:22.084 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : re2-1:20211101-20.el9.x86_64 160/184 2026-02-13T03:57:22.084 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 161/184 2026-02-13T03:57:22.084 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 162/184 2026-02-13T03:57:22.084 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 163/184 2026-02-13T03:57:22.084 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 164/184 2026-02-13T03:57:22.084 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 165/184 2026-02-13T03:57:22.084 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 166/184 2026-02-13T03:57:22.084 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : NetworkManager-1:1.54.3-2.el9.x86_64 167/184 2026-02-13T03:57:22.084 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : NetworkManager-1:1.54.1-1.el9.x86_64 168/184 2026-02-13T03:57:22.084 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : NetworkManager-libnm-1:1.54.3-2.el9.x86_64 169/184 2026-02-13T03:57:22.085 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : NetworkManager-libnm-1:1.54.1-1.el9.x86_64 170/184 2026-02-13T03:57:22.085 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : NetworkManager-team-1:1.54.3-2.el9.x86_64 171/184 2026-02-13T03:57:22.085 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : NetworkManager-team-1:1.54.1-1.el9.x86_64 172/184 2026-02-13T03:57:22.085 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : NetworkManager-tui-1:1.54.3-2.el9.x86_64 173/184 2026-02-13T03:57:22.085 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : NetworkManager-tui-1:1.54.1-1.el9.x86_64 174/184 2026-02-13T03:57:22.085 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : iproute-6.17.0-2.el9.x86_64 175/184 2026-02-13T03:57:22.085 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : iproute-6.17.0-1.el9.x86_64 176/184 2026-02-13T03:57:22.085 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : iproute-tc-6.17.0-2.el9.x86_64 177/184 2026-02-13T03:57:22.085 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : iproute-tc-6.17.0-1.el9.x86_64 178/184 2026-02-13T03:57:22.085 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : openssl-1:3.5.5-1.el9.x86_64 179/184 2026-02-13T03:57:22.085 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : openssl-1:3.5.1-6.el9.x86_64 180/184 2026-02-13T03:57:22.085 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : openssl-fips-provider-1:3.5.5-1.el9.x86_64 181/184 2026-02-13T03:57:22.085 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : openssl-fips-provider-1:3.5.1-6.el9.x86_64 182/184 2026-02-13T03:57:22.086 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : openssl-libs-1:3.5.5-1.el9.x86_64 183/184 2026-02-13T03:57:22.139 INFO:teuthology.orchestra.run.trial158.stdout: Verifying : openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T03:57:22.140 INFO:teuthology.orchestra.run.trial158.stdout: 2026-02-13T03:57:22.140 INFO:teuthology.orchestra.run.trial158.stdout:Upgraded: 2026-02-13T03:57:22.140 INFO:teuthology.orchestra.run.trial158.stdout: NetworkManager-1:1.54.3-2.el9.x86_64 2026-02-13T03:57:22.140 INFO:teuthology.orchestra.run.trial158.stdout: NetworkManager-libnm-1:1.54.3-2.el9.x86_64 2026-02-13T03:57:22.140 INFO:teuthology.orchestra.run.trial158.stdout: NetworkManager-team-1:1.54.3-2.el9.x86_64 2026-02-13T03:57:22.140 INFO:teuthology.orchestra.run.trial158.stdout: NetworkManager-tui-1:1.54.3-2.el9.x86_64 2026-02-13T03:57:22.140 INFO:teuthology.orchestra.run.trial158.stdout: iproute-6.17.0-2.el9.x86_64 2026-02-13T03:57:22.140 INFO:teuthology.orchestra.run.trial158.stdout: iproute-tc-6.17.0-2.el9.x86_64 2026-02-13T03:57:22.140 INFO:teuthology.orchestra.run.trial158.stdout: librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:22.140 INFO:teuthology.orchestra.run.trial158.stdout: librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:22.141 INFO:teuthology.orchestra.run.trial158.stdout: openssl-1:3.5.5-1.el9.x86_64 2026-02-13T03:57:22.141 INFO:teuthology.orchestra.run.trial158.stdout: openssl-fips-provider-1:3.5.5-1.el9.x86_64 2026-02-13T03:57:22.141 INFO:teuthology.orchestra.run.trial158.stdout: openssl-libs-1:3.5.5-1.el9.x86_64 2026-02-13T03:57:22.141 INFO:teuthology.orchestra.run.trial158.stdout:Installed: 2026-02-13T03:57:22.141 INFO:teuthology.orchestra.run.trial158.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-13T03:57:22.141 INFO:teuthology.orchestra.run.trial158.stdout: automake-1.16.2-8.el9.noarch 2026-02-13T03:57:22.141 INFO:teuthology.orchestra.run.trial158.stdout: bison-3.7.4-5.el9.x86_64 2026-02-13T03:57:22.141 INFO:teuthology.orchestra.run.trial158.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-13T03:57:22.141 INFO:teuthology.orchestra.run.trial158.stdout: ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:22.141 INFO:teuthology.orchestra.run.trial158.stdout: ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:22.141 INFO:teuthology.orchestra.run.trial158.stdout: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:22.141 INFO:teuthology.orchestra.run.trial158.stdout: ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:22.141 INFO:teuthology.orchestra.run.trial158.stdout: ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:57:22.142 INFO:teuthology.orchestra.run.trial158.stdout: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:22.142 INFO:teuthology.orchestra.run.trial158.stdout: ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:22.142 INFO:teuthology.orchestra.run.trial158.stdout: ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:22.142 INFO:teuthology.orchestra.run.trial158.stdout: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:57:22.142 INFO:teuthology.orchestra.run.trial158.stdout: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:57:22.142 INFO:teuthology.orchestra.run.trial158.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:57:22.142 INFO:teuthology.orchestra.run.trial158.stdout: ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:57:22.142 INFO:teuthology.orchestra.run.trial158.stdout: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:57:22.142 INFO:teuthology.orchestra.run.trial158.stdout: ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:22.142 INFO:teuthology.orchestra.run.trial158.stdout: ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:22.142 INFO:teuthology.orchestra.run.trial158.stdout: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:22.142 INFO:teuthology.orchestra.run.trial158.stdout: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:22.143 INFO:teuthology.orchestra.run.trial158.stdout: ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:57:22.143 INFO:teuthology.orchestra.run.trial158.stdout: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:22.143 INFO:teuthology.orchestra.run.trial158.stdout: ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:22.143 INFO:teuthology.orchestra.run.trial158.stdout: ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:22.143 INFO:teuthology.orchestra.run.trial158.stdout: ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:57:22.143 INFO:teuthology.orchestra.run.trial158.stdout: cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:57:22.143 INFO:teuthology.orchestra.run.trial158.stdout: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:22.143 INFO:teuthology.orchestra.run.trial158.stdout: cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:22.143 INFO:teuthology.orchestra.run.trial158.stdout: cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:57:22.143 INFO:teuthology.orchestra.run.trial158.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-13T03:57:22.143 INFO:teuthology.orchestra.run.trial158.stdout: elfutils-libelf-devel-0.194-1.el9.x86_64 2026-02-13T03:57:22.143 INFO:teuthology.orchestra.run.trial158.stdout: flex-2.6.4-9.el9.x86_64 2026-02-13T03:57:22.144 INFO:teuthology.orchestra.run.trial158.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-13T03:57:22.144 INFO:teuthology.orchestra.run.trial158.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-13T03:57:22.144 INFO:teuthology.orchestra.run.trial158.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-13T03:57:22.144 INFO:teuthology.orchestra.run.trial158.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-13T03:57:22.144 INFO:teuthology.orchestra.run.trial158.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-13T03:57:22.144 INFO:teuthology.orchestra.run.trial158.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-13T03:57:22.144 INFO:teuthology.orchestra.run.trial158.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-13T03:57:22.144 INFO:teuthology.orchestra.run.trial158.stdout: libaio-devel-0.3.111-13.el9.x86_64 2026-02-13T03:57:22.144 INFO:teuthology.orchestra.run.trial158.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-13T03:57:22.144 INFO:teuthology.orchestra.run.trial158.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-13T03:57:22.144 INFO:teuthology.orchestra.run.trial158.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-13T03:57:22.144 INFO:teuthology.orchestra.run.trial158.stdout: libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:22.145 INFO:teuthology.orchestra.run.trial158.stdout: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:22.145 INFO:teuthology.orchestra.run.trial158.stdout: libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:22.145 INFO:teuthology.orchestra.run.trial158.stdout: libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:22.145 INFO:teuthology.orchestra.run.trial158.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-13T03:57:22.145 INFO:teuthology.orchestra.run.trial158.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-13T03:57:22.145 INFO:teuthology.orchestra.run.trial158.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-13T03:57:22.145 INFO:teuthology.orchestra.run.trial158.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-13T03:57:22.145 INFO:teuthology.orchestra.run.trial158.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-13T03:57:22.145 INFO:teuthology.orchestra.run.trial158.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-13T03:57:22.145 INFO:teuthology.orchestra.run.trial158.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-13T03:57:22.145 INFO:teuthology.orchestra.run.trial158.stdout: librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:22.145 INFO:teuthology.orchestra.run.trial158.stdout: libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:22.145 INFO:teuthology.orchestra.run.trial158.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-13T03:57:22.146 INFO:teuthology.orchestra.run.trial158.stdout: librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:22.146 INFO:teuthology.orchestra.run.trial158.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T03:57:22.146 INFO:teuthology.orchestra.run.trial158.stdout: libtool-2.4.6-46.el9.x86_64 2026-02-13T03:57:22.146 INFO:teuthology.orchestra.run.trial158.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-13T03:57:22.146 INFO:teuthology.orchestra.run.trial158.stdout: libuuid-devel-2.37.4-21.el9.x86_64 2026-02-13T03:57:22.146 INFO:teuthology.orchestra.run.trial158.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-13T03:57:22.146 INFO:teuthology.orchestra.run.trial158.stdout: libzstd-devel-1.5.5-1.el9.x86_64 2026-02-13T03:57:22.146 INFO:teuthology.orchestra.run.trial158.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-13T03:57:22.146 INFO:teuthology.orchestra.run.trial158.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-13T03:57:22.146 INFO:teuthology.orchestra.run.trial158.stdout: lua-5.4.4-4.el9.x86_64 2026-02-13T03:57:22.146 INFO:teuthology.orchestra.run.trial158.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-13T03:57:22.146 INFO:teuthology.orchestra.run.trial158.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-13T03:57:22.146 INFO:teuthology.orchestra.run.trial158.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-13T03:57:22.147 INFO:teuthology.orchestra.run.trial158.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-13T03:57:22.147 INFO:teuthology.orchestra.run.trial158.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-13T03:57:22.147 INFO:teuthology.orchestra.run.trial158.stdout: openssl-devel-1:3.5.5-1.el9.x86_64 2026-02-13T03:57:22.147 INFO:teuthology.orchestra.run.trial158.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-13T03:57:22.147 INFO:teuthology.orchestra.run.trial158.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-13T03:57:22.147 INFO:teuthology.orchestra.run.trial158.stdout: perl-Thread-Queue-3.14-460.el9.noarch 2026-02-13T03:57:22.147 INFO:teuthology.orchestra.run.trial158.stdout: perl-threads-1:2.25-460.el9.x86_64 2026-02-13T03:57:22.147 INFO:teuthology.orchestra.run.trial158.stdout: perl-threads-shared-1.61-460.el9.x86_64 2026-02-13T03:57:22.147 INFO:teuthology.orchestra.run.trial158.stdout: postgresql-13.23-1.el9.x86_64 2026-02-13T03:57:22.147 INFO:teuthology.orchestra.run.trial158.stdout: postgresql-contrib-13.23-1.el9.x86_64 2026-02-13T03:57:22.147 INFO:teuthology.orchestra.run.trial158.stdout: postgresql-private-libs-13.23-1.el9.x86_64 2026-02-13T03:57:22.147 INFO:teuthology.orchestra.run.trial158.stdout: postgresql-server-13.23-1.el9.x86_64 2026-02-13T03:57:22.148 INFO:teuthology.orchestra.run.trial158.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-13T03:57:22.148 INFO:teuthology.orchestra.run.trial158.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-13T03:57:22.148 INFO:teuthology.orchestra.run.trial158.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-13T03:57:22.148 INFO:teuthology.orchestra.run.trial158.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-13T03:57:22.148 INFO:teuthology.orchestra.run.trial158.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-13T03:57:22.148 INFO:teuthology.orchestra.run.trial158.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-13T03:57:22.148 INFO:teuthology.orchestra.run.trial158.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-13T03:57:22.148 INFO:teuthology.orchestra.run.trial158.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-13T03:57:22.148 INFO:teuthology.orchestra.run.trial158.stdout: python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:22.148 INFO:teuthology.orchestra.run.trial158.stdout: python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:22.148 INFO:teuthology.orchestra.run.trial158.stdout: python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:22.148 INFO:teuthology.orchestra.run.trial158.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-13T03:57:22.149 INFO:teuthology.orchestra.run.trial158.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-13T03:57:22.149 INFO:teuthology.orchestra.run.trial158.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-13T03:57:22.149 INFO:teuthology.orchestra.run.trial158.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-13T03:57:22.149 INFO:teuthology.orchestra.run.trial158.stdout: python3-cmd2-2.4.2-2.el9.noarch 2026-02-13T03:57:22.149 INFO:teuthology.orchestra.run.trial158.stdout: python3-colorama-0.4.6-3.el9.noarch 2026-02-13T03:57:22.149 INFO:teuthology.orchestra.run.trial158.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-13T03:57:22.149 INFO:teuthology.orchestra.run.trial158.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-13T03:57:22.149 INFO:teuthology.orchestra.run.trial158.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-13T03:57:22.149 INFO:teuthology.orchestra.run.trial158.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-13T03:57:22.149 INFO:teuthology.orchestra.run.trial158.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-13T03:57:22.149 INFO:teuthology.orchestra.run.trial158.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-13T03:57:22.149 INFO:teuthology.orchestra.run.trial158.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-13T03:57:22.149 INFO:teuthology.orchestra.run.trial158.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-13T03:57:22.150 INFO:teuthology.orchestra.run.trial158.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-13T03:57:22.150 INFO:teuthology.orchestra.run.trial158.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-13T03:57:22.150 INFO:teuthology.orchestra.run.trial158.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-13T03:57:22.150 INFO:teuthology.orchestra.run.trial158.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-13T03:57:22.150 INFO:teuthology.orchestra.run.trial158.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-13T03:57:22.150 INFO:teuthology.orchestra.run.trial158.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-13T03:57:22.150 INFO:teuthology.orchestra.run.trial158.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T03:57:22.150 INFO:teuthology.orchestra.run.trial158.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-13T03:57:22.150 INFO:teuthology.orchestra.run.trial158.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-13T03:57:22.150 INFO:teuthology.orchestra.run.trial158.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-13T03:57:22.150 INFO:teuthology.orchestra.run.trial158.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-13T03:57:22.150 INFO:teuthology.orchestra.run.trial158.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-13T03:57:22.150 INFO:teuthology.orchestra.run.trial158.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-13T03:57:22.151 INFO:teuthology.orchestra.run.trial158.stdout: python3-ply-3.11-14.el9.noarch 2026-02-13T03:57:22.151 INFO:teuthology.orchestra.run.trial158.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-13T03:57:22.151 INFO:teuthology.orchestra.run.trial158.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-13T03:57:22.151 INFO:teuthology.orchestra.run.trial158.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-13T03:57:22.151 INFO:teuthology.orchestra.run.trial158.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-13T03:57:22.151 INFO:teuthology.orchestra.run.trial158.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-13T03:57:22.151 INFO:teuthology.orchestra.run.trial158.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-13T03:57:22.151 INFO:teuthology.orchestra.run.trial158.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2026-02-13T03:57:22.151 INFO:teuthology.orchestra.run.trial158.stdout: python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:22.151 INFO:teuthology.orchestra.run.trial158.stdout: python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:22.151 INFO:teuthology.orchestra.run.trial158.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-13T03:57:22.151 INFO:teuthology.orchestra.run.trial158.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-13T03:57:22.151 INFO:teuthology.orchestra.run.trial158.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-13T03:57:22.152 INFO:teuthology.orchestra.run.trial158.stdout: python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:22.152 INFO:teuthology.orchestra.run.trial158.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-13T03:57:22.152 INFO:teuthology.orchestra.run.trial158.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-13T03:57:22.152 INFO:teuthology.orchestra.run.trial158.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-13T03:57:22.152 INFO:teuthology.orchestra.run.trial158.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-13T03:57:22.152 INFO:teuthology.orchestra.run.trial158.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-13T03:57:22.152 INFO:teuthology.orchestra.run.trial158.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-13T03:57:22.152 INFO:teuthology.orchestra.run.trial158.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-13T03:57:22.152 INFO:teuthology.orchestra.run.trial158.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2026-02-13T03:57:22.152 INFO:teuthology.orchestra.run.trial158.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-13T03:57:22.152 INFO:teuthology.orchestra.run.trial158.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-13T03:57:22.152 INFO:teuthology.orchestra.run.trial158.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-13T03:57:22.152 INFO:teuthology.orchestra.run.trial158.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-13T03:57:22.153 INFO:teuthology.orchestra.run.trial158.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-13T03:57:22.153 INFO:teuthology.orchestra.run.trial158.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-13T03:57:22.153 INFO:teuthology.orchestra.run.trial158.stdout: rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:22.153 INFO:teuthology.orchestra.run.trial158.stdout: rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:22.153 INFO:teuthology.orchestra.run.trial158.stdout: rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:22.153 INFO:teuthology.orchestra.run.trial158.stdout: re2-1:20211101-20.el9.x86_64 2026-02-13T03:57:22.153 INFO:teuthology.orchestra.run.trial158.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-13T03:57:22.153 INFO:teuthology.orchestra.run.trial158.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-13T03:57:22.153 INFO:teuthology.orchestra.run.trial158.stdout: unzip-6.0-59.el9.x86_64 2026-02-13T03:57:22.153 INFO:teuthology.orchestra.run.trial158.stdout: uuid-1.6.2-55.el9.x86_64 2026-02-13T03:57:22.153 INFO:teuthology.orchestra.run.trial158.stdout: xfsprogs-devel-6.4.0-7.el9.x86_64 2026-02-13T03:57:22.153 INFO:teuthology.orchestra.run.trial158.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-13T03:57:22.154 INFO:teuthology.orchestra.run.trial158.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-13T03:57:22.154 INFO:teuthology.orchestra.run.trial158.stdout: zip-3.0-35.el9.x86_64 2026-02-13T03:57:22.154 INFO:teuthology.orchestra.run.trial158.stdout: zlib-devel-1.2.11-41.el9.x86_64 2026-02-13T03:57:22.154 INFO:teuthology.orchestra.run.trial158.stdout: 2026-02-13T03:57:22.154 INFO:teuthology.orchestra.run.trial158.stdout:Complete! 2026-02-13T03:57:22.243 DEBUG:teuthology.parallel:result is None 2026-02-13T03:57:22.244 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 137/184 2026-02-13T03:57:22.305 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 138/184 2026-02-13T03:57:22.307 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 139/184 2026-02-13T03:57:22.321 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 139/184 2026-02-13T03:57:22.322 INFO:teuthology.orchestra.run.trial099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:57:22.322 INFO:teuthology.orchestra.run.trial099.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-13T03:57:22.322 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-13T03:57:22.333 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 140/184 2026-02-13T03:57:22.357 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 140/184 2026-02-13T03:57:22.357 INFO:teuthology.orchestra.run.trial099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:57:22.357 INFO:teuthology.orchestra.run.trial099.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-13T03:57:22.357 INFO:teuthology.orchestra.run.trial099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T03:57:22.358 INFO:teuthology.orchestra.run.trial099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-13T03:57:22.358 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-13T03:57:22.417 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 141/184 2026-02-13T03:57:22.420 INFO:teuthology.orchestra.run.trial099.stdout: Installing : cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 141/184 2026-02-13T03:57:22.430 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 142/184 2026-02-13T03:57:22.453 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 143/184 2026-02-13T03:57:22.455 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 144/184 2026-02-13T03:57:22.697 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 144/184 2026-02-13T03:57:22.712 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 145/184 2026-02-13T03:57:23.215 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 145/184 2026-02-13T03:57:23.217 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 146/184 2026-02-13T03:57:23.313 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 146/184 2026-02-13T03:57:23.361 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 147/184 2026-02-13T03:57:23.364 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 148/184 2026-02-13T03:57:23.411 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 148/184 2026-02-13T03:57:23.411 INFO:teuthology.orchestra.run.trial092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:57:23.411 INFO:teuthology.orchestra.run.trial092.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-13T03:57:23.411 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T03:57:23.411 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T03:57:23.411 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T03:57:23.429 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 149/184 2026-02-13T03:57:23.450 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 149/184 2026-02-13T03:57:24.027 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 144/184 2026-02-13T03:57:24.034 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 145/184 2026-02-13T03:57:24.049 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 150/184 2026-02-13T03:57:24.054 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 151/184 2026-02-13T03:57:24.102 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 151/184 2026-02-13T03:57:24.102 INFO:teuthology.orchestra.run.trial092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:57:24.102 INFO:teuthology.orchestra.run.trial092.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-13T03:57:24.102 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T03:57:24.102 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T03:57:24.102 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T03:57:24.115 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 152/184 2026-02-13T03:57:24.160 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 152/184 2026-02-13T03:57:24.160 INFO:teuthology.orchestra.run.trial092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:57:24.160 INFO:teuthology.orchestra.run.trial092.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-13T03:57:24.161 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T03:57:24.177 INFO:teuthology.orchestra.run.trial092.stdout: Installing : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 153/184 2026-02-13T03:57:24.222 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 153/184 2026-02-13T03:57:24.222 INFO:teuthology.orchestra.run.trial092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:57:24.222 INFO:teuthology.orchestra.run.trial092.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2026-02-13T03:57:24.222 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-13T03:57:24.222 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-13T03:57:24.223 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T03:57:24.358 INFO:teuthology.orchestra.run.trial092.stdout: Installing : rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 154/184 2026-02-13T03:57:24.405 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 154/184 2026-02-13T03:57:24.406 INFO:teuthology.orchestra.run.trial092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:57:24.406 INFO:teuthology.orchestra.run.trial092.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-13T03:57:24.406 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T03:57:24.406 INFO:teuthology.orchestra.run.trial092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T03:57:24.406 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T03:57:24.490 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 145/184 2026-02-13T03:57:24.491 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 146/184 2026-02-13T03:57:24.553 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 146/184 2026-02-13T03:57:24.594 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 147/184 2026-02-13T03:57:24.596 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 148/184 2026-02-13T03:57:24.615 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 148/184 2026-02-13T03:57:24.616 INFO:teuthology.orchestra.run.trial099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:57:24.616 INFO:teuthology.orchestra.run.trial099.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-13T03:57:24.616 INFO:teuthology.orchestra.run.trial099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T03:57:24.616 INFO:teuthology.orchestra.run.trial099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-13T03:57:24.616 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-13T03:57:24.627 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 149/184 2026-02-13T03:57:24.637 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 149/184 2026-02-13T03:57:25.210 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 150/184 2026-02-13T03:57:25.212 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 151/184 2026-02-13T03:57:25.234 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 151/184 2026-02-13T03:57:25.234 INFO:teuthology.orchestra.run.trial099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:57:25.235 INFO:teuthology.orchestra.run.trial099.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-13T03:57:25.235 INFO:teuthology.orchestra.run.trial099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T03:57:25.235 INFO:teuthology.orchestra.run.trial099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-13T03:57:25.235 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-13T03:57:25.244 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 152/184 2026-02-13T03:57:25.264 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 152/184 2026-02-13T03:57:25.264 INFO:teuthology.orchestra.run.trial099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:57:25.264 INFO:teuthology.orchestra.run.trial099.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-13T03:57:25.264 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-13T03:57:25.277 INFO:teuthology.orchestra.run.trial099.stdout: Installing : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 153/184 2026-02-13T03:57:25.297 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 153/184 2026-02-13T03:57:25.297 INFO:teuthology.orchestra.run.trial099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:57:25.297 INFO:teuthology.orchestra.run.trial099.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2026-02-13T03:57:25.297 INFO:teuthology.orchestra.run.trial099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-13T03:57:25.297 INFO:teuthology.orchestra.run.trial099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2026-02-13T03:57:25.297 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-13T03:57:25.421 INFO:teuthology.orchestra.run.trial099.stdout: Installing : rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 154/184 2026-02-13T03:57:25.442 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 154/184 2026-02-13T03:57:25.442 INFO:teuthology.orchestra.run.trial099.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-13T03:57:25.443 INFO:teuthology.orchestra.run.trial099.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-13T03:57:25.443 INFO:teuthology.orchestra.run.trial099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T03:57:25.443 INFO:teuthology.orchestra.run.trial099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-13T03:57:25.443 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-13T03:57:28.005 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 155/184 2026-02-13T03:57:28.026 INFO:teuthology.orchestra.run.trial092.stdout: Installing : xfsprogs-devel-6.4.0-7.el9.x86_64 156/184 2026-02-13T03:57:28.031 INFO:teuthology.orchestra.run.trial092.stdout: Installing : elfutils-libelf-devel-0.194-1.el9.x86_64 157/184 2026-02-13T03:57:28.142 INFO:teuthology.orchestra.run.trial092.stdout: Installing : cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 158/184 2026-02-13T03:57:28.175 INFO:teuthology.orchestra.run.trial092.stdout: Installing : postgresql-contrib-13.23-1.el9.x86_64 159/184 2026-02-13T03:57:28.182 INFO:teuthology.orchestra.run.trial092.stdout: Upgrading : iproute-tc-6.17.0-2.el9.x86_64 160/184 2026-02-13T03:57:28.184 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_ 161/184 2026-02-13T03:57:28.389 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T03:57:28.399 INFO:teuthology.orchestra.run.trial092.stdout: Installing : postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T03:57:28.436 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T03:57:28.443 INFO:teuthology.orchestra.run.trial092.stdout: Installing : cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 163/184 2026-02-13T03:57:28.454 INFO:teuthology.orchestra.run.trial092.stdout: Installing : rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 164/184 2026-02-13T03:57:28.502 INFO:teuthology.orchestra.run.trial092.stdout: Installing : rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 165/184 2026-02-13T03:57:28.861 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 155/184 2026-02-13T03:57:28.875 INFO:teuthology.orchestra.run.trial099.stdout: Installing : xfsprogs-devel-6.4.0-7.el9.x86_64 156/184 2026-02-13T03:57:28.878 INFO:teuthology.orchestra.run.trial099.stdout: Installing : elfutils-libelf-devel-0.194-1.el9.x86_64 157/184 2026-02-13T03:57:28.952 INFO:teuthology.orchestra.run.trial099.stdout: Installing : cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 158/184 2026-02-13T03:57:28.971 INFO:teuthology.orchestra.run.trial099.stdout: Installing : postgresql-contrib-13.23-1.el9.x86_64 159/184 2026-02-13T03:57:28.975 INFO:teuthology.orchestra.run.trial099.stdout: Upgrading : iproute-tc-6.17.0-2.el9.x86_64 160/184 2026-02-13T03:57:28.976 INFO:teuthology.orchestra.run.trial099.stdout: Installing : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_ 161/184 2026-02-13T03:57:29.093 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T03:57:29.097 INFO:teuthology.orchestra.run.trial099.stdout: Installing : postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T03:57:29.115 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: postgresql-server-13.23-1.el9.x86_64 162/184 2026-02-13T03:57:29.119 INFO:teuthology.orchestra.run.trial099.stdout: Installing : cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 163/184 2026-02-13T03:57:29.128 INFO:teuthology.orchestra.run.trial099.stdout: Installing : rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 164/184 2026-02-13T03:57:29.170 INFO:teuthology.orchestra.run.trial099.stdout: Installing : rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 165/184 2026-02-13T03:57:29.370 INFO:teuthology.orchestra.run.trial092.stdout: Installing : ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 166/184 2026-02-13T03:57:29.417 INFO:teuthology.orchestra.run.trial092.stdout: Installing : openssl-devel-1:3.5.5-1.el9.x86_64 167/184 2026-02-13T03:57:29.421 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libtool-2.4.6-46.el9.x86_64 168/184 2026-02-13T03:57:29.426 INFO:teuthology.orchestra.run.trial092.stdout: Upgrading : NetworkManager-team-1:1.54.3-2.el9.x86_64 169/184 2026-02-13T03:57:29.429 INFO:teuthology.orchestra.run.trial092.stdout: Upgrading : NetworkManager-tui-1:1.54.3-2.el9.x86_64 170/184 2026-02-13T03:57:29.444 INFO:teuthology.orchestra.run.trial092.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 171/184 2026-02-13T03:57:29.486 INFO:teuthology.orchestra.run.trial092.stdout: Installing : flex-2.6.4-9.el9.x86_64 172/184 2026-02-13T03:57:29.492 INFO:teuthology.orchestra.run.trial092.stdout: Installing : bison-3.7.4-5.el9.x86_64 173/184 2026-02-13T03:57:29.495 INFO:teuthology.orchestra.run.trial092.stdout: Cleanup : NetworkManager-tui-1:1.54.1-1.el9.x86_64 174/184 2026-02-13T03:57:29.502 INFO:teuthology.orchestra.run.trial092.stdout: Cleanup : openssl-1:3.5.1-6.el9.x86_64 175/184 2026-02-13T03:57:29.503 INFO:teuthology.orchestra.run.trial092.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 176/184 2026-02-13T03:57:29.531 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 176/184 2026-02-13T03:57:29.531 INFO:teuthology.orchestra.run.trial092.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 177/184 2026-02-13T03:57:29.559 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 177/184 2026-02-13T03:57:29.561 INFO:teuthology.orchestra.run.trial092.stdout: Cleanup : openssl-fips-provider-1:3.5.1-6.el9.x86_64 178/184 2026-02-13T03:57:29.565 INFO:teuthology.orchestra.run.trial092.stdout: Cleanup : iproute-tc-6.17.0-1.el9.x86_64 179/184 2026-02-13T03:57:29.567 INFO:teuthology.orchestra.run.trial092.stdout: Cleanup : NetworkManager-team-1:1.54.1-1.el9.x86_64 180/184 2026-02-13T03:57:29.580 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T03:57:29.580 INFO:teuthology.orchestra.run.trial092.stdout: Cleanup : NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T03:57:29.615 INFO:teuthology.orchestra.run.trial099.stdout: Installing : ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 166/184 2026-02-13T03:57:29.639 INFO:teuthology.orchestra.run.trial099.stdout: Installing : openssl-devel-1:3.5.5-1.el9.x86_64 167/184 2026-02-13T03:57:29.641 INFO:teuthology.orchestra.run.trial099.stdout: Installing : libtool-2.4.6-46.el9.x86_64 168/184 2026-02-13T03:57:29.644 INFO:teuthology.orchestra.run.trial099.stdout: Upgrading : NetworkManager-team-1:1.54.3-2.el9.x86_64 169/184 2026-02-13T03:57:29.646 INFO:teuthology.orchestra.run.trial099.stdout: Upgrading : NetworkManager-tui-1:1.54.3-2.el9.x86_64 170/184 2026-02-13T03:57:29.655 INFO:teuthology.orchestra.run.trial099.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 171/184 2026-02-13T03:57:29.681 INFO:teuthology.orchestra.run.trial099.stdout: Installing : flex-2.6.4-9.el9.x86_64 172/184 2026-02-13T03:57:29.684 INFO:teuthology.orchestra.run.trial099.stdout: Installing : bison-3.7.4-5.el9.x86_64 173/184 2026-02-13T03:57:29.686 INFO:teuthology.orchestra.run.trial099.stdout: Cleanup : NetworkManager-tui-1:1.54.1-1.el9.x86_64 174/184 2026-02-13T03:57:29.689 INFO:teuthology.orchestra.run.trial099.stdout: Cleanup : openssl-1:3.5.1-6.el9.x86_64 175/184 2026-02-13T03:57:29.690 INFO:teuthology.orchestra.run.trial099.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 176/184 2026-02-13T03:57:29.702 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 176/184 2026-02-13T03:57:29.702 INFO:teuthology.orchestra.run.trial099.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 177/184 2026-02-13T03:57:29.715 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 177/184 2026-02-13T03:57:29.716 INFO:teuthology.orchestra.run.trial099.stdout: Cleanup : openssl-fips-provider-1:3.5.1-6.el9.x86_64 178/184 2026-02-13T03:57:29.718 INFO:teuthology.orchestra.run.trial099.stdout: Cleanup : iproute-tc-6.17.0-1.el9.x86_64 179/184 2026-02-13T03:57:29.719 INFO:teuthology.orchestra.run.trial099.stdout: Cleanup : NetworkManager-team-1:1.54.1-1.el9.x86_64 180/184 2026-02-13T03:57:29.725 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T03:57:29.725 INFO:teuthology.orchestra.run.trial099.stdout: Cleanup : NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T03:57:29.726 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T03:57:29.732 INFO:teuthology.orchestra.run.trial092.stdout: Cleanup : NetworkManager-libnm-1:1.54.1-1.el9.x86_64 182/184 2026-02-13T03:57:29.737 INFO:teuthology.orchestra.run.trial092.stdout: Cleanup : iproute-6.17.0-1.el9.x86_64 183/184 2026-02-13T03:57:29.741 INFO:teuthology.orchestra.run.trial092.stdout: Cleanup : openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T03:57:29.755 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: iproute-6.17.0-2.el9.x86_64 184/184 2026-02-13T03:57:29.770 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 184/184 2026-02-13T03:57:29.803 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 184/184 2026-02-13T03:57:29.817 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: NetworkManager-1:1.54.1-1.el9.x86_64 181/184 2026-02-13T03:57:29.819 INFO:teuthology.orchestra.run.trial099.stdout: Cleanup : NetworkManager-libnm-1:1.54.1-1.el9.x86_64 182/184 2026-02-13T03:57:29.822 INFO:teuthology.orchestra.run.trial099.stdout: Cleanup : iproute-6.17.0-1.el9.x86_64 183/184 2026-02-13T03:57:29.823 INFO:teuthology.orchestra.run.trial099.stdout: Cleanup : openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T03:57:29.829 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: iproute-6.17.0-2.el9.x86_64 184/184 2026-02-13T03:57:29.836 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 184/184 2026-02-13T03:57:29.860 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 184/184 2026-02-13T03:57:29.956 INFO:teuthology.orchestra.run.trial092.stdout: Running scriptlet: openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T03:57:29.956 INFO:teuthology.orchestra.run.trial092.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2026-02-13T03:57:29.956 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T03:57:30.800 INFO:teuthology.orchestra.run.trial099.stdout: Running scriptlet: openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T03:57:30.800 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 1/184 2026-02-13T03:57:30.800 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 2/184 2026-02-13T03:57:30.800 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 3/184 2026-02-13T03:57:30.800 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 4/184 2026-02-13T03:57:30.800 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 5/184 2026-02-13T03:57:30.800 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 6/184 2026-02-13T03:57:30.800 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 7/184 2026-02-13T03:57:30.800 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 8/184 2026-02-13T03:57:30.800 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 9/184 2026-02-13T03:57:30.800 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 10/184 2026-02-13T03:57:30.801 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 11/184 2026-02-13T03:57:30.801 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 12/184 2026-02-13T03:57:30.801 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 13/184 2026-02-13T03:57:30.801 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 14/184 2026-02-13T03:57:30.801 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 15/184 2026-02-13T03:57:30.801 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 16/184 2026-02-13T03:57:30.801 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_ 17/184 2026-02-13T03:57:30.801 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 18/184 2026-02-13T03:57:30.801 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 19/184 2026-02-13T03:57:30.801 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 20/184 2026-02-13T03:57:30.801 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_6 21/184 2026-02-13T03:57:30.801 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 22/184 2026-02-13T03:57:30.801 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 23/184 2026-02-13T03:57:30.801 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 24/184 2026-02-13T03:57:30.801 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9. 25/184 2026-02-13T03:57:30.801 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_6 26/184 2026-02-13T03:57:30.801 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 27/184 2026-02-13T03:57:30.801 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 28/184 2026-02-13T03:57:30.801 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 29/184 2026-02-13T03:57:30.801 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 30/184 2026-02-13T03:57:30.801 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 31/184 2026-02-13T03:57:30.801 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 32/184 2026-02-13T03:57:30.801 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 33/184 2026-02-13T03:57:30.801 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 34/184 2026-02-13T03:57:30.801 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 35/184 2026-02-13T03:57:30.801 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 36/184 2026-02-13T03:57:30.801 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 37/184 2026-02-13T03:57:30.801 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 38/184 2026-02-13T03:57:30.801 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 39/184 2026-02-13T03:57:30.804 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 40/184 2026-02-13T03:57:30.804 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 41/184 2026-02-13T03:57:30.804 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 42/184 2026-02-13T03:57:30.804 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 43/184 2026-02-13T03:57:30.804 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 44/184 2026-02-13T03:57:30.804 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 45/184 2026-02-13T03:57:30.804 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 46/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 47/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 48/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 49/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 50/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 51/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 52/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 53/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 54/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-ply-3.11-14.el9.noarch 55/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 56/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 57/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 58/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : unzip-6.0-59.el9.x86_64 59/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : zip-3.0-35.el9.x86_64 60/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : automake-1.16.2-8.el9.noarch 61/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : bison-3.7.4-5.el9.x86_64 62/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 63/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : elfutils-libelf-devel-0.194-1.el9.x86_64 64/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : flex-2.6.4-9.el9.x86_64 65/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 66/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 67/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 68/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 69/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 70/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 71/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 72/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 73/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 74/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 75/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : libuuid-devel-2.37.4-21.el9.x86_64 76/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 77/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : libzstd-devel-1.5.5-1.el9.x86_64 78/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 79/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : lua-5.4.4-4.el9.x86_64 80/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 81/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 82/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : openssl-devel-1:3.5.5-1.el9.x86_64 83/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : perl-Thread-Queue-3.14-460.el9.noarch 84/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : perl-threads-1:2.25-460.el9.x86_64 85/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : perl-threads-shared-1.61-460.el9.x86_64 86/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : postgresql-13.23-1.el9.x86_64 87/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : postgresql-contrib-13.23-1.el9.x86_64 88/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : postgresql-private-libs-13.23-1.el9.x86_64 89/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : postgresql-server-13.23-1.el9.x86_64 90/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 91/184 2026-02-13T03:57:30.805 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 92/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 93/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 94/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 95/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 96/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 97/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 98/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 99/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 100/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 101/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 102/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 103/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 104/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 105/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 106/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 107/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 108/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 109/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 110/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 111/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 112/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 113/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : xfsprogs-devel-6.4.0-7.el9.x86_64 114/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 115/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 116/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 117/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 118/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 119/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 120/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 121/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 122/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 123/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 124/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 125/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 126/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 127/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 128/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 129/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 130/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 131/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 132/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 133/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 134/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 135/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 136/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 137/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 138/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 139/184 2026-02-13T03:57:30.806 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 140/184 2026-02-13T03:57:30.807 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 141/184 2026-02-13T03:57:30.807 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 142/184 2026-02-13T03:57:30.807 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 143/184 2026-02-13T03:57:30.807 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 144/184 2026-02-13T03:57:30.807 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 145/184 2026-02-13T03:57:30.807 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 146/184 2026-02-13T03:57:30.807 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 147/184 2026-02-13T03:57:30.807 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 148/184 2026-02-13T03:57:30.807 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 149/184 2026-02-13T03:57:30.807 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 150/184 2026-02-13T03:57:30.807 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 151/184 2026-02-13T03:57:30.807 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 152/184 2026-02-13T03:57:30.807 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 153/184 2026-02-13T03:57:30.807 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 154/184 2026-02-13T03:57:30.807 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 155/184 2026-02-13T03:57:30.807 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 156/184 2026-02-13T03:57:30.807 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 157/184 2026-02-13T03:57:30.807 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 158/184 2026-02-13T03:57:30.807 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 159/184 2026-02-13T03:57:30.807 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : re2-1:20211101-20.el9.x86_64 160/184 2026-02-13T03:57:30.807 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 161/184 2026-02-13T03:57:30.807 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 162/184 2026-02-13T03:57:30.807 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 163/184 2026-02-13T03:57:30.807 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 164/184 2026-02-13T03:57:30.807 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 165/184 2026-02-13T03:57:30.807 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 166/184 2026-02-13T03:57:30.807 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : NetworkManager-1:1.54.3-2.el9.x86_64 167/184 2026-02-13T03:57:30.807 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : NetworkManager-1:1.54.1-1.el9.x86_64 168/184 2026-02-13T03:57:30.807 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : NetworkManager-libnm-1:1.54.3-2.el9.x86_64 169/184 2026-02-13T03:57:30.807 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : NetworkManager-libnm-1:1.54.1-1.el9.x86_64 170/184 2026-02-13T03:57:30.807 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : NetworkManager-team-1:1.54.3-2.el9.x86_64 171/184 2026-02-13T03:57:30.807 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : NetworkManager-team-1:1.54.1-1.el9.x86_64 172/184 2026-02-13T03:57:30.807 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : NetworkManager-tui-1:1.54.3-2.el9.x86_64 173/184 2026-02-13T03:57:30.807 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : NetworkManager-tui-1:1.54.1-1.el9.x86_64 174/184 2026-02-13T03:57:30.807 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : iproute-6.17.0-2.el9.x86_64 175/184 2026-02-13T03:57:30.807 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : iproute-6.17.0-1.el9.x86_64 176/184 2026-02-13T03:57:30.807 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : iproute-tc-6.17.0-2.el9.x86_64 177/184 2026-02-13T03:57:30.807 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : iproute-tc-6.17.0-1.el9.x86_64 178/184 2026-02-13T03:57:30.807 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : openssl-1:3.5.5-1.el9.x86_64 179/184 2026-02-13T03:57:30.807 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : openssl-1:3.5.1-6.el9.x86_64 180/184 2026-02-13T03:57:30.807 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : openssl-fips-provider-1:3.5.5-1.el9.x86_64 181/184 2026-02-13T03:57:30.807 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : openssl-fips-provider-1:3.5.1-6.el9.x86_64 182/184 2026-02-13T03:57:30.807 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : openssl-libs-1:3.5.5-1.el9.x86_64 183/184 2026-02-13T03:57:30.881 INFO:teuthology.orchestra.run.trial099.stdout: Verifying : openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T03:57:30.881 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-13T03:57:30.881 INFO:teuthology.orchestra.run.trial099.stdout:Upgraded: 2026-02-13T03:57:30.881 INFO:teuthology.orchestra.run.trial099.stdout: NetworkManager-1:1.54.3-2.el9.x86_64 2026-02-13T03:57:30.881 INFO:teuthology.orchestra.run.trial099.stdout: NetworkManager-libnm-1:1.54.3-2.el9.x86_64 2026-02-13T03:57:30.881 INFO:teuthology.orchestra.run.trial099.stdout: NetworkManager-team-1:1.54.3-2.el9.x86_64 2026-02-13T03:57:30.881 INFO:teuthology.orchestra.run.trial099.stdout: NetworkManager-tui-1:1.54.3-2.el9.x86_64 2026-02-13T03:57:30.881 INFO:teuthology.orchestra.run.trial099.stdout: iproute-6.17.0-2.el9.x86_64 2026-02-13T03:57:30.881 INFO:teuthology.orchestra.run.trial099.stdout: iproute-tc-6.17.0-2.el9.x86_64 2026-02-13T03:57:30.881 INFO:teuthology.orchestra.run.trial099.stdout: librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:30.881 INFO:teuthology.orchestra.run.trial099.stdout: librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:30.881 INFO:teuthology.orchestra.run.trial099.stdout: openssl-1:3.5.5-1.el9.x86_64 2026-02-13T03:57:30.881 INFO:teuthology.orchestra.run.trial099.stdout: openssl-fips-provider-1:3.5.5-1.el9.x86_64 2026-02-13T03:57:30.881 INFO:teuthology.orchestra.run.trial099.stdout: openssl-libs-1:3.5.5-1.el9.x86_64 2026-02-13T03:57:30.881 INFO:teuthology.orchestra.run.trial099.stdout:Installed: 2026-02-13T03:57:30.881 INFO:teuthology.orchestra.run.trial099.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-13T03:57:30.881 INFO:teuthology.orchestra.run.trial099.stdout: automake-1.16.2-8.el9.noarch 2026-02-13T03:57:30.881 INFO:teuthology.orchestra.run.trial099.stdout: bison-3.7.4-5.el9.x86_64 2026-02-13T03:57:30.881 INFO:teuthology.orchestra.run.trial099.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-13T03:57:30.881 INFO:teuthology.orchestra.run.trial099.stdout: ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:30.881 INFO:teuthology.orchestra.run.trial099.stdout: ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:30.881 INFO:teuthology.orchestra.run.trial099.stdout: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:30.881 INFO:teuthology.orchestra.run.trial099.stdout: ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:30.881 INFO:teuthology.orchestra.run.trial099.stdout: ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:57:30.881 INFO:teuthology.orchestra.run.trial099.stdout: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:30.881 INFO:teuthology.orchestra.run.trial099.stdout: ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:30.881 INFO:teuthology.orchestra.run.trial099.stdout: ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:30.881 INFO:teuthology.orchestra.run.trial099.stdout: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:57:30.881 INFO:teuthology.orchestra.run.trial099.stdout: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:57:30.881 INFO:teuthology.orchestra.run.trial099.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:57:30.881 INFO:teuthology.orchestra.run.trial099.stdout: ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:57:30.881 INFO:teuthology.orchestra.run.trial099.stdout: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:57:30.881 INFO:teuthology.orchestra.run.trial099.stdout: ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:30.881 INFO:teuthology.orchestra.run.trial099.stdout: ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:30.881 INFO:teuthology.orchestra.run.trial099.stdout: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:30.881 INFO:teuthology.orchestra.run.trial099.stdout: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:30.881 INFO:teuthology.orchestra.run.trial099.stdout: ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:57:30.881 INFO:teuthology.orchestra.run.trial099.stdout: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:30.881 INFO:teuthology.orchestra.run.trial099.stdout: ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:30.881 INFO:teuthology.orchestra.run.trial099.stdout: ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:30.881 INFO:teuthology.orchestra.run.trial099.stdout: ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:57:30.881 INFO:teuthology.orchestra.run.trial099.stdout: cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:57:30.881 INFO:teuthology.orchestra.run.trial099.stdout: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: elfutils-libelf-devel-0.194-1.el9.x86_64 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: flex-2.6.4-9.el9.x86_64 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: libaio-devel-0.3.111-13.el9.x86_64 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: libtool-2.4.6-46.el9.x86_64 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: libuuid-devel-2.37.4-21.el9.x86_64 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: libzstd-devel-1.5.5-1.el9.x86_64 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: lua-5.4.4-4.el9.x86_64 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: openssl-devel-1:3.5.5-1.el9.x86_64 2026-02-13T03:57:30.882 INFO:teuthology.orchestra.run.trial099.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: perl-Thread-Queue-3.14-460.el9.noarch 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: perl-threads-1:2.25-460.el9.x86_64 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: perl-threads-shared-1.61-460.el9.x86_64 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: postgresql-13.23-1.el9.x86_64 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: postgresql-contrib-13.23-1.el9.x86_64 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: postgresql-private-libs-13.23-1.el9.x86_64 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: postgresql-server-13.23-1.el9.x86_64 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: python3-cmd2-2.4.2-2.el9.noarch 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: python3-colorama-0.4.6-3.el9.noarch 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-13T03:57:30.883 INFO:teuthology.orchestra.run.trial099.stdout: python3-ply-3.11-14.el9.noarch 2026-02-13T03:57:30.884 INFO:teuthology.orchestra.run.trial099.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-13T03:57:30.884 INFO:teuthology.orchestra.run.trial099.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-13T03:57:30.884 INFO:teuthology.orchestra.run.trial099.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-13T03:57:30.884 INFO:teuthology.orchestra.run.trial099.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-13T03:57:30.884 INFO:teuthology.orchestra.run.trial099.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-13T03:57:30.884 INFO:teuthology.orchestra.run.trial099.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-13T03:57:30.884 INFO:teuthology.orchestra.run.trial099.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2026-02-13T03:57:30.884 INFO:teuthology.orchestra.run.trial099.stdout: python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:30.884 INFO:teuthology.orchestra.run.trial099.stdout: python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:30.884 INFO:teuthology.orchestra.run.trial099.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-13T03:57:30.884 INFO:teuthology.orchestra.run.trial099.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-13T03:57:30.884 INFO:teuthology.orchestra.run.trial099.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-13T03:57:30.884 INFO:teuthology.orchestra.run.trial099.stdout: python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:30.884 INFO:teuthology.orchestra.run.trial099.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-13T03:57:30.884 INFO:teuthology.orchestra.run.trial099.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-13T03:57:30.884 INFO:teuthology.orchestra.run.trial099.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-13T03:57:30.884 INFO:teuthology.orchestra.run.trial099.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-13T03:57:30.884 INFO:teuthology.orchestra.run.trial099.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-13T03:57:30.884 INFO:teuthology.orchestra.run.trial099.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-13T03:57:30.884 INFO:teuthology.orchestra.run.trial099.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-13T03:57:30.884 INFO:teuthology.orchestra.run.trial099.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2026-02-13T03:57:30.884 INFO:teuthology.orchestra.run.trial099.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-13T03:57:30.884 INFO:teuthology.orchestra.run.trial099.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-13T03:57:30.884 INFO:teuthology.orchestra.run.trial099.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-13T03:57:30.884 INFO:teuthology.orchestra.run.trial099.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-13T03:57:30.884 INFO:teuthology.orchestra.run.trial099.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-13T03:57:30.884 INFO:teuthology.orchestra.run.trial099.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-13T03:57:30.884 INFO:teuthology.orchestra.run.trial099.stdout: rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:30.884 INFO:teuthology.orchestra.run.trial099.stdout: rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:30.884 INFO:teuthology.orchestra.run.trial099.stdout: rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:30.884 INFO:teuthology.orchestra.run.trial099.stdout: re2-1:20211101-20.el9.x86_64 2026-02-13T03:57:30.884 INFO:teuthology.orchestra.run.trial099.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-13T03:57:30.884 INFO:teuthology.orchestra.run.trial099.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-13T03:57:30.884 INFO:teuthology.orchestra.run.trial099.stdout: unzip-6.0-59.el9.x86_64 2026-02-13T03:57:30.884 INFO:teuthology.orchestra.run.trial099.stdout: uuid-1.6.2-55.el9.x86_64 2026-02-13T03:57:30.884 INFO:teuthology.orchestra.run.trial099.stdout: xfsprogs-devel-6.4.0-7.el9.x86_64 2026-02-13T03:57:30.884 INFO:teuthology.orchestra.run.trial099.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-13T03:57:30.884 INFO:teuthology.orchestra.run.trial099.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-13T03:57:30.884 INFO:teuthology.orchestra.run.trial099.stdout: zip-3.0-35.el9.x86_64 2026-02-13T03:57:30.884 INFO:teuthology.orchestra.run.trial099.stdout: zlib-devel-1.2.11-41.el9.x86_64 2026-02-13T03:57:30.884 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-13T03:57:30.885 INFO:teuthology.orchestra.run.trial099.stdout:Complete! 2026-02-13T03:57:30.918 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 1/184 2026-02-13T03:57:30.918 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 2/184 2026-02-13T03:57:30.918 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 3/184 2026-02-13T03:57:30.918 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 4/184 2026-02-13T03:57:30.918 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3 5/184 2026-02-13T03:57:30.918 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 6/184 2026-02-13T03:57:30.918 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 7/184 2026-02-13T03:57:30.919 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 8/184 2026-02-13T03:57:30.919 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 9/184 2026-02-13T03:57:30.919 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86 10/184 2026-02-13T03:57:30.919 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86 11/184 2026-02-13T03:57:30.919 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 12/184 2026-02-13T03:57:30.919 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 13/184 2026-02-13T03:57:30.919 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 14/184 2026-02-13T03:57:30.919 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 15/184 2026-02-13T03:57:30.919 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 16/184 2026-02-13T03:57:30.919 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_ 17/184 2026-02-13T03:57:30.919 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86 18/184 2026-02-13T03:57:30.919 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 19/184 2026-02-13T03:57:30.919 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 20/184 2026-02-13T03:57:30.919 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_6 21/184 2026-02-13T03:57:30.919 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86 22/184 2026-02-13T03:57:30.919 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 23/184 2026-02-13T03:57:30.919 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el 24/184 2026-02-13T03:57:30.919 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9. 25/184 2026-02-13T03:57:30.919 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_6 26/184 2026-02-13T03:57:30.923 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 27/184 2026-02-13T03:57:30.923 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 28/184 2026-02-13T03:57:30.923 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 29/184 2026-02-13T03:57:30.923 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 30/184 2026-02-13T03:57:30.923 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 31/184 2026-02-13T03:57:30.923 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 32/184 2026-02-13T03:57:30.923 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829. 33/184 2026-02-13T03:57:30.923 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noa 34/184 2026-02-13T03:57:30.923 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.n 35/184 2026-02-13T03:57:30.923 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8 36/184 2026-02-13T03:57:30.923 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el 37/184 2026-02-13T03:57:30.923 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 38/184 2026-02-13T03:57:30.923 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.e 39/184 2026-02-13T03:57:30.923 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 40/184 2026-02-13T03:57:30.923 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 41/184 2026-02-13T03:57:30.923 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 42/184 2026-02-13T03:57:30.923 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 43/184 2026-02-13T03:57:30.923 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 44/184 2026-02-13T03:57:30.923 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 45/184 2026-02-13T03:57:30.923 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 46/184 2026-02-13T03:57:30.923 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 47/184 2026-02-13T03:57:30.923 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 48/184 2026-02-13T03:57:30.923 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 49/184 2026-02-13T03:57:30.923 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 50/184 2026-02-13T03:57:30.923 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 51/184 2026-02-13T03:57:30.923 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 52/184 2026-02-13T03:57:30.923 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 53/184 2026-02-13T03:57:30.923 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 54/184 2026-02-13T03:57:30.923 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-ply-3.11-14.el9.noarch 55/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 56/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 57/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 58/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : unzip-6.0-59.el9.x86_64 59/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : zip-3.0-35.el9.x86_64 60/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : automake-1.16.2-8.el9.noarch 61/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : bison-3.7.4-5.el9.x86_64 62/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 63/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : elfutils-libelf-devel-0.194-1.el9.x86_64 64/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : flex-2.6.4-9.el9.x86_64 65/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 66/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 67/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 68/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 69/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 70/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 71/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 72/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 73/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 74/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 75/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libuuid-devel-2.37.4-21.el9.x86_64 76/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 77/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libzstd-devel-1.5.5-1.el9.x86_64 78/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 79/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : lua-5.4.4-4.el9.x86_64 80/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 81/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 82/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : openssl-devel-1:3.5.5-1.el9.x86_64 83/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : perl-Thread-Queue-3.14-460.el9.noarch 84/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : perl-threads-1:2.25-460.el9.x86_64 85/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : perl-threads-shared-1.61-460.el9.x86_64 86/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : postgresql-13.23-1.el9.x86_64 87/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : postgresql-contrib-13.23-1.el9.x86_64 88/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : postgresql-private-libs-13.23-1.el9.x86_64 89/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : postgresql-server-13.23-1.el9.x86_64 90/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 91/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 92/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 93/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 94/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 95/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 96/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 97/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 98/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 99/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 100/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 101/184 2026-02-13T03:57:30.924 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 102/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 103/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 104/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 105/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 106/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 107/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 108/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 109/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 110/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 111/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 112/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 113/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : xfsprogs-devel-6.4.0-7.el9.x86_64 114/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 115/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 116/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 117/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 118/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 119/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 120/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 121/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 122/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 123/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 124/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 125/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 126/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 127/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 128/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 129/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 130/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 131/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 132/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 133/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 134/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 135/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 136/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 137/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 138/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 139/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 140/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 141/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 142/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 143/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 144/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 145/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 146/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 147/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 148/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 149/184 2026-02-13T03:57:30.925 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 150/184 2026-02-13T03:57:30.926 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 151/184 2026-02-13T03:57:30.926 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 152/184 2026-02-13T03:57:30.926 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 153/184 2026-02-13T03:57:30.926 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 154/184 2026-02-13T03:57:30.926 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 155/184 2026-02-13T03:57:30.926 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 156/184 2026-02-13T03:57:30.926 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 157/184 2026-02-13T03:57:30.926 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 158/184 2026-02-13T03:57:30.926 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 159/184 2026-02-13T03:57:30.926 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : re2-1:20211101-20.el9.x86_64 160/184 2026-02-13T03:57:30.926 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 161/184 2026-02-13T03:57:30.926 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 162/184 2026-02-13T03:57:30.926 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 163/184 2026-02-13T03:57:30.926 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 164/184 2026-02-13T03:57:30.926 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 165/184 2026-02-13T03:57:30.926 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 166/184 2026-02-13T03:57:30.926 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : NetworkManager-1:1.54.3-2.el9.x86_64 167/184 2026-02-13T03:57:30.926 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : NetworkManager-1:1.54.1-1.el9.x86_64 168/184 2026-02-13T03:57:30.926 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : NetworkManager-libnm-1:1.54.3-2.el9.x86_64 169/184 2026-02-13T03:57:30.926 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : NetworkManager-libnm-1:1.54.1-1.el9.x86_64 170/184 2026-02-13T03:57:30.926 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : NetworkManager-team-1:1.54.3-2.el9.x86_64 171/184 2026-02-13T03:57:30.926 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : NetworkManager-team-1:1.54.1-1.el9.x86_64 172/184 2026-02-13T03:57:30.926 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : NetworkManager-tui-1:1.54.3-2.el9.x86_64 173/184 2026-02-13T03:57:30.926 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : NetworkManager-tui-1:1.54.1-1.el9.x86_64 174/184 2026-02-13T03:57:30.926 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : iproute-6.17.0-2.el9.x86_64 175/184 2026-02-13T03:57:30.926 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : iproute-6.17.0-1.el9.x86_64 176/184 2026-02-13T03:57:30.926 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : iproute-tc-6.17.0-2.el9.x86_64 177/184 2026-02-13T03:57:30.926 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : iproute-tc-6.17.0-1.el9.x86_64 178/184 2026-02-13T03:57:30.926 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : openssl-1:3.5.5-1.el9.x86_64 179/184 2026-02-13T03:57:30.926 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : openssl-1:3.5.1-6.el9.x86_64 180/184 2026-02-13T03:57:30.926 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : openssl-fips-provider-1:3.5.5-1.el9.x86_64 181/184 2026-02-13T03:57:30.926 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : openssl-fips-provider-1:3.5.1-6.el9.x86_64 182/184 2026-02-13T03:57:30.926 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : openssl-libs-1:3.5.5-1.el9.x86_64 183/184 2026-02-13T03:57:30.977 DEBUG:teuthology.parallel:result is None 2026-02-13T03:57:31.026 INFO:teuthology.orchestra.run.trial092.stdout: Verifying : openssl-libs-1:3.5.1-6.el9.x86_64 184/184 2026-02-13T03:57:31.026 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T03:57:31.026 INFO:teuthology.orchestra.run.trial092.stdout:Upgraded: 2026-02-13T03:57:31.026 INFO:teuthology.orchestra.run.trial092.stdout: NetworkManager-1:1.54.3-2.el9.x86_64 2026-02-13T03:57:31.026 INFO:teuthology.orchestra.run.trial092.stdout: NetworkManager-libnm-1:1.54.3-2.el9.x86_64 2026-02-13T03:57:31.026 INFO:teuthology.orchestra.run.trial092.stdout: NetworkManager-team-1:1.54.3-2.el9.x86_64 2026-02-13T03:57:31.026 INFO:teuthology.orchestra.run.trial092.stdout: NetworkManager-tui-1:1.54.3-2.el9.x86_64 2026-02-13T03:57:31.026 INFO:teuthology.orchestra.run.trial092.stdout: iproute-6.17.0-2.el9.x86_64 2026-02-13T03:57:31.026 INFO:teuthology.orchestra.run.trial092.stdout: iproute-tc-6.17.0-2.el9.x86_64 2026-02-13T03:57:31.026 INFO:teuthology.orchestra.run.trial092.stdout: librados2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:31.026 INFO:teuthology.orchestra.run.trial092.stdout: librbd1-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:31.026 INFO:teuthology.orchestra.run.trial092.stdout: openssl-1:3.5.5-1.el9.x86_64 2026-02-13T03:57:31.026 INFO:teuthology.orchestra.run.trial092.stdout: openssl-fips-provider-1:3.5.5-1.el9.x86_64 2026-02-13T03:57:31.026 INFO:teuthology.orchestra.run.trial092.stdout: openssl-libs-1:3.5.5-1.el9.x86_64 2026-02-13T03:57:31.026 INFO:teuthology.orchestra.run.trial092.stdout:Installed: 2026-02-13T03:57:31.026 INFO:teuthology.orchestra.run.trial092.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-13T03:57:31.026 INFO:teuthology.orchestra.run.trial092.stdout: automake-1.16.2-8.el9.noarch 2026-02-13T03:57:31.026 INFO:teuthology.orchestra.run.trial092.stdout: bison-3.7.4-5.el9.x86_64 2026-02-13T03:57:31.026 INFO:teuthology.orchestra.run.trial092.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-13T03:57:31.026 INFO:teuthology.orchestra.run.trial092.stdout: ceph-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:31.026 INFO:teuthology.orchestra.run.trial092.stdout: ceph-base-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:31.026 INFO:teuthology.orchestra.run.trial092.stdout: ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:31.026 INFO:teuthology.orchestra.run.trial092.stdout: ceph-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:31.026 INFO:teuthology.orchestra.run.trial092.stdout: ceph-grafana-dashboards-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:57:31.026 INFO:teuthology.orchestra.run.trial092.stdout: ceph-immutable-object-cache-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:31.026 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mds-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:31.026 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mgr-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:31.026 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mgr-cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:57:31.026 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mgr-dashboard-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:57:31.026 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:57:31.026 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mgr-modules-core-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:57:31.026 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mgr-rook-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:57:31.026 INFO:teuthology.orchestra.run.trial092.stdout: ceph-mon-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:31.026 INFO:teuthology.orchestra.run.trial092.stdout: ceph-osd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:31.026 INFO:teuthology.orchestra.run.trial092.stdout: ceph-osd-classic-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:31.026 INFO:teuthology.orchestra.run.trial092.stdout: ceph-osd-crimson-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:31.026 INFO:teuthology.orchestra.run.trial092.stdout: ceph-prometheus-alerts-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:57:31.026 INFO:teuthology.orchestra.run.trial092.stdout: ceph-radosgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:31.026 INFO:teuthology.orchestra.run.trial092.stdout: ceph-selinux-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:31.026 INFO:teuthology.orchestra.run.trial092.stdout: ceph-test-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: ceph-volume-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: cephadm-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: cephfs-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: cephfs-shell-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: cephfs-top-2:20.3.0-5241.g8f8d3829.el9.noarch 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: cryptsetup-2.8.1-2.el9.x86_64 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: elfutils-libelf-devel-0.194-1.el9.x86_64 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: flex-2.6.4-9.el9.x86_64 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: libaio-devel-0.3.111-13.el9.x86_64 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: libcephfs-devel-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: libcephfs-proxy2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: libcephfs2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: libcephsqlite-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: librados-devel-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: libradosstriper1-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: librgw2-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: libtool-2.4.6-46.el9.x86_64 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: libuuid-devel-2.37.4-21.el9.x86_64 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: libzstd-devel-1.5.5-1.el9.x86_64 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: lua-5.4.4-4.el9.x86_64 2026-02-13T03:57:31.027 INFO:teuthology.orchestra.run.trial092.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: openssl-devel-1:3.5.5-1.el9.x86_64 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: perl-Thread-Queue-3.14-460.el9.noarch 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: perl-threads-1:2.25-460.el9.x86_64 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: perl-threads-shared-1.61-460.el9.x86_64 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: postgresql-13.23-1.el9.x86_64 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: postgresql-contrib-13.23-1.el9.x86_64 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: postgresql-private-libs-13.23-1.el9.x86_64 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: postgresql-server-13.23-1.el9.x86_64 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: python3-ceph-argparse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: python3-ceph-common-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: python3-cephfs-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: python3-cmd2-2.4.2-2.el9.noarch 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: python3-colorama-0.4.6-3.el9.noarch 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-13T03:57:31.028 INFO:teuthology.orchestra.run.trial092.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: python3-ply-3.11-14.el9.noarch 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: python3-rados-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: python3-rbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: python3-rgw-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: rbd-fuse-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: rbd-mirror-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: rbd-nbd-2:20.3.0-5241.g8f8d3829.el9.x86_64 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: re2-1:20211101-20.el9.x86_64 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: unzip-6.0-59.el9.x86_64 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: uuid-1.6.2-55.el9.x86_64 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: xfsprogs-devel-6.4.0-7.el9.x86_64 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-13T03:57:31.029 INFO:teuthology.orchestra.run.trial092.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-13T03:57:31.030 INFO:teuthology.orchestra.run.trial092.stdout: zip-3.0-35.el9.x86_64 2026-02-13T03:57:31.030 INFO:teuthology.orchestra.run.trial092.stdout: zlib-devel-1.2.11-41.el9.x86_64 2026-02-13T03:57:31.030 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T03:57:31.030 INFO:teuthology.orchestra.run.trial092.stdout:Complete! 2026-02-13T03:57:31.274 DEBUG:teuthology.parallel:result is None 2026-02-13T03:57:31.274 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T03:57:31.388 DEBUG:teuthology.orchestra.run.trial092:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-13T03:57:31.430 INFO:teuthology.orchestra.run.trial092.stdout:20.3.0-5241.g8f8d3829.el9 2026-02-13T03:57:31.430 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5241.g8f8d3829.el9 2026-02-13T03:57:31.430 INFO:teuthology.task.install:The correct ceph version 20.3.0-5241.g8f8d3829 is installed. 2026-02-13T03:57:31.431 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T03:57:31.547 DEBUG:teuthology.orchestra.run.trial099:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-13T03:57:31.567 INFO:teuthology.orchestra.run.trial099.stdout:20.3.0-5241.g8f8d3829.el9 2026-02-13T03:57:31.567 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5241.g8f8d3829.el9 2026-02-13T03:57:31.567 INFO:teuthology.task.install:The correct ceph version 20.3.0-5241.g8f8d3829 is installed. 2026-02-13T03:57:31.568 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T03:57:31.682 DEBUG:teuthology.orchestra.run.trial158:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-13T03:57:31.704 INFO:teuthology.orchestra.run.trial158.stdout:20.3.0-5241.g8f8d3829.el9 2026-02-13T03:57:31.705 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5241.g8f8d3829.el9 2026-02-13T03:57:31.705 INFO:teuthology.task.install:The correct ceph version 20.3.0-5241.g8f8d3829 is installed. 2026-02-13T03:57:31.705 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-13T03:57:31.706 DEBUG:teuthology.orchestra.run.trial092:> set -ex 2026-02-13T03:57:31.706 DEBUG:teuthology.orchestra.run.trial092:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-13T03:57:31.763 DEBUG:teuthology.orchestra.run.trial099:> set -ex 2026-02-13T03:57:31.763 DEBUG:teuthology.orchestra.run.trial099:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-13T03:57:31.788 DEBUG:teuthology.orchestra.run.trial158:> set -ex 2026-02-13T03:57:31.788 DEBUG:teuthology.orchestra.run.trial158:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-13T03:57:31.814 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-13T03:57:31.814 DEBUG:teuthology.orchestra.run.trial092:> set -ex 2026-02-13T03:57:31.815 DEBUG:teuthology.orchestra.run.trial092:> sudo dd of=/usr/bin/daemon-helper 2026-02-13T03:57:31.869 DEBUG:teuthology.orchestra.run.trial092:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-13T03:57:31.962 DEBUG:teuthology.orchestra.run.trial099:> set -ex 2026-02-13T03:57:31.962 DEBUG:teuthology.orchestra.run.trial099:> sudo dd of=/usr/bin/daemon-helper 2026-02-13T03:57:31.986 DEBUG:teuthology.orchestra.run.trial099:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-13T03:57:32.050 DEBUG:teuthology.orchestra.run.trial158:> set -ex 2026-02-13T03:57:32.050 DEBUG:teuthology.orchestra.run.trial158:> sudo dd of=/usr/bin/daemon-helper 2026-02-13T03:57:32.075 DEBUG:teuthology.orchestra.run.trial158:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-13T03:57:32.139 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-13T03:57:32.139 DEBUG:teuthology.orchestra.run.trial092:> set -ex 2026-02-13T03:57:32.139 DEBUG:teuthology.orchestra.run.trial092:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-13T03:57:32.192 DEBUG:teuthology.orchestra.run.trial092:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-13T03:57:32.287 DEBUG:teuthology.orchestra.run.trial099:> set -ex 2026-02-13T03:57:32.287 DEBUG:teuthology.orchestra.run.trial099:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-13T03:57:32.311 DEBUG:teuthology.orchestra.run.trial099:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-13T03:57:32.374 DEBUG:teuthology.orchestra.run.trial158:> set -ex 2026-02-13T03:57:32.375 DEBUG:teuthology.orchestra.run.trial158:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-13T03:57:32.400 DEBUG:teuthology.orchestra.run.trial158:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-13T03:57:32.465 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-13T03:57:32.465 DEBUG:teuthology.orchestra.run.trial092:> set -ex 2026-02-13T03:57:32.466 DEBUG:teuthology.orchestra.run.trial092:> sudo dd of=/usr/bin/stdin-killer 2026-02-13T03:57:32.522 DEBUG:teuthology.orchestra.run.trial092:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-13T03:57:32.618 DEBUG:teuthology.orchestra.run.trial099:> set -ex 2026-02-13T03:57:32.618 DEBUG:teuthology.orchestra.run.trial099:> sudo dd of=/usr/bin/stdin-killer 2026-02-13T03:57:32.644 DEBUG:teuthology.orchestra.run.trial099:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-13T03:57:32.709 DEBUG:teuthology.orchestra.run.trial158:> set -ex 2026-02-13T03:57:32.709 DEBUG:teuthology.orchestra.run.trial158:> sudo dd of=/usr/bin/stdin-killer 2026-02-13T03:57:32.735 DEBUG:teuthology.orchestra.run.trial158:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-13T03:57:32.801 INFO:teuthology.run_tasks:Running task cephadm... 2026-02-13T03:57:32.931 INFO:tasks.cephadm:Config: {'distro-suffix': 'rockylinux-10', 'roleless': False, 'skip_dashboard': True, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd', 'disabled'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mgr/snap_schedule/allow_m_granularity': True, 'mgr/snap_schedule/dump_on_update': True, 'mgr/snap_schedule/log_level': 'debug', 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'client_fscrypt_dummy_encryption': True, 'fuse default permissions': False, 'fuse set user groups': True}, 'global': {'ms die on skipped message': False}, 'mds': {'mds_bal_replicate_threshold': 1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'is offline because no MDS', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'BLUESTORE_SLOW_OP_ALERT', 'slow operation indications in BlueStore', 'experiencing slow operations in BlueStore', 'MGR_MODULE_ERROR', 'OSD_DOWN', 'osd.* is down', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'osds down', 'osd.* is down', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'pg .* is stuck inactive', 'pg .* is .*degraded'], 'mgr-modules': ['snap_schedule'], 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f', 'subvols': {'create': 2}} 2026-02-13T03:57:32.931 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 2026-02-13T03:57:32.934 INFO:tasks.cephadm:Cluster fsid is 1fefccae-0890-11f1-bcc5-d404e6e7d460 2026-02-13T03:57:32.934 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2026-02-13T03:57:32.934 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '10.20.193.92', 'mon.b': '10.20.193.99', 'mon.c': '10.20.193.158'} 2026-02-13T03:57:32.934 INFO:tasks.cephadm:First mon is mon.a on trial092 2026-02-13T03:57:32.934 INFO:tasks.cephadm:First mgr is x 2026-02-13T03:57:32.934 INFO:tasks.cephadm:Normalizing hostnames... 2026-02-13T03:57:32.935 DEBUG:teuthology.orchestra.run.trial092:> sudo hostname $(hostname -s) 2026-02-13T03:57:32.992 DEBUG:teuthology.orchestra.run.trial099:> sudo hostname $(hostname -s) 2026-02-13T03:57:33.016 DEBUG:teuthology.orchestra.run.trial158:> sudo hostname $(hostname -s) 2026-02-13T03:57:33.042 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2026-02-13T03:57:33.043 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T03:57:33.206 INFO:tasks.cephadm:builder_project result: [{'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/flavors/default/', 'ref': 'wip-pdonnell-testing-20260210.171210', 'sha1': '8f8d38294e4db8750b4b1649f62ce37caa63080f', 'distro': 'centos', 'distro_version': '9', 'distro_codename': None, 'modified': '2026-02-10 22:03:44.386901', 'status': 'ready', 'flavor': 'default', 'project': 'ceph', 'archs': ['source', 'x86_64'], 'extra': {'version': '20.3.0-5241-g8f8d3829', 'package_manager_version': '20.3.0-5241.g8f8d3829', 'build_url': 'https://jenkins.ceph.com/job/ceph-dev-pipeline/2911/', 'root_build_cause': '', 'node_name': '10.20.192.26+soko16', 'job_name': 'ceph-dev-pipeline'}}] 2026-02-13T03:57:33.346 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-pdonnell-testing-20260210.171210, sha1 8f8d38294e4db8750b4b1649f62ce37caa63080f from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=8f8d38294e4db8750b4b1649f62ce37caa63080f 2026-02-13T03:57:33.347 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/x86_64/flavors/default/cephadm 2026-02-13T03:57:33.347 INFO:tasks.cephadm:Downloading cephadm from url: https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/x86_64/flavors/default/cephadm 2026-02-13T03:57:33.347 DEBUG:teuthology.orchestra.run.trial092:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-13T03:57:33.694 INFO:teuthology.orchestra.run.trial092.stdout:-rw-r--r--. 1 ubuntu ubuntu 1073479 Feb 13 03:57 /home/ubuntu/cephtest/cephadm 2026-02-13T03:57:33.695 DEBUG:teuthology.orchestra.run.trial099:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-13T03:57:34.014 INFO:teuthology.orchestra.run.trial099.stdout:-rw-r--r--. 1 ubuntu ubuntu 1073479 Feb 13 03:57 /home/ubuntu/cephtest/cephadm 2026-02-13T03:57:34.014 DEBUG:teuthology.orchestra.run.trial158:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20260210.171210/8f8d38294e4db8750b4b1649f62ce37caa63080f/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2026-02-13T03:57:34.337 INFO:teuthology.orchestra.run.trial158.stdout:-rw-r--r--. 1 ubuntu ubuntu 1073479 Feb 13 03:57 /home/ubuntu/cephtest/cephadm 2026-02-13T03:57:34.338 DEBUG:teuthology.orchestra.run.trial092:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-13T03:57:34.379 DEBUG:teuthology.orchestra.run.trial099:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-13T03:57:34.397 DEBUG:teuthology.orchestra.run.trial158:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2026-02-13T03:57:34.441 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 on all hosts... 2026-02-13T03:57:34.441 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 pull 2026-02-13T03:57:34.445 DEBUG:teuthology.orchestra.run.trial099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 pull 2026-02-13T03:57:34.448 DEBUG:teuthology.orchestra.run.trial158:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 pull 2026-02-13T03:57:34.611 INFO:teuthology.orchestra.run.trial158.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10... 2026-02-13T03:57:34.612 INFO:teuthology.orchestra.run.trial099.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10... 2026-02-13T03:57:34.806 INFO:teuthology.orchestra.run.trial092.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10... 2026-02-13T03:57:44.461 INFO:teuthology.orchestra.run.trial158.stdout:{ 2026-02-13T03:57:44.461 INFO:teuthology.orchestra.run.trial158.stdout: "ceph_version": "ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev)", 2026-02-13T03:57:44.461 INFO:teuthology.orchestra.run.trial158.stdout: "image_id": "b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da", 2026-02-13T03:57:44.462 INFO:teuthology.orchestra.run.trial158.stdout: "repo_digests": [ 2026-02-13T03:57:44.462 INFO:teuthology.orchestra.run.trial158.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9" 2026-02-13T03:57:44.462 INFO:teuthology.orchestra.run.trial158.stdout: ] 2026-02-13T03:57:44.462 INFO:teuthology.orchestra.run.trial158.stdout:} 2026-02-13T03:57:44.475 INFO:teuthology.orchestra.run.trial099.stdout:{ 2026-02-13T03:57:44.475 INFO:teuthology.orchestra.run.trial099.stdout: "ceph_version": "ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev)", 2026-02-13T03:57:44.476 INFO:teuthology.orchestra.run.trial099.stdout: "image_id": "b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da", 2026-02-13T03:57:44.476 INFO:teuthology.orchestra.run.trial099.stdout: "repo_digests": [ 2026-02-13T03:57:44.476 INFO:teuthology.orchestra.run.trial099.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9" 2026-02-13T03:57:44.476 INFO:teuthology.orchestra.run.trial099.stdout: ] 2026-02-13T03:57:44.476 INFO:teuthology.orchestra.run.trial099.stdout:} 2026-02-13T03:57:47.438 INFO:teuthology.orchestra.run.trial092.stdout:{ 2026-02-13T03:57:47.438 INFO:teuthology.orchestra.run.trial092.stdout: "ceph_version": "ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev)", 2026-02-13T03:57:47.438 INFO:teuthology.orchestra.run.trial092.stdout: "image_id": "b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da", 2026-02-13T03:57:47.438 INFO:teuthology.orchestra.run.trial092.stdout: "repo_digests": [ 2026-02-13T03:57:47.438 INFO:teuthology.orchestra.run.trial092.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9" 2026-02-13T03:57:47.438 INFO:teuthology.orchestra.run.trial092.stdout: ] 2026-02-13T03:57:47.439 INFO:teuthology.orchestra.run.trial092.stdout:} 2026-02-13T03:57:47.460 DEBUG:teuthology.orchestra.run.trial092:> sudo mkdir -p /etc/ceph 2026-02-13T03:57:47.516 DEBUG:teuthology.orchestra.run.trial099:> sudo mkdir -p /etc/ceph 2026-02-13T03:57:47.543 DEBUG:teuthology.orchestra.run.trial158:> sudo mkdir -p /etc/ceph 2026-02-13T03:57:47.570 DEBUG:teuthology.orchestra.run.trial092:> sudo chmod 777 /etc/ceph 2026-02-13T03:57:47.623 DEBUG:teuthology.orchestra.run.trial099:> sudo chmod 777 /etc/ceph 2026-02-13T03:57:47.648 DEBUG:teuthology.orchestra.run.trial158:> sudo chmod 777 /etc/ceph 2026-02-13T03:57:47.672 INFO:tasks.cephadm:Writing seed config... 2026-02-13T03:57:47.673 INFO:tasks.cephadm: override: [client] client_fscrypt_dummy_encryption = True 2026-02-13T03:57:47.673 INFO:tasks.cephadm: override: [client] fuse default permissions = False 2026-02-13T03:57:47.673 INFO:tasks.cephadm: override: [client] fuse set user groups = True 2026-02-13T03:57:47.673 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2026-02-13T03:57:47.673 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2026-02-13T03:57:47.673 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2026-02-13T03:57:47.673 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2026-02-13T03:57:47.673 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2026-02-13T03:57:47.673 INFO:tasks.cephadm: override: [mon] debug mon = 20 2026-02-13T03:57:47.673 INFO:tasks.cephadm: override: [mon] debug ms = 1 2026-02-13T03:57:47.673 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2026-02-13T03:57:47.673 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2026-02-13T03:57:47.673 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2026-02-13T03:57:47.673 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2026-02-13T03:57:47.673 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2026-02-13T03:57:47.673 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2026-02-13T03:57:47.673 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2026-02-13T03:57:47.673 INFO:tasks.cephadm: override: [osd] debug ms = 1 2026-02-13T03:57:47.673 INFO:tasks.cephadm: override: [osd] debug osd = 20 2026-02-13T03:57:47.673 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2026-02-13T03:57:47.673 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2026-02-13T03:57:47.673 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2026-02-13T03:57:47.673 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2026-02-13T03:57:47.673 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2026-02-13T03:57:47.673 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2026-02-13T03:57:47.673 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2026-02-13T03:57:47.673 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2026-02-13T03:57:47.674 DEBUG:teuthology.orchestra.run.trial092:> set -ex 2026-02-13T03:57:47.674 DEBUG:teuthology.orchestra.run.trial092:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2026-02-13T03:57:47.711 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 1fefccae-0890-11f1-bcc5-d404e6e7d460 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd mclock skip benchmark = true osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client_fscrypt_dummy_encryption = True fuse default permissions = False fuse set user groups = True [mds] mds_bal_replicate_threshold = 1 2026-02-13T03:57:47.711 DEBUG:teuthology.orchestra.run.trial092:mon.a> sudo journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mon.a.service 2026-02-13T03:57:47.754 DEBUG:teuthology.orchestra.run.trial092:mgr.x> sudo journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mgr.x.service 2026-02-13T03:57:47.798 INFO:tasks.cephadm:Bootstrapping... 2026-02-13T03:57:47.798 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 -v bootstrap --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 10.20.193.92 --skip-dashboard --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2026-02-13T03:57:47.988 INFO:teuthology.orchestra.run.trial092.stdout:-------------------------------------------------------------------------------- 2026-02-13T03:57:47.988 INFO:teuthology.orchestra.run.trial092.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', '-v', 'bootstrap', '--fsid', '1fefccae-0890-11f1-bcc5-d404e6e7d460', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '10.20.193.92', '--skip-dashboard', '--skip-admin-label'] 2026-02-13T03:57:47.988 INFO:teuthology.orchestra.run.trial092.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2026-02-13T03:57:47.988 INFO:teuthology.orchestra.run.trial092.stdout:Verifying podman|docker is present... 2026-02-13T03:57:48.022 INFO:teuthology.orchestra.run.trial092.stdout:/bin/podman: stdout 5.6.0 2026-02-13T03:57:48.022 INFO:teuthology.orchestra.run.trial092.stdout:Verifying lvm2 is present... 2026-02-13T03:57:48.022 INFO:teuthology.orchestra.run.trial092.stdout:Verifying time synchronization is in place... 2026-02-13T03:57:48.033 INFO:teuthology.orchestra.run.trial092.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-13T03:57:48.033 INFO:teuthology.orchestra.run.trial092.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-13T03:57:48.043 INFO:teuthology.orchestra.run.trial092.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-13T03:57:48.044 INFO:teuthology.orchestra.run.trial092.stdout:systemctl: stdout inactive 2026-02-13T03:57:48.055 INFO:teuthology.orchestra.run.trial092.stdout:systemctl: stdout enabled 2026-02-13T03:57:48.065 INFO:teuthology.orchestra.run.trial092.stdout:systemctl: stdout active 2026-02-13T03:57:48.065 INFO:teuthology.orchestra.run.trial092.stdout:Unit chronyd.service is enabled and running 2026-02-13T03:57:48.066 INFO:teuthology.orchestra.run.trial092.stdout:Repeating the final host check... 2026-02-13T03:57:48.096 INFO:teuthology.orchestra.run.trial092.stdout:/bin/podman: stdout 5.6.0 2026-02-13T03:57:48.096 INFO:teuthology.orchestra.run.trial092.stdout:podman (/bin/podman) version 5.6.0 is present 2026-02-13T03:57:48.096 INFO:teuthology.orchestra.run.trial092.stdout:systemctl is present 2026-02-13T03:57:48.096 INFO:teuthology.orchestra.run.trial092.stdout:lvcreate is present 2026-02-13T03:57:48.106 INFO:teuthology.orchestra.run.trial092.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2026-02-13T03:57:48.106 INFO:teuthology.orchestra.run.trial092.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2026-02-13T03:57:48.117 INFO:teuthology.orchestra.run.trial092.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2026-02-13T03:57:48.117 INFO:teuthology.orchestra.run.trial092.stdout:systemctl: stdout inactive 2026-02-13T03:57:48.129 INFO:teuthology.orchestra.run.trial092.stdout:systemctl: stdout enabled 2026-02-13T03:57:48.138 INFO:teuthology.orchestra.run.trial092.stdout:systemctl: stdout active 2026-02-13T03:57:48.138 INFO:teuthology.orchestra.run.trial092.stdout:Unit chronyd.service is enabled and running 2026-02-13T03:57:48.138 INFO:teuthology.orchestra.run.trial092.stdout:Host looks OK 2026-02-13T03:57:48.138 INFO:teuthology.orchestra.run.trial092.stdout:Cluster fsid: 1fefccae-0890-11f1-bcc5-d404e6e7d460 2026-02-13T03:57:48.139 INFO:teuthology.orchestra.run.trial092.stdout:Acquiring lock 140598725652736 on /run/cephadm/1fefccae-0890-11f1-bcc5-d404e6e7d460.lock 2026-02-13T03:57:48.139 INFO:teuthology.orchestra.run.trial092.stdout:Lock 140598725652736 acquired on /run/cephadm/1fefccae-0890-11f1-bcc5-d404e6e7d460.lock 2026-02-13T03:57:48.139 INFO:teuthology.orchestra.run.trial092.stdout:Verifying IP 10.20.193.92 port 3300 ... 2026-02-13T03:57:48.140 INFO:teuthology.orchestra.run.trial092.stdout:Verifying IP 10.20.193.92 port 6789 ... 2026-02-13T03:57:48.140 INFO:teuthology.orchestra.run.trial092.stdout:Base mon IP(s) is [10.20.193.92:3300, 10.20.193.92:6789], mon addrv is [v2:10.20.193.92:3300,v1:10.20.193.92:6789] 2026-02-13T03:57:48.146 INFO:teuthology.orchestra.run.trial092.stdout:/sbin/ip: stdout default via 10.20.192.1 dev enp1s0f0np0 proto dhcp src 10.20.193.92 metric 100 2026-02-13T03:57:48.146 INFO:teuthology.orchestra.run.trial092.stdout:/sbin/ip: stdout 10.20.192.0/20 dev enp1s0f0np0 proto kernel scope link src 10.20.193.92 metric 100 2026-02-13T03:57:48.151 INFO:teuthology.orchestra.run.trial092.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2026-02-13T03:57:48.152 INFO:teuthology.orchestra.run.trial092.stdout:/sbin/ip: stdout fe80::/64 dev enp1s0f0np0 proto kernel metric 256 pref medium 2026-02-13T03:57:48.157 INFO:teuthology.orchestra.run.trial092.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2026-02-13T03:57:48.157 INFO:teuthology.orchestra.run.trial092.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2026-02-13T03:57:48.157 INFO:teuthology.orchestra.run.trial092.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-13T03:57:48.157 INFO:teuthology.orchestra.run.trial092.stdout:/sbin/ip: stdout 2: enp1s0f0np0: mtu 1500 state UP qlen 1000 2026-02-13T03:57:48.157 INFO:teuthology.orchestra.run.trial092.stdout:/sbin/ip: stdout inet6 fe80::925a:8ff:fe77:5dde/64 scope link proto kernel_ll 2026-02-13T03:57:48.157 INFO:teuthology.orchestra.run.trial092.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2026-02-13T03:57:48.157 INFO:teuthology.orchestra.run.trial092.stdout:Mon IP `10.20.193.92` is in CIDR network `10.20.192.0/20` 2026-02-13T03:57:48.158 INFO:teuthology.orchestra.run.trial092.stdout:Mon IP `10.20.193.92` is in CIDR network `10.20.192.0/20` 2026-02-13T03:57:48.158 INFO:teuthology.orchestra.run.trial092.stdout:Inferred mon public CIDR from local network configuration ['10.20.192.0/20', '10.20.192.0/20'] 2026-02-13T03:57:48.158 INFO:teuthology.orchestra.run.trial092.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2026-02-13T03:57:48.158 INFO:teuthology.orchestra.run.trial092.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10... 2026-02-13T03:57:48.405 INFO:teuthology.orchestra.run.trial092.stdout:/bin/podman: stdout b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da 2026-02-13T03:57:48.405 INFO:teuthology.orchestra.run.trial092.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10... 2026-02-13T03:57:48.406 INFO:teuthology.orchestra.run.trial092.stdout:/bin/podman: stderr Getting image source signatures 2026-02-13T03:57:48.406 INFO:teuthology.orchestra.run.trial092.stdout:/bin/podman: stderr Copying blob sha256:9b7325f35ad40fc8a795fce82955bc486ff370c187eaa160f4df65d0fb22f2a2 2026-02-13T03:57:48.406 INFO:teuthology.orchestra.run.trial092.stdout:/bin/podman: stderr Copying blob sha256:0c53e9fad0324c188a40a9b1e0ca4eb777da2812507ec104055fa6ec400d9a27 2026-02-13T03:57:48.406 INFO:teuthology.orchestra.run.trial092.stdout:/bin/podman: stderr Copying config sha256:b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da 2026-02-13T03:57:48.406 INFO:teuthology.orchestra.run.trial092.stdout:/bin/podman: stderr Writing manifest to image destination 2026-02-13T03:57:48.655 INFO:teuthology.orchestra.run.trial092.stdout:ceph: stdout ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev) 2026-02-13T03:57:48.655 INFO:teuthology.orchestra.run.trial092.stdout:Ceph version: ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev) 2026-02-13T03:57:48.655 INFO:teuthology.orchestra.run.trial092.stdout:Extracting ceph user uid/gid from container image... 2026-02-13T03:57:48.822 INFO:teuthology.orchestra.run.trial092.stdout:stat: stdout 167 167 2026-02-13T03:57:48.822 INFO:teuthology.orchestra.run.trial092.stdout:Creating initial keys... 2026-02-13T03:57:49.067 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph-authtool: stdout AQA8oY5pBLaMORAA8+4QnLrcpWwnPe8a/TlB+g== 2026-02-13T03:57:49.298 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph-authtool: stdout AQA9oY5pGWACDBAAXAhJqeiHbDvCFd6qGC/06Q== 2026-02-13T03:57:49.522 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph-authtool: stdout AQA9oY5pcW47GRAAJf5NTSGv79n2sjzVoADeRQ== 2026-02-13T03:57:49.523 INFO:teuthology.orchestra.run.trial092.stdout:Creating initial monmap... 2026-02-13T03:57:49.766 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-13T03:57:49.766 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = tentacle 2026-02-13T03:57:49.766 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 1fefccae-0890-11f1-bcc5-d404e6e7d460 2026-02-13T03:57:49.767 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-13T03:57:49.767 INFO:teuthology.orchestra.run.trial092.stdout:monmaptool for a [v2:10.20.193.92:3300,v1:10.20.193.92:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2026-02-13T03:57:49.767 INFO:teuthology.orchestra.run.trial092.stdout:setting min_mon_release = tentacle 2026-02-13T03:57:49.767 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/monmaptool: set fsid to 1fefccae-0890-11f1-bcc5-d404e6e7d460 2026-02-13T03:57:49.767 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2026-02-13T03:57:49.767 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T03:57:49.767 INFO:teuthology.orchestra.run.trial092.stdout:Creating mon... 2026-02-13T03:57:49.980 INFO:teuthology.orchestra.run.trial092.stdout:create mon.a on 2026-02-13T03:57:50.235 INFO:teuthology.orchestra.run.trial092.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2026-02-13T03:57:50.415 INFO:teuthology.orchestra.run.trial092.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2026-02-13T03:57:50.606 INFO:teuthology.orchestra.run.trial092.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460.target → /etc/systemd/system/ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460.target. 2026-02-13T03:57:50.606 INFO:teuthology.orchestra.run.trial092.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460.target → /etc/systemd/system/ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460.target. 2026-02-13T03:57:50.823 INFO:teuthology.orchestra.run.trial092.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mon.a 2026-02-13T03:57:50.823 INFO:teuthology.orchestra.run.trial092.stdout:systemctl: stderr Failed to reset failed state of unit ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mon.a.service: Unit ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mon.a.service not loaded. 2026-02-13T03:57:51.050 INFO:teuthology.orchestra.run.trial092.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460.target.wants/ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mon.a.service → /etc/systemd/system/ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@.service. 2026-02-13T03:57:51.326 INFO:teuthology.orchestra.run.trial092.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-13T03:57:51.326 INFO:teuthology.orchestra.run.trial092.stdout:systemctl: stdout disabled 2026-02-13T03:57:51.337 INFO:teuthology.orchestra.run.trial092.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-13T03:57:51.337 INFO:teuthology.orchestra.run.trial092.stdout:systemctl: stdout inactive 2026-02-13T03:57:51.337 INFO:teuthology.orchestra.run.trial092.stdout:firewalld.service is not enabled 2026-02-13T03:57:51.337 INFO:teuthology.orchestra.run.trial092.stdout:Not possible to enable service . firewalld.service is not available 2026-02-13T03:57:51.338 INFO:teuthology.orchestra.run.trial092.stdout:Waiting for mon to start... 2026-02-13T03:57:51.338 INFO:teuthology.orchestra.run.trial092.stdout:Waiting for mon... 2026-02-13T03:57:51.383 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:51 trial092 ceph-mon[22691]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-13T03:57:51.635 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout cluster: 2026-02-13T03:57:51.637 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout id: 1fefccae-0890-11f1-bcc5-d404e6e7d460 2026-02-13T03:57:51.637 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2026-02-13T03:57:51.637 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout 2026-02-13T03:57:51.637 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout services: 2026-02-13T03:57:51.637 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.217493s) [leader: a] 2026-02-13T03:57:51.637 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2026-02-13T03:57:51.637 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2026-02-13T03:57:51.637 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout 2026-02-13T03:57:51.637 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout data: 2026-02-13T03:57:51.638 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2026-02-13T03:57:51.638 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2026-02-13T03:57:51.638 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2026-02-13T03:57:51.638 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout pgs: 2026-02-13T03:57:51.638 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout 2026-02-13T03:57:51.638 INFO:teuthology.orchestra.run.trial092.stdout:mon is available 2026-02-13T03:57:51.638 INFO:teuthology.orchestra.run.trial092.stdout:Assimilating anything we can from ceph.conf... 2026-02-13T03:57:51.929 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout 2026-02-13T03:57:51.929 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout [global] 2026-02-13T03:57:51.929 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout fsid = 1fefccae-0890-11f1-bcc5-d404e6e7d460 2026-02-13T03:57:51.929 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-13T03:57:51.930 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.92:3300,v1:10.20.193.92:6789] 2026-02-13T03:57:51.930 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-13T03:57:51.930 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-13T03:57:51.930 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-13T03:57:51.930 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-13T03:57:51.930 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout 2026-02-13T03:57:51.930 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-13T03:57:51.930 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-13T03:57:51.930 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout 2026-02-13T03:57:51.930 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout [osd] 2026-02-13T03:57:51.930 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2026-02-13T03:57:51.930 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2026-02-13T03:57:51.931 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2026-02-13T03:57:51.931 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-13T03:57:51.931 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-13T03:57:51.931 INFO:teuthology.orchestra.run.trial092.stdout:Generating new minimal ceph.conf... 2026-02-13T03:57:52.255 INFO:teuthology.orchestra.run.trial092.stdout:Restarting the monitor... 2026-02-13T03:57:52.564 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:52 trial092 systemd[1]: Stopping Ceph mon.a for 1fefccae-0890-11f1-bcc5-d404e6e7d460... 2026-02-13T03:57:52.565 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:52 trial092 ceph-mon[22691]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-13T03:57:52.565 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:52 trial092 ceph-mon[22691]: monmap epoch 1 2026-02-13T03:57:52.565 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:52 trial092 ceph-mon[22691]: fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 2026-02-13T03:57:52.565 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:52 trial092 ceph-mon[22691]: last_changed 2026-02-13T03:57:49.665673+0000 2026-02-13T03:57:52.565 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:52 trial092 ceph-mon[22691]: created 2026-02-13T03:57:49.665673+0000 2026-02-13T03:57:52.565 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:52 trial092 ceph-mon[22691]: min_mon_release 20 (tentacle) 2026-02-13T03:57:52.565 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:52 trial092 ceph-mon[22691]: election_strategy: 1 2026-02-13T03:57:52.565 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:52 trial092 ceph-mon[22691]: 0: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.a 2026-02-13T03:57:52.565 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:52 trial092 ceph-mon[22691]: fsmap 2026-02-13T03:57:52.565 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:52 trial092 ceph-mon[22691]: osdmap e1: 0 total, 0 up, 0 in 2026-02-13T03:57:52.565 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:52 trial092 ceph-mon[22691]: mgrmap e1: no daemons active 2026-02-13T03:57:52.566 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:52 trial092 ceph-mon[22691]: from='client.? 10.20.193.92:0/2945018338' entity='client.admin' cmd={"prefix": "status"} : dispatch 2026-02-13T03:57:52.566 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:52 trial092 ceph-mon[22691]: from='client.? 10.20.193.92:0/123476997' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2026-02-13T03:57:52.566 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:52 trial092 ceph-mon[22691]: from='client.? 10.20.193.92:0/123476997' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2026-02-13T03:57:52.566 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:52 trial092 ceph-mon[22691]: from='client.? 10.20.193.92:0/899756128' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:57:52.566 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:52 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mon-a[22687]: 2026-02-13T03:57:52.388+0000 7f8eb163e6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T03:57:52.566 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:52 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mon-a[22687]: 2026-02-13T03:57:52.388+0000 7f8eb163e6c0 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2026-02-13T03:57:52.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:52 trial092 podman[22930]: 2026-02-13 03:57:52.562392113 +0000 UTC m=+0.195753493 container died 8567914c5d2aa38aed818a97fee52516365490ba5f0db54d3ef52a0121dce7bc (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mon-a, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, license=BSD-3-Clause, summary=Rocky Linux Base image, version=10, OSD_FLAVOR=default, ceph=True, io.buildah.version=1.33.7, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation) 2026-02-13T03:57:52.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:52 trial092 podman[22930]: 2026-02-13 03:57:52.623877867 +0000 UTC m=+0.257239247 container remove 8567914c5d2aa38aed818a97fee52516365490ba5f0db54d3ef52a0121dce7bc (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mon-a, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, license=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, OSD_FLAVOR=default, summary=Rocky Linux Base image, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , version=10, name=rockylinux, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-13T03:57:52.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:52 trial092 bash[22930]: ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mon-a 2026-02-13T03:57:52.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:52 trial092 systemd[1]: ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mon.a.service: Deactivated successfully. 2026-02-13T03:57:52.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:52 trial092 systemd[1]: Stopped Ceph mon.a for 1fefccae-0890-11f1-bcc5-d404e6e7d460. 2026-02-13T03:57:52.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:52 trial092 systemd[1]: Starting Ceph mon.a for 1fefccae-0890-11f1-bcc5-d404e6e7d460... 2026-02-13T03:57:53.189 INFO:teuthology.orchestra.run.trial092.stdout:Setting public_network to 10.20.192.0/20 in global config section 2026-02-13T03:57:53.273 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 podman[23027]: 2026-02-13 03:57:52.911270011 +0000 UTC m=+0.018550082 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 2026-02-13T03:57:53.273 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 podman[23027]: 2026-02-13 03:57:53.092029402 +0000 UTC m=+0.199309462 container create da16d12499066fcd05f665c57cbb4a9be18c294971f953c482a38d1507613870 (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mon-a, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, summary=Rocky Linux Base image, OSD_FLAVOR=default, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , vendor=Rocky Enterprise Software Foundation, version=10, io.buildah.version=1.33.7, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.version=10, name=rockylinux) 2026-02-13T03:57:53.273 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 podman[23027]: 2026-02-13 03:57:53.170725594 +0000 UTC m=+0.278005664 container init da16d12499066fcd05f665c57cbb4a9be18c294971f953c482a38d1507613870 (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mon-a, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, name=rockylinux, ceph=True, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-pdonnell-testing-20260210.171210, OSD_FLAVOR=default, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, io.buildah.version=1.33.7, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, vendor=Rocky Enterprise Software Foundation, version=10, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-13T03:57:53.273 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 podman[23027]: 2026-02-13 03:57:53.175616637 +0000 UTC m=+0.282896707 container start da16d12499066fcd05f665c57cbb4a9be18c294971f953c482a38d1507613870 (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mon-a, version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-pdonnell-testing-20260210.171210, summary=Rocky Linux Base image, license=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, name=rockylinux, ceph=True, OSD_FLAVOR=default, io.buildah.version=1.33.7, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f) 2026-02-13T03:57:53.274 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 bash[23027]: da16d12499066fcd05f665c57cbb4a9be18c294971f953c482a38d1507613870 2026-02-13T03:57:53.274 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 systemd[1]: Started Ceph mon.a for 1fefccae-0890-11f1-bcc5-d404e6e7d460. 2026-02-13T03:57:53.274 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: set uid:gid to 167:167 (ceph:ceph) 2026-02-13T03:57:53.274 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: ceph version 20.3.0-5241-g8f8d3829 (8f8d38294e4db8750b4b1649f62ce37caa63080f) tentacle (dev - RelWithDebInfo), process ceph-mon, pid 2 2026-02-13T03:57:53.274 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: pidfile_write: ignore empty --pid-file 2026-02-13T03:57:53.274 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: load: jerasure load: lrc 2026-02-13T03:57:53.274 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: RocksDB version: 7.9.2 2026-02-13T03:57:53.274 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Git sha 0 2026-02-13T03:57:53.274 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Compile date 2026-02-10 21:31:46 2026-02-13T03:57:53.274 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: DB SUMMARY 2026-02-13T03:57:53.274 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: DB Session ID: UTSR1MHN6EEOVBVH6QRO 2026-02-13T03:57:53.274 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: CURRENT file: CURRENT 2026-02-13T03:57:53.275 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: IDENTITY file: IDENTITY 2026-02-13T03:57:53.275 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2026-02-13T03:57:53.275 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2026-02-13T03:57:53.275 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 96719 ; 2026-02-13T03:57:53.275 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.error_if_exists: 0 2026-02-13T03:57:53.275 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.create_if_missing: 0 2026-02-13T03:57:53.275 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.paranoid_checks: 1 2026-02-13T03:57:53.275 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.flush_verify_memtable_count: 1 2026-02-13T03:57:53.275 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2026-02-13T03:57:53.275 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2026-02-13T03:57:53.275 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.env: 0x55a510d602c0 2026-02-13T03:57:53.275 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.fs: PosixFileSystem 2026-02-13T03:57:53.275 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.info_log: 0x55a544608ee0 2026-02-13T03:57:53.276 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.max_file_opening_threads: 16 2026-02-13T03:57:53.276 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.statistics: (nil) 2026-02-13T03:57:53.276 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.use_fsync: 0 2026-02-13T03:57:53.276 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.max_log_file_size: 0 2026-02-13T03:57:53.276 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.max_manifest_file_size: 1073741824 2026-02-13T03:57:53.276 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.log_file_time_to_roll: 0 2026-02-13T03:57:53.276 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.keep_log_file_num: 1000 2026-02-13T03:57:53.276 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.recycle_log_file_num: 0 2026-02-13T03:57:53.276 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.allow_fallocate: 1 2026-02-13T03:57:53.276 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.allow_mmap_reads: 0 2026-02-13T03:57:53.276 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.allow_mmap_writes: 0 2026-02-13T03:57:53.276 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.use_direct_reads: 0 2026-02-13T03:57:53.276 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2026-02-13T03:57:53.277 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.create_missing_column_families: 0 2026-02-13T03:57:53.277 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.db_log_dir: 2026-02-13T03:57:53.277 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.wal_dir: 2026-02-13T03:57:53.277 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.table_cache_numshardbits: 6 2026-02-13T03:57:53.277 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.WAL_ttl_seconds: 0 2026-02-13T03:57:53.277 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.WAL_size_limit_MB: 0 2026-02-13T03:57:53.277 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2026-02-13T03:57:53.277 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.manifest_preallocation_size: 4194304 2026-02-13T03:57:53.277 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.is_fd_close_on_exec: 1 2026-02-13T03:57:53.277 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.advise_random_on_open: 1 2026-02-13T03:57:53.277 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.db_write_buffer_size: 0 2026-02-13T03:57:53.277 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.write_buffer_manager: 0x55a5445ffb80 2026-02-13T03:57:53.278 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.access_hint_on_compaction_start: 1 2026-02-13T03:57:53.278 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.random_access_max_buffer_size: 1048576 2026-02-13T03:57:53.278 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.use_adaptive_mutex: 0 2026-02-13T03:57:53.278 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.rate_limiter: (nil) 2026-02-13T03:57:53.278 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2026-02-13T03:57:53.278 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.wal_recovery_mode: 2 2026-02-13T03:57:53.278 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.enable_thread_tracking: 0 2026-02-13T03:57:53.278 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.enable_pipelined_write: 0 2026-02-13T03:57:53.278 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.unordered_write: 0 2026-02-13T03:57:53.278 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.allow_concurrent_memtable_write: 1 2026-02-13T03:57:53.278 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2026-02-13T03:57:53.278 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.write_thread_max_yield_usec: 100 2026-02-13T03:57:53.278 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.write_thread_slow_yield_usec: 3 2026-02-13T03:57:53.279 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.row_cache: None 2026-02-13T03:57:53.279 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.wal_filter: None 2026-02-13T03:57:53.279 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.avoid_flush_during_recovery: 0 2026-02-13T03:57:53.279 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.allow_ingest_behind: 0 2026-02-13T03:57:53.279 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.two_write_queues: 0 2026-02-13T03:57:53.279 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.manual_wal_flush: 0 2026-02-13T03:57:53.279 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.wal_compression: 0 2026-02-13T03:57:53.279 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.atomic_flush: 0 2026-02-13T03:57:53.279 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2026-02-13T03:57:53.279 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.persist_stats_to_disk: 0 2026-02-13T03:57:53.279 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.write_dbid_to_manifest: 0 2026-02-13T03:57:53.279 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.log_readahead_size: 0 2026-02-13T03:57:53.279 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.file_checksum_gen_factory: Unknown 2026-02-13T03:57:53.279 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.best_efforts_recovery: 0 2026-02-13T03:57:53.280 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2026-02-13T03:57:53.280 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2026-02-13T03:57:53.280 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.allow_data_in_errors: 0 2026-02-13T03:57:53.280 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.db_host_id: __hostname__ 2026-02-13T03:57:53.280 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.enforce_single_del_contracts: true 2026-02-13T03:57:53.280 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.max_background_jobs: 2 2026-02-13T03:57:53.280 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.max_background_compactions: -1 2026-02-13T03:57:53.280 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.max_subcompactions: 1 2026-02-13T03:57:53.280 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.avoid_flush_during_shutdown: 0 2026-02-13T03:57:53.280 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2026-02-13T03:57:53.280 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.delayed_write_rate : 16777216 2026-02-13T03:57:53.280 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.max_total_wal_size: 0 2026-02-13T03:57:53.280 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2026-02-13T03:57:53.281 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.stats_dump_period_sec: 600 2026-02-13T03:57:53.281 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.stats_persist_period_sec: 600 2026-02-13T03:57:53.281 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.stats_history_buffer_size: 1048576 2026-02-13T03:57:53.281 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.max_open_files: -1 2026-02-13T03:57:53.281 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.bytes_per_sync: 0 2026-02-13T03:57:53.281 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.wal_bytes_per_sync: 0 2026-02-13T03:57:53.281 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.strict_bytes_per_sync: 0 2026-02-13T03:57:53.281 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.compaction_readahead_size: 0 2026-02-13T03:57:53.281 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.max_background_flushes: -1 2026-02-13T03:57:53.281 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Compression algorithms supported: 2026-02-13T03:57:53.281 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: kZSTD supported: 0 2026-02-13T03:57:53.281 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: kXpressCompression supported: 0 2026-02-13T03:57:53.281 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: kBZip2Compression supported: 0 2026-02-13T03:57:53.282 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: kZSTDNotFinalCompression supported: 0 2026-02-13T03:57:53.282 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: kLZ4Compression supported: 1 2026-02-13T03:57:53.282 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: kZlibCompression supported: 1 2026-02-13T03:57:53.282 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: kLZ4HCCompression supported: 1 2026-02-13T03:57:53.282 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: kSnappyCompression supported: 1 2026-02-13T03:57:53.282 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Fast CRC32 supported: Supported on x86 2026-02-13T03:57:53.282 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: DMutex implementation: pthread_mutex_t 2026-02-13T03:57:53.282 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2026-02-13T03:57:53.282 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2026-02-13T03:57:53.282 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2026-02-13T03:57:53.282 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.merge_operator: 2026-02-13T03:57:53.282 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.compaction_filter: None 2026-02-13T03:57:53.282 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.compaction_filter_factory: None 2026-02-13T03:57:53.283 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.sst_partitioner_factory: None 2026-02-13T03:57:53.283 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.memtable_factory: SkipListFactory 2026-02-13T03:57:53.283 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.table_factory: BlockBasedTable 2026-02-13T03:57:53.283 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a5447883e0) 2026-02-13T03:57:53.283 INFO:journalctl@ceph.mon.a.trial092.stdout: cache_index_and_filter_blocks: 1 2026-02-13T03:57:53.283 INFO:journalctl@ceph.mon.a.trial092.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2026-02-13T03:57:53.283 INFO:journalctl@ceph.mon.a.trial092.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2026-02-13T03:57:53.283 INFO:journalctl@ceph.mon.a.trial092.stdout: pin_top_level_index_and_filter: 1 2026-02-13T03:57:53.283 INFO:journalctl@ceph.mon.a.trial092.stdout: index_type: 0 2026-02-13T03:57:53.283 INFO:journalctl@ceph.mon.a.trial092.stdout: data_block_index_type: 0 2026-02-13T03:57:53.283 INFO:journalctl@ceph.mon.a.trial092.stdout: index_shortening: 1 2026-02-13T03:57:53.283 INFO:journalctl@ceph.mon.a.trial092.stdout: data_block_hash_table_util_ratio: 0.750000 2026-02-13T03:57:53.283 INFO:journalctl@ceph.mon.a.trial092.stdout: checksum: 4 2026-02-13T03:57:53.284 INFO:journalctl@ceph.mon.a.trial092.stdout: no_block_cache: 0 2026-02-13T03:57:53.284 INFO:journalctl@ceph.mon.a.trial092.stdout: block_cache: 0x55a544601690 2026-02-13T03:57:53.284 INFO:journalctl@ceph.mon.a.trial092.stdout: block_cache_name: BinnedLRUCache 2026-02-13T03:57:53.284 INFO:journalctl@ceph.mon.a.trial092.stdout: block_cache_options: 2026-02-13T03:57:53.284 INFO:journalctl@ceph.mon.a.trial092.stdout: capacity : 536870912 2026-02-13T03:57:53.284 INFO:journalctl@ceph.mon.a.trial092.stdout: num_shard_bits : 4 2026-02-13T03:57:53.284 INFO:journalctl@ceph.mon.a.trial092.stdout: strict_capacity_limit : 0 2026-02-13T03:57:53.284 INFO:journalctl@ceph.mon.a.trial092.stdout: high_pri_pool_ratio: 0.000 2026-02-13T03:57:53.284 INFO:journalctl@ceph.mon.a.trial092.stdout: block_cache_compressed: (nil) 2026-02-13T03:57:53.284 INFO:journalctl@ceph.mon.a.trial092.stdout: persistent_cache: (nil) 2026-02-13T03:57:53.284 INFO:journalctl@ceph.mon.a.trial092.stdout: block_size: 4096 2026-02-13T03:57:53.284 INFO:journalctl@ceph.mon.a.trial092.stdout: block_size_deviation: 10 2026-02-13T03:57:53.284 INFO:journalctl@ceph.mon.a.trial092.stdout: block_restart_interval: 16 2026-02-13T03:57:53.285 INFO:journalctl@ceph.mon.a.trial092.stdout: index_block_restart_interval: 1 2026-02-13T03:57:53.285 INFO:journalctl@ceph.mon.a.trial092.stdout: metadata_block_size: 4096 2026-02-13T03:57:53.285 INFO:journalctl@ceph.mon.a.trial092.stdout: partition_filters: 0 2026-02-13T03:57:53.285 INFO:journalctl@ceph.mon.a.trial092.stdout: use_delta_encoding: 1 2026-02-13T03:57:53.285 INFO:journalctl@ceph.mon.a.trial092.stdout: filter_policy: bloomfilter 2026-02-13T03:57:53.285 INFO:journalctl@ceph.mon.a.trial092.stdout: whole_key_filtering: 1 2026-02-13T03:57:53.285 INFO:journalctl@ceph.mon.a.trial092.stdout: verify_compression: 0 2026-02-13T03:57:53.285 INFO:journalctl@ceph.mon.a.trial092.stdout: read_amp_bytes_per_bit: 0 2026-02-13T03:57:53.285 INFO:journalctl@ceph.mon.a.trial092.stdout: format_version: 5 2026-02-13T03:57:53.285 INFO:journalctl@ceph.mon.a.trial092.stdout: enable_index_compression: 1 2026-02-13T03:57:53.285 INFO:journalctl@ceph.mon.a.trial092.stdout: block_align: 0 2026-02-13T03:57:53.285 INFO:journalctl@ceph.mon.a.trial092.stdout: max_auto_readahead_size: 262144 2026-02-13T03:57:53.285 INFO:journalctl@ceph.mon.a.trial092.stdout: prepopulate_block_cache: 0 2026-02-13T03:57:53.286 INFO:journalctl@ceph.mon.a.trial092.stdout: initial_auto_readahead_size: 8192 2026-02-13T03:57:53.286 INFO:journalctl@ceph.mon.a.trial092.stdout: num_file_reads_for_auto_readahead: 2 2026-02-13T03:57:53.286 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.write_buffer_size: 33554432 2026-02-13T03:57:53.286 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.max_write_buffer_number: 2 2026-02-13T03:57:53.286 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.compression: NoCompression 2026-02-13T03:57:53.286 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.bottommost_compression: Disabled 2026-02-13T03:57:53.286 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.prefix_extractor: nullptr 2026-02-13T03:57:53.286 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2026-02-13T03:57:53.286 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.num_levels: 7 2026-02-13T03:57:53.286 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2026-02-13T03:57:53.286 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2026-02-13T03:57:53.286 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2026-02-13T03:57:53.286 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2026-02-13T03:57:53.287 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.bottommost_compression_opts.level: 32767 2026-02-13T03:57:53.287 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2026-02-13T03:57:53.287 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2026-02-13T03:57:53.287 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2026-02-13T03:57:53.287 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2026-02-13T03:57:53.287 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.bottommost_compression_opts.enabled: false 2026-02-13T03:57:53.287 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2026-02-13T03:57:53.287 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2026-02-13T03:57:53.287 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.compression_opts.window_bits: -14 2026-02-13T03:57:53.287 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.compression_opts.level: 32767 2026-02-13T03:57:53.287 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.compression_opts.strategy: 0 2026-02-13T03:57:53.287 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2026-02-13T03:57:53.287 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2026-02-13T03:57:53.287 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2026-02-13T03:57:53.288 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.compression_opts.parallel_threads: 1 2026-02-13T03:57:53.288 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.compression_opts.enabled: false 2026-02-13T03:57:53.288 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2026-02-13T03:57:53.288 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2026-02-13T03:57:53.288 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2026-02-13T03:57:53.288 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.level0_stop_writes_trigger: 36 2026-02-13T03:57:53.288 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.target_file_size_base: 67108864 2026-02-13T03:57:53.288 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.target_file_size_multiplier: 1 2026-02-13T03:57:53.288 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.max_bytes_for_level_base: 268435456 2026-02-13T03:57:53.288 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2026-02-13T03:57:53.288 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2026-02-13T03:57:53.288 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2026-02-13T03:57:53.288 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2026-02-13T03:57:53.289 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2026-02-13T03:57:53.289 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2026-02-13T03:57:53.289 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2026-02-13T03:57:53.289 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2026-02-13T03:57:53.289 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2026-02-13T03:57:53.289 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2026-02-13T03:57:53.289 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.max_compaction_bytes: 1677721600 2026-02-13T03:57:53.289 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2026-02-13T03:57:53.289 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.arena_block_size: 1048576 2026-02-13T03:57:53.289 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2026-02-13T03:57:53.289 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2026-02-13T03:57:53.289 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.disable_auto_compactions: 0 2026-02-13T03:57:53.289 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2026-02-13T03:57:53.290 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2026-02-13T03:57:53.290 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2026-02-13T03:57:53.290 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2026-02-13T03:57:53.290 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2026-02-13T03:57:53.290 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2026-02-13T03:57:53.290 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2026-02-13T03:57:53.290 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2026-02-13T03:57:53.290 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2026-02-13T03:57:53.290 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2026-02-13T03:57:53.290 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2026-02-13T03:57:53.290 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.inplace_update_support: 0 2026-02-13T03:57:53.290 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.inplace_update_num_locks: 10000 2026-02-13T03:57:53.290 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2026-02-13T03:57:53.291 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.memtable_whole_key_filtering: 0 2026-02-13T03:57:53.291 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.memtable_huge_page_size: 0 2026-02-13T03:57:53.291 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.bloom_locality: 0 2026-02-13T03:57:53.291 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.max_successive_merges: 0 2026-02-13T03:57:53.291 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.optimize_filters_for_hits: 0 2026-02-13T03:57:53.291 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.paranoid_file_checks: 0 2026-02-13T03:57:53.291 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.force_consistency_checks: 1 2026-02-13T03:57:53.291 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.report_bg_io_stats: 0 2026-02-13T03:57:53.291 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.ttl: 2592000 2026-02-13T03:57:53.291 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.periodic_compaction_seconds: 0 2026-02-13T03:57:53.291 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.preclude_last_level_data_seconds: 0 2026-02-13T03:57:53.291 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.preserve_internal_time_seconds: 0 2026-02-13T03:57:53.291 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.enable_blob_files: false 2026-02-13T03:57:53.292 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.min_blob_size: 0 2026-02-13T03:57:53.292 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.blob_file_size: 268435456 2026-02-13T03:57:53.292 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.blob_compression_type: NoCompression 2026-02-13T03:57:53.292 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.enable_blob_garbage_collection: false 2026-02-13T03:57:53.292 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2026-02-13T03:57:53.292 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2026-02-13T03:57:53.292 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.blob_compaction_readahead_size: 0 2026-02-13T03:57:53.292 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.blob_file_starting_level: 0 2026-02-13T03:57:53.292 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2026-02-13T03:57:53.292 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2026-02-13T03:57:53.292 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2026-02-13T03:57:53.292 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 5a8f6a85-bd2d-4631-8a16-703e85e86064 2026-02-13T03:57:53.292 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: EVENT_LOG_v1 {"time_micros": 1770955073207421, "job": 1, "event": "recovery_started", "wal_files": [9]} 2026-02-13T03:57:53.293 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2026-02-13T03:57:53.293 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: EVENT_LOG_v1 {"time_micros": 1770955073208532, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 92992, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 280, "table_properties": {"data_size": 91039, "index_size": 274, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 12096, "raw_average_key_size": 48, "raw_value_size": 84253, "raw_average_value_size": 341, "num_data_blocks": 12, "num_entries": 247, "num_filter_entries": 247, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1770955073, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "5a8f6a85-bd2d-4631-8a16-703e85e86064", "db_session_id": "UTSR1MHN6EEOVBVH6QRO", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2026-02-13T03:57:53.293 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: EVENT_LOG_v1 {"time_micros": 1770955073208645, "job": 1, "event": "recovery_finished"} 2026-02-13T03:57:53.293 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2026-02-13T03:57:53.293 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2026-02-13T03:57:53.293 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55a544624e00 2026-02-13T03:57:53.293 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: DB pointer 0x55a54542e000 2026-02-13T03:57:53.293 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2026-02-13T03:57:53.293 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: rocksdb: [db/db_impl/db_impl.cc:1111] 2026-02-13T03:57:53.293 INFO:journalctl@ceph.mon.a.trial092.stdout: ** DB Stats ** 2026-02-13T03:57:53.293 INFO:journalctl@ceph.mon.a.trial092.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-13T03:57:53.293 INFO:journalctl@ceph.mon.a.trial092.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2026-02-13T03:57:53.294 INFO:journalctl@ceph.mon.a.trial092.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-13T03:57:53.294 INFO:journalctl@ceph.mon.a.trial092.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-13T03:57:53.294 INFO:journalctl@ceph.mon.a.trial092.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2026-02-13T03:57:53.294 INFO:journalctl@ceph.mon.a.trial092.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2026-02-13T03:57:53.294 INFO:journalctl@ceph.mon.a.trial092.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2026-02-13T03:57:53.294 INFO:journalctl@ceph.mon.a.trial092.stdout: 2026-02-13T03:57:53.294 INFO:journalctl@ceph.mon.a.trial092.stdout: ** Compaction Stats [default] ** 2026-02-13T03:57:53.294 INFO:journalctl@ceph.mon.a.trial092.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-13T03:57:53.294 INFO:journalctl@ceph.mon.a.trial092.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2026-02-13T03:57:53.294 INFO:journalctl@ceph.mon.a.trial092.stdout: L0 2/0 92.68 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 119.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-13T03:57:53.294 INFO:journalctl@ceph.mon.a.trial092.stdout: Sum 2/0 92.68 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 119.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-13T03:57:53.294 INFO:journalctl@ceph.mon.a.trial092.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 119.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-13T03:57:53.295 INFO:journalctl@ceph.mon.a.trial092.stdout: 2026-02-13T03:57:53.295 INFO:journalctl@ceph.mon.a.trial092.stdout: ** Compaction Stats [default] ** 2026-02-13T03:57:53.295 INFO:journalctl@ceph.mon.a.trial092.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2026-02-13T03:57:53.295 INFO:journalctl@ceph.mon.a.trial092.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2026-02-13T03:57:53.295 INFO:journalctl@ceph.mon.a.trial092.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 119.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2026-02-13T03:57:53.295 INFO:journalctl@ceph.mon.a.trial092.stdout: 2026-02-13T03:57:53.295 INFO:journalctl@ceph.mon.a.trial092.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2026-02-13T03:57:53.295 INFO:journalctl@ceph.mon.a.trial092.stdout: 2026-02-13T03:57:53.295 INFO:journalctl@ceph.mon.a.trial092.stdout: Uptime(secs): 0.0 total, 0.0 interval 2026-02-13T03:57:53.295 INFO:journalctl@ceph.mon.a.trial092.stdout: Flush(GB): cumulative 0.000, interval 0.000 2026-02-13T03:57:53.295 INFO:journalctl@ceph.mon.a.trial092.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2026-02-13T03:57:53.296 INFO:journalctl@ceph.mon.a.trial092.stdout: AddFile(Total Files): cumulative 0, interval 0 2026-02-13T03:57:53.296 INFO:journalctl@ceph.mon.a.trial092.stdout: AddFile(L0 Files): cumulative 0, interval 0 2026-02-13T03:57:53.296 INFO:journalctl@ceph.mon.a.trial092.stdout: AddFile(Keys): cumulative 0, interval 0 2026-02-13T03:57:53.296 INFO:journalctl@ceph.mon.a.trial092.stdout: Cumulative compaction: 0.00 GB write, 19.14 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-13T03:57:53.296 INFO:journalctl@ceph.mon.a.trial092.stdout: Interval compaction: 0.00 GB write, 19.14 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2026-02-13T03:57:53.296 INFO:journalctl@ceph.mon.a.trial092.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2026-02-13T03:57:53.296 INFO:journalctl@ceph.mon.a.trial092.stdout: Block cache BinnedLRUCache@0x55a544601690#2 capacity: 512.00 MB usage: 1.30 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2026-02-13T03:57:53.296 INFO:journalctl@ceph.mon.a.trial092.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2026-02-13T03:57:53.296 INFO:journalctl@ceph.mon.a.trial092.stdout: 2026-02-13T03:57:53.296 INFO:journalctl@ceph.mon.a.trial092.stdout: ** File Read Latency Histogram By Level [default] ** 2026-02-13T03:57:53.296 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: starting mon.a rank 0 at public addrs [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] at bind addrs [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 2026-02-13T03:57:53.296 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: mon.a@-1(???) e1 preinit fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 2026-02-13T03:57:53.296 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: mon.a@-1(???).mds e1 new map 2026-02-13T03:57:53.297 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: mon.a@-1(???).mds e1 print_map 2026-02-13T03:57:53.297 INFO:journalctl@ceph.mon.a.trial092.stdout: e1 2026-02-13T03:57:53.297 INFO:journalctl@ceph.mon.a.trial092.stdout: btime 2026-02-13T03:57:51:342626+0000 2026-02-13T03:57:53.297 INFO:journalctl@ceph.mon.a.trial092.stdout: enable_multiple, ever_enabled_multiple: 1,1 2026-02-13T03:57:53.297 INFO:journalctl@ceph.mon.a.trial092.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2026-02-13T03:57:53.297 INFO:journalctl@ceph.mon.a.trial092.stdout: legacy client fscid: -1 2026-02-13T03:57:53.297 INFO:journalctl@ceph.mon.a.trial092.stdout: 2026-02-13T03:57:53.297 INFO:journalctl@ceph.mon.a.trial092.stdout: No filesystems configured 2026-02-13T03:57:53.297 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2026-02-13T03:57:53.297 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-13T03:57:53.297 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-13T03:57:53.297 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2026-02-13T03:57:53.298 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2026-02-13T03:57:53.298 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: mon.a is new leader, mons a in quorum (ranks 0) 2026-02-13T03:57:53.298 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: monmap epoch 1 2026-02-13T03:57:53.298 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 2026-02-13T03:57:53.298 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: last_changed 2026-02-13T03:57:49.665673+0000 2026-02-13T03:57:53.298 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: created 2026-02-13T03:57:49.665673+0000 2026-02-13T03:57:53.298 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: min_mon_release 20 (tentacle) 2026-02-13T03:57:53.298 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: election_strategy: 1 2026-02-13T03:57:53.298 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: 0: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.a 2026-02-13T03:57:53.298 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: fsmap 2026-02-13T03:57:53.298 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: osdmap e1: 0 total, 0 up, 0 in 2026-02-13T03:57:53.298 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:53 trial092 ceph-mon[23047]: mgrmap e1: no daemons active 2026-02-13T03:57:53.702 INFO:teuthology.orchestra.run.trial092.stdout:Wrote config to /etc/ceph/ceph.conf 2026-02-13T03:57:53.703 INFO:teuthology.orchestra.run.trial092.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2026-02-13T03:57:53.703 INFO:teuthology.orchestra.run.trial092.stdout:Creating mgr... 2026-02-13T03:57:53.704 INFO:teuthology.orchestra.run.trial092.stdout:Verifying port 0.0.0.0:9283 ... 2026-02-13T03:57:53.704 INFO:teuthology.orchestra.run.trial092.stdout:Verifying port 0.0.0.0:8765 ... 2026-02-13T03:57:53.925 INFO:teuthology.orchestra.run.trial092.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mgr.x 2026-02-13T03:57:53.925 INFO:teuthology.orchestra.run.trial092.stdout:systemctl: stderr Failed to reset failed state of unit ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mgr.x.service: Unit ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mgr.x.service not loaded. 2026-02-13T03:57:54.116 INFO:teuthology.orchestra.run.trial092.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460.target.wants/ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mgr.x.service → /etc/systemd/system/ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@.service. 2026-02-13T03:57:54.317 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:54 trial092 systemd[1]: Starting Ceph mgr.x for 1fefccae-0890-11f1-bcc5-d404e6e7d460... 2026-02-13T03:57:54.387 INFO:teuthology.orchestra.run.trial092.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-13T03:57:54.387 INFO:teuthology.orchestra.run.trial092.stdout:systemctl: stdout disabled 2026-02-13T03:57:54.398 INFO:teuthology.orchestra.run.trial092.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-13T03:57:54.398 INFO:teuthology.orchestra.run.trial092.stdout:systemctl: stdout inactive 2026-02-13T03:57:54.398 INFO:teuthology.orchestra.run.trial092.stdout:firewalld.service is not enabled 2026-02-13T03:57:54.398 INFO:teuthology.orchestra.run.trial092.stdout:Not possible to enable service . firewalld.service is not available 2026-02-13T03:57:54.412 INFO:teuthology.orchestra.run.trial092.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2026-02-13T03:57:54.413 INFO:teuthology.orchestra.run.trial092.stdout:systemctl: stdout disabled 2026-02-13T03:57:54.424 INFO:teuthology.orchestra.run.trial092.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2026-02-13T03:57:54.424 INFO:teuthology.orchestra.run.trial092.stdout:systemctl: stdout inactive 2026-02-13T03:57:54.424 INFO:teuthology.orchestra.run.trial092.stdout:firewalld.service is not enabled 2026-02-13T03:57:54.424 INFO:teuthology.orchestra.run.trial092.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2026-02-13T03:57:54.424 INFO:teuthology.orchestra.run.trial092.stdout:Waiting for mgr to start... 2026-02-13T03:57:54.424 INFO:teuthology.orchestra.run.trial092.stdout:Waiting for mgr... 2026-02-13T03:57:54.592 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:54 trial092 podman[23257]: 2026-02-13 03:57:54.315345796 +0000 UTC m=+0.028163504 container create 59a2d583c8c52778cadae4e272cef3e86070e333dca177918087bdda31107eea (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x, name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, license=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_REF=wip-pdonnell-testing-20260210.171210, summary=Rocky Linux Base image, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, ceph=True) 2026-02-13T03:57:54.592 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:54 trial092 podman[23257]: 2026-02-13 03:57:54.355946954 +0000 UTC m=+0.068764592 container init 59a2d583c8c52778cadae4e272cef3e86070e333dca177918087bdda31107eea (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x, io.buildah.version=1.33.7, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, summary=Rocky Linux Base image, name=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , license=BSD-3-Clause, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-13T03:57:54.592 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:54 trial092 podman[23257]: 2026-02-13 03:57:54.360822267 +0000 UTC m=+0.073639905 container start 59a2d583c8c52778cadae4e272cef3e86070e333dca177918087bdda31107eea (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.title=rockylinux, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.licenses=BSD-3-Clause, license=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, vendor=Rocky Enterprise Software Foundation, ceph=True, OSD_FLAVOR=default, summary=Rocky Linux Base image, org.opencontainers.image.version=10, name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-13T03:57:54.592 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:54 trial092 bash[23257]: 59a2d583c8c52778cadae4e272cef3e86070e333dca177918087bdda31107eea 2026-02-13T03:57:54.592 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:54 trial092 podman[23257]: 2026-02-13 03:57:54.304761214 +0000 UTC m=+0.017578862 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 2026-02-13T03:57:54.593 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:54 trial092 systemd[1]: Started Ceph mgr.x for 1fefccae-0890-11f1-bcc5-d404e6e7d460. 2026-02-13T03:57:54.593 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:54 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:54.406+0000 7f565af3efc0 -1 mgr[py] Loading module stats in main interpreter 2026-02-13T03:57:54.593 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:54 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:54.465+0000 7f565af3efc0 -1 mgr[py] Loading module dashboard in main interpreter 2026-02-13T03:57:54.593 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:54 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1159073957' entity='client.admin' 2026-02-13T03:57:54.762 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout 2026-02-13T03:57:54.763 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout { 2026-02-13T03:57:54.763 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "fsid": "1fefccae-0890-11f1-bcc5-d404e6e7d460", 2026-02-13T03:57:54.763 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "health": { 2026-02-13T03:57:54.763 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-13T03:57:54.763 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-13T03:57:54.763 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-13T03:57:54.763 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout }, 2026-02-13T03:57:54.763 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-13T03:57:54.763 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-13T03:57:54.763 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout 0 2026-02-13T03:57:54.763 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout ], 2026-02-13T03:57:54.764 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-13T03:57:54.764 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "a" 2026-02-13T03:57:54.764 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout ], 2026-02-13T03:57:54.764 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "quorum_age": 1, 2026-02-13T03:57:54.764 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-13T03:57:54.764 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T03:57:54.764 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-13T03:57:54.764 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-13T03:57:54.764 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout }, 2026-02-13T03:57:54.764 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-13T03:57:54.764 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T03:57:54.764 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-13T03:57:54.764 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-13T03:57:54.765 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-13T03:57:54.765 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-13T03:57:54.765 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-13T03:57:54.765 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-13T03:57:54.765 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout }, 2026-02-13T03:57:54.765 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-13T03:57:54.765 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-13T03:57:54.765 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-13T03:57:54.765 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-13T03:57:54.765 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-13T03:57:54.765 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-13T03:57:54.765 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-13T03:57:54.765 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-13T03:57:54.766 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-13T03:57:54.766 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout }, 2026-02-13T03:57:54.766 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-13T03:57:54.766 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T03:57:54.766 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "btime": "2026-02-13T03:57:51:342626+0000", 2026-02-13T03:57:54.766 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-13T03:57:54.766 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-13T03:57:54.766 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout }, 2026-02-13T03:57:54.766 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-13T03:57:54.766 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "available": false, 2026-02-13T03:57:54.766 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-13T03:57:54.766 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-13T03:57:54.766 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-13T03:57:54.767 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-13T03:57:54.767 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout ], 2026-02-13T03:57:54.767 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-13T03:57:54.767 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout }, 2026-02-13T03:57:54.767 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-13T03:57:54.767 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T03:57:54.767 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "modified": "2026-02-13T03:57:51.343079+0000", 2026-02-13T03:57:54.767 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-13T03:57:54.767 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout }, 2026-02-13T03:57:54.767 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-13T03:57:54.767 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout } 2026-02-13T03:57:54.767 INFO:teuthology.orchestra.run.trial092.stdout:mgr not available, waiting (1/15)... 2026-02-13T03:57:54.843 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:54 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:54.810+0000 7f565af3efc0 -1 mgr[py] Loading module mirroring in main interpreter 2026-02-13T03:57:54.843 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:54 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:54.820+0000 7f565af3efc0 -1 mgr[py] Loading module snap_schedule in main interpreter 2026-02-13T03:57:54.843 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:54 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:54.827+0000 7f565af3efc0 -1 mgr[py] Loading module prometheus in main interpreter 2026-02-13T03:57:54.843 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:54 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:54.834+0000 7f565af3efc0 -1 mgr[py] Loading module balancer in main interpreter 2026-02-13T03:57:54.843 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:54 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:54.840+0000 7f565af3efc0 -1 mgr[py] Loading module rbd_support in main interpreter 2026-02-13T03:57:55.183 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:54 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:54.853+0000 7f565af3efc0 -1 mgr[py] Loading module smb in main interpreter 2026-02-13T03:57:55.183 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:54 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:54.879+0000 7f565af3efc0 -1 mgr[py] Loading module devicehealth in main interpreter 2026-02-13T03:57:55.184 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:54 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:54.883+0000 7f565af3efc0 -1 mgr[py] Loading module alerts in main interpreter 2026-02-13T03:57:55.184 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:54 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:54.884+0000 7f565af3efc0 -1 mgr[py] Loading module telemetry in main interpreter 2026-02-13T03:57:55.184 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:54 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:54.892+0000 7f565af3efc0 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-13T03:57:55.184 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:54 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:54.946+0000 7f565af3efc0 -1 mgr[py] Loading module status in main interpreter 2026-02-13T03:57:55.184 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:54 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:54.948+0000 7f565af3efc0 -1 mgr[py] Loading module rgw in main interpreter 2026-02-13T03:57:55.184 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:54 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:54.953+0000 7f565af3efc0 -1 mgr[py] Loading module insights in main interpreter 2026-02-13T03:57:55.184 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:54 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:54.955+0000 7f565af3efc0 -1 mgr[py] Loading module iostat in main interpreter 2026-02-13T03:57:55.184 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:54 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:54.956+0000 7f565af3efc0 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-13T03:57:55.184 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:54 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:54.960+0000 7f565af3efc0 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-13T03:57:55.184 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:54 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:54.961+0000 7f565af3efc0 -1 mgr[py] Loading module crash in main interpreter 2026-02-13T03:57:55.184 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:54 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:54.964+0000 7f565af3efc0 -1 mgr[py] Loading module progress in main interpreter 2026-02-13T03:57:55.185 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:54 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:54.967+0000 7f565af3efc0 -1 mgr[py] Loading module rook in main interpreter 2026-02-13T03:57:55.592 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:55 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:55.250+0000 7f565af3efc0 -1 mgr[py] Loading module nfs in main interpreter 2026-02-13T03:57:55.592 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:55 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:55.250+0000 7f565af3efc0 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-13T03:57:55.592 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:55 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:55.253+0000 7f565af3efc0 -1 mgr[py] Loading module selftest in main interpreter 2026-02-13T03:57:55.592 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:55 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:55.255+0000 7f565af3efc0 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-13T03:57:55.593 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:55 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:55.257+0000 7f565af3efc0 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-13T03:57:55.593 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:55 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:55.258+0000 7f565af3efc0 -1 mgr[py] Loading module orchestrator in main interpreter 2026-02-13T03:57:55.593 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:55 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:55.258+0000 7f565af3efc0 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-13T03:57:55.593 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:55 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:55.459+0000 7f565af3efc0 -1 mgr[py] Loading module volumes in main interpreter 2026-02-13T03:57:55.593 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:55 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:55.491+0000 7f565af3efc0 -1 mgr[py] Loading module k8sevents in main interpreter 2026-02-13T03:57:55.593 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:55 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:55.495+0000 7f565af3efc0 -1 mgr[py] Loading module mds_autoscaler in main interpreter 2026-02-13T03:57:55.593 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:55 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:55.496+0000 7f565af3efc0 -1 mgr[py] Loading module localpool in main interpreter 2026-02-13T03:57:55.593 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:55 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:55.497+0000 7f565af3efc0 -1 mgr[py] Loading module influx in main interpreter 2026-02-13T03:57:55.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:55 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1760655168' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-13T03:57:55.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:55 trial092 ceph-mon[23047]: Activating manager daemon x 2026-02-13T03:57:55.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:55 trial092 ceph-mon[23047]: mgrmap e2: x(active, starting, since 0.00362565s) 2026-02-13T03:57:55.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:55 trial092 ceph-mon[23047]: from='mgr.14100 10.20.193.92:0/122875918' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-13T03:57:55.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:55 trial092 ceph-mon[23047]: from='mgr.14100 10.20.193.92:0/122875918' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-13T03:57:55.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:55 trial092 ceph-mon[23047]: from='mgr.14100 10.20.193.92:0/122875918' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-13T03:57:55.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:55 trial092 ceph-mon[23047]: from='mgr.14100 10.20.193.92:0/122875918' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:57:55.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:55 trial092 ceph-mon[23047]: from='mgr.14100 10.20.193.92:0/122875918' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-13T03:57:55.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:55 trial092 ceph-mon[23047]: Manager daemon x is now available 2026-02-13T03:57:55.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:55 trial092 ceph-mon[23047]: from='mgr.14100 10.20.193.92:0/122875918' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-13T03:57:55.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:55 trial092 ceph-mon[23047]: from='mgr.14100 10.20.193.92:0/122875918' entity='mgr.x' 2026-02-13T03:57:55.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:55 trial092 ceph-mon[23047]: from='mgr.14100 10.20.193.92:0/122875918' entity='mgr.x' 2026-02-13T03:57:55.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:55 trial092 ceph-mon[23047]: from='mgr.14100 10.20.193.92:0/122875918' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-13T03:57:55.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:55 trial092 ceph-mon[23047]: from='mgr.14100 10.20.193.92:0/122875918' entity='mgr.x' 2026-02-13T03:57:57.179 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout 2026-02-13T03:57:57.180 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout { 2026-02-13T03:57:57.180 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "fsid": "1fefccae-0890-11f1-bcc5-d404e6e7d460", 2026-02-13T03:57:57.180 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "health": { 2026-02-13T03:57:57.180 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2026-02-13T03:57:57.180 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "checks": {}, 2026-02-13T03:57:57.180 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "mutes": [] 2026-02-13T03:57:57.180 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout }, 2026-02-13T03:57:57.180 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2026-02-13T03:57:57.180 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "quorum": [ 2026-02-13T03:57:57.181 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout 0 2026-02-13T03:57:57.181 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout ], 2026-02-13T03:57:57.181 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2026-02-13T03:57:57.181 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "a" 2026-02-13T03:57:57.181 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout ], 2026-02-13T03:57:57.181 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2026-02-13T03:57:57.181 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "monmap": { 2026-02-13T03:57:57.181 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T03:57:57.181 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "tentacle", 2026-02-13T03:57:57.181 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "num_mons": 1 2026-02-13T03:57:57.181 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout }, 2026-02-13T03:57:57.181 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "osdmap": { 2026-02-13T03:57:57.181 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T03:57:57.182 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2026-02-13T03:57:57.182 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2026-02-13T03:57:57.182 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2026-02-13T03:57:57.182 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2026-02-13T03:57:57.182 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2026-02-13T03:57:57.182 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2026-02-13T03:57:57.182 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout }, 2026-02-13T03:57:57.182 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "pgmap": { 2026-02-13T03:57:57.182 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2026-02-13T03:57:57.182 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2026-02-13T03:57:57.182 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2026-02-13T03:57:57.182 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2026-02-13T03:57:57.183 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2026-02-13T03:57:57.183 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2026-02-13T03:57:57.183 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2026-02-13T03:57:57.183 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2026-02-13T03:57:57.183 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout }, 2026-02-13T03:57:57.183 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "fsmap": { 2026-02-13T03:57:57.183 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T03:57:57.183 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "btime": "2026-02-13T03:57:51:342626+0000", 2026-02-13T03:57:57.183 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "by_rank": [], 2026-02-13T03:57:57.183 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "up:standby": 0 2026-02-13T03:57:57.183 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout }, 2026-02-13T03:57:57.183 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "mgrmap": { 2026-02-13T03:57:57.183 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-13T03:57:57.184 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2026-02-13T03:57:57.184 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "modules": [ 2026-02-13T03:57:57.184 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "iostat", 2026-02-13T03:57:57.184 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "nfs" 2026-02-13T03:57:57.184 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout ], 2026-02-13T03:57:57.184 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-13T03:57:57.184 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout }, 2026-02-13T03:57:57.184 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "servicemap": { 2026-02-13T03:57:57.184 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "epoch": 1, 2026-02-13T03:57:57.184 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "modified": "2026-02-13T03:57:51.343079+0000", 2026-02-13T03:57:57.184 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "services": {} 2026-02-13T03:57:57.184 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout }, 2026-02-13T03:57:57.184 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "progress_events": {} 2026-02-13T03:57:57.185 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout } 2026-02-13T03:57:57.185 INFO:teuthology.orchestra.run.trial092.stdout:mgr is available 2026-02-13T03:57:57.539 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout 2026-02-13T03:57:57.539 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout [global] 2026-02-13T03:57:57.539 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout fsid = 1fefccae-0890-11f1-bcc5-d404e6e7d460 2026-02-13T03:57:57.539 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2026-02-13T03:57:57.539 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout mon_host = [v2:10.20.193.92:3300,v1:10.20.193.92:6789] 2026-02-13T03:57:57.539 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2026-02-13T03:57:57.539 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2026-02-13T03:57:57.540 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2026-02-13T03:57:57.540 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2026-02-13T03:57:57.540 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout 2026-02-13T03:57:57.540 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout [mgr] 2026-02-13T03:57:57.540 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2026-02-13T03:57:57.540 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout 2026-02-13T03:57:57.540 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout [osd] 2026-02-13T03:57:57.540 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2026-02-13T03:57:57.540 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2026-02-13T03:57:57.540 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2026-02-13T03:57:57.540 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2026-02-13T03:57:57.540 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2026-02-13T03:57:57.540 INFO:teuthology.orchestra.run.trial092.stdout:Enabling cephadm module... 2026-02-13T03:57:57.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:57 trial092 ceph-mon[23047]: mgrmap e3: x(active, since 1.00652s) 2026-02-13T03:57:57.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:57 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/2056734347' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2026-02-13T03:57:57.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:57 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/2058965610' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2026-02-13T03:57:58.920 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:58 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: ignoring --setuser ceph since I am not root 2026-02-13T03:57:58.920 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:58 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: ignoring --setgroup ceph since I am not root 2026-02-13T03:57:58.920 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:58 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:58.581+0000 7f3125f50fc0 -1 mgr[py] Loading module stats in main interpreter 2026-02-13T03:57:58.920 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:58 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:58.638+0000 7f3125f50fc0 -1 mgr[py] Loading module dashboard in main interpreter 2026-02-13T03:57:58.921 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:58 trial092 ceph-mon[23047]: mgrmap e4: x(active, since 2s) 2026-02-13T03:57:58.921 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:58 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/3918927073' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2026-02-13T03:57:59.003 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout { 2026-02-13T03:57:59.003 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "epoch": 5, 2026-02-13T03:57:59.003 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "available": true, 2026-02-13T03:57:59.003 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "active_name": "x", 2026-02-13T03:57:59.003 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "num_standby": 0 2026-02-13T03:57:59.003 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout } 2026-02-13T03:57:59.004 INFO:teuthology.orchestra.run.trial092.stdout:Waiting for the mgr to restart... 2026-02-13T03:57:59.004 INFO:teuthology.orchestra.run.trial092.stdout:Waiting for mgr epoch 5... 2026-02-13T03:57:59.183 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:58 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:58.966+0000 7f3125f50fc0 -1 mgr[py] Loading module mirroring in main interpreter 2026-02-13T03:57:59.183 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:58 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:58.976+0000 7f3125f50fc0 -1 mgr[py] Loading module snap_schedule in main interpreter 2026-02-13T03:57:59.183 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:58 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:58.982+0000 7f3125f50fc0 -1 mgr[py] Loading module prometheus in main interpreter 2026-02-13T03:57:59.183 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:58 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:58.989+0000 7f3125f50fc0 -1 mgr[py] Loading module balancer in main interpreter 2026-02-13T03:57:59.183 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:58 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:58.995+0000 7f3125f50fc0 -1 mgr[py] Loading module rbd_support in main interpreter 2026-02-13T03:57:59.183 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:59 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:59.008+0000 7f3125f50fc0 -1 mgr[py] Loading module smb in main interpreter 2026-02-13T03:57:59.183 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:59 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:59.034+0000 7f3125f50fc0 -1 mgr[py] Loading module devicehealth in main interpreter 2026-02-13T03:57:59.183 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:59 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:59.038+0000 7f3125f50fc0 -1 mgr[py] Loading module alerts in main interpreter 2026-02-13T03:57:59.183 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:59 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:59.040+0000 7f3125f50fc0 -1 mgr[py] Loading module telemetry in main interpreter 2026-02-13T03:57:59.184 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:59 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:59.047+0000 7f3125f50fc0 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-13T03:57:59.184 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:59 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:59.099+0000 7f3125f50fc0 -1 mgr[py] Loading module status in main interpreter 2026-02-13T03:57:59.184 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:59 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:59.101+0000 7f3125f50fc0 -1 mgr[py] Loading module rgw in main interpreter 2026-02-13T03:57:59.184 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:59 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:59.105+0000 7f3125f50fc0 -1 mgr[py] Loading module insights in main interpreter 2026-02-13T03:57:59.184 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:59 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:59.108+0000 7f3125f50fc0 -1 mgr[py] Loading module iostat in main interpreter 2026-02-13T03:57:59.184 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:59 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:59.108+0000 7f3125f50fc0 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-13T03:57:59.184 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:59 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:59.112+0000 7f3125f50fc0 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-13T03:57:59.184 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:59 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:59.113+0000 7f3125f50fc0 -1 mgr[py] Loading module crash in main interpreter 2026-02-13T03:57:59.184 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:59 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:59.116+0000 7f3125f50fc0 -1 mgr[py] Loading module progress in main interpreter 2026-02-13T03:57:59.184 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:59 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:59.119+0000 7f3125f50fc0 -1 mgr[py] Loading module rook in main interpreter 2026-02-13T03:57:59.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:59 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/3918927073' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2026-02-13T03:57:59.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:59 trial092 ceph-mon[23047]: mgrmap e5: x(active, since 3s) 2026-02-13T03:57:59.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:57:59 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1292904878' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2026-02-13T03:57:59.684 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:59 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:59.375+0000 7f3125f50fc0 -1 mgr[py] Loading module nfs in main interpreter 2026-02-13T03:57:59.684 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:59 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:59.375+0000 7f3125f50fc0 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-13T03:57:59.684 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:59 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:59.377+0000 7f3125f50fc0 -1 mgr[py] Loading module selftest in main interpreter 2026-02-13T03:57:59.684 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:59 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:59.380+0000 7f3125f50fc0 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-13T03:57:59.684 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:59 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:59.382+0000 7f3125f50fc0 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-13T03:57:59.684 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:59 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:59.382+0000 7f3125f50fc0 -1 mgr[py] Loading module orchestrator in main interpreter 2026-02-13T03:57:59.684 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:59 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:59.382+0000 7f3125f50fc0 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-13T03:57:59.685 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:59 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:59.576+0000 7f3125f50fc0 -1 mgr[py] Loading module volumes in main interpreter 2026-02-13T03:57:59.685 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:59 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:59.607+0000 7f3125f50fc0 -1 mgr[py] Loading module k8sevents in main interpreter 2026-02-13T03:57:59.685 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:59 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:59.611+0000 7f3125f50fc0 -1 mgr[py] Loading module mds_autoscaler in main interpreter 2026-02-13T03:57:59.685 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:59 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:59.612+0000 7f3125f50fc0 -1 mgr[py] Loading module localpool in main interpreter 2026-02-13T03:57:59.685 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:57:59 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:57:59.613+0000 7f3125f50fc0 -1 mgr[py] Loading module influx in main interpreter 2026-02-13T03:58:00.739 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout { 2026-02-13T03:58:00.740 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2026-02-13T03:58:00.740 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout "initialized": true 2026-02-13T03:58:00.740 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout } 2026-02-13T03:58:00.740 INFO:teuthology.orchestra.run.trial092.stdout:mgr epoch 5 is available 2026-02-13T03:58:00.740 INFO:teuthology.orchestra.run.trial092.stdout:Verifying orchestrator module is enabled... 2026-02-13T03:58:00.781 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:00 trial092 ceph-mon[23047]: Active manager daemon x restarted 2026-02-13T03:58:00.782 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:00 trial092 ceph-mon[23047]: Activating manager daemon x 2026-02-13T03:58:00.782 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:00 trial092 ceph-mon[23047]: osdmap e2: 0 total, 0 up, 0 in 2026-02-13T03:58:00.782 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:00 trial092 ceph-mon[23047]: mgrmap e6: x(active, starting, since 0.0026254s) 2026-02-13T03:58:00.782 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:00 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:58:00.782 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:00 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-13T03:58:00.782 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:00 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-13T03:58:00.782 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:00 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-13T03:58:00.782 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:00 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-13T03:58:00.782 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:00 trial092 ceph-mon[23047]: Manager daemon x is now available 2026-02-13T03:58:00.782 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:00 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:00.782 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:00 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:00.783 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:00 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:00.783 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:00 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:00.783 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:00 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:00.783 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:00 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:00.783 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:00 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:58:00.783 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:00 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:00.783 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:00 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:58:00.783 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:00 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:00.783 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:00 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-13T03:58:00.783 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:00 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-13T03:58:01.710 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2026-02-13T03:58:01.710 INFO:teuthology.orchestra.run.trial092.stdout:Setting orchestrator backend to cephadm... 2026-02-13T03:58:01.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:01 trial092 ceph-mon[23047]: Optimize plan auto_2026-02-13_03:57:59, mode upmap, max misplaced 0.050000 2026-02-13T03:58:01.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:01 trial092 ceph-mon[23047]: No pools available 2026-02-13T03:58:01.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:01 trial092 ceph-mon[23047]: Found migration_current of "None". Setting to last migration. 2026-02-13T03:58:01.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:01 trial092 ceph-mon[23047]: mgrmap e7: x(active, since 1.00541s) 2026-02-13T03:58:01.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:01 trial092 ceph-mon[23047]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2026-02-13T03:58:01.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:01 trial092 ceph-mon[23047]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2026-02-13T03:58:01.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:01 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:58:01.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:01 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/4120598032' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2026-02-13T03:58:02.490 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout value unchanged 2026-02-13T03:58:02.490 INFO:teuthology.orchestra.run.trial092.stdout:Generating ssh key... 2026-02-13T03:58:02.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:02 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/4120598032' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2026-02-13T03:58:02.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:02 trial092 ceph-mon[23047]: mgrmap e8: x(active, since 2s) 2026-02-13T03:58:02.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:02 trial092 ceph-mon[23047]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:58:02.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:02 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:02.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:02 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:58:02.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:02 trial092 ceph-mon[23047]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:58:03.156 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:02 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: Generating public/private ed25519 key pair. 2026-02-13T03:58:03.156 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:02 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: Your identification has been saved in /tmp/tmphh5uco7h/key 2026-02-13T03:58:03.156 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:02 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: Your public key has been saved in /tmp/tmphh5uco7h/key.pub 2026-02-13T03:58:03.156 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:02 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: The key fingerprint is: 2026-02-13T03:58:03.156 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:02 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: SHA256:1MlioACYg8B3zQO6floUZQIjsk8h6PqmF29HU+7hbPw ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460 2026-02-13T03:58:03.156 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:02 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: The key's randomart image is: 2026-02-13T03:58:03.156 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:02 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: +--[ED25519 256]--+ 2026-02-13T03:58:03.156 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:02 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: |@+oo.o=o | 2026-02-13T03:58:03.156 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:02 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: |B+.+oo+= o . | 2026-02-13T03:58:03.157 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:02 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: |o.o.o. = + | 2026-02-13T03:58:03.157 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:02 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: | + . .o.. | 2026-02-13T03:58:03.157 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:02 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: |. .. . oS | 2026-02-13T03:58:03.157 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:02 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: |. o . o o | 2026-02-13T03:58:03.157 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:02 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: | . + + * . | 2026-02-13T03:58:03.157 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:02 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: | + * . * | 2026-02-13T03:58:03.157 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:02 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: |.+ o . . .E | 2026-02-13T03:58:03.157 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:02 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: +----[SHA256]-----+ 2026-02-13T03:58:03.232 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFvrwAId5ydL5bHpythe/oMZlVzFNDx4RZPPaJ1HGZQn ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460 2026-02-13T03:58:03.233 INFO:teuthology.orchestra.run.trial092.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2026-02-13T03:58:03.233 INFO:teuthology.orchestra.run.trial092.stdout:Adding key to root@localhost authorized_keys... 2026-02-13T03:58:03.234 INFO:teuthology.orchestra.run.trial092.stdout:Adding host trial092... 2026-02-13T03:58:04.042 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:03 trial092 ceph-mon[23047]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:58:04.042 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:03 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:04.042 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:03 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:04.042 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:03 trial092 ceph-mon[23047]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:58:04.042 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:03 trial092 ceph-mon[23047]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial092", "addr": "10.20.193.92", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:58:05.868 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout Added host 'trial092' with addr '10.20.193.92' 2026-02-13T03:58:05.868 INFO:teuthology.orchestra.run.trial092.stdout:Deploying unmanaged mon service... 2026-02-13T03:58:06.270 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2026-02-13T03:58:06.270 INFO:teuthology.orchestra.run.trial092.stdout:Deploying unmanaged mgr service... 2026-02-13T03:58:06.655 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2026-02-13T03:58:07.011 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:06 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:07.011 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:06 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:58:07.012 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:06 trial092 ceph-mon[23047]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:58:07.012 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:06 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:07.012 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:06 trial092 ceph-mon[23047]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:58:07.012 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:06 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:07.012 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:06 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:07.046 INFO:teuthology.orchestra.run.trial092.stdout:Saving cluster configuration to /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/config directory 2026-02-13T03:58:07.510 INFO:teuthology.orchestra.run.trial092.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2026-02-13T03:58:07.510 INFO:teuthology.orchestra.run.trial092.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2026-02-13T03:58:07.511 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T03:58:07.511 INFO:teuthology.orchestra.run.trial092.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2026-02-13T03:58:07.511 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T03:58:07.511 INFO:teuthology.orchestra.run.trial092.stdout:Or, if you are only running a single cluster on this host: 2026-02-13T03:58:07.511 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T03:58:07.511 INFO:teuthology.orchestra.run.trial092.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2026-02-13T03:58:07.511 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T03:58:07.511 INFO:teuthology.orchestra.run.trial092.stdout:Please consider enabling telemetry to help improve Ceph: 2026-02-13T03:58:07.511 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T03:58:07.511 INFO:teuthology.orchestra.run.trial092.stdout: ceph telemetry on 2026-02-13T03:58:07.511 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T03:58:07.512 INFO:teuthology.orchestra.run.trial092.stdout:For more information see: 2026-02-13T03:58:07.512 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T03:58:07.512 INFO:teuthology.orchestra.run.trial092.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2026-02-13T03:58:07.512 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T03:58:07.512 INFO:teuthology.orchestra.run.trial092.stdout:Bootstrap complete. 2026-02-13T03:58:07.525 INFO:teuthology.orchestra.run.trial092.stdout:systemctl: stdout static 2026-02-13T03:58:07.536 INFO:teuthology.orchestra.run.trial092.stdout:Non-zero exit code 3 from systemctl is-active logrotate 2026-02-13T03:58:07.536 INFO:teuthology.orchestra.run.trial092.stdout:systemctl: stdout inactive 2026-02-13T03:58:07.536 INFO:teuthology.orchestra.run.trial092.stdout:Enabling the logrotate.timer service to perform daily log rotation. 2026-02-13T03:58:07.794 INFO:tasks.cephadm:Fetching config... 2026-02-13T03:58:07.795 DEBUG:teuthology.orchestra.run.trial092:> set -ex 2026-02-13T03:58:07.795 DEBUG:teuthology.orchestra.run.trial092:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2026-02-13T03:58:07.836 INFO:tasks.cephadm:Fetching client.admin keyring... 2026-02-13T03:58:07.837 DEBUG:teuthology.orchestra.run.trial092:> set -ex 2026-02-13T03:58:07.837 DEBUG:teuthology.orchestra.run.trial092:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2026-02-13T03:58:07.916 INFO:tasks.cephadm:Fetching mon keyring... 2026-02-13T03:58:07.916 DEBUG:teuthology.orchestra.run.trial092:> set -ex 2026-02-13T03:58:07.916 DEBUG:teuthology.orchestra.run.trial092:> sudo dd if=/var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/keyring of=/dev/stdout 2026-02-13T03:58:08.014 INFO:tasks.cephadm:Fetching pub ssh key... 2026-02-13T03:58:08.014 DEBUG:teuthology.orchestra.run.trial092:> set -ex 2026-02-13T03:58:08.014 DEBUG:teuthology.orchestra.run.trial092:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2026-02-13T03:58:08.095 INFO:tasks.cephadm:Installing pub ssh key for root users... 2026-02-13T03:58:08.095 DEBUG:teuthology.orchestra.run.trial092:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFvrwAId5ydL5bHpythe/oMZlVzFNDx4RZPPaJ1HGZQn ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-13T03:58:08.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:07 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/240837913' entity='client.admin' 2026-02-13T03:58:08.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:07 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:08.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:07 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/3240187772' entity='client.admin' 2026-02-13T03:58:08.213 INFO:teuthology.orchestra.run.trial092.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFvrwAId5ydL5bHpythe/oMZlVzFNDx4RZPPaJ1HGZQn ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460 2026-02-13T03:58:08.234 DEBUG:teuthology.orchestra.run.trial099:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFvrwAId5ydL5bHpythe/oMZlVzFNDx4RZPPaJ1HGZQn ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-13T03:58:08.270 INFO:teuthology.orchestra.run.trial099.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFvrwAId5ydL5bHpythe/oMZlVzFNDx4RZPPaJ1HGZQn ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460 2026-02-13T03:58:08.280 DEBUG:teuthology.orchestra.run.trial158:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFvrwAId5ydL5bHpythe/oMZlVzFNDx4RZPPaJ1HGZQn ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2026-02-13T03:58:08.314 INFO:teuthology.orchestra.run.trial158.stdout:ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFvrwAId5ydL5bHpythe/oMZlVzFNDx4RZPPaJ1HGZQn ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460 2026-02-13T03:58:08.324 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2026-02-13T03:58:08.509 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:58:08.929 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2026-02-13T03:58:08.929 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph orch client-keyring set client.admin '*' --mode 0755 2026-02-13T03:58:09.114 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:58:09.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:09 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:09.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:09 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/3692029741' entity='client.admin' 2026-02-13T03:58:09.566 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial099 2026-02-13T03:58:09.567 DEBUG:teuthology.orchestra.run.trial099:> set -ex 2026-02-13T03:58:09.567 DEBUG:teuthology.orchestra.run.trial099:> dd of=/etc/ceph/ceph.conf 2026-02-13T03:58:09.584 DEBUG:teuthology.orchestra.run.trial099:> set -ex 2026-02-13T03:58:09.584 DEBUG:teuthology.orchestra.run.trial099:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-13T03:58:09.640 INFO:tasks.cephadm:Adding host trial099 to orchestrator... 2026-02-13T03:58:09.640 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph orch host add trial099 2026-02-13T03:58:09.823 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:58:10.613 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:10 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:10.613 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:10 trial092 ceph-mon[23047]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:58:10.613 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:10 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:11.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:11 trial092 ceph-mon[23047]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial099", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:58:11.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:11 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:11.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:11 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:11.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:11 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:11.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:11 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:11.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:11 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial092", "name": "osd_memory_target"} : dispatch 2026-02-13T03:58:11.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:11 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:11.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:11 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:58:11.962 INFO:teuthology.orchestra.run.trial092.stdout:Added host 'trial099' with addr '10.20.193.99' 2026-02-13T03:58:12.091 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-13T03:58:12.278 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:58:12.599 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T03:58:12.599 INFO:teuthology.orchestra.run.trial092.stdout:[{"addr": "10.20.193.92", "hostname": "trial092", "labels": [], "status": ""}, {"addr": "10.20.193.99", "hostname": "trial099", "labels": [], "status": ""}] 2026-02-13T03:58:12.706 INFO:tasks.cephadm:Writing (initial) conf and keyring to trial158 2026-02-13T03:58:12.707 DEBUG:teuthology.orchestra.run.trial158:> set -ex 2026-02-13T03:58:12.707 DEBUG:teuthology.orchestra.run.trial158:> dd of=/etc/ceph/ceph.conf 2026-02-13T03:58:12.726 DEBUG:teuthology.orchestra.run.trial158:> set -ex 2026-02-13T03:58:12.726 DEBUG:teuthology.orchestra.run.trial158:> dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-13T03:58:12.782 INFO:tasks.cephadm:Adding host trial158 to orchestrator... 2026-02-13T03:58:12.782 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph orch host add trial158 2026-02-13T03:58:12.967 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:58:13.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:12 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:13.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:12 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:13.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:12 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:13.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:12 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:13.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:12 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:58:13.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:12 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:14.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:14 trial092 ceph-mon[23047]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T03:58:14.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:14 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:14.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:14 trial092 ceph-mon[23047]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "trial158", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:58:14.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:14 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:15.122 INFO:teuthology.orchestra.run.trial092.stdout:Added host 'trial158' with addr '10.20.193.158' 2026-02-13T03:58:15.230 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph orch host ls --format=json 2026-02-13T03:58:15.415 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:58:15.720 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T03:58:15.721 INFO:teuthology.orchestra.run.trial092.stdout:[{"addr": "10.20.193.92", "hostname": "trial092", "labels": [], "status": ""}, {"addr": "10.20.193.99", "hostname": "trial099", "labels": [], "status": ""}, {"addr": "10.20.193.158", "hostname": "trial158", "labels": [], "status": ""}] 2026-02-13T03:58:15.721 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:15 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:15.721 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:15 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:15.721 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:15 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:15.722 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:15 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:15.722 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:15 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial099", "name": "osd_memory_target"} : dispatch 2026-02-13T03:58:15.722 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:15 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:15.722 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:15 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:58:15.722 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:15 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:15.722 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:15 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:15.722 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:15 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:15.722 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:15 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:15.722 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:15 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:58:15.722 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:15 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:15.826 INFO:tasks.cephadm:Setting crush tunables to default 2026-02-13T03:58:15.826 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph osd crush tunables default 2026-02-13T03:58:16.009 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:58:16.763 INFO:teuthology.orchestra.run.trial092.stderr:adjusted tunables profile to default 2026-02-13T03:58:16.869 INFO:tasks.cephadm:Adding mon.a on trial092 2026-02-13T03:58:16.869 INFO:tasks.cephadm:Adding mon.b on trial099 2026-02-13T03:58:16.869 INFO:tasks.cephadm:Adding mon.c on trial158 2026-02-13T03:58:16.869 DEBUG:teuthology.orchestra.run.trial158:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph orch apply mon '3;trial092:10.20.193.92=a;trial099:10.20.193.99=b;trial158:10.20.193.158=c' 2026-02-13T03:58:17.028 INFO:teuthology.orchestra.run.trial158.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T03:58:17.028 INFO:teuthology.orchestra.run.trial158.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T03:58:17.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:16 trial092 ceph-mon[23047]: from='client.14158 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T03:58:17.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:16 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:17.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:16 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/2049174321' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2026-02-13T03:58:17.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:16 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:17.252 INFO:teuthology.orchestra.run.trial158.stdout:Scheduled mon update... 2026-02-13T03:58:17.329 DEBUG:teuthology.orchestra.run.trial099:mon.b> sudo journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mon.b.service 2026-02-13T03:58:17.331 DEBUG:teuthology.orchestra.run.trial158:mon.c> sudo journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mon.c.service 2026-02-13T03:58:17.332 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-13T03:58:17.332 DEBUG:teuthology.orchestra.run.trial158:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph mon dump -f json 2026-02-13T03:58:17.558 INFO:teuthology.orchestra.run.trial158.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T03:58:17.558 INFO:teuthology.orchestra.run.trial158.stderr:Inferring config /etc/ceph/ceph.conf 2026-02-13T03:58:17.809 INFO:teuthology.orchestra.run.trial158.stdout: 2026-02-13T03:58:17.809 INFO:teuthology.orchestra.run.trial158.stdout:{"epoch":1,"fsid":"1fefccae-0890-11f1-bcc5-d404e6e7d460","modified":"2026-02-13T03:57:49.665673Z","created":"2026-02-13T03:57:49.665673Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:3300","nonce":0},{"type":"v1","addr":"10.20.193.92:6789","nonce":0}]},"addr":"10.20.193.92:6789/0","public_addr":"10.20.193.92:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T03:57:49:665696+0000","crush_location":[]}],"quorum":[0]} 2026-02-13T03:58:17.809 INFO:teuthology.orchestra.run.trial158.stderr:dumped monmap epoch 1 2026-02-13T03:58:18.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:17 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/2049174321' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2026-02-13T03:58:18.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:17 trial092 ceph-mon[23047]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T03:58:18.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:17 trial092 ceph-mon[23047]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;trial092:10.20.193.92=a;trial099:10.20.193.99=b;trial158:10.20.193.158=c", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:58:18.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:17 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:18.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:17 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:18.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:17 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:18.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:17 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:18.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:17 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:18.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:17 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial158", "name": "osd_memory_target"} : dispatch 2026-02-13T03:58:18.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:17 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:18.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:17 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:58:18.851 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-13T03:58:18.851 DEBUG:teuthology.orchestra.run.trial158:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph mon dump -f json 2026-02-13T03:58:19.004 INFO:teuthology.orchestra.run.trial158.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.c/config 2026-02-13T03:58:19.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:18 trial092 ceph-mon[23047]: from='client.? 10.20.193.158:0/3987467049' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T03:58:19.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:18 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:19.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:18 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:19.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:18 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:19.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:18 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T03:58:19.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:18 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:19.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:19 trial158 ceph-mon[27763]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2026-02-13T03:58:24.224 INFO:teuthology.orchestra.run.trial158.stdout: 2026-02-13T03:58:24.224 INFO:teuthology.orchestra.run.trial158.stdout:{"epoch":2,"fsid":"1fefccae-0890-11f1-bcc5-d404e6e7d460","modified":"2026-02-13T03:58:19.212940Z","created":"2026-02-13T03:57:49.665673Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:3300","nonce":0},{"type":"v1","addr":"10.20.193.92:6789","nonce":0}]},"addr":"10.20.193.92:6789/0","public_addr":"10.20.193.92:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T03:57:49:665696+0000","crush_location":[]},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:3300","nonce":0},{"type":"v1","addr":"10.20.193.158:6789","nonce":0}]},"addr":"10.20.193.158:6789/0","public_addr":"10.20.193.158:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T03:58:19:212938+0000","crush_location":[]}],"quorum":[0,1]} 2026-02-13T03:58:24.225 INFO:teuthology.orchestra.run.trial158.stderr:dumped monmap epoch 2 2026-02-13T03:58:24.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:24 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:58:24.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:24 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:58:24.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:24 trial158 ceph-mon[27763]: mon.a calling monitor election 2026-02-13T03:58:24.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:24 trial158 ceph-mon[27763]: from='client.? 10.20.193.158:0/2272930884' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T03:58:24.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:24 trial158 ceph-mon[27763]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:58:24.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:24 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:58:24.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:24 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:58:24.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:24 trial158 ceph-mon[27763]: mon.c calling monitor election 2026-02-13T03:58:24.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:24 trial158 ceph-mon[27763]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:58:24.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:24 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:58:24.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:24 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:58:24.581 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:24 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:58:24.581 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:24 trial158 ceph-mon[27763]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2026-02-13T03:58:24.581 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:24 trial158 ceph-mon[27763]: monmap epoch 2 2026-02-13T03:58:24.581 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:24 trial158 ceph-mon[27763]: fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 2026-02-13T03:58:24.581 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:24 trial158 ceph-mon[27763]: last_changed 2026-02-13T03:58:19.212940+0000 2026-02-13T03:58:24.581 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:24 trial158 ceph-mon[27763]: created 2026-02-13T03:57:49.665673+0000 2026-02-13T03:58:24.581 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:24 trial158 ceph-mon[27763]: min_mon_release 20 (tentacle) 2026-02-13T03:58:24.581 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:24 trial158 ceph-mon[27763]: election_strategy: 1 2026-02-13T03:58:24.581 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:24 trial158 ceph-mon[27763]: 0: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.a 2026-02-13T03:58:24.581 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:24 trial158 ceph-mon[27763]: 1: [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] mon.c 2026-02-13T03:58:24.581 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:24 trial158 ceph-mon[27763]: fsmap 2026-02-13T03:58:24.581 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:24 trial158 ceph-mon[27763]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T03:58:24.582 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:24 trial158 ceph-mon[27763]: mgrmap e8: x(active, since 24s) 2026-02-13T03:58:24.582 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:24 trial158 ceph-mon[27763]: overall HEALTH_OK 2026-02-13T03:58:24.582 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:24 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:24.582 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:24 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:24.582 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:24 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:24.582 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:24 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T03:58:24.582 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:24 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:24.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:24 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:58:24.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:24 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:58:24.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:24 trial092 ceph-mon[23047]: mon.a calling monitor election 2026-02-13T03:58:24.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:24 trial092 ceph-mon[23047]: from='client.? 10.20.193.158:0/2272930884' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T03:58:24.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:24 trial092 ceph-mon[23047]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:58:24.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:24 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:58:24.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:24 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:58:24.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:24 trial092 ceph-mon[23047]: mon.c calling monitor election 2026-02-13T03:58:24.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:24 trial092 ceph-mon[23047]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:58:24.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:24 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:58:24.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:24 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:58:24.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:24 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:58:24.685 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:24 trial092 ceph-mon[23047]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2026-02-13T03:58:24.685 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:24 trial092 ceph-mon[23047]: monmap epoch 2 2026-02-13T03:58:24.685 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:24 trial092 ceph-mon[23047]: fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 2026-02-13T03:58:24.685 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:24 trial092 ceph-mon[23047]: last_changed 2026-02-13T03:58:19.212940+0000 2026-02-13T03:58:24.685 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:24 trial092 ceph-mon[23047]: created 2026-02-13T03:57:49.665673+0000 2026-02-13T03:58:24.685 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:24 trial092 ceph-mon[23047]: min_mon_release 20 (tentacle) 2026-02-13T03:58:24.685 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:24 trial092 ceph-mon[23047]: election_strategy: 1 2026-02-13T03:58:24.685 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:24 trial092 ceph-mon[23047]: 0: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.a 2026-02-13T03:58:24.685 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:24 trial092 ceph-mon[23047]: 1: [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] mon.c 2026-02-13T03:58:24.685 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:24 trial092 ceph-mon[23047]: fsmap 2026-02-13T03:58:24.685 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:24 trial092 ceph-mon[23047]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T03:58:24.685 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:24 trial092 ceph-mon[23047]: mgrmap e8: x(active, since 24s) 2026-02-13T03:58:24.686 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:24 trial092 ceph-mon[23047]: overall HEALTH_OK 2026-02-13T03:58:24.686 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:24 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:24.686 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:24 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:24.686 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:24 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:24.686 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:24 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T03:58:24.686 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:24 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:25.283 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2026-02-13T03:58:25.284 DEBUG:teuthology.orchestra.run.trial158:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph mon dump -f json 2026-02-13T03:58:25.404 INFO:teuthology.orchestra.run.trial158.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.c/config 2026-02-13T03:58:25.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:25 trial158 ceph-mon[27763]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:58:25.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:25 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:58:25.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:25 trial092 ceph-mon[23047]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:58:25.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:25 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:58:25.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:25 trial099 ceph-mon[27808]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2026-02-13T03:58:26.683 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:26 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:58:26.213+0000 7f30d00eb6c0 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-13T03:58:30.590 INFO:teuthology.orchestra.run.trial158.stdout: 2026-02-13T03:58:30.590 INFO:teuthology.orchestra.run.trial158.stdout:{"epoch":3,"fsid":"1fefccae-0890-11f1-bcc5-d404e6e7d460","modified":"2026-02-13T03:58:25.579950Z","created":"2026-02-13T03:57:49.665673Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:3300","nonce":0},{"type":"v1","addr":"10.20.193.92:6789","nonce":0}]},"addr":"10.20.193.92:6789/0","public_addr":"10.20.193.92:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T03:57:49:665696+0000","crush_location":[]},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:3300","nonce":0},{"type":"v1","addr":"10.20.193.158:6789","nonce":0}]},"addr":"10.20.193.158:6789/0","public_addr":"10.20.193.158:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T03:58:19:212938+0000","crush_location":[]},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:3300","nonce":0},{"type":"v1","addr":"10.20.193.99:6789","nonce":0}]},"addr":"10.20.193.99:6789/0","public_addr":"10.20.193.99:6789/0","priority":0,"weight":0,"time_added":"2026-02-13T03:58:25:579949+0000","crush_location":[]}],"quorum":[0,1,2]} 2026-02-13T03:58:30.591 INFO:teuthology.orchestra.run.trial158.stderr:dumped monmap epoch 3 2026-02-13T03:58:30.632 INFO:tasks.cephadm:Generating final ceph.conf file... 2026-02-13T03:58:30.633 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph config generate-minimal-conf 2026-02-13T03:58:30.818 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:58:30.903 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:30 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:58:30.903 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:30 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:58:30.903 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:30 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:58:30.903 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:30 trial092 ceph-mon[23047]: mon.a calling monitor election 2026-02-13T03:58:30.903 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:30 trial092 ceph-mon[23047]: mon.c calling monitor election 2026-02-13T03:58:30.903 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:30 trial092 ceph-mon[23047]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:58:30.903 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:30 trial092 ceph-mon[23047]: from='client.? 10.20.193.158:0/2444037626' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T03:58:30.903 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:30 trial092 ceph-mon[23047]: mon.b calling monitor election 2026-02-13T03:58:30.903 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:30 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:58:30.903 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:30 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:58:30.904 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:30 trial092 ceph-mon[23047]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:58:30.904 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:30 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:58:30.904 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:30 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:58:30.904 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:30 trial092 ceph-mon[23047]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:58:30.904 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:30 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:58:30.904 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:30 trial092 ceph-mon[23047]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-13T03:58:30.904 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:30 trial092 ceph-mon[23047]: monmap epoch 3 2026-02-13T03:58:30.904 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:30 trial092 ceph-mon[23047]: fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 2026-02-13T03:58:30.904 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:30 trial092 ceph-mon[23047]: last_changed 2026-02-13T03:58:25.579950+0000 2026-02-13T03:58:30.904 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:30 trial092 ceph-mon[23047]: created 2026-02-13T03:57:49.665673+0000 2026-02-13T03:58:30.904 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:30 trial092 ceph-mon[23047]: min_mon_release 20 (tentacle) 2026-02-13T03:58:30.904 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:30 trial092 ceph-mon[23047]: election_strategy: 1 2026-02-13T03:58:30.904 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:30 trial092 ceph-mon[23047]: 0: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.a 2026-02-13T03:58:30.905 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:30 trial092 ceph-mon[23047]: 1: [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] mon.c 2026-02-13T03:58:30.905 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:30 trial092 ceph-mon[23047]: 2: [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] mon.b 2026-02-13T03:58:30.905 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:30 trial092 ceph-mon[23047]: fsmap 2026-02-13T03:58:30.905 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:30 trial092 ceph-mon[23047]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T03:58:30.905 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:30 trial092 ceph-mon[23047]: mgrmap e8: x(active, since 30s) 2026-02-13T03:58:30.905 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:30 trial092 ceph-mon[23047]: overall HEALTH_OK 2026-02-13T03:58:30.905 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:30 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:30.905 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:30 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:30.905 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:30 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:30.905 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:30 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:31.018 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:30 trial099 ceph-mon[27808]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:58:31.018 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:30 trial099 ceph-mon[27808]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:58:31.018 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:30 trial099 ceph-mon[27808]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:58:31.018 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:30 trial099 ceph-mon[27808]: mon.a calling monitor election 2026-02-13T03:58:31.018 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:30 trial099 ceph-mon[27808]: mon.c calling monitor election 2026-02-13T03:58:31.019 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:30 trial099 ceph-mon[27808]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:58:31.019 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:30 trial099 ceph-mon[27808]: from='client.? 10.20.193.158:0/2444037626' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T03:58:31.019 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:30 trial099 ceph-mon[27808]: mon.b calling monitor election 2026-02-13T03:58:31.019 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:30 trial099 ceph-mon[27808]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:58:31.019 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:30 trial099 ceph-mon[27808]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:58:31.019 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:30 trial099 ceph-mon[27808]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:58:31.019 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:30 trial099 ceph-mon[27808]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:58:31.019 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:30 trial099 ceph-mon[27808]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:58:31.019 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:30 trial099 ceph-mon[27808]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:58:31.019 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:30 trial099 ceph-mon[27808]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:58:31.019 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:30 trial099 ceph-mon[27808]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-13T03:58:31.019 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:30 trial099 ceph-mon[27808]: monmap epoch 3 2026-02-13T03:58:31.020 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:30 trial099 ceph-mon[27808]: fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 2026-02-13T03:58:31.020 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:30 trial099 ceph-mon[27808]: last_changed 2026-02-13T03:58:25.579950+0000 2026-02-13T03:58:31.020 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:30 trial099 ceph-mon[27808]: created 2026-02-13T03:57:49.665673+0000 2026-02-13T03:58:31.020 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:30 trial099 ceph-mon[27808]: min_mon_release 20 (tentacle) 2026-02-13T03:58:31.020 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:30 trial099 ceph-mon[27808]: election_strategy: 1 2026-02-13T03:58:31.020 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:30 trial099 ceph-mon[27808]: 0: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.a 2026-02-13T03:58:31.020 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:30 trial099 ceph-mon[27808]: 1: [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] mon.c 2026-02-13T03:58:31.020 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:30 trial099 ceph-mon[27808]: 2: [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] mon.b 2026-02-13T03:58:31.020 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:30 trial099 ceph-mon[27808]: fsmap 2026-02-13T03:58:31.020 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:30 trial099 ceph-mon[27808]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T03:58:31.020 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:30 trial099 ceph-mon[27808]: mgrmap e8: x(active, since 30s) 2026-02-13T03:58:31.020 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:30 trial099 ceph-mon[27808]: overall HEALTH_OK 2026-02-13T03:58:31.021 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:30 trial099 ceph-mon[27808]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:31.021 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:30 trial099 ceph-mon[27808]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:31.021 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:30 trial099 ceph-mon[27808]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:31.021 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:30 trial099 ceph-mon[27808]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:31.021 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:30 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:58:31.021 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:30 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:58:31.022 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:30 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:58:31.022 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:30 trial158 ceph-mon[27763]: mon.a calling monitor election 2026-02-13T03:58:31.022 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:30 trial158 ceph-mon[27763]: mon.c calling monitor election 2026-02-13T03:58:31.022 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:30 trial158 ceph-mon[27763]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:58:31.022 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:30 trial158 ceph-mon[27763]: from='client.? 10.20.193.158:0/2444037626' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2026-02-13T03:58:31.022 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:30 trial158 ceph-mon[27763]: mon.b calling monitor election 2026-02-13T03:58:31.022 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:30 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:58:31.022 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:30 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:58:31.022 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:30 trial158 ceph-mon[27763]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:58:31.022 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:30 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:58:31.022 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:30 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:58:31.023 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:30 trial158 ceph-mon[27763]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:58:31.023 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:30 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:58:31.023 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:30 trial158 ceph-mon[27763]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2026-02-13T03:58:31.023 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:30 trial158 ceph-mon[27763]: monmap epoch 3 2026-02-13T03:58:31.023 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:30 trial158 ceph-mon[27763]: fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 2026-02-13T03:58:31.023 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:30 trial158 ceph-mon[27763]: last_changed 2026-02-13T03:58:25.579950+0000 2026-02-13T03:58:31.023 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:30 trial158 ceph-mon[27763]: created 2026-02-13T03:57:49.665673+0000 2026-02-13T03:58:31.023 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:30 trial158 ceph-mon[27763]: min_mon_release 20 (tentacle) 2026-02-13T03:58:31.023 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:30 trial158 ceph-mon[27763]: election_strategy: 1 2026-02-13T03:58:31.023 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:30 trial158 ceph-mon[27763]: 0: [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] mon.a 2026-02-13T03:58:31.023 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:30 trial158 ceph-mon[27763]: 1: [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] mon.c 2026-02-13T03:58:31.023 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:30 trial158 ceph-mon[27763]: 2: [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] mon.b 2026-02-13T03:58:31.023 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:30 trial158 ceph-mon[27763]: fsmap 2026-02-13T03:58:31.024 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:30 trial158 ceph-mon[27763]: osdmap e3: 0 total, 0 up, 0 in 2026-02-13T03:58:31.024 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:30 trial158 ceph-mon[27763]: mgrmap e8: x(active, since 30s) 2026-02-13T03:58:31.024 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:30 trial158 ceph-mon[27763]: overall HEALTH_OK 2026-02-13T03:58:31.024 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:30 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:31.024 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:30 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:31.024 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:30 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:31.024 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:30 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:31.119 INFO:teuthology.orchestra.run.trial092.stdout:# minimal ceph.conf for 1fefccae-0890-11f1-bcc5-d404e6e7d460 2026-02-13T03:58:31.119 INFO:teuthology.orchestra.run.trial092.stdout:[global] 2026-02-13T03:58:31.119 INFO:teuthology.orchestra.run.trial092.stdout: fsid = 1fefccae-0890-11f1-bcc5-d404e6e7d460 2026-02-13T03:58:31.119 INFO:teuthology.orchestra.run.trial092.stdout: mon_host = [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] 2026-02-13T03:58:31.225 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2026-02-13T03:58:31.225 DEBUG:teuthology.orchestra.run.trial092:> set -ex 2026-02-13T03:58:31.225 DEBUG:teuthology.orchestra.run.trial092:> sudo dd of=/etc/ceph/ceph.conf 2026-02-13T03:58:31.284 DEBUG:teuthology.orchestra.run.trial092:> set -ex 2026-02-13T03:58:31.284 DEBUG:teuthology.orchestra.run.trial092:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-13T03:58:31.379 DEBUG:teuthology.orchestra.run.trial099:> set -ex 2026-02-13T03:58:31.379 DEBUG:teuthology.orchestra.run.trial099:> sudo dd of=/etc/ceph/ceph.conf 2026-02-13T03:58:31.406 DEBUG:teuthology.orchestra.run.trial099:> set -ex 2026-02-13T03:58:31.406 DEBUG:teuthology.orchestra.run.trial099:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-13T03:58:31.470 DEBUG:teuthology.orchestra.run.trial158:> set -ex 2026-02-13T03:58:31.470 DEBUG:teuthology.orchestra.run.trial158:> sudo dd of=/etc/ceph/ceph.conf 2026-02-13T03:58:31.498 DEBUG:teuthology.orchestra.run.trial158:> set -ex 2026-02-13T03:58:31.498 DEBUG:teuthology.orchestra.run.trial158:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2026-02-13T03:58:31.563 INFO:tasks.cephadm:enabling module snap_schedule 2026-02-13T03:58:31.563 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- sudo ceph --cluster ceph mgr module enable snap_schedule 2026-02-13T03:58:31.747 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:58:31.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:31 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:58:31.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:31 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/927210865' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:31.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:31 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:31.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:31 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:31.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:31 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:31.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:31 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:31.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:31 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:31.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:31 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:58:31.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:31 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:31.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:31 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:31.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:31 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:31.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:31 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:31.831 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:31 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:58:31.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:31 trial099 ceph-mon[27808]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:58:31.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:31 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/927210865' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:31.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:31 trial099 ceph-mon[27808]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:31.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:31 trial099 ceph-mon[27808]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:31.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:31 trial099 ceph-mon[27808]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:31.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:31 trial099 ceph-mon[27808]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:31.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:31 trial099 ceph-mon[27808]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:31.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:31 trial099 ceph-mon[27808]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:58:31.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:31 trial099 ceph-mon[27808]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:31.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:31 trial099 ceph-mon[27808]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:31.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:31 trial099 ceph-mon[27808]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:31.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:31 trial099 ceph-mon[27808]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:31.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:31 trial099 ceph-mon[27808]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:58:31.879 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:31 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:58:31.880 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:31 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/927210865' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:31.880 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:31 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:31.880 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:31 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:31.880 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:31 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:31.880 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:31 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:31.880 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:31 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:31.880 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:31 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:58:31.880 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:31 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:31.880 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:31 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:31.881 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:31 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:31.881 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:31 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:31.881 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:31 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:58:32.818 INFO:tasks.cephadm:Adding mgr.x on trial092 2026-02-13T03:58:32.818 INFO:tasks.cephadm:Adding mgr.y on trial099 2026-02-13T03:58:32.819 INFO:tasks.cephadm:Adding mgr.z on trial158 2026-02-13T03:58:32.819 DEBUG:teuthology.orchestra.run.trial158:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph orch apply mgr '3;trial092=x;trial099=y;trial158=z' 2026-02-13T03:58:32.935 INFO:teuthology.orchestra.run.trial158.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.c/config 2026-02-13T03:58:32.957 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:32 trial158 ceph-mon[27763]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:58:32.957 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:32 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:32.958 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:32 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:32.958 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:32 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:32.958 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:32 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T03:58:32.958 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:32 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T03:58:32.958 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:32 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:32.958 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:32 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/1548540604' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2026-02-13T03:58:32.958 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:32 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:32.958 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:32 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:32.958 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:32 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T03:58:32.959 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:32 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T03:58:32.959 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:32 trial158 ceph-mon[27763]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:33.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:32 trial099 ceph-mon[27808]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:58:33.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:32 trial099 ceph-mon[27808]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:33.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:32 trial099 ceph-mon[27808]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:33.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:32 trial099 ceph-mon[27808]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:33.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:32 trial099 ceph-mon[27808]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T03:58:33.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:32 trial099 ceph-mon[27808]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T03:58:33.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:32 trial099 ceph-mon[27808]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:33.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:32 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/1548540604' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2026-02-13T03:58:33.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:32 trial099 ceph-mon[27808]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:33.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:32 trial099 ceph-mon[27808]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:33.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:32 trial099 ceph-mon[27808]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T03:58:33.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:32 trial099 ceph-mon[27808]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T03:58:33.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:32 trial099 ceph-mon[27808]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:33.179 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:32 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: ignoring --setuser ceph since I am not root 2026-02-13T03:58:33.180 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:32 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: ignoring --setgroup ceph since I am not root 2026-02-13T03:58:33.180 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:32 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:58:32.798+0000 7fb208123fc0 -1 mgr[py] Loading module stats in main interpreter 2026-02-13T03:58:33.180 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:32 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:58:32.853+0000 7fb208123fc0 -1 mgr[py] Loading module dashboard in main interpreter 2026-02-13T03:58:33.180 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:33 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:58:33.176+0000 7fb208123fc0 -1 mgr[py] Loading module mirroring in main interpreter 2026-02-13T03:58:33.180 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:32 trial092 ceph-mon[23047]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:58:33.180 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:32 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:33.180 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:32 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:33.180 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:32 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:33.181 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:32 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T03:58:33.181 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:32 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T03:58:33.181 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:32 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:33.181 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:32 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1548540604' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "snap_schedule"} : dispatch 2026-02-13T03:58:33.181 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:32 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:33.181 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:32 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' 2026-02-13T03:58:33.181 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:32 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T03:58:33.181 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:32 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T03:58:33.181 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:32 trial092 ceph-mon[23047]: from='mgr.14116 10.20.193.92:0/4234314947' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:33.433 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:33 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:58:33.186+0000 7fb208123fc0 -1 mgr[py] Loading module snap_schedule in main interpreter 2026-02-13T03:58:33.434 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:33 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:58:33.193+0000 7fb208123fc0 -1 mgr[py] Loading module prometheus in main interpreter 2026-02-13T03:58:33.434 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:33 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:58:33.199+0000 7fb208123fc0 -1 mgr[py] Loading module balancer in main interpreter 2026-02-13T03:58:33.434 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:33 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:58:33.205+0000 7fb208123fc0 -1 mgr[py] Loading module rbd_support in main interpreter 2026-02-13T03:58:33.434 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:33 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:58:33.218+0000 7fb208123fc0 -1 mgr[py] Loading module smb in main interpreter 2026-02-13T03:58:33.434 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:33 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:58:33.244+0000 7fb208123fc0 -1 mgr[py] Loading module devicehealth in main interpreter 2026-02-13T03:58:33.434 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:33 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:58:33.247+0000 7fb208123fc0 -1 mgr[py] Loading module alerts in main interpreter 2026-02-13T03:58:33.434 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:33 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:58:33.249+0000 7fb208123fc0 -1 mgr[py] Loading module telemetry in main interpreter 2026-02-13T03:58:33.434 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:33 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:58:33.256+0000 7fb208123fc0 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-13T03:58:33.434 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:33 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:58:33.306+0000 7fb208123fc0 -1 mgr[py] Loading module status in main interpreter 2026-02-13T03:58:33.435 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:33 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:58:33.308+0000 7fb208123fc0 -1 mgr[py] Loading module rgw in main interpreter 2026-02-13T03:58:33.435 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:33 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:58:33.313+0000 7fb208123fc0 -1 mgr[py] Loading module insights in main interpreter 2026-02-13T03:58:33.435 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:33 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:58:33.315+0000 7fb208123fc0 -1 mgr[py] Loading module iostat in main interpreter 2026-02-13T03:58:33.435 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:33 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:58:33.316+0000 7fb208123fc0 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-13T03:58:33.435 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:33 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:58:33.319+0000 7fb208123fc0 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-13T03:58:33.435 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:33 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:58:33.320+0000 7fb208123fc0 -1 mgr[py] Loading module crash in main interpreter 2026-02-13T03:58:33.435 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:33 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:58:33.323+0000 7fb208123fc0 -1 mgr[py] Loading module progress in main interpreter 2026-02-13T03:58:33.435 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:33 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:58:33.326+0000 7fb208123fc0 -1 mgr[py] Loading module rook in main interpreter 2026-02-13T03:58:33.847 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:33 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:58:33.579+0000 7fb208123fc0 -1 mgr[py] Loading module nfs in main interpreter 2026-02-13T03:58:33.848 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:33 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:58:33.579+0000 7fb208123fc0 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-13T03:58:33.848 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:33 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:58:33.582+0000 7fb208123fc0 -1 mgr[py] Loading module selftest in main interpreter 2026-02-13T03:58:33.848 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:33 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:58:33.584+0000 7fb208123fc0 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-13T03:58:33.848 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:33 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:58:33.586+0000 7fb208123fc0 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-13T03:58:33.848 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:33 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:58:33.587+0000 7fb208123fc0 -1 mgr[py] Loading module orchestrator in main interpreter 2026-02-13T03:58:33.848 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:33 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:58:33.587+0000 7fb208123fc0 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-13T03:58:33.848 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:33 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:58:33.781+0000 7fb208123fc0 -1 mgr[py] Loading module volumes in main interpreter 2026-02-13T03:58:33.848 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:33 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:58:33.812+0000 7fb208123fc0 -1 mgr[py] Loading module k8sevents in main interpreter 2026-02-13T03:58:33.848 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:33 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:58:33.816+0000 7fb208123fc0 -1 mgr[py] Loading module mds_autoscaler in main interpreter 2026-02-13T03:58:33.849 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:33 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:58:33.817+0000 7fb208123fc0 -1 mgr[py] Loading module localpool in main interpreter 2026-02-13T03:58:33.849 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:33 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T03:58:33.818+0000 7fb208123fc0 -1 mgr[py] Loading module influx in main interpreter 2026-02-13T03:58:33.849 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:33 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1548540604' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2026-02-13T03:58:33.849 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:33 trial092 ceph-mon[23047]: mgrmap e9: x(active, since 33s) 2026-02-13T03:58:34.035 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:33 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/1548540604' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2026-02-13T03:58:34.035 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:33 trial099 ceph-mon[27808]: mgrmap e9: x(active, since 33s) 2026-02-13T03:58:34.036 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:33 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/1548540604' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2026-02-13T03:58:34.036 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:33 trial158 ceph-mon[27763]: mgrmap e9: x(active, since 33s) 2026-02-13T03:58:34.183 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:33 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: /usr/share/ceph/mgr/cephadm/ssl_cert_utils.py:345: CryptographyDeprecationWarning: Properties that return a naïve datetime object have been deprecated. Please switch to not_valid_after_utc. 2026-02-13T03:58:34.183 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:33 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: tz = given_cert.not_valid_after.tzinfo 2026-02-13T03:58:34.183 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:33 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: /usr/share/ceph/mgr/cephadm/ssl_cert_utils.py:346: CryptographyDeprecationWarning: Properties that return a naïve datetime object have been deprecated. Please switch to not_valid_after_utc. 2026-02-13T03:58:34.183 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 03:58:33 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: if datetime.now(tz) >= given_cert.not_valid_after: 2026-02-13T03:58:34.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:34 trial158 ceph-mon[27763]: Active manager daemon x restarted 2026-02-13T03:58:34.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:34 trial158 ceph-mon[27763]: Activating manager daemon x 2026-02-13T03:58:34.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:34 trial158 ceph-mon[27763]: osdmap e4: 0 total, 0 up, 0 in 2026-02-13T03:58:34.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:34 trial158 ceph-mon[27763]: mgrmap e10: x(active, starting, since 0.00390931s) 2026-02-13T03:58:34.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:34 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:58:34.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:34 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:58:34.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:34 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:58:34.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:34 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-13T03:58:34.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:34 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-13T03:58:34.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:34 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-13T03:58:34.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:34 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-13T03:58:34.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:34 trial158 ceph-mon[27763]: Manager daemon x is now available 2026-02-13T03:58:34.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:34 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:58:34.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:34 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-13T03:58:34.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:34 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-13T03:58:34.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:34 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:34.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:34 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:34.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:34 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:34.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:34 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:34.836 INFO:teuthology.orchestra.run.trial158.stdout:Scheduled mgr update... 2026-02-13T03:58:34.865 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:34 trial099 ceph-mon[27808]: Active manager daemon x restarted 2026-02-13T03:58:34.865 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:34 trial099 ceph-mon[27808]: Activating manager daemon x 2026-02-13T03:58:34.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:34 trial099 ceph-mon[27808]: osdmap e4: 0 total, 0 up, 0 in 2026-02-13T03:58:34.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:34 trial099 ceph-mon[27808]: mgrmap e10: x(active, starting, since 0.00390931s) 2026-02-13T03:58:34.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:34 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:58:34.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:34 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:58:34.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:34 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:58:34.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:34 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-13T03:58:34.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:34 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-13T03:58:34.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:34 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-13T03:58:34.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:34 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-13T03:58:34.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:34 trial099 ceph-mon[27808]: Manager daemon x is now available 2026-02-13T03:58:34.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:34 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:58:34.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:34 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-13T03:58:34.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:34 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-13T03:58:34.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:34 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:34.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:34 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:34.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:34 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:34.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:34 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:34.896 DEBUG:teuthology.orchestra.run.trial099:mgr.y> sudo journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mgr.y.service 2026-02-13T03:58:34.898 DEBUG:teuthology.orchestra.run.trial158:mgr.z> sudo journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mgr.z.service 2026-02-13T03:58:34.899 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2026-02-13T03:58:34.899 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph config set client client_mount_timeout 600 2026-02-13T03:58:34.902 INFO:tasks.cephadm:setting config [client] debug_client = 20 2026-02-13T03:58:34.902 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph config set client debug_client 20 2026-02-13T03:58:34.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:34 trial092 ceph-mon[23047]: Active manager daemon x restarted 2026-02-13T03:58:34.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:34 trial092 ceph-mon[23047]: Activating manager daemon x 2026-02-13T03:58:34.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:34 trial092 ceph-mon[23047]: osdmap e4: 0 total, 0 up, 0 in 2026-02-13T03:58:34.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:34 trial092 ceph-mon[23047]: mgrmap e10: x(active, starting, since 0.00390931s) 2026-02-13T03:58:34.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:34 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:58:34.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:34 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:58:34.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:34 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:58:34.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:34 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2026-02-13T03:58:34.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:34 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2026-02-13T03:58:34.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:34 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2026-02-13T03:58:34.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:34 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2026-02-13T03:58:34.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:34 trial092 ceph-mon[23047]: Manager daemon x is now available 2026-02-13T03:58:34.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:34 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:58:34.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:34 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2026-02-13T03:58:34.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:34 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2026-02-13T03:58:34.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:34 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:34.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:34 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:34.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:34 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:34.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:34 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:34.935 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2026-02-13T03:58:34.935 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph config set client debug_ms 1 2026-02-13T03:58:34.980 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2026-02-13T03:58:34.980 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph config set client rados_mon_op_timeout 900 2026-02-13T03:58:35.025 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2026-02-13T03:58:35.025 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph config set client rados_osd_op_timeout 900 2026-02-13T03:58:35.082 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2026-02-13T03:58:35.082 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph config set mds debug_mds 20 2026-02-13T03:58:35.094 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:58:35.097 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2026-02-13T03:58:35.097 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph config set mds debug_mds_balancer 20 2026-02-13T03:58:35.137 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:58:35.142 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2026-02-13T03:58:35.142 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph config set mds debug_ms 2 2026-02-13T03:58:35.187 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2026-02-13T03:58:35.187 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph config set mds mds_bal_fragment_size_max 10000 2026-02-13T03:58:35.189 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:58:35.194 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2026-02-13T03:58:35.194 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph config set mds mds_bal_merge_size 5 2026-02-13T03:58:35.245 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2026-02-13T03:58:35.245 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph config set mds mds_bal_split_bits 3 2026-02-13T03:58:35.257 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:58:35.261 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2026-02-13T03:58:35.261 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph config set mds mds_bal_split_size 100 2026-02-13T03:58:35.317 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2026-02-13T03:58:35.318 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph config set mds mds_debug_frag True 2026-02-13T03:58:35.340 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:58:35.347 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2026-02-13T03:58:35.347 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph config set mds mds_debug_scatterstat True 2026-02-13T03:58:35.393 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2026-02-13T03:58:35.393 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph config set mds mds_op_complaint_time 180 2026-02-13T03:58:35.441 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2026-02-13T03:58:35.442 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph config set mds mds_verify_scatter True 2026-02-13T03:58:35.443 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:58:35.496 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2026-02-13T03:58:35.496 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph config set mds osd_op_complaint_time 180 2026-02-13T03:58:35.542 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2026-02-13T03:58:35.543 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph config set mds rados_mon_op_timeout 900 2026-02-13T03:58:35.550 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:58:35.556 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2026-02-13T03:58:35.557 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph config set mds rados_osd_op_timeout 900 2026-02-13T03:58:35.592 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:58:35.595 INFO:tasks.cephadm:setting config [mgr] client_mount_timeout = 30 2026-02-13T03:58:35.595 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph config set mgr client_mount_timeout 30 2026-02-13T03:58:35.722 INFO:tasks.cephadm:setting config [mgr] debug_cephsqlite = 20 2026-02-13T03:58:35.723 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph config set mgr debug_cephsqlite 20 2026-02-13T03:58:35.724 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.678+0000 7feb41cb36c0 1 -- 10.20.193.92:0/4198280597 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7feb1003f820 msgr2=0x7feb1005fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:35.724 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.678+0000 7feb41cb36c0 1 --2- 10.20.193.92:0/4198280597 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7feb1003f820 0x7feb1005fcd0 secure :-1 s=READY pgs=11 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb24005fd0 tx=0x7feb24005f60 comp rx=0 tx=0).stop 2026-02-13T03:58:35.724 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.678+0000 7feb41cb36c0 1 -- 10.20.193.92:0/4198280597 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7feb3c113f70 msgr2=0x7feb3c154da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:35.724 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.678+0000 7feb41cb36c0 1 --2- 10.20.193.92:0/4198280597 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7feb3c113f70 0x7feb3c154da0 secure :-1 s=READY pgs=95 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb3000b6c0 tx=0x7feb3000bb90 comp rx=0 tx=0).stop 2026-02-13T03:58:35.724 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.678+0000 7feb41cb36c0 1 -- 10.20.193.92:0/4198280597 shutdown_connections 2026-02-13T03:58:35.724 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.678+0000 7feb41cb36c0 1 --2- 10.20.193.92:0/4198280597 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7feb1003f820 0x7feb1005fcd0 unknown :-1 s=CLOSED pgs=11 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:35.725 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.678+0000 7feb41cb36c0 1 --2- 10.20.193.92:0/4198280597 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7feb3c1554e0 0x7feb3c0fd770 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:35.725 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.678+0000 7feb41cb36c0 1 --2- 10.20.193.92:0/4198280597 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7feb3c134920 0x7feb3c175910 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:35.725 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.678+0000 7feb41cb36c0 1 --2- 10.20.193.92:0/4198280597 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7feb3c113f70 0x7feb3c154da0 unknown :-1 s=CLOSED pgs=95 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:35.725 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.678+0000 7feb41cb36c0 1 -- 10.20.193.92:0/4198280597 >> 10.20.193.92:0/4198280597 conn(0x7feb3c05b8e0 msgr2=0x7feb3c0f3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:35.725 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.678+0000 7feb41cb36c0 1 -- 10.20.193.92:0/4198280597 shutdown_connections 2026-02-13T03:58:35.725 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.678+0000 7feb41cb36c0 1 -- 10.20.193.92:0/4198280597 wait complete. 2026-02-13T03:58:35.725 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.710+0000 7f5ea43b76c0 1 -- 10.20.193.92:0/1734843922 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5e9c114120 msgr2=0x7f5e9c114570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:35.726 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.710+0000 7f5ea43b76c0 1 --2- 10.20.193.92:0/1734843922 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5e9c114120 0x7f5e9c114570 secure :-1 s=READY pgs=8 gs=1 cs=0 l=1 c_cookie=9746780067421190455 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e90009970 tx=0x7f5e9002ed30 comp rx=0 tx=0).stop 2026-02-13T03:58:35.726 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.710+0000 7f5ea43b76c0 1 -- 10.20.193.92:0/1734843922 shutdown_connections 2026-02-13T03:58:35.726 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.710+0000 7f5ea43b76c0 1 --2- 10.20.193.92:0/1734843922 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5e9c114120 0x7f5e9c114570 unknown :-1 s=CLOSED pgs=8 gs=1 cs=0 l=1 c_cookie=9746780067421190455 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:35.726 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.710+0000 7f5ea43b76c0 1 --2- 10.20.193.92:0/1734843922 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f5e9c114cb0 0x7f5e9c1757c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:35.726 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.710+0000 7f5ea43b76c0 1 --2- 10.20.193.92:0/1734843922 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5e9c1137a0 0x7f5e9c113b90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:35.726 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.710+0000 7f5ea43b76c0 1 -- 10.20.193.92:0/1734843922 >> 10.20.193.92:0/1734843922 conn(0x7f5e9c064120 msgr2=0x7f5e9c064540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:35.726 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.710+0000 7f5ea43b76c0 1 -- 10.20.193.92:0/1734843922 shutdown_connections 2026-02-13T03:58:35.726 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.710+0000 7f5ea43b76c0 1 -- 10.20.193.92:0/1734843922 wait complete. 2026-02-13T03:58:35.726 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.711+0000 7f5ea43b76c0 1 Processor -- start 2026-02-13T03:58:35.726 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.711+0000 7f5ea43b76c0 1 -- start start 2026-02-13T03:58:35.726 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.712+0000 7f5ea43b76c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5e9c1137a0 0x7f5e9c10fe60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:35.727 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.712+0000 7f5ea43b76c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5e9c114120 0x7f5e9c1757c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:35.727 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.712+0000 7f5ea21286c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5e9c1137a0 0x7f5e9c10fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:35.727 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.712+0000 7f5ea43b76c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f5e9c114cb0 0x7f5e9c1106c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:35.727 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.712+0000 7f5ea43b76c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5e9c1112f0 con 0x7f5e9c114120 2026-02-13T03:58:35.727 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.712+0000 7f5ea43b76c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f5e9c111460 con 0x7f5e9c1137a0 2026-02-13T03:58:35.727 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.712+0000 7f5ea21286c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5e9c1137a0 0x7f5e9c10fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:59380/0 (socket says 10.20.193.92:59380) 2026-02-13T03:58:35.727 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.712+0000 7f5ea21286c0 1 -- 10.20.193.92:0/3153857537 learned_addr learned my addr 10.20.193.92:0/3153857537 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T03:58:35.727 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.712+0000 7f5ea43b76c0 1 -- 10.20.193.92:0/3153857537 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f5e9c111620 con 0x7f5e9c114cb0 2026-02-13T03:58:35.727 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.713+0000 7f5ea29296c0 1 --2- 10.20.193.92:0/3153857537 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f5e9c114cb0 0x7f5e9c1106c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:35.728 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:58:35.728 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.713+0000 7f5ea19276c0 1 --2- 10.20.193.92:0/3153857537 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5e9c114120 0x7f5e9c1757c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:35.728 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.713+0000 7f5ea19276c0 1 -- 10.20.193.92:0/3153857537 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f5e9c114cb0 msgr2=0x7f5e9c1106c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:35.728 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.713+0000 7f5ea19276c0 1 --2- 10.20.193.92:0/3153857537 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f5e9c114cb0 0x7f5e9c1106c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:35.728 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.713+0000 7f5ea19276c0 1 -- 10.20.193.92:0/3153857537 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5e9c1137a0 msgr2=0x7f5e9c10fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:35.728 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.713+0000 7f5ea19276c0 1 --2- 10.20.193.92:0/3153857537 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5e9c1137a0 0x7f5e9c10fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:35.728 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.713+0000 7f5ea19276c0 1 -- 10.20.193.92:0/3153857537 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e8c0094c0 con 0x7f5e9c114120 2026-02-13T03:58:35.729 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.714+0000 7f5ea19276c0 1 --2- 10.20.193.92:0/3153857537 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5e9c114120 0x7f5e9c1757c0 secure :-1 s=READY pgs=96 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e90005b40 tx=0x7f5e90005600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:35.729 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.714+0000 7f5e8b7fe6c0 1 -- 10.20.193.92:0/3153857537 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e90002ba0 con 0x7f5e9c114120 2026-02-13T03:58:35.729 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.714+0000 7f5ea43b76c0 1 -- 10.20.193.92:0/3153857537 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e90009590 con 0x7f5e9c114120 2026-02-13T03:58:35.729 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.714+0000 7f5ea43b76c0 1 -- 10.20.193.92:0/3153857537 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e9c111be0 con 0x7f5e9c114120 2026-02-13T03:58:35.729 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.714+0000 7f5e8b7fe6c0 1 -- 10.20.193.92:0/3153857537 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(28 keys) ==== 1157+0+0 (secure 0 0 0) 0x7f5e90002d00 con 0x7f5e9c114120 2026-02-13T03:58:35.729 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.714+0000 7f5e8b7fe6c0 1 -- 10.20.193.92:0/3153857537 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5e90037360 con 0x7f5e9c114120 2026-02-13T03:58:35.729 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.715+0000 7f5ea43b76c0 1 -- 10.20.193.92:0/3153857537 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e9c179740 con 0x7f5e9c114120 2026-02-13T03:58:35.729 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.716+0000 7f5e8b7fe6c0 1 -- 10.20.193.92:0/3153857537 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f5e90007a70 con 0x7f5e9c114120 2026-02-13T03:58:35.729 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.716+0000 7f5e8b7fe6c0 1 --2- 10.20.193.92:0/3153857537 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f5e8403f820 0x7f5e8405fcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:35.729 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.717+0000 7f5e8b7fe6c0 1 -- 10.20.193.92:0/3153857537 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f5e900754d0 con 0x7f5e9c114120 2026-02-13T03:58:35.730 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.717+0000 7f5ea21286c0 1 --2- 10.20.193.92:0/3153857537 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f5e8403f820 0x7f5e8405fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:35.730 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.717+0000 7f5ea21286c0 1 --2- 10.20.193.92:0/3153857537 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f5e8403f820 0x7f5e8405fcd0 secure :-1 s=READY pgs=13 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e8c005c80 tx=0x7f5e8c009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:35.730 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.718+0000 7f5e8b7fe6c0 1 -- 10.20.193.92:0/3153857537 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f5e90034270 con 0x7f5e9c114120 2026-02-13T03:58:35.774 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.767+0000 7f3f583706c0 1 -- 10.20.193.92:0/2194895610 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f3f50100a00 con 0x7f3f501147f0 2026-02-13T03:58:35.788 INFO:tasks.cephadm:setting config [mgr] debug_client = 20 2026-02-13T03:58:35.788 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph config set mgr debug_client 20 2026-02-13T03:58:35.789 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.772+0000 7f3f377fe6c0 1 -- 10.20.193.92:0/2194895610 <== mon.2 v2:10.20.193.99:3300/0 8 ==== config(29 keys) ==== 1188+0+0 (secure 0 0 0) 0x7f3f4400c630 con 0x7f3f501147f0 2026-02-13T03:58:35.789 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.772+0000 7f3f377fe6c0 1 -- 10.20.193.92:0/2194895610 <== mon.2 v2:10.20.193.99:3300/0 9 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7f3f44005020 con 0x7f3f501147f0 2026-02-13T03:58:35.789 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.775+0000 7f3f583706c0 1 -- 10.20.193.92:0/2194895610 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f3f2c03f820 msgr2=0x7f3f2c05fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:35.790 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.775+0000 7f3f583706c0 1 --2- 10.20.193.92:0/2194895610 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f3f2c03f820 0x7f3f2c05fcd0 secure :-1 s=READY pgs=12 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f4c030f50 tx=0x7f3f4c002470 comp rx=0 tx=0).stop 2026-02-13T03:58:35.790 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.775+0000 7f3f583706c0 1 -- 10.20.193.92:0/2194895610 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f3f501147f0 msgr2=0x7f3f500ff240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:35.790 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.775+0000 7f3f583706c0 1 --2- 10.20.193.92:0/2194895610 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f3f501147f0 0x7f3f500ff240 secure :-1 s=READY pgs=7 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3f44004750 tx=0x7f3f4400be50 comp rx=0 tx=0).stop 2026-02-13T03:58:35.790 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.775+0000 7f3f583706c0 1 -- 10.20.193.92:0/2194895610 shutdown_connections 2026-02-13T03:58:35.790 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.775+0000 7f3f583706c0 1 --2- 10.20.193.92:0/2194895610 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f3f2c03f820 0x7f3f2c05fcd0 unknown :-1 s=CLOSED pgs=12 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:35.790 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.775+0000 7f3f583706c0 1 --2- 10.20.193.92:0/2194895610 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f3f501147f0 0x7f3f500ff240 unknown :-1 s=CLOSED pgs=7 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:35.790 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.775+0000 7f3f583706c0 1 --2- 10.20.193.92:0/2194895610 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f3f50113f10 0x7f3f50175870 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:35.790 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.775+0000 7f3f583706c0 1 --2- 10.20.193.92:0/2194895610 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3f50113560 0x7f3f500fe9e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:35.790 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.775+0000 7f3f583706c0 1 -- 10.20.193.92:0/2194895610 >> 10.20.193.92:0/2194895610 conn(0x7f3f50064300 msgr2=0x7f3f500f4e30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:35.790 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.776+0000 7f3f583706c0 1 -- 10.20.193.92:0/2194895610 shutdown_connections 2026-02-13T03:58:35.790 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.776+0000 7f3f583706c0 1 -- 10.20.193.92:0/2194895610 wait complete. 2026-02-13T03:58:35.791 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.771+0000 7f5e8b7fe6c0 1 -- 10.20.193.92:0/3153857537 <== mon.0 v2:10.20.193.92:3300/0 7 ==== config(29 keys) ==== 1188+0+0 (secure 0 0 0) 0x7f5e90034270 con 0x7f5e9c114120 2026-02-13T03:58:35.828 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.823+0000 7f5ea43b76c0 1 -- 10.20.193.92:0/3153857537 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f5e9c113270 con 0x7f5e9c114120 2026-02-13T03:58:35.855 INFO:tasks.cephadm:setting config [mgr] debug_mgr = 20 2026-02-13T03:58:35.855 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph config set mgr debug_mgr 20 2026-02-13T03:58:35.856 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.826+0000 7f5e8b7fe6c0 1 -- 10.20.193.92:0/3153857537 <== mon.0 v2:10.20.193.92:3300/0 8 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v13)=0 v13) ==== 123+0+0 (secure 0 0 0) 0x7f5e900328d0 con 0x7f5e9c114120 2026-02-13T03:58:35.857 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.826+0000 7f5e8b7fe6c0 1 -- 10.20.193.92:0/3153857537 <== mon.0 v2:10.20.193.92:3300/0 9 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f5e900741f0 con 0x7f5e9c114120 2026-02-13T03:58:35.857 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.829+0000 7f5ea43b76c0 1 -- 10.20.193.92:0/3153857537 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f5e8403f820 msgr2=0x7f5e8405fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:35.857 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.829+0000 7f5ea43b76c0 1 --2- 10.20.193.92:0/3153857537 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f5e8403f820 0x7f5e8405fcd0 secure :-1 s=READY pgs=13 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e8c005c80 tx=0x7f5e8c009260 comp rx=0 tx=0).stop 2026-02-13T03:58:35.857 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.829+0000 7f5ea43b76c0 1 -- 10.20.193.92:0/3153857537 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5e9c114120 msgr2=0x7f5e9c1757c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:35.857 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.829+0000 7f5ea43b76c0 1 --2- 10.20.193.92:0/3153857537 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5e9c114120 0x7f5e9c1757c0 secure :-1 s=READY pgs=96 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e90005b40 tx=0x7f5e90005600 comp rx=0 tx=0).stop 2026-02-13T03:58:35.857 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.829+0000 7f5ea43b76c0 1 -- 10.20.193.92:0/3153857537 shutdown_connections 2026-02-13T03:58:35.857 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.830+0000 7f5ea43b76c0 1 --2- 10.20.193.92:0/3153857537 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f5e9c114cb0 0x7f5e9c1106c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:35.857 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.830+0000 7f5ea43b76c0 1 --2- 10.20.193.92:0/3153857537 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5e9c114120 0x7f5e9c1757c0 unknown :-1 s=CLOSED pgs=96 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:35.857 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.830+0000 7f5ea43b76c0 1 --2- 10.20.193.92:0/3153857537 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f5e8403f820 0x7f5e8405fcd0 unknown :-1 s=CLOSED pgs=13 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:35.857 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.830+0000 7f5ea43b76c0 1 --2- 10.20.193.92:0/3153857537 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5e9c1137a0 0x7f5e9c10fe60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:35.858 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.830+0000 7f5ea43b76c0 1 -- 10.20.193.92:0/3153857537 >> 10.20.193.92:0/3153857537 conn(0x7f5e9c064120 msgr2=0x7f5e9c0f4e30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:35.858 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.834+0000 7f5ea43b76c0 1 -- 10.20.193.92:0/3153857537 shutdown_connections 2026-02-13T03:58:35.858 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.834+0000 7f5ea43b76c0 1 -- 10.20.193.92:0/3153857537 wait complete. 2026-02-13T03:58:35.868 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:58:35.881 INFO:tasks.cephadm:setting config [mgr] debug_ms = 1 2026-02-13T03:58:35.881 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph config set mgr debug_ms 1 2026-02-13T03:58:35.929 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/allow_m_granularity = True 2026-02-13T03:58:35.930 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2026-02-13T03:58:35.960 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/dump_on_update = True 2026-02-13T03:58:35.960 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph config set mgr mgr/snap_schedule/dump_on_update True 2026-02-13T03:58:35.962 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.954+0000 7f6c8bb9f6c0 1 -- 10.20.193.92:0/885889956 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f6c8405e5c0 msgr2=0x7f6c84113dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:35.962 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.954+0000 7f6c8bb9f6c0 1 --2- 10.20.193.92:0/885889956 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f6c8405e5c0 0x7f6c84113dc0 secure :-1 s=READY pgs=9 gs=1 cs=0 l=1 c_cookie=6696024046496464413 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c8000aa40 tx=0x7f6c8002fe00 comp rx=0 tx=0).stop 2026-02-13T03:58:35.962 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.955+0000 7f6c8bb9f6c0 1 -- 10.20.193.92:0/885889956 shutdown_connections 2026-02-13T03:58:35.962 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.955+0000 7f6c8bb9f6c0 1 --2- 10.20.193.92:0/885889956 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f6c84157320 0x7f6c841777d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:35.962 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.955+0000 7f6c8bb9f6c0 1 --2- 10.20.193.92:0/885889956 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6c84114390 0x7f6c841147e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:35.962 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.955+0000 7f6c8bb9f6c0 1 --2- 10.20.193.92:0/885889956 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f6c8405e5c0 0x7f6c84113dc0 unknown :-1 s=CLOSED pgs=9 gs=1 cs=0 l=1 c_cookie=6696024046496464413 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:35.962 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.955+0000 7f6c8bb9f6c0 1 -- 10.20.193.92:0/885889956 >> 10.20.193.92:0/885889956 conn(0x7f6c8405b8e0 msgr2=0x7f6c8405bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:35.962 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.955+0000 7f6c8bb9f6c0 1 -- 10.20.193.92:0/885889956 shutdown_connections 2026-02-13T03:58:35.962 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.955+0000 7f6c8bb9f6c0 1 -- 10.20.193.92:0/885889956 wait complete. 2026-02-13T03:58:35.963 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.955+0000 7f6c8bb9f6c0 1 Processor -- start 2026-02-13T03:58:35.963 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.956+0000 7f6c8bb9f6c0 1 -- start start 2026-02-13T03:58:35.963 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.956+0000 7f6c8bb9f6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f6c8405e5c0 0x7f6c84102ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:35.963 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.956+0000 7f6c8bb9f6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6c84114390 0x7f6c84103640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:35.963 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.956+0000 7f6c8bb9f6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f6c84157320 0x7f6c84104230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:35.963 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.956+0000 7f6c8910f6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6c84114390 0x7f6c84103640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:35.963 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.956+0000 7f6c8910f6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6c84114390 0x7f6c84103640 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:47704/0 (socket says 10.20.193.92:47704) 2026-02-13T03:58:35.963 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.956+0000 7f6c8910f6c0 1 -- 10.20.193.92:0/164648841 learned_addr learned my addr 10.20.193.92:0/164648841 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T03:58:35.963 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.956+0000 7f6c8bb9f6c0 1 -- 10.20.193.92:0/164648841 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6c841049c0 con 0x7f6c84114390 2026-02-13T03:58:35.963 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.956+0000 7f6c8bb9f6c0 1 -- 10.20.193.92:0/164648841 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6c84104b30 con 0x7f6c84157320 2026-02-13T03:58:35.963 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.956+0000 7f6c8a1116c0 1 --2- 10.20.193.92:0/164648841 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f6c84157320 0x7f6c84104230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:35.964 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.956+0000 7f6c899106c0 1 --2- 10.20.193.92:0/164648841 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f6c8405e5c0 0x7f6c84102ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:35.964 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.957+0000 7f6c8bb9f6c0 1 -- 10.20.193.92:0/164648841 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f6c84104cf0 con 0x7f6c8405e5c0 2026-02-13T03:58:35.964 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.957+0000 7f6c899106c0 1 -- 10.20.193.92:0/164648841 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f6c84157320 msgr2=0x7f6c84104230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:35.964 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.957+0000 7f6c899106c0 1 --2- 10.20.193.92:0/164648841 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f6c84157320 0x7f6c84104230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:35.964 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.957+0000 7f6c899106c0 1 -- 10.20.193.92:0/164648841 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6c84114390 msgr2=0x7f6c84103640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:35.964 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.957+0000 7f6c899106c0 1 --2- 10.20.193.92:0/164648841 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6c84114390 0x7f6c84103640 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:35.964 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.958+0000 7f6c899106c0 1 -- 10.20.193.92:0/164648841 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c8000a660 con 0x7f6c8405e5c0 2026-02-13T03:58:35.964 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.958+0000 7f6c899106c0 1 --2- 10.20.193.92:0/164648841 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f6c8405e5c0 0x7f6c84102ff0 secure :-1 s=READY pgs=10 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c8000aa40 tx=0x7f6c80032f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:35.964 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.958+0000 7f6c8a1116c0 1 --2- 10.20.193.92:0/164648841 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f6c84157320 0x7f6c84104230 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:58:35.964 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.958+0000 7f6c8910f6c0 1 --2- 10.20.193.92:0/164648841 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6c84114390 0x7f6c84103640 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:58:35.964 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.958+0000 7f6c7affd6c0 1 -- 10.20.193.92:0/164648841 <== mon.1 v2:10.20.193.158:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c80030e10 con 0x7f6c8405e5c0 2026-02-13T03:58:35.964 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.958+0000 7f6c7affd6c0 1 -- 10.20.193.92:0/164648841 <== mon.1 v2:10.20.193.158:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f6c80003d40 con 0x7f6c8405e5c0 2026-02-13T03:58:35.965 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.958+0000 7f6c7affd6c0 1 -- 10.20.193.92:0/164648841 <== mon.1 v2:10.20.193.158:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c800323c0 con 0x7f6c8405e5c0 2026-02-13T03:58:35.965 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.958+0000 7f6c8bb9f6c0 1 -- 10.20.193.92:0/164648841 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c84104f70 con 0x7f6c8405e5c0 2026-02-13T03:58:35.965 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.959+0000 7f6c8bb9f6c0 1 -- 10.20.193.92:0/164648841 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c841550e0 con 0x7f6c8405e5c0 2026-02-13T03:58:35.972 INFO:tasks.cephadm:setting config [mgr] mgr/snap_schedule/log_level = debug 2026-02-13T03:58:35.973 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph config set mgr mgr/snap_schedule/log_level debug 2026-02-13T03:58:35.973 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.964+0000 7f6c8bb9f6c0 1 -- 10.20.193.92:0/164648841 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c58005310 con 0x7f6c8405e5c0 2026-02-13T03:58:35.973 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.962+0000 7f6c7affd6c0 1 -- 10.20.193.92:0/164648841 <== mon.1 v2:10.20.193.158:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f6c80008670 con 0x7f6c8405e5c0 2026-02-13T03:58:35.974 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.964+0000 7f6c7affd6c0 1 --2- 10.20.193.92:0/164648841 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f6c6003f870 0x7f6c6005fd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:35.974 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.964+0000 7f6c7affd6c0 1 -- 10.20.193.92:0/164648841 <== mon.1 v2:10.20.193.158:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f6c800766d0 con 0x7f6c8405e5c0 2026-02-13T03:58:35.974 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.965+0000 7f6c8910f6c0 1 --2- 10.20.193.92:0/164648841 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f6c6003f870 0x7f6c6005fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:35.974 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.965+0000 7f6c8910f6c0 1 --2- 10.20.193.92:0/164648841 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f6c6003f870 0x7f6c6005fd20 secure :-1 s=READY pgs=14 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c74005fd0 tx=0x7f6c74009240 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:35.985 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:35 trial092 ceph-mon[23047]: Optimize plan auto_2026-02-13_03:58:33, mode upmap, max misplaced 0.050000 2026-02-13T03:58:35.985 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:35 trial092 ceph-mon[23047]: No pools available 2026-02-13T03:58:35.986 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:35 trial092 ceph-mon[23047]: mgrmap e11: x(active, since 1.00832s) 2026-02-13T03:58:35.986 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:35 trial092 ceph-mon[23047]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;trial092=x;trial099=y;trial158=z", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:58:35.986 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:35 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:35.986 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:35 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:35.986 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:35 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:35.986 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:35 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:35.986 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:35 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:35.986 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:35 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial099", "name": "osd_memory_target"} : dispatch 2026-02-13T03:58:35.986 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:35 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:35.986 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:35 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:35.986 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:35 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial158", "name": "osd_memory_target"} : dispatch 2026-02-13T03:58:35.987 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:35 trial092 ceph-mon[23047]: from='client.? ' entity='client.admin' 2026-02-13T03:58:35.987 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:35 trial092 ceph-mon[23047]: from='client.? ' entity='client.admin' 2026-02-13T03:58:35.987 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:35 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/4198280597' entity='client.admin' 2026-02-13T03:58:35.987 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:35 trial092 ceph-mon[23047]: from='client.? ' entity='client.admin' 2026-02-13T03:58:35.987 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:35 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/3153857537' entity='client.admin' 2026-02-13T03:58:35.987 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:35.969+0000 7f6c7affd6c0 1 -- 10.20.193.92:0/164648841 <== mon.1 v2:10.20.193.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6c80008970 con 0x7f6c8405e5c0 2026-02-13T03:58:35.989 INFO:tasks.cephadm:setting config [mgr] mon_warn_on_pool_no_app = False 2026-02-13T03:58:35.989 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph config set mgr mon_warn_on_pool_no_app False 2026-02-13T03:58:36.005 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2026-02-13T03:58:36.005 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph config set mon mon_op_complaint_time 120 2026-02-13T03:58:36.033 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:58:36.037 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2026-02-13T03:58:36.037 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph config set osd osd_op_complaint_time 180 2026-02-13T03:58:36.080 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.077+0000 7f6c8bb9f6c0 1 -- 10.20.193.92:0/164648841 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f6c4c0051d0 con 0x7f6c8405e5c0 2026-02-13T03:58:36.104 DEBUG:tasks.cephadm:set 30 configs 2026-02-13T03:58:36.104 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1fefccae-0890-11f1-bcc5-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='trial092') 2026-02-13T03:58:36.104 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1fefccae-0890-11f1-bcc5-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='trial092') 2026-02-13T03:58:36.104 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1fefccae-0890-11f1-bcc5-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='trial092') 2026-02-13T03:58:36.105 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1fefccae-0890-11f1-bcc5-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='trial092') 2026-02-13T03:58:36.105 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.082+0000 7f6c7affd6c0 1 -- 10.20.193.92:0/164648841 <== mon.1 v2:10.20.193.158:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v14)=0 v14) ==== 108+0+0 (secure 0 0 0) 0x7f6c80006ce0 con 0x7f6c8405e5c0 2026-02-13T03:58:36.105 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.086+0000 7f6c8bb9f6c0 1 -- 10.20.193.92:0/164648841 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f6c6003f870 msgr2=0x7f6c6005fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:36.106 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.086+0000 7f6c8bb9f6c0 1 --2- 10.20.193.92:0/164648841 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f6c6003f870 0x7f6c6005fd20 secure :-1 s=READY pgs=14 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c74005fd0 tx=0x7f6c74009240 comp rx=0 tx=0).stop 2026-02-13T03:58:36.106 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.087+0000 7f6c8bb9f6c0 1 -- 10.20.193.92:0/164648841 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f6c8405e5c0 msgr2=0x7f6c84102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:36.106 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.087+0000 7f6c8bb9f6c0 1 --2- 10.20.193.92:0/164648841 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f6c8405e5c0 0x7f6c84102ff0 secure :-1 s=READY pgs=10 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c8000aa40 tx=0x7f6c80032f70 comp rx=0 tx=0).stop 2026-02-13T03:58:36.106 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.087+0000 7f6c8bb9f6c0 1 -- 10.20.193.92:0/164648841 shutdown_connections 2026-02-13T03:58:36.106 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.087+0000 7f6c8bb9f6c0 1 --2- 10.20.193.92:0/164648841 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f6c6003f870 0x7f6c6005fd20 unknown :-1 s=CLOSED pgs=14 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.106 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.087+0000 7f6c8bb9f6c0 1 --2- 10.20.193.92:0/164648841 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f6c84157320 0x7f6c84104230 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.106 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.087+0000 7f6c8bb9f6c0 1 --2- 10.20.193.92:0/164648841 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6c84114390 0x7f6c84103640 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.106 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.087+0000 7f6c8bb9f6c0 1 --2- 10.20.193.92:0/164648841 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f6c8405e5c0 0x7f6c84102ff0 unknown :-1 s=CLOSED pgs=10 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.106 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.087+0000 7f6c8bb9f6c0 1 -- 10.20.193.92:0/164648841 >> 10.20.193.92:0/164648841 conn(0x7f6c8405b8e0 msgr2=0x7f6c840f95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:36.106 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.087+0000 7f6c8bb9f6c0 1 -- 10.20.193.92:0/164648841 shutdown_connections 2026-02-13T03:58:36.106 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.087+0000 7f6c8bb9f6c0 1 -- 10.20.193.92:0/164648841 wait complete. 2026-02-13T03:58:36.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:35 trial099 ceph-mon[27808]: Optimize plan auto_2026-02-13_03:58:33, mode upmap, max misplaced 0.050000 2026-02-13T03:58:36.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:35 trial099 ceph-mon[27808]: No pools available 2026-02-13T03:58:36.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:35 trial099 ceph-mon[27808]: mgrmap e11: x(active, since 1.00832s) 2026-02-13T03:58:36.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:35 trial099 ceph-mon[27808]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;trial092=x;trial099=y;trial158=z", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:58:36.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:35 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:36.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:35 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:36.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:35 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:36.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:35 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:36.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:35 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:36.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:35 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial099", "name": "osd_memory_target"} : dispatch 2026-02-13T03:58:36.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:35 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:36.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:35 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:36.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:35 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial158", "name": "osd_memory_target"} : dispatch 2026-02-13T03:58:36.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:35 trial099 ceph-mon[27808]: from='client.? ' entity='client.admin' 2026-02-13T03:58:36.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:35 trial099 ceph-mon[27808]: from='client.? ' entity='client.admin' 2026-02-13T03:58:36.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:35 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/4198280597' entity='client.admin' 2026-02-13T03:58:36.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:35 trial099 ceph-mon[27808]: from='client.? ' entity='client.admin' 2026-02-13T03:58:36.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:35 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/3153857537' entity='client.admin' 2026-02-13T03:58:36.118 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.114+0000 7f233f1606c0 1 -- 10.20.193.92:0/1175840270 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2338150b40 msgr2=0x7f2338170f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:36.118 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.114+0000 7f233f1606c0 1 --2- 10.20.193.92:0/1175840270 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2338150b40 0x7f2338170f20 secure :-1 s=READY pgs=11 gs=2 cs=0 l=1 c_cookie=3918852107851617060 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f233400aa40 tx=0x7f233402fde0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.118 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.114+0000 7f233f1606c0 1 -- 10.20.193.92:0/1175840270 shutdown_connections 2026-02-13T03:58:36.118 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.114+0000 7f233f1606c0 1 --2- 10.20.193.92:0/1175840270 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2338060d00 0x7f2338061170 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.118 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.114+0000 7f233f1606c0 1 --2- 10.20.193.92:0/1175840270 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2338150b40 0x7f2338170f20 unknown :-1 s=CLOSED pgs=11 gs=2 cs=0 l=1 c_cookie=3918852107851617060 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.118 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.114+0000 7f233f1606c0 1 --2- 10.20.193.92:0/1175840270 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2338062140 0x7f23380607c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.118 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.114+0000 7f233f1606c0 1 -- 10.20.193.92:0/1175840270 >> 10.20.193.92:0/1175840270 conn(0x7f23380ea190 msgr2=0x7f233810a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:36.119 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.114+0000 7f233f1606c0 1 -- 10.20.193.92:0/1175840270 shutdown_connections 2026-02-13T03:58:36.119 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.115+0000 7f233f1606c0 1 -- 10.20.193.92:0/1175840270 wait complete. 2026-02-13T03:58:36.119 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.116+0000 7f233f1606c0 1 Processor -- start 2026-02-13T03:58:36.119 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.116+0000 7f233f1606c0 1 -- start start 2026-02-13T03:58:36.122 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.117+0000 7f233f1606c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2338060d00 0x7f233815c0e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:36.122 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.117+0000 7f233f1606c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2338062140 0x7f233815c730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:36.122 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.117+0000 7f233f1606c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2338150b40 0x7f233815d320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:36.122 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.117+0000 7f233f1606c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f233815dab0 con 0x7f2338062140 2026-02-13T03:58:36.122 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.117+0000 7f233f1606c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f233815dc20 con 0x7f2338150b40 2026-02-13T03:58:36.123 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.117+0000 7f233f1606c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f233815dde0 con 0x7f2338060d00 2026-02-13T03:58:36.123 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.117+0000 7f233e15e6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2338060d00 0x7f233815c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:36.123 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.118+0000 7f233e95f6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2338150b40 0x7f233815d320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:36.123 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.118+0000 7f233d95d6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2338062140 0x7f233815c730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:36.123 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.118+0000 7f233d95d6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2338062140 0x7f233815c730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:47714/0 (socket says 10.20.193.92:47714) 2026-02-13T03:58:36.123 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.118+0000 7f233d95d6c0 1 -- 10.20.193.92:0/2759985192 learned_addr learned my addr 10.20.193.92:0/2759985192 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T03:58:36.123 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.118+0000 7f233e95f6c0 1 -- 10.20.193.92:0/2759985192 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2338060d00 msgr2=0x7f233815c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:36.123 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.118+0000 7f233e95f6c0 1 --2- 10.20.193.92:0/2759985192 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2338060d00 0x7f233815c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.123 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.118+0000 7f233e95f6c0 1 -- 10.20.193.92:0/2759985192 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2338062140 msgr2=0x7f233815c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:36.123 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.118+0000 7f233e95f6c0 1 --2- 10.20.193.92:0/2759985192 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2338062140 0x7f233815c730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.123 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.118+0000 7f233e95f6c0 1 -- 10.20.193.92:0/2759985192 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23280094c0 con 0x7f2338150b40 2026-02-13T03:58:36.124 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.118+0000 7f233d95d6c0 1 --2- 10.20.193.92:0/2759985192 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2338062140 0x7f233815c730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T03:58:36.124 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.119+0000 7f233e95f6c0 1 --2- 10.20.193.92:0/2759985192 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2338150b40 0x7f233815d320 secure :-1 s=READY pgs=10 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f233400aa40 tx=0x7f23340054b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:36.124 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.119+0000 7f231f7fe6c0 1 -- 10.20.193.92:0/2759985192 <== mon.2 v2:10.20.193.99:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2334003a30 con 0x7f2338150b40 2026-02-13T03:58:36.124 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.119+0000 7f231f7fe6c0 1 -- 10.20.193.92:0/2759985192 <== mon.2 v2:10.20.193.99:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f2334030e80 con 0x7f2338150b40 2026-02-13T03:58:36.124 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.119+0000 7f231f7fe6c0 1 -- 10.20.193.92:0/2759985192 <== mon.2 v2:10.20.193.99:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2334003a30 con 0x7f2338150b40 2026-02-13T03:58:36.124 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.119+0000 7f233f1606c0 1 -- 10.20.193.92:0/2759985192 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f233400a660 con 0x7f2338150b40 2026-02-13T03:58:36.124 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.119+0000 7f233f1606c0 1 -- 10.20.193.92:0/2759985192 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f233815e390 con 0x7f2338150b40 2026-02-13T03:58:36.125 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.121+0000 7f231f7fe6c0 1 -- 10.20.193.92:0/2759985192 <== mon.2 v2:10.20.193.99:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f2334003b90 con 0x7f2338150b40 2026-02-13T03:58:36.126 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.121+0000 7f231f7fe6c0 1 --2- 10.20.193.92:0/2759985192 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f231003f880 0x7f231005fd30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:36.126 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.121+0000 7f233f1606c0 1 -- 10.20.193.92:0/2759985192 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2300005310 con 0x7f2338150b40 2026-02-13T03:58:36.126 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.121+0000 7f231f7fe6c0 1 -- 10.20.193.92:0/2759985192 <== mon.2 v2:10.20.193.99:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f2334031030 con 0x7f2338150b40 2026-02-13T03:58:36.126 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.121+0000 7f233e15e6c0 1 --2- 10.20.193.92:0/2759985192 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f231003f880 0x7f231005fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:36.126 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.122+0000 7f233e15e6c0 1 --2- 10.20.193.92:0/2759985192 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f231003f880 0x7f231005fd30 secure :-1 s=READY pgs=15 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2328004750 tx=0x7f2328009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:36.127 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.125+0000 7f231f7fe6c0 1 -- 10.20.193.92:0/2759985192 <== mon.2 v2:10.20.193.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2334034980 con 0x7f2338150b40 2026-02-13T03:58:36.153 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1fefccae-0890-11f1-bcc5-d404e6e7d460', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='trial092') 2026-02-13T03:58:36.154 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1fefccae-0890-11f1-bcc5-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='trial092') 2026-02-13T03:58:36.154 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:58:36.214 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:58:36.236 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.233+0000 7f233f1606c0 1 -- 10.20.193.92:0/2759985192 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f23000055c0 con 0x7f2338150b40 2026-02-13T03:58:36.241 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.236+0000 7f231f7fe6c0 1 -- 10.20.193.92:0/2759985192 <== mon.2 v2:10.20.193.99:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v15)=0 v15) ==== 117+0+0 (secure 0 0 0) 0x7f2334034980 con 0x7f2338150b40 2026-02-13T03:58:36.241 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.239+0000 7f231d7fa6c0 1 -- 10.20.193.92:0/2759985192 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f231003f880 msgr2=0x7f231005fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:36.242 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.239+0000 7f231d7fa6c0 1 --2- 10.20.193.92:0/2759985192 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f231003f880 0x7f231005fd30 secure :-1 s=READY pgs=15 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2328004750 tx=0x7f2328009260 comp rx=0 tx=0).stop 2026-02-13T03:58:36.242 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.239+0000 7f231d7fa6c0 1 -- 10.20.193.92:0/2759985192 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2338150b40 msgr2=0x7f233815d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:36.249 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.239+0000 7f231d7fa6c0 1 --2- 10.20.193.92:0/2759985192 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2338150b40 0x7f233815d320 secure :-1 s=READY pgs=10 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f233400aa40 tx=0x7f23340054b0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.249 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.239+0000 7f231d7fa6c0 1 -- 10.20.193.92:0/2759985192 shutdown_connections 2026-02-13T03:58:36.250 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.239+0000 7f231d7fa6c0 1 --2- 10.20.193.92:0/2759985192 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f231003f880 0x7f231005fd30 unknown :-1 s=CLOSED pgs=15 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.250 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.239+0000 7f231d7fa6c0 1 --2- 10.20.193.92:0/2759985192 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2338150b40 0x7f233815d320 unknown :-1 s=CLOSED pgs=10 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.250 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.239+0000 7f231d7fa6c0 1 --2- 10.20.193.92:0/2759985192 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2338062140 0x7f233815c730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.250 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.239+0000 7f231d7fa6c0 1 --2- 10.20.193.92:0/2759985192 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2338060d00 0x7f233815c0e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.250 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.239+0000 7f231d7fa6c0 1 -- 10.20.193.92:0/2759985192 >> 10.20.193.92:0/2759985192 conn(0x7f23380ea190 msgr2=0x7f233810a570 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:36.250 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.240+0000 7f231d7fa6c0 1 -- 10.20.193.92:0/2759985192 shutdown_connections 2026-02-13T03:58:36.250 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.240+0000 7f231d7fa6c0 1 -- 10.20.193.92:0/2759985192 wait complete. 2026-02-13T03:58:36.271 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:58:36.274 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.266+0000 7f1cea8a76c0 1 -- 10.20.193.92:0/59348198 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1ce41146f0 msgr2=0x7f1ce4114b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:36.274 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.266+0000 7f1cea8a76c0 1 --2- 10.20.193.92:0/59348198 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1ce41146f0 0x7f1ce4114b60 secure :-1 s=READY pgs=11 gs=1 cs=0 l=1 c_cookie=2578901543371461990 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1cd4009970 tx=0x7f1cd402edc0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.274 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.267+0000 7f1cea8a76c0 1 -- 10.20.193.92:0/59348198 shutdown_connections 2026-02-13T03:58:36.274 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.267+0000 7f1cea8a76c0 1 --2- 10.20.193.92:0/59348198 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1ce41146f0 0x7f1ce4114b60 unknown :-1 s=CLOSED pgs=11 gs=1 cs=0 l=1 c_cookie=2578901543371461990 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.274 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.267+0000 7f1cea8a76c0 1 --2- 10.20.193.92:0/59348198 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1ce4115120 0x7f1ce41155c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.274 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.267+0000 7f1cea8a76c0 1 --2- 10.20.193.92:0/59348198 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1ce4113dc0 0x7f1ce41141b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.274 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.267+0000 7f1cea8a76c0 1 -- 10.20.193.92:0/59348198 >> 10.20.193.92:0/59348198 conn(0x7f1ce405b8e0 msgr2=0x7f1ce405bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:36.274 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.267+0000 7f1cea8a76c0 1 -- 10.20.193.92:0/59348198 shutdown_connections 2026-02-13T03:58:36.275 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.267+0000 7f1cea8a76c0 1 -- 10.20.193.92:0/59348198 wait complete. 2026-02-13T03:58:36.275 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.268+0000 7f1cea8a76c0 1 Processor -- start 2026-02-13T03:58:36.275 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.268+0000 7f1cea8a76c0 1 -- start start 2026-02-13T03:58:36.275 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.268+0000 7f1cea8a76c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1ce4113dc0 0x7f1ce40feb60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:36.275 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.268+0000 7f1cea8a76c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1ce41146f0 0x7f1ce40ff1b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:36.275 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.268+0000 7f1cea8a76c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1ce4115120 0x7f1ce40ffda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:36.275 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.268+0000 7f1cea8a76c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce41004a0 con 0x7f1ce4113dc0 2026-02-13T03:58:36.275 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.268+0000 7f1cea8a76c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce4100610 con 0x7f1ce4115120 2026-02-13T03:58:36.275 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.268+0000 7f1cea8a76c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce41007d0 con 0x7f1ce41146f0 2026-02-13T03:58:36.275 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.268+0000 7f1ce37fe6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1ce41146f0 0x7f1ce40ff1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:36.275 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.269+0000 7f1ce8e196c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1ce4115120 0x7f1ce40ffda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:36.276 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.269+0000 7f1ce37fe6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1ce41146f0 0x7f1ce40ff1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:51454/0 (socket says 10.20.193.92:51454) 2026-02-13T03:58:36.276 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.269+0000 7f1ce37fe6c0 1 -- 10.20.193.92:0/963394323 learned_addr learned my addr 10.20.193.92:0/963394323 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T03:58:36.276 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.269+0000 7f1ce3fff6c0 1 --2- 10.20.193.92:0/963394323 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1ce4113dc0 0x7f1ce40feb60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:36.276 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.269+0000 7f1ce37fe6c0 1 -- 10.20.193.92:0/963394323 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1ce4115120 msgr2=0x7f1ce40ffda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:36.276 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.269+0000 7f1ce37fe6c0 1 --2- 10.20.193.92:0/963394323 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1ce4115120 0x7f1ce40ffda0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.276 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.269+0000 7f1ce37fe6c0 1 -- 10.20.193.92:0/963394323 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1ce4113dc0 msgr2=0x7f1ce40feb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:36.276 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.270+0000 7f1ce37fe6c0 1 --2- 10.20.193.92:0/963394323 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1ce4113dc0 0x7f1ce40feb60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.276 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.270+0000 7f1ce37fe6c0 1 -- 10.20.193.92:0/963394323 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cd4009590 con 0x7f1ce41146f0 2026-02-13T03:58:36.276 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.270+0000 7f1ce3fff6c0 1 --2- 10.20.193.92:0/963394323 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1ce4113dc0 0x7f1ce40feb60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:58:36.276 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.270+0000 7f1ce37fe6c0 1 --2- 10.20.193.92:0/963394323 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1ce41146f0 0x7f1ce40ff1b0 secure :-1 s=READY pgs=12 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1cd40092e0 tx=0x7f1cd402f990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:36.276 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.270+0000 7f1ce17fa6c0 1 -- 10.20.193.92:0/963394323 <== mon.1 v2:10.20.193.158:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1cd4002980 con 0x7f1ce41146f0 2026-02-13T03:58:36.276 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.270+0000 7f1ce17fa6c0 1 -- 10.20.193.92:0/963394323 <== mon.1 v2:10.20.193.158:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f1cd4002ae0 con 0x7f1ce41146f0 2026-02-13T03:58:36.277 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.270+0000 7f1ce17fa6c0 1 -- 10.20.193.92:0/963394323 <== mon.1 v2:10.20.193.158:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1cd4036410 con 0x7f1ce41146f0 2026-02-13T03:58:36.277 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.270+0000 7f1cea8a76c0 1 -- 10.20.193.92:0/963394323 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ce4100a50 con 0x7f1ce41146f0 2026-02-13T03:58:36.277 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.270+0000 7f1cea8a76c0 1 -- 10.20.193.92:0/963394323 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ce4100fc0 con 0x7f1ce41146f0 2026-02-13T03:58:36.278 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.271+0000 7f1cea8a76c0 1 -- 10.20.193.92:0/963394323 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ce4100c10 con 0x7f1ce41146f0 2026-02-13T03:58:36.278 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.272+0000 7f1ce17fa6c0 1 -- 10.20.193.92:0/963394323 <== mon.1 v2:10.20.193.158:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f1cd4007350 con 0x7f1ce41146f0 2026-02-13T03:58:36.278 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.272+0000 7f1ce17fa6c0 1 --2- 10.20.193.92:0/963394323 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f1cb003f820 0x7f1cb005fcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:36.278 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.272+0000 7f1ce17fa6c0 1 -- 10.20.193.92:0/963394323 <== mon.1 v2:10.20.193.158:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f1cd4075490 con 0x7f1ce41146f0 2026-02-13T03:58:36.278 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.273+0000 7f1ce3fff6c0 1 --2- 10.20.193.92:0/963394323 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f1cb003f820 0x7f1cb005fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:36.278 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.273+0000 7f1ce3fff6c0 1 --2- 10.20.193.92:0/963394323 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f1cb003f820 0x7f1cb005fcd0 secure :-1 s=READY pgs=16 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1cd0004750 tx=0x7f1cd0009060 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:36.279 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.274+0000 7f1ce17fa6c0 1 -- 10.20.193.92:0/963394323 <== mon.1 v2:10.20.193.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1cd4033720 con 0x7f1ce41146f0 2026-02-13T03:58:36.284 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:58:36.292 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1fefccae-0890-11f1-bcc5-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='trial092') 2026-02-13T03:58:36.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:35 trial158 ceph-mon[27763]: Optimize plan auto_2026-02-13_03:58:33, mode upmap, max misplaced 0.050000 2026-02-13T03:58:36.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:35 trial158 ceph-mon[27763]: No pools available 2026-02-13T03:58:36.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:35 trial158 ceph-mon[27763]: mgrmap e11: x(active, since 1.00832s) 2026-02-13T03:58:36.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:35 trial158 ceph-mon[27763]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;trial092=x;trial099=y;trial158=z", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:58:36.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:35 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:36.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:35 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:36.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:35 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:36.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:35 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:36.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:35 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:36.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:35 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial099", "name": "osd_memory_target"} : dispatch 2026-02-13T03:58:36.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:35 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:36.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:35 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:36.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:35 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial158", "name": "osd_memory_target"} : dispatch 2026-02-13T03:58:36.331 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:35 trial158 ceph-mon[27763]: from='client.? ' entity='client.admin' 2026-02-13T03:58:36.331 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:35 trial158 ceph-mon[27763]: from='client.? ' entity='client.admin' 2026-02-13T03:58:36.331 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:35 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/4198280597' entity='client.admin' 2026-02-13T03:58:36.331 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:35 trial158 ceph-mon[27763]: from='client.? ' entity='client.admin' 2026-02-13T03:58:36.331 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:35 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/3153857537' entity='client.admin' 2026-02-13T03:58:36.332 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.325+0000 7ff010d256c0 1 -- 10.20.193.92:0/1706104855 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff00c113f70 msgr2=0x7ff00c134350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:36.332 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.325+0000 7ff010d256c0 1 --2- 10.20.193.92:0/1706104855 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff00c113f70 0x7ff00c134350 secure :-1 s=READY pgs=12 gs=1 cs=0 l=1 c_cookie=10692849701055821411 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feff4006fd0 tx=0x7feff402fd30 comp rx=0 tx=0).stop 2026-02-13T03:58:36.333 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.325+0000 7ff010d256c0 1 -- 10.20.193.92:0/1706104855 shutdown_connections 2026-02-13T03:58:36.333 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.325+0000 7ff010d256c0 1 --2- 10.20.193.92:0/1706104855 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff00c1554e0 0x7ff00c175990 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.333 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.325+0000 7ff010d256c0 1 --2- 10.20.193.92:0/1706104855 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff00c134920 0x7ff00c154da0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.333 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.325+0000 7ff010d256c0 1 --2- 10.20.193.92:0/1706104855 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff00c113f70 0x7ff00c134350 unknown :-1 s=CLOSED pgs=12 gs=1 cs=0 l=1 c_cookie=10692849701055821411 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.333 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.325+0000 7ff010d256c0 1 -- 10.20.193.92:0/1706104855 >> 10.20.193.92:0/1706104855 conn(0x7ff00c05b8e0 msgr2=0x7ff00c05bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:36.333 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.326+0000 7ff010d256c0 1 -- 10.20.193.92:0/1706104855 shutdown_connections 2026-02-13T03:58:36.333 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.326+0000 7ff010d256c0 1 -- 10.20.193.92:0/1706104855 wait complete. 2026-02-13T03:58:36.333 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.326+0000 7ff010d256c0 1 Processor -- start 2026-02-13T03:58:36.333 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.327+0000 7ff010d256c0 1 -- start start 2026-02-13T03:58:36.334 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.327+0000 7ff010d256c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff00c113f70 0x7ff00c154da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:36.334 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.327+0000 7ff010d256c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff00c134920 0x7ff00c175930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:36.334 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.328+0000 7ff010d256c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff00c1554e0 0x7ff00c0ff7e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:36.334 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.328+0000 7ff010d256c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff00c0fff70 con 0x7ff00c134920 2026-02-13T03:58:36.334 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.328+0000 7ff010d256c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff00c1000b0 con 0x7ff00c1554e0 2026-02-13T03:58:36.334 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.328+0000 7ff010d256c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7ff00c100720 con 0x7ff00c113f70 2026-02-13T03:58:36.334 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.328+0000 7ff00a5756c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff00c113f70 0x7ff00c154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:36.334 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.328+0000 7ff00a5756c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff00c113f70 0x7ff00c154da0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:51482/0 (socket says 10.20.193.92:51482) 2026-02-13T03:58:36.334 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.328+0000 7ff00a5756c0 1 -- 10.20.193.92:0/2372394389 learned_addr learned my addr 10.20.193.92:0/2372394389 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T03:58:36.334 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.328+0000 7ff00ad766c0 1 --2- 10.20.193.92:0/2372394389 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff00c1554e0 0x7ff00c0ff7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:36.334 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.328+0000 7ff009d746c0 1 --2- 10.20.193.92:0/2372394389 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff00c134920 0x7ff00c175930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:36.334 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.328+0000 7ff00ad766c0 1 -- 10.20.193.92:0/2372394389 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff00c113f70 msgr2=0x7ff00c154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:36.335 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.328+0000 7ff00ad766c0 1 --2- 10.20.193.92:0/2372394389 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff00c113f70 0x7ff00c154da0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.335 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.328+0000 7ff00ad766c0 1 -- 10.20.193.92:0/2372394389 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff00c134920 msgr2=0x7ff00c175930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:36.335 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.328+0000 7ff00ad766c0 1 --2- 10.20.193.92:0/2372394389 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff00c134920 0x7ff00c175930 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.335 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.328+0000 7ff00ad766c0 1 -- 10.20.193.92:0/2372394389 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefec0071c0 con 0x7ff00c1554e0 2026-02-13T03:58:36.335 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.328+0000 7ff00ad766c0 1 --2- 10.20.193.92:0/2372394389 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff00c1554e0 0x7ff00c0ff7e0 secure :-1 s=READY pgs=13 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feffc00b670 tx=0x7feffc00bb40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:36.335 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.328+0000 7ff0037fe6c0 1 -- 10.20.193.92:0/2372394389 <== mon.2 v2:10.20.193.99:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feffc004240 con 0x7ff00c1554e0 2026-02-13T03:58:36.335 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.328+0000 7ff0037fe6c0 1 -- 10.20.193.92:0/2372394389 <== mon.2 v2:10.20.193.99:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7feffc009030 con 0x7ff00c1554e0 2026-02-13T03:58:36.335 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.328+0000 7ff0037fe6c0 1 -- 10.20.193.92:0/2372394389 <== mon.2 v2:10.20.193.99:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feffc003960 con 0x7ff00c1554e0 2026-02-13T03:58:36.335 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.329+0000 7ff010d256c0 1 -- 10.20.193.92:0/2372394389 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feff400a5b0 con 0x7ff00c1554e0 2026-02-13T03:58:36.335 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.329+0000 7ff010d256c0 1 -- 10.20.193.92:0/2372394389 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff00c100cb0 con 0x7ff00c1554e0 2026-02-13T03:58:36.335 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.329+0000 7ff010d256c0 1 -- 10.20.193.92:0/2372394389 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff00c179ba0 con 0x7ff00c1554e0 2026-02-13T03:58:36.346 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.343+0000 7ff0037fe6c0 1 -- 10.20.193.92:0/2372394389 <== mon.2 v2:10.20.193.99:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7feffc003af0 con 0x7ff00c1554e0 2026-02-13T03:58:36.347 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.344+0000 7ff0037fe6c0 1 --2- 10.20.193.92:0/2372394389 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fefe803f820 0x7fefe805fcd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:36.347 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.344+0000 7ff0037fe6c0 1 -- 10.20.193.92:0/2372394389 <== mon.2 v2:10.20.193.99:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7feffc051080 con 0x7ff00c1554e0 2026-02-13T03:58:36.347 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.344+0000 7ff0037fe6c0 1 -- 10.20.193.92:0/2372394389 <== mon.2 v2:10.20.193.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7feffc0535f0 con 0x7ff00c1554e0 2026-02-13T03:58:36.366 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.359+0000 7ff00a5756c0 1 --2- 10.20.193.92:0/2372394389 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fefe803f820 0x7fefe805fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:36.369 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.364+0000 7ff00a5756c0 1 --2- 10.20.193.92:0/2372394389 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fefe803f820 0x7fefe805fcd0 secure :-1 s=READY pgs=17 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feff4030d00 tx=0x7feff4005830 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:36.392 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:58:36.397 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.390+0000 7f1cea8a76c0 1 -- 10.20.193.92:0/963394323 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7f1ce417e1e0 con 0x7f1ce41146f0 2026-02-13T03:58:36.412 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:58:36.416 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.395+0000 7f1ce17fa6c0 1 -- 10.20.193.92:0/963394323 <== mon.1 v2:10.20.193.158:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v16)=0 v16) ==== 116+0+0 (secure 0 0 0) 0x7f1cd4033030 con 0x7f1ce41146f0 2026-02-13T03:58:36.416 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.397+0000 7f1cea8a76c0 1 -- 10.20.193.92:0/963394323 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f1cb003f820 msgr2=0x7f1cb005fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:36.416 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.397+0000 7f1cea8a76c0 1 --2- 10.20.193.92:0/963394323 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f1cb003f820 0x7f1cb005fcd0 secure :-1 s=READY pgs=16 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1cd0004750 tx=0x7f1cd0009060 comp rx=0 tx=0).stop 2026-02-13T03:58:36.416 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.397+0000 7f1cea8a76c0 1 -- 10.20.193.92:0/963394323 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1ce41146f0 msgr2=0x7f1ce40ff1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:36.417 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.397+0000 7f1cea8a76c0 1 --2- 10.20.193.92:0/963394323 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1ce41146f0 0x7f1ce40ff1b0 secure :-1 s=READY pgs=12 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1cd40092e0 tx=0x7f1cd402f990 comp rx=0 tx=0).stop 2026-02-13T03:58:36.417 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.398+0000 7f1cea8a76c0 1 -- 10.20.193.92:0/963394323 shutdown_connections 2026-02-13T03:58:36.417 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.398+0000 7f1cea8a76c0 1 --2- 10.20.193.92:0/963394323 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f1cb003f820 0x7f1cb005fcd0 unknown :-1 s=CLOSED pgs=16 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.417 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.398+0000 7f1cea8a76c0 1 --2- 10.20.193.92:0/963394323 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1ce4115120 0x7f1ce40ffda0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.417 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.398+0000 7f1cea8a76c0 1 --2- 10.20.193.92:0/963394323 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1ce41146f0 0x7f1ce40ff1b0 unknown :-1 s=CLOSED pgs=12 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.417 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.398+0000 7f1cea8a76c0 1 --2- 10.20.193.92:0/963394323 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1ce4113dc0 0x7f1ce40feb60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.417 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.398+0000 7f1cea8a76c0 1 -- 10.20.193.92:0/963394323 >> 10.20.193.92:0/963394323 conn(0x7f1ce405b8e0 msgr2=0x7f1ce40f5090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:36.417 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.398+0000 7f1cea8a76c0 1 -- 10.20.193.92:0/963394323 shutdown_connections 2026-02-13T03:58:36.417 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.398+0000 7f1cea8a76c0 1 -- 10.20.193.92:0/963394323 wait complete. 2026-02-13T03:58:36.455 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.453+0000 7ff010d256c0 1 -- 10.20.193.92:0/2372394389 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7ff00c179d80 con 0x7ff00c1554e0 2026-02-13T03:58:36.461 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.457+0000 7ff0037fe6c0 1 -- 10.20.193.92:0/2372394389 <== mon.2 v2:10.20.193.99:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v17)=0 v17) ==== 127+0+0 (secure 0 0 0) 0x7feffc004b10 con 0x7ff00c1554e0 2026-02-13T03:58:36.482 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.460+0000 7ff010d256c0 1 -- 10.20.193.92:0/2372394389 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fefe803f820 msgr2=0x7fefe805fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:36.482 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.460+0000 7ff010d256c0 1 --2- 10.20.193.92:0/2372394389 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fefe803f820 0x7fefe805fcd0 secure :-1 s=READY pgs=17 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feff4030d00 tx=0x7feff4005830 comp rx=0 tx=0).stop 2026-02-13T03:58:36.482 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.460+0000 7ff010d256c0 1 -- 10.20.193.92:0/2372394389 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff00c1554e0 msgr2=0x7ff00c0ff7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:36.482 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.460+0000 7ff010d256c0 1 --2- 10.20.193.92:0/2372394389 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff00c1554e0 0x7ff00c0ff7e0 secure :-1 s=READY pgs=13 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feffc00b670 tx=0x7feffc00bb40 comp rx=0 tx=0).stop 2026-02-13T03:58:36.482 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.460+0000 7ff010d256c0 1 -- 10.20.193.92:0/2372394389 shutdown_connections 2026-02-13T03:58:36.482 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.460+0000 7ff010d256c0 1 --2- 10.20.193.92:0/2372394389 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fefe803f820 0x7fefe805fcd0 unknown :-1 s=CLOSED pgs=17 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.482 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.460+0000 7ff010d256c0 1 --2- 10.20.193.92:0/2372394389 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff00c1554e0 0x7ff00c0ff7e0 unknown :-1 s=CLOSED pgs=13 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.482 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.460+0000 7ff010d256c0 1 --2- 10.20.193.92:0/2372394389 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff00c134920 0x7ff00c175930 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.482 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.460+0000 7ff010d256c0 1 --2- 10.20.193.92:0/2372394389 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff00c113f70 0x7ff00c154da0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.483 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.460+0000 7ff010d256c0 1 -- 10.20.193.92:0/2372394389 >> 10.20.193.92:0/2372394389 conn(0x7ff00c05b8e0 msgr2=0x7ff00c0f6000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:36.483 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.460+0000 7ff010d256c0 1 -- 10.20.193.92:0/2372394389 shutdown_connections 2026-02-13T03:58:36.483 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.460+0000 7ff010d256c0 1 -- 10.20.193.92:0/2372394389 wait complete. 2026-02-13T03:58:36.593 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:58:36.628 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1fefccae-0890-11f1-bcc5-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='trial092') 2026-02-13T03:58:36.675 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:58:36.682 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.665+0000 7f8b71d266c0 1 -- 10.20.193.92:0/783908509 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8b6c10fe70 msgr2=0x7f8b6c1102e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:36.682 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.665+0000 7f8b71d266c0 1 --2- 10.20.193.92:0/783908509 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8b6c10fe70 0x7f8b6c1102e0 secure :-1 s=READY pgs=97 gs=3 cs=0 l=1 c_cookie=11086181979895560855 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8b54009bd0 tx=0x7f8b5402ef70 comp rx=0 tx=0).stop 2026-02-13T03:58:36.682 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.665+0000 7f8b71d266c0 1 -- 10.20.193.92:0/783908509 shutdown_connections 2026-02-13T03:58:36.682 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.665+0000 7f8b71d266c0 1 --2- 10.20.193.92:0/783908509 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f8b6c110820 0x7f8b6c1711b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.683 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.665+0000 7f8b71d266c0 1 --2- 10.20.193.92:0/783908509 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8b6c10fe70 0x7f8b6c1102e0 unknown :-1 s=CLOSED pgs=97 gs=3 cs=0 l=1 c_cookie=11086181979895560855 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.683 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.665+0000 7f8b71d266c0 1 --2- 10.20.193.92:0/783908509 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8b6c10ecf0 0x7f8b6c10f0e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.683 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.665+0000 7f8b71d266c0 1 -- 10.20.193.92:0/783908509 >> 10.20.193.92:0/783908509 conn(0x7f8b6c0ec410 msgr2=0x7f8b6c10c820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:36.683 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.665+0000 7f8b71d266c0 1 -- 10.20.193.92:0/783908509 shutdown_connections 2026-02-13T03:58:36.683 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.665+0000 7f8b71d266c0 1 -- 10.20.193.92:0/783908509 wait complete. 2026-02-13T03:58:36.683 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.666+0000 7f8b71d266c0 1 Processor -- start 2026-02-13T03:58:36.683 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.666+0000 7f8b71d266c0 1 -- start start 2026-02-13T03:58:36.684 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.666+0000 7f8b71d266c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f8b6c10ecf0 0x7f8b6c0f81a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:36.684 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.666+0000 7f8b71d266c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8b6c10fe70 0x7f8b6c171190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:36.684 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.666+0000 7f8b71d266c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8b6c110820 0x7f8b6c0f89e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:36.684 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.666+0000 7f8b71d266c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6c0f95a0 con 0x7f8b6c10fe70 2026-02-13T03:58:36.684 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.666+0000 7f8b71d266c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6c0f9710 con 0x7f8b6c110820 2026-02-13T03:58:36.684 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.666+0000 7f8b71d266c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f8b6c0f98d0 con 0x7f8b6c10ecf0 2026-02-13T03:58:36.684 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.666+0000 7f8b715256c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8b6c110820 0x7f8b6c0f89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:36.685 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.666+0000 7f8b70d246c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f8b6c10ecf0 0x7f8b6c0f81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:36.685 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.666+0000 7f8b70d246c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f8b6c10ecf0 0x7f8b6c0f81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:51506/0 (socket says 10.20.193.92:51506) 2026-02-13T03:58:36.685 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.666+0000 7f8b70d246c0 1 -- 10.20.193.92:0/2106125630 learned_addr learned my addr 10.20.193.92:0/2106125630 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T03:58:36.685 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.666+0000 7f8b63fff6c0 1 --2- 10.20.193.92:0/2106125630 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8b6c10fe70 0x7f8b6c171190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:36.685 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.667+0000 7f8b70d246c0 1 -- 10.20.193.92:0/2106125630 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8b6c110820 msgr2=0x7f8b6c0f89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:36.685 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.667+0000 7f8b70d246c0 1 --2- 10.20.193.92:0/2106125630 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8b6c110820 0x7f8b6c0f89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.685 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.667+0000 7f8b70d246c0 1 -- 10.20.193.92:0/2106125630 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8b6c10fe70 msgr2=0x7f8b6c171190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:36.686 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.667+0000 7f8b70d246c0 1 --2- 10.20.193.92:0/2106125630 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8b6c10fe70 0x7f8b6c171190 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.686 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.667+0000 7f8b70d246c0 1 -- 10.20.193.92:0/2106125630 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b54009590 con 0x7f8b6c10ecf0 2026-02-13T03:58:36.686 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.667+0000 7f8b63fff6c0 1 --2- 10.20.193.92:0/2106125630 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8b6c10fe70 0x7f8b6c171190 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T03:58:36.686 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.667+0000 7f8b70d246c0 1 --2- 10.20.193.92:0/2106125630 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f8b6c10ecf0 0x7f8b6c0f81a0 secure :-1 s=READY pgs=13 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8b5c00b6c0 tx=0x7f8b5c00bb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:36.686 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.668+0000 7f8b61ffb6c0 1 -- 10.20.193.92:0/2106125630 <== mon.1 v2:10.20.193.158:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8b5c0044a0 con 0x7f8b6c10ecf0 2026-02-13T03:58:36.686 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.668+0000 7f8b71d266c0 1 -- 10.20.193.92:0/2106125630 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b6c0f9b50 con 0x7f8b6c10ecf0 2026-02-13T03:58:36.686 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.668+0000 7f8b71d266c0 1 -- 10.20.193.92:0/2106125630 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b6c0fa080 con 0x7f8b6c10ecf0 2026-02-13T03:58:36.687 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.668+0000 7f8b61ffb6c0 1 -- 10.20.193.92:0/2106125630 <== mon.1 v2:10.20.193.158:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f8b5c009030 con 0x7f8b6c10ecf0 2026-02-13T03:58:36.687 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.668+0000 7f8b61ffb6c0 1 -- 10.20.193.92:0/2106125630 <== mon.1 v2:10.20.193.158:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8b5c0044a0 con 0x7f8b6c10ecf0 2026-02-13T03:58:36.687 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.669+0000 7f8b71d266c0 1 -- 10.20.193.92:0/2106125630 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b34005310 con 0x7f8b6c10ecf0 2026-02-13T03:58:36.687 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.669+0000 7f8b61ffb6c0 1 -- 10.20.193.92:0/2106125630 <== mon.1 v2:10.20.193.158:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f8b5c00cbf0 con 0x7f8b6c10ecf0 2026-02-13T03:58:36.688 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.670+0000 7f8b61ffb6c0 1 --2- 10.20.193.92:0/2106125630 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f8b4803f880 0x7f8b4805fd30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:36.688 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.670+0000 7f8b61ffb6c0 1 -- 10.20.193.92:0/2106125630 <== mon.1 v2:10.20.193.158:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f8b5c050d10 con 0x7f8b6c10ecf0 2026-02-13T03:58:36.689 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.671+0000 7f8b63fff6c0 1 --2- 10.20.193.92:0/2106125630 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f8b4803f880 0x7f8b4805fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:36.689 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.671+0000 7f8b63fff6c0 1 --2- 10.20.193.92:0/2106125630 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f8b4803f880 0x7f8b4805fd30 secure :-1 s=READY pgs=18 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8b54002d00 tx=0x7f8b540023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:36.695 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.673+0000 7f7c5e2c86c0 1 -- 10.20.193.92:0/1830001309 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7c58157340 msgr2=0x7f7c581777d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:36.695 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.673+0000 7f7c56ffd6c0 1 -- 10.20.193.92:0/1830001309 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7c48004350 con 0x7f7c58157340 2026-02-13T03:58:36.695 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.673+0000 7f7c5e2c86c0 1 --2- 10.20.193.92:0/1830001309 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7c58157340 0x7f7c581777d0 secure :-1 s=READY pgs=98 gs=1 cs=0 l=1 c_cookie=10411802440516184402 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7c48009bd0 tx=0x7f7c4802efb0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.695 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.673+0000 7f7c5e2c86c0 1 -- 10.20.193.92:0/1830001309 shutdown_connections 2026-02-13T03:58:36.695 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.673+0000 7f7c5e2c86c0 1 --2- 10.20.193.92:0/1830001309 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7c581143e0 0x7f7c58114850 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.696 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.673+0000 7f7c5e2c86c0 1 --2- 10.20.193.92:0/1830001309 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7c58157340 0x7f7c581777d0 unknown :-1 s=CLOSED pgs=98 gs=1 cs=0 l=1 c_cookie=10411802440516184402 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.696 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.673+0000 7f7c5e2c86c0 1 --2- 10.20.193.92:0/1830001309 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7c5805e790 0x7f7c58113dc0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.696 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.673+0000 7f7c5e2c86c0 1 -- 10.20.193.92:0/1830001309 >> 10.20.193.92:0/1830001309 conn(0x7f7c5805b8e0 msgr2=0x7f7c5805bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:36.696 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.691+0000 7f7c5e2c86c0 1 -- 10.20.193.92:0/1830001309 shutdown_connections 2026-02-13T03:58:36.696 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.691+0000 7f7c5e2c86c0 1 -- 10.20.193.92:0/1830001309 wait complete. 2026-02-13T03:58:36.696 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.691+0000 7f7c5e2c86c0 1 Processor -- start 2026-02-13T03:58:36.696 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.692+0000 7f7c5e2c86c0 1 -- start start 2026-02-13T03:58:36.696 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.692+0000 7f7c5e2c86c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7c5805e790 0x7f7c580fedd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:36.696 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.692+0000 7f7c5e2c86c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7c581143e0 0x7f7c580ff420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:36.696 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.692+0000 7f7c5e2c86c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7c58157340 0x7f7c58100010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:36.696 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.692+0000 7f7c5e2c86c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7c581006e0 con 0x7f7c58157340 2026-02-13T03:58:36.697 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.692+0000 7f7c5e2c86c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7c58100850 con 0x7f7c5805e790 2026-02-13T03:58:36.697 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.692+0000 7f7c5e2c86c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f7c58100a10 con 0x7f7c581143e0 2026-02-13T03:58:36.698 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.693+0000 7f7c5c83a6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7c58157340 0x7f7c58100010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:36.698 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.693+0000 7f7c5c83a6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7c58157340 0x7f7c58100010 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:47794/0 (socket says 10.20.193.92:47794) 2026-02-13T03:58:36.698 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.693+0000 7f7c5c83a6c0 1 -- 10.20.193.92:0/843142928 learned_addr learned my addr 10.20.193.92:0/843142928 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T03:58:36.698 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.693+0000 7f7c5c83a6c0 1 -- 10.20.193.92:0/843142928 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7c581143e0 msgr2=0x7f7c580ff420 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T03:58:36.698 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.693+0000 7f7c5c83a6c0 1 --2- 10.20.193.92:0/843142928 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7c581143e0 0x7f7c580ff420 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.698 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.693+0000 7f7c5c83a6c0 1 -- 10.20.193.92:0/843142928 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7c5805e790 msgr2=0x7f7c580fedd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T03:58:36.698 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.693+0000 7f7c5c83a6c0 1 --2- 10.20.193.92:0/843142928 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7c5805e790 0x7f7c580fedd0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.699 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.693+0000 7f7c5c83a6c0 1 -- 10.20.193.92:0/843142928 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c48009590 con 0x7f7c58157340 2026-02-13T03:58:36.699 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.693+0000 7f7c5c83a6c0 1 --2- 10.20.193.92:0/843142928 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7c58157340 0x7f7c58100010 secure :-1 s=READY pgs=99 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7c48005b00 tx=0x7f7c48031830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:36.699 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.694+0000 7f7c557fa6c0 1 -- 10.20.193.92:0/843142928 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7c48031e50 con 0x7f7c58157340 2026-02-13T03:58:36.704 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.694+0000 7f7c557fa6c0 1 -- 10.20.193.92:0/843142928 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f7c4802fd40 con 0x7f7c58157340 2026-02-13T03:58:36.704 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.694+0000 7f7c557fa6c0 1 -- 10.20.193.92:0/843142928 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7c48007880 con 0x7f7c58157340 2026-02-13T03:58:36.705 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.694+0000 7f7c5e2c86c0 1 -- 10.20.193.92:0/843142928 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c58100c90 con 0x7f7c58157340 2026-02-13T03:58:36.705 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.694+0000 7f7c5e2c86c0 1 -- 10.20.193.92:0/843142928 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c58115140 con 0x7f7c58157340 2026-02-13T03:58:36.705 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.694+0000 7f8b61ffb6c0 1 -- 10.20.193.92:0/2106125630 <== mon.1 v2:10.20.193.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f8b5c00c410 con 0x7f8b6c10ecf0 2026-02-13T03:58:36.706 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.695+0000 7f7c5e2c86c0 1 -- 10.20.193.92:0/843142928 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c5817bf70 con 0x7f7c58157340 2026-02-13T03:58:36.706 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.699+0000 7f7c557fa6c0 1 -- 10.20.193.92:0/843142928 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 11) ==== 52725+0+0 (secure 0 0 0) 0x7f7c4802f810 con 0x7f7c58157340 2026-02-13T03:58:36.706 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.699+0000 7f7c557fa6c0 1 --2- 10.20.193.92:0/843142928 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f7c2c03f7a0 0x7f7c2c05fc50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:36.706 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.699+0000 7f7c557fa6c0 1 -- 10.20.193.92:0/843142928 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f7c48005c00 con 0x7f7c58157340 2026-02-13T03:58:36.706 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.699+0000 7f7c57fff6c0 1 --2- 10.20.193.92:0/843142928 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f7c2c03f7a0 0x7f7c2c05fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:36.707 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.700+0000 7f7c57fff6c0 1 --2- 10.20.193.92:0/843142928 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f7c2c03f7a0 0x7f7c2c05fc50 secure :-1 s=READY pgs=19 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7c5805dc60 tx=0x7f7c4c007d40 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:36.707 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.701+0000 7f7c557fa6c0 1 -- 10.20.193.92:0/843142928 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7c480313b0 con 0x7f7c58157340 2026-02-13T03:58:36.729 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:58:36.753 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:58:36.754 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:58:36.766 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:58:36.796 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.794+0000 7f7c557fa6c0 1 -- 10.20.193.92:0/843142928 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7f7c4802f810 con 0x7f7c58157340 2026-02-13T03:58:36.797 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.795+0000 7f8b61ffb6c0 1 -- 10.20.193.92:0/2106125630 <== mon.1 v2:10.20.193.158:3300/0 7 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7f8b5c0071c0 con 0x7f8b6c10ecf0 2026-02-13T03:58:36.809 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.806+0000 7f468085c6c0 1 -- 10.20.193.92:0/1764860248 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f46781554e0 msgr2=0x7f4678175990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:36.809 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.806+0000 7f468085c6c0 1 --2- 10.20.193.92:0/1764860248 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f46781554e0 0x7f4678175990 secure :-1 s=READY pgs=14 gs=1 cs=0 l=1 c_cookie=9657942120498510054 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f466c00aa40 tx=0x7f466c02fde0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.810 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.807+0000 7f468085c6c0 1 -- 10.20.193.92:0/1764860248 shutdown_connections 2026-02-13T03:58:36.810 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.807+0000 7f468085c6c0 1 --2- 10.20.193.92:0/1764860248 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f46781554e0 0x7f4678175990 unknown :-1 s=CLOSED pgs=14 gs=1 cs=0 l=1 c_cookie=9657942120498510054 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.810 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.807+0000 7f468085c6c0 1 --2- 10.20.193.92:0/1764860248 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4678134920 0x7f4678154da0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.811 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.807+0000 7f468085c6c0 1 --2- 10.20.193.92:0/1764860248 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4678113f70 0x7f4678134350 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.811 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.807+0000 7f468085c6c0 1 -- 10.20.193.92:0/1764860248 >> 10.20.193.92:0/1764860248 conn(0x7f467805b8e0 msgr2=0x7f467805bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:36.811 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.808+0000 7f468085c6c0 1 -- 10.20.193.92:0/1764860248 shutdown_connections 2026-02-13T03:58:36.811 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.808+0000 7f468085c6c0 1 -- 10.20.193.92:0/1764860248 wait complete. 2026-02-13T03:58:36.819 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.815+0000 7f468085c6c0 1 Processor -- start 2026-02-13T03:58:36.819 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.815+0000 7f468085c6c0 1 -- start start 2026-02-13T03:58:36.819 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.816+0000 7f468085c6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4678113f70 0x7f4678154da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:36.819 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.816+0000 7f468085c6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4678134920 0x7f46781758c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:36.819 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.816+0000 7f468085c6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f46781554e0 0x7f467817abb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:36.820 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.816+0000 7f468085c6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f467817b340 con 0x7f4678134920 2026-02-13T03:58:36.820 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.816+0000 7f468085c6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f467817b4b0 con 0x7f46781554e0 2026-02-13T03:58:36.820 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.816+0000 7f468085c6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f467817bb90 con 0x7f4678113f70 2026-02-13T03:58:36.821 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.819+0000 7f467e5d16c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4678113f70 0x7f4678154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:36.821 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.819+0000 7f467e5d16c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4678113f70 0x7f4678154da0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:51536/0 (socket says 10.20.193.92:51536) 2026-02-13T03:58:36.822 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.819+0000 7f467e5d16c0 1 -- 10.20.193.92:0/2163778126 learned_addr learned my addr 10.20.193.92:0/2163778126 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T03:58:36.828 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.825+0000 7f467ddd06c0 1 --2- 10.20.193.92:0/2163778126 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4678134920 0x7f46781758c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:36.828 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.826+0000 7f467ddd06c0 1 -- 10.20.193.92:0/2163778126 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4678113f70 msgr2=0x7f4678154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:36.838 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.835+0000 7f467edd26c0 1 --2- 10.20.193.92:0/2163778126 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f46781554e0 0x7f467817abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:36.838 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.835+0000 7f467ddd06c0 1 --2- 10.20.193.92:0/2163778126 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4678113f70 0x7f4678154da0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.838 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.835+0000 7f467ddd06c0 1 -- 10.20.193.92:0/2163778126 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f46781554e0 msgr2=0x7f467817abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:36.838 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.835+0000 7f467ddd06c0 1 --2- 10.20.193.92:0/2163778126 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f46781554e0 0x7f467817abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.839 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.836+0000 7f467ddd06c0 1 -- 10.20.193.92:0/2163778126 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f466c00a660 con 0x7f4678134920 2026-02-13T03:58:36.839 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.836+0000 7f467edd26c0 1 --2- 10.20.193.92:0/2163778126 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f46781554e0 0x7f467817abb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:58:36.839 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.836+0000 7f467e5d16c0 1 --2- 10.20.193.92:0/2163778126 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4678113f70 0x7f4678154da0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:58:36.840 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.837+0000 7f467ddd06c0 1 --2- 10.20.193.92:0/2163778126 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4678134920 0x7f46781758c0 secure :-1 s=READY pgs=100 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f466400ba30 tx=0x7f466400bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:36.840 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.837+0000 7f7c5e2c86c0 1 -- 10.20.193.92:0/843142928 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f7c1c0051d0 con 0x7f7c58157340 2026-02-13T03:58:36.840 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.837+0000 7f46637fe6c0 1 -- 10.20.193.92:0/2163778126 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4664004350 con 0x7f4678134920 2026-02-13T03:58:36.841 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.838+0000 7f46637fe6c0 1 -- 10.20.193.92:0/2163778126 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f4664009030 con 0x7f4678134920 2026-02-13T03:58:36.841 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.838+0000 7f468085c6c0 1 -- 10.20.193.92:0/2163778126 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f467817be70 con 0x7f4678134920 2026-02-13T03:58:36.841 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.838+0000 7f46637fe6c0 1 -- 10.20.193.92:0/2163778126 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f46640071c0 con 0x7f4678134920 2026-02-13T03:58:36.842 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.839+0000 7f468085c6c0 1 -- 10.20.193.92:0/2163778126 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f467817c350 con 0x7f4678134920 2026-02-13T03:58:36.843 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.840+0000 7f7c557fa6c0 1 -- 10.20.193.92:0/843142928 <== mon.0 v2:10.20.193.92:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v18)=0 v18) ==== 115+0+0 (secure 0 0 0) 0x7f7c48034db0 con 0x7f7c58157340 2026-02-13T03:58:36.847 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.842+0000 7f468085c6c0 1 -- 10.20.193.92:0/2163778126 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4640005310 con 0x7f4678134920 2026-02-13T03:58:36.848 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.844+0000 7f7c5e2c86c0 1 -- 10.20.193.92:0/843142928 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f7c2c03f7a0 msgr2=0x7f7c2c05fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:36.848 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.844+0000 7f7c5e2c86c0 1 --2- 10.20.193.92:0/843142928 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f7c2c03f7a0 0x7f7c2c05fc50 secure :-1 s=READY pgs=19 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7c5805dc60 tx=0x7f7c4c007d40 comp rx=0 tx=0).stop 2026-02-13T03:58:36.848 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.844+0000 7f7c5e2c86c0 1 -- 10.20.193.92:0/843142928 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7c58157340 msgr2=0x7f7c58100010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:36.848 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.844+0000 7f7c5e2c86c0 1 --2- 10.20.193.92:0/843142928 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7c58157340 0x7f7c58100010 secure :-1 s=READY pgs=99 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7c48005b00 tx=0x7f7c48031830 comp rx=0 tx=0).stop 2026-02-13T03:58:36.850 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.846+0000 7f46637fe6c0 1 -- 10.20.193.92:0/2163778126 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7f46640026b0 con 0x7f4678134920 2026-02-13T03:58:36.850 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.847+0000 7f46637fe6c0 1 --2- 10.20.193.92:0/2163778126 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f465003f990 0x7f465005fe40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:36.850 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.847+0000 7f46637fe6c0 1 -- 10.20.193.92:0/2163778126 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f4664051340 con 0x7f4678134920 2026-02-13T03:58:36.853 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.851+0000 7f7c5e2c86c0 1 -- 10.20.193.92:0/843142928 shutdown_connections 2026-02-13T03:58:36.853 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.851+0000 7f7c5e2c86c0 1 --2- 10.20.193.92:0/843142928 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7c58157340 0x7f7c58100010 unknown :-1 s=CLOSED pgs=99 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.853 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.851+0000 7f7c5e2c86c0 1 --2- 10.20.193.92:0/843142928 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7c581143e0 0x7f7c580ff420 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.854 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.851+0000 7f7c5e2c86c0 1 --2- 10.20.193.92:0/843142928 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f7c2c03f7a0 0x7f7c2c05fc50 unknown :-1 s=CLOSED pgs=19 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.854 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.851+0000 7f7c5e2c86c0 1 --2- 10.20.193.92:0/843142928 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7c5805e790 0x7f7c580fedd0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.854 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.851+0000 7f7c5e2c86c0 1 -- 10.20.193.92:0/843142928 >> 10.20.193.92:0/843142928 conn(0x7f7c5805b8e0 msgr2=0x7f7c580f5690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:36.854 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.851+0000 7f7c5e2c86c0 1 -- 10.20.193.92:0/843142928 shutdown_connections 2026-02-13T03:58:36.854 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.851+0000 7f7c5e2c86c0 1 -- 10.20.193.92:0/843142928 wait complete. 2026-02-13T03:58:36.854 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.852+0000 7f467e5d16c0 1 --2- 10.20.193.92:0/2163778126 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f465003f990 0x7f465005fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:36.855 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.853+0000 7f467e5d16c0 1 --2- 10.20.193.92:0/2163778126 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f465003f990 0x7f465005fe40 secure :-1 s=READY pgs=20 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4670009240 tx=0x7f467000a340 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:36.855 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.853+0000 7f46637fe6c0 1 -- 10.20.193.92:0/2163778126 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f466400a270 con 0x7f4678134920 2026-02-13T03:58:36.864 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:58:36.867 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.864+0000 7f8b71d266c0 1 -- 10.20.193.92:0/2106125630 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f8b34005b40 con 0x7f8b6c10ecf0 2026-02-13T03:58:36.877 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.872+0000 7f8b61ffb6c0 1 -- 10.20.193.92:0/2106125630 <== mon.1 v2:10.20.193.158:3300/0 8 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v19)=0 v19) ==== 121+0+0 (secure 0 0 0) 0x7f8b5c00fb90 con 0x7f8b6c10ecf0 2026-02-13T03:58:36.878 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.875+0000 7f8b71d266c0 1 -- 10.20.193.92:0/2106125630 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f8b4803f880 msgr2=0x7f8b4805fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:36.878 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.875+0000 7f8b71d266c0 1 --2- 10.20.193.92:0/2106125630 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f8b4803f880 0x7f8b4805fd30 secure :-1 s=READY pgs=18 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8b54002d00 tx=0x7f8b540023a0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.878 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.875+0000 7f8b71d266c0 1 -- 10.20.193.92:0/2106125630 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f8b6c10ecf0 msgr2=0x7f8b6c0f81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:36.878 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.875+0000 7f8b71d266c0 1 --2- 10.20.193.92:0/2106125630 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f8b6c10ecf0 0x7f8b6c0f81a0 secure :-1 s=READY pgs=13 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8b5c00b6c0 tx=0x7f8b5c00bb90 comp rx=0 tx=0).stop 2026-02-13T03:58:36.879 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.875+0000 7f8b71d266c0 1 -- 10.20.193.92:0/2106125630 shutdown_connections 2026-02-13T03:58:36.879 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.875+0000 7f8b71d266c0 1 --2- 10.20.193.92:0/2106125630 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f8b4803f880 0x7f8b4805fd30 unknown :-1 s=CLOSED pgs=18 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.879 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.875+0000 7f8b71d266c0 1 --2- 10.20.193.92:0/2106125630 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8b6c110820 0x7f8b6c0f89e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.879 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.875+0000 7f8b71d266c0 1 --2- 10.20.193.92:0/2106125630 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8b6c10fe70 0x7f8b6c171190 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.879 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.875+0000 7f8b71d266c0 1 --2- 10.20.193.92:0/2106125630 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f8b6c10ecf0 0x7f8b6c0f81a0 unknown :-1 s=CLOSED pgs=13 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.879 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.875+0000 7f8b71d266c0 1 -- 10.20.193.92:0/2106125630 >> 10.20.193.92:0/2106125630 conn(0x7f8b6c0ec410 msgr2=0x7f8b6c0ee220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:36.879 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.876+0000 7f8b71d266c0 1 -- 10.20.193.92:0/2106125630 shutdown_connections 2026-02-13T03:58:36.879 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.876+0000 7f8b71d266c0 1 -- 10.20.193.92:0/2106125630 wait complete. 2026-02-13T03:58:36.895 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.892+0000 7f7f2d18f6c0 1 -- 10.20.193.92:0/1754145741 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7f200bcaf0 msgr2=0x7f7f2011d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:36.895 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.892+0000 7f7f2d18f6c0 1 --2- 10.20.193.92:0/1754145741 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7f200bcaf0 0x7f7f2011d460 secure :-1 s=READY pgs=14 gs=2 cs=0 l=1 c_cookie=23060115418296418 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f28000b70 tx=0x7f7f28088140 comp rx=0 tx=0).stop 2026-02-13T03:58:36.896 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.893+0000 7f7f2d18f6c0 1 -- 10.20.193.92:0/1754145741 shutdown_connections 2026-02-13T03:58:36.896 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.893+0000 7f7f2d18f6c0 1 --2- 10.20.193.92:0/1754145741 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7f200bcaf0 0x7f7f2011d460 unknown :-1 s=CLOSED pgs=14 gs=2 cs=0 l=1 c_cookie=23060115418296418 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.896 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.893+0000 7f7f2d18f6c0 1 --2- 10.20.193.92:0/1754145741 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7f200bc140 0x7f7f200bc5b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.896 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.893+0000 7f7f2d18f6c0 1 --2- 10.20.193.92:0/1754145741 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7f200bafc0 0x7f7f200bb3b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.896 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.893+0000 7f7f2d18f6c0 1 -- 10.20.193.92:0/1754145741 >> 10.20.193.92:0/1754145741 conn(0x7f7f2000bef0 msgr2=0x7f7f2000c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:36.896 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.893+0000 7f7f2d18f6c0 1 -- 10.20.193.92:0/1754145741 shutdown_connections 2026-02-13T03:58:36.896 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.893+0000 7f7f2d18f6c0 1 -- 10.20.193.92:0/1754145741 wait complete. 2026-02-13T03:58:36.897 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.894+0000 7f7f2d18f6c0 1 Processor -- start 2026-02-13T03:58:36.897 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.894+0000 7f7f2d18f6c0 1 -- start start 2026-02-13T03:58:36.898 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.895+0000 7f7f2d18f6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7f200bafc0 0x7f7f200a5ee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:36.898 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.895+0000 7f7f2d18f6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7f200bc140 0x7f7f2011d440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:36.898 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.895+0000 7f7f2d18f6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7f200bcaf0 0x7f7f200a6720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:36.898 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.895+0000 7f7f26d766c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7f200bafc0 0x7f7f200a5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:36.898 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.895+0000 7f7f26d766c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7f200bafc0 0x7f7f200a5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:59534/0 (socket says 10.20.193.92:59534) 2026-02-13T03:58:36.899 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.895+0000 7f7f265756c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7f200bc140 0x7f7f2011d440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:36.899 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.895+0000 7f7f265756c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7f200bc140 0x7f7f2011d440 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:51566/0 (socket says 10.20.193.92:51566) 2026-02-13T03:58:36.899 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.895+0000 7f7f26d766c0 1 -- 10.20.193.92:0/3978408429 learned_addr learned my addr 10.20.193.92:0/3978408429 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T03:58:36.899 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.895+0000 7f7f2d18f6c0 1 -- 10.20.193.92:0/3978408429 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7f200a7320 con 0x7f7f200bcaf0 2026-02-13T03:58:36.899 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.895+0000 7f7f2d18f6c0 1 -- 10.20.193.92:0/3978408429 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7f200a7490 con 0x7f7f200bafc0 2026-02-13T03:58:36.899 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.895+0000 7f7f2d18f6c0 1 -- 10.20.193.92:0/3978408429 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f7f200a7650 con 0x7f7f200bc140 2026-02-13T03:58:36.899 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.896+0000 7f7f2c98e6c0 1 --2- 10.20.193.92:0/3978408429 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7f200bcaf0 0x7f7f200a6720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:36.899 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.896+0000 7f7f265756c0 1 -- 10.20.193.92:0/3978408429 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7f200bafc0 msgr2=0x7f7f200a5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:36.899 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.896+0000 7f7f265756c0 1 --2- 10.20.193.92:0/3978408429 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7f200bafc0 0x7f7f200a5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.899 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.896+0000 7f7f265756c0 1 -- 10.20.193.92:0/3978408429 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7f200bcaf0 msgr2=0x7f7f200a6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:36.899 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.896+0000 7f7f265756c0 1 --2- 10.20.193.92:0/3978408429 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7f200bcaf0 0x7f7f200a6720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:36.899 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.896+0000 7f7f265756c0 1 -- 10.20.193.92:0/3978408429 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f28038e80 con 0x7f7f200bc140 2026-02-13T03:58:36.901 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.899+0000 7f7f265756c0 1 --2- 10.20.193.92:0/3978408429 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7f200bc140 0x7f7f2011d440 secure :-1 s=READY pgs=15 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f1000b440 tx=0x7f7f1000b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:36.903 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.899+0000 7f7f07fff6c0 1 -- 10.20.193.92:0/3978408429 <== mon.1 v2:10.20.193.158:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7f100044a0 con 0x7f7f200bc140 2026-02-13T03:58:36.903 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.899+0000 7f7f07fff6c0 1 -- 10.20.193.92:0/3978408429 <== mon.1 v2:10.20.193.158:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f7f10002be0 con 0x7f7f200bc140 2026-02-13T03:58:36.903 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.900+0000 7f7f07fff6c0 1 -- 10.20.193.92:0/3978408429 <== mon.1 v2:10.20.193.158:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7f1000cdc0 con 0x7f7f200bc140 2026-02-13T03:58:36.903 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.900+0000 7f7f2d18f6c0 1 -- 10.20.193.92:0/3978408429 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f200a78d0 con 0x7f7f200bc140 2026-02-13T03:58:36.903 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.900+0000 7f7f2d18f6c0 1 -- 10.20.193.92:0/3978408429 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f200a7d30 con 0x7f7f200bc140 2026-02-13T03:58:36.903 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.900+0000 7f7f2d18f6c0 1 -- 10.20.193.92:0/3978408429 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7eec005310 con 0x7f7f200bc140 2026-02-13T03:58:36.906 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.904+0000 7f7f07fff6c0 1 -- 10.20.193.92:0/3978408429 <== mon.1 v2:10.20.193.158:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7f7f100026b0 con 0x7f7f200bc140 2026-02-13T03:58:36.908 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.905+0000 7f7f07fff6c0 1 --2- 10.20.193.92:0/3978408429 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f7efc03f910 0x7f7efc05fdc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:36.908 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.905+0000 7f7f07fff6c0 1 -- 10.20.193.92:0/3978408429 <== mon.1 v2:10.20.193.158:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f7f100510d0 con 0x7f7f200bc140 2026-02-13T03:58:36.908 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.905+0000 7f7f07fff6c0 1 -- 10.20.193.92:0/3978408429 <== mon.1 v2:10.20.193.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7f10051460 con 0x7f7f200bc140 2026-02-13T03:58:36.908 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.905+0000 7f7f26d766c0 1 --2- 10.20.193.92:0/3978408429 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f7efc03f910 0x7f7efc05fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:36.909 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.906+0000 7f7f26d766c0 1 --2- 10.20.193.92:0/3978408429 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f7efc03f910 0x7f7efc05fdc0 secure :-1 s=READY pgs=21 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f1c0095e0 tx=0x7f7f1c009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:36.949 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:58:36.962 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:58:36.993 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.989+0000 7f468085c6c0 1 -- 10.20.193.92:0/2163778126 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f46400055c0 con 0x7f4678134920 2026-02-13T03:58:37.005 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:36.994+0000 7f46637fe6c0 1 -- 10.20.193.92:0/2163778126 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v20)=0 v20) ==== 106+0+0 (secure 0 0 0) 0x7f466400a270 con 0x7f4678134920 2026-02-13T03:58:37.013 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:58:37.014 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.012+0000 7f468085c6c0 1 -- 10.20.193.92:0/2163778126 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f465003f990 msgr2=0x7f465005fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.015 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.012+0000 7f468085c6c0 1 --2- 10.20.193.92:0/2163778126 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f465003f990 0x7f465005fe40 secure :-1 s=READY pgs=20 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4670009240 tx=0x7f467000a340 comp rx=0 tx=0).stop 2026-02-13T03:58:37.015 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.012+0000 7f468085c6c0 1 -- 10.20.193.92:0/2163778126 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4678134920 msgr2=0x7f46781758c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.015 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.012+0000 7f468085c6c0 1 --2- 10.20.193.92:0/2163778126 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4678134920 0x7f46781758c0 secure :-1 s=READY pgs=100 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f466400ba30 tx=0x7f466400bf00 comp rx=0 tx=0).stop 2026-02-13T03:58:37.047 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.041+0000 7f468085c6c0 1 -- 10.20.193.92:0/2163778126 shutdown_connections 2026-02-13T03:58:37.047 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.041+0000 7f468085c6c0 1 --2- 10.20.193.92:0/2163778126 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f465003f990 0x7f465005fe40 unknown :-1 s=CLOSED pgs=20 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.047 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.041+0000 7f468085c6c0 1 --2- 10.20.193.92:0/2163778126 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f46781554e0 0x7f467817abb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.047 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.041+0000 7f468085c6c0 1 --2- 10.20.193.92:0/2163778126 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4678134920 0x7f46781758c0 unknown :-1 s=CLOSED pgs=100 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.048 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.041+0000 7f468085c6c0 1 --2- 10.20.193.92:0/2163778126 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4678113f70 0x7f4678154da0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.048 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.041+0000 7f468085c6c0 1 -- 10.20.193.92:0/2163778126 >> 10.20.193.92:0/2163778126 conn(0x7f467805b8e0 msgr2=0x7f46780f6050 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:37.053 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.051+0000 7f468085c6c0 1 -- 10.20.193.92:0/2163778126 shutdown_connections 2026-02-13T03:58:37.054 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.051+0000 7f468085c6c0 1 -- 10.20.193.92:0/2163778126 wait complete. 2026-02-13T03:58:37.058 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:58:37.061 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:58:37.064 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:58:37.092 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.088+0000 7f117ca2f6c0 1 -- 10.20.193.92:0/1060080916 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1178155310 msgr2=0x7f11781757c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.092 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.088+0000 7f117ca2f6c0 1 --2- 10.20.193.92:0/1060080916 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1178155310 0x7f11781757c0 secure :-1 s=READY pgs=15 gs=1 cs=0 l=1 c_cookie=9972866870706447343 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1170008640 tx=0x7f1170030f70 comp rx=0 tx=0).stop 2026-02-13T03:58:37.099 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.097+0000 7f117ca2f6c0 1 -- 10.20.193.92:0/1060080916 shutdown_connections 2026-02-13T03:58:37.099 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.097+0000 7f117ca2f6c0 1 --2- 10.20.193.92:0/1060080916 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1178155310 0x7f11781757c0 unknown :-1 s=CLOSED pgs=15 gs=1 cs=0 l=1 c_cookie=9972866870706447343 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.100 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.097+0000 7f117ca2f6c0 1 --2- 10.20.193.92:0/1060080916 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1178134770 0x7f1178154bd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.100 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.097+0000 7f117ca2f6c0 1 --2- 10.20.193.92:0/1060080916 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1178113dc0 0x7f11781341a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.100 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.097+0000 7f117ca2f6c0 1 -- 10.20.193.92:0/1060080916 >> 10.20.193.92:0/1060080916 conn(0x7f117805b700 msgr2=0x7f117805bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:37.100 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.097+0000 7f117ca2f6c0 1 -- 10.20.193.92:0/1060080916 shutdown_connections 2026-02-13T03:58:37.100 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.097+0000 7f117ca2f6c0 1 -- 10.20.193.92:0/1060080916 wait complete. 2026-02-13T03:58:37.100 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.098+0000 7f117ca2f6c0 1 Processor -- start 2026-02-13T03:58:37.101 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.098+0000 7f117ca2f6c0 1 -- start start 2026-02-13T03:58:37.101 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.099+0000 7f117ca2f6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1178113dc0 0x7f1178154bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.103 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.099+0000 7f117ca2f6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1178134770 0x7f11781756f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.103 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.099+0000 7f117ca2f6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1178155310 0x7f1178105150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.103 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.099+0000 7f117ca2f6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f11781058e0 con 0x7f1178134770 2026-02-13T03:58:37.104 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.099+0000 7f117ca2f6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1178105a50 con 0x7f1178113dc0 2026-02-13T03:58:37.104 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.099+0000 7f117ca2f6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f11781038a0 con 0x7f1178155310 2026-02-13T03:58:37.104 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.100+0000 7f11775776c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1178155310 0x7f1178105150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.104 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.100+0000 7f11775776c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1178155310 0x7f1178105150 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:51582/0 (socket says 10.20.193.92:51582) 2026-02-13T03:58:37.104 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.100+0000 7f11775776c0 1 -- 10.20.193.92:0/1834119391 learned_addr learned my addr 10.20.193.92:0/1834119391 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T03:58:37.104 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.100+0000 7f11765756c0 1 --2- 10.20.193.92:0/1834119391 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1178113dc0 0x7f1178154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.104 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.100+0000 7f11775776c0 1 -- 10.20.193.92:0/1834119391 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1178113dc0 msgr2=0x7f1178154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.104 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.100+0000 7f11775776c0 1 --2- 10.20.193.92:0/1834119391 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1178113dc0 0x7f1178154bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.104 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.100+0000 7f11775776c0 1 -- 10.20.193.92:0/1834119391 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1178134770 msgr2=0x7f11781756f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.104 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.100+0000 7f11775776c0 1 --2- 10.20.193.92:0/1834119391 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1178134770 0x7f11781756f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.105 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.100+0000 7f11775776c0 1 -- 10.20.193.92:0/1834119391 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11600094c0 con 0x7f1178155310 2026-02-13T03:58:37.105 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.100+0000 7f11775776c0 1 --2- 10.20.193.92:0/1834119391 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1178155310 0x7f1178105150 secure :-1 s=READY pgs=16 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1170031c10 tx=0x7f1170031ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:37.105 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.100+0000 7f11677fe6c0 1 -- 10.20.193.92:0/1834119391 <== mon.1 v2:10.20.193.158:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f117000b030 con 0x7f1178155310 2026-02-13T03:58:37.105 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.100+0000 7f11677fe6c0 1 -- 10.20.193.92:0/1834119391 <== mon.1 v2:10.20.193.158:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f1170003e60 con 0x7f1178155310 2026-02-13T03:58:37.105 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.100+0000 7f117ca2f6c0 1 -- 10.20.193.92:0/1834119391 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1170008260 con 0x7f1178155310 2026-02-13T03:58:37.105 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.100+0000 7f117ca2f6c0 1 -- 10.20.193.92:0/1834119391 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1178103e10 con 0x7f1178155310 2026-02-13T03:58:37.105 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.100+0000 7f11677fe6c0 1 -- 10.20.193.92:0/1834119391 <== mon.1 v2:10.20.193.158:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f117000b030 con 0x7f1178155310 2026-02-13T03:58:37.106 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.102+0000 7f11677fe6c0 1 -- 10.20.193.92:0/1834119391 <== mon.1 v2:10.20.193.158:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7f11700042f0 con 0x7f1178155310 2026-02-13T03:58:37.106 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.102+0000 7f11677fe6c0 1 --2- 10.20.193.92:0/1834119391 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f115803f9a0 0x7f115805fe50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.106 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.102+0000 7f11677fe6c0 1 -- 10.20.193.92:0/1834119391 <== mon.1 v2:10.20.193.158:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f11700763f0 con 0x7f1178155310 2026-02-13T03:58:37.106 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.102+0000 7f11765756c0 1 --2- 10.20.193.92:0/1834119391 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f115803f9a0 0x7f115805fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.106 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.103+0000 7f11765756c0 1 --2- 10.20.193.92:0/1834119391 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f115803f9a0 0x7f115805fe50 secure :-1 s=READY pgs=22 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f116c004750 tx=0x7f116c009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:37.116 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.111+0000 7f117ca2f6c0 1 -- 10.20.193.92:0/1834119391 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f113c005310 con 0x7f1178155310 2026-02-13T03:58:37.117 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.114+0000 7f11677fe6c0 1 -- 10.20.193.92:0/1834119391 <== mon.1 v2:10.20.193.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1170032040 con 0x7f1178155310 2026-02-13T03:58:37.198 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.193+0000 7f7f2d18f6c0 1 -- 10.20.193.92:0/3978408429 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f7eec0055c0 con 0x7f7f200bc140 2026-02-13T03:58:37.202 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.197+0000 7f49e18836c0 1 -- 10.20.193.92:0/2934307088 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f49dc113f70 msgr2=0x7f49dc134350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.202 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.197+0000 7f49e18836c0 1 --2- 10.20.193.92:0/2934307088 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f49dc113f70 0x7f49dc134350 secure :-1 s=READY pgs=101 gs=1 cs=0 l=1 c_cookie=15670856280205938506 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49d000bc00 tx=0x7f49d0030ff0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.202 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.199+0000 7f49e18836c0 1 -- 10.20.193.92:0/2934307088 shutdown_connections 2026-02-13T03:58:37.202 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.199+0000 7f49e18836c0 1 --2- 10.20.193.92:0/2934307088 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f49dc134920 0x7f49dc154da0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.202 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.199+0000 7f49e18836c0 1 --2- 10.20.193.92:0/2934307088 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f49dc1554e0 0x7f49dc175990 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.202 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.199+0000 7f49e18836c0 1 --2- 10.20.193.92:0/2934307088 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f49dc113f70 0x7f49dc134350 unknown :-1 s=CLOSED pgs=101 gs=1 cs=0 l=1 c_cookie=15670856280205938506 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.202 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.199+0000 7f49e18836c0 1 -- 10.20.193.92:0/2934307088 >> 10.20.193.92:0/2934307088 conn(0x7f49dc05b8e0 msgr2=0x7f49dc05bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:37.203 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.200+0000 7f49e18836c0 1 -- 10.20.193.92:0/2934307088 shutdown_connections 2026-02-13T03:58:37.206 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.200+0000 7f49e18836c0 1 -- 10.20.193.92:0/2934307088 wait complete. 2026-02-13T03:58:37.207 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.204+0000 7f49e18836c0 1 Processor -- start 2026-02-13T03:58:37.222 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.219+0000 7f49e18836c0 1 -- start start 2026-02-13T03:58:37.224 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.220+0000 7f49e18836c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f49dc113f70 0x7f49dc175990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.224 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.220+0000 7f49e18836c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f49dc134920 0x7f49dc154d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.225 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.221+0000 7f49e18836c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f49dc1554e0 0x7f49dc0ff880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.225 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.221+0000 7f49e18836c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f49dc100010 con 0x7f49dc134920 2026-02-13T03:58:37.225 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.221+0000 7f49e18836c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f49dc100180 con 0x7f49dc113f70 2026-02-13T03:58:37.225 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.221+0000 7f49e18836c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f49dc1007c0 con 0x7f49dc1554e0 2026-02-13T03:58:37.225 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.221+0000 7f49da7fc6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f49dc134920 0x7f49dc154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.225 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.221+0000 7f49da7fc6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f49dc134920 0x7f49dc154d40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:47850/0 (socket says 10.20.193.92:47850) 2026-02-13T03:58:37.225 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.221+0000 7f49da7fc6c0 1 -- 10.20.193.92:0/2820354456 learned_addr learned my addr 10.20.193.92:0/2820354456 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T03:58:37.225 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.221+0000 7f49da7fc6c0 1 -- 10.20.193.92:0/2820354456 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f49dc1554e0 msgr2=0x7f49dc0ff880 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T03:58:37.225 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.221+0000 7f49da7fc6c0 1 --2- 10.20.193.92:0/2820354456 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f49dc1554e0 0x7f49dc0ff880 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.225 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.221+0000 7f49da7fc6c0 1 -- 10.20.193.92:0/2820354456 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f49dc113f70 msgr2=0x7f49dc175990 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T03:58:37.225 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.221+0000 7f49da7fc6c0 1 --2- 10.20.193.92:0/2820354456 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f49dc113f70 0x7f49dc175990 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.226 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.221+0000 7f49da7fc6c0 1 -- 10.20.193.92:0/2820354456 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49d000b820 con 0x7f49dc134920 2026-02-13T03:58:37.226 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.222+0000 7f49da7fc6c0 1 --2- 10.20.193.92:0/2820354456 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f49dc134920 0x7f49dc154d40 secure :-1 s=READY pgs=102 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49c400ba30 tx=0x7f49c400bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:37.233 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.223+0000 7f49e087d6c0 1 -- 10.20.193.92:0/2820354456 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f49c4004a80 con 0x7f49dc134920 2026-02-13T03:58:37.233 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.225+0000 7f49e18836c0 1 -- 10.20.193.92:0/2820354456 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49dc100a50 con 0x7f49dc134920 2026-02-13T03:58:37.233 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.225+0000 7f49e087d6c0 1 -- 10.20.193.92:0/2820354456 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f49c4009030 con 0x7f49dc134920 2026-02-13T03:58:37.233 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.227+0000 7f49e087d6c0 1 -- 10.20.193.92:0/2820354456 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f49c4007440 con 0x7f49dc134920 2026-02-13T03:58:37.233 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.227+0000 7f49e18836c0 1 -- 10.20.193.92:0/2820354456 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49dc100f30 con 0x7f49dc134920 2026-02-13T03:58:37.235 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.231+0000 7f66ba2186c0 1 -- 10.20.193.92:0/404292383 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f66ac107a60 msgr2=0x7f66ac127e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.235 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.231+0000 7f66ba2186c0 1 --2- 10.20.193.92:0/404292383 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f66ac107a60 0x7f66ac127e60 secure :-1 s=READY pgs=103 gs=1 cs=0 l=1 c_cookie=17816875222167363951 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66a8010240 tx=0x7f66a80345a0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.235 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.232+0000 7f66ba2186c0 1 -- 10.20.193.92:0/404292383 shutdown_connections 2026-02-13T03:58:37.235 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.232+0000 7f66ba2186c0 1 --2- 10.20.193.92:0/404292383 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f66ac107a60 0x7f66ac127e60 unknown :-1 s=CLOSED pgs=103 gs=1 cs=0 l=1 c_cookie=17816875222167363951 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.235 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.232+0000 7f66ba2186c0 1 --2- 10.20.193.92:0/404292383 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f66ac0c41a0 0x7f66ac107520 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.237 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.232+0000 7f66ba2186c0 1 --2- 10.20.193.92:0/404292383 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f66ac0c3870 0x7f66ac0c3c60 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.237 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.232+0000 7f66ba2186c0 1 -- 10.20.193.92:0/404292383 >> 10.20.193.92:0/404292383 conn(0x7f66ac0a1550 msgr2=0x7f66ac0c1960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:37.237 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.232+0000 7f66ba2186c0 1 -- 10.20.193.92:0/404292383 shutdown_connections 2026-02-13T03:58:37.238 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.232+0000 7f66ba2186c0 1 -- 10.20.193.92:0/404292383 wait complete. 2026-02-13T03:58:37.238 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.234+0000 7f66ba2186c0 1 Processor -- start 2026-02-13T03:58:37.238 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.234+0000 7f66ba2186c0 1 -- start start 2026-02-13T03:58:37.238 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.234+0000 7f66ba2186c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f66ac0c3870 0x7f66ac0a52b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.238 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.234+0000 7f66ba2186c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f66ac0c41a0 0x7f66ac107520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.238 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.234+0000 7f66ba2186c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f66ac107a60 0x7f66ac0a5b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.241 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.235+0000 7f66ba2186c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f66ac0a6740 con 0x7f66ac0c41a0 2026-02-13T03:58:37.241 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.235+0000 7f66ba2186c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f66ac0a68b0 con 0x7f66ac107a60 2026-02-13T03:58:37.241 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.235+0000 7f66b2ffd6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f66ac0c41a0 0x7f66ac107520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.241 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.235+0000 7f66ba2186c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f66ac0a6a70 con 0x7f66ac0c3870 2026-02-13T03:58:37.241 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.235+0000 7f66b2ffd6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f66ac0c41a0 0x7f66ac107520 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:47860/0 (socket says 10.20.193.92:47860) 2026-02-13T03:58:37.242 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.235+0000 7f66b2ffd6c0 1 -- 10.20.193.92:0/3831284443 learned_addr learned my addr 10.20.193.92:0/3831284443 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T03:58:37.242 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.236+0000 7f66b2ffd6c0 1 -- 10.20.193.92:0/3831284443 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f66ac0c3870 msgr2=0x7f66ac0a52b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T03:58:37.242 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.236+0000 7f66b2ffd6c0 1 --2- 10.20.193.92:0/3831284443 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f66ac0c3870 0x7f66ac0a52b0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.242 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.236+0000 7f66b2ffd6c0 1 -- 10.20.193.92:0/3831284443 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f66ac107a60 msgr2=0x7f66ac0a5b10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T03:58:37.242 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.236+0000 7f66b2ffd6c0 1 --2- 10.20.193.92:0/3831284443 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f66ac107a60 0x7f66ac0a5b10 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.242 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.236+0000 7f66b2ffd6c0 1 -- 10.20.193.92:0/3831284443 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66a800eb70 con 0x7f66ac0c41a0 2026-02-13T03:58:37.242 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.237+0000 7f66b2ffd6c0 1 --2- 10.20.193.92:0/3831284443 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f66ac0c41a0 0x7f66ac107520 secure :-1 s=READY pgs=104 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66a400b6c0 tx=0x7f66a400bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:37.243 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.238+0000 7f66b0ff96c0 1 -- 10.20.193.92:0/3831284443 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f66a40044a0 con 0x7f66ac0c41a0 2026-02-13T03:58:37.243 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.238+0000 7f66b0ff96c0 1 -- 10.20.193.92:0/3831284443 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f66a4004600 con 0x7f66ac0c41a0 2026-02-13T03:58:37.243 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.238+0000 7f66b0ff96c0 1 -- 10.20.193.92:0/3831284443 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f66a400ce80 con 0x7f66ac0c41a0 2026-02-13T03:58:37.243 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.238+0000 7f66ba2186c0 1 -- 10.20.193.92:0/3831284443 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66ac0a6d50 con 0x7f66ac0c41a0 2026-02-13T03:58:37.243 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.238+0000 7f66ba2186c0 1 -- 10.20.193.92:0/3831284443 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66ac0a7260 con 0x7f66ac0c41a0 2026-02-13T03:58:37.246 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.241+0000 7f66b0ff96c0 1 -- 10.20.193.92:0/3831284443 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7f66a400e160 con 0x7f66ac0c41a0 2026-02-13T03:58:37.246 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.242+0000 7f66b0ff96c0 1 --2- 10.20.193.92:0/3831284443 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f668403f990 0x7f668405fe40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.246 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.242+0000 7f66b0ff96c0 1 -- 10.20.193.92:0/3831284443 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f66a4052500 con 0x7f66ac0c41a0 2026-02-13T03:58:37.246 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.238+0000 7f49e087d6c0 1 -- 10.20.193.92:0/2820354456 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7f49c400c780 con 0x7f49dc134920 2026-02-13T03:58:37.247 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.238+0000 7f49e087d6c0 1 --2- 10.20.193.92:0/2820354456 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f49b003f990 0x7f49b005fe40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.248 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.242+0000 7f66b37fe6c0 1 --2- 10.20.193.92:0/3831284443 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f668403f990 0x7f668405fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.248 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.243+0000 7f66b37fe6c0 1 --2- 10.20.193.92:0/3831284443 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f668403f990 0x7f668405fe40 secure :-1 s=READY pgs=23 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66a0004770 tx=0x7f66a0006c90 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:37.248 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.245+0000 7f49daffd6c0 1 --2- 10.20.193.92:0/2820354456 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f49b003f990 0x7f49b005fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.266 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:37 trial092 ceph-mon[23047]: from='client.? ' entity='client.admin' 2026-02-13T03:58:37.266 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:37 trial092 ceph-mon[23047]: from='client.? ' entity='client.admin' 2026-02-13T03:58:37.266 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:37 trial092 ceph-mon[23047]: from='client.? ' entity='client.admin' 2026-02-13T03:58:37.266 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:37 trial092 ceph-mon[23047]: from='client.? ' entity='client.admin' 2026-02-13T03:58:37.267 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:37 trial092 ceph-mon[23047]: mgrmap e12: x(active, since 2s) 2026-02-13T03:58:37.267 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:37 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/843142928' entity='client.admin' 2026-02-13T03:58:37.267 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:37 trial092 ceph-mon[23047]: from='client.? ' entity='client.admin' 2026-02-13T03:58:37.267 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:37 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/2163778126' entity='client.admin' 2026-02-13T03:58:37.267 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.246+0000 7f7f07fff6c0 1 -- 10.20.193.92:0/3978408429 <== mon.1 v2:10.20.193.158:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v21)=0 v21) ==== 116+0+0 (secure 0 0 0) 0x7f7f10011400 con 0x7f7f200bc140 2026-02-13T03:58:37.267 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.253+0000 7f7f2d18f6c0 1 -- 10.20.193.92:0/3978408429 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f7efc03f910 msgr2=0x7f7efc05fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.267 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.253+0000 7f7f2d18f6c0 1 --2- 10.20.193.92:0/3978408429 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f7efc03f910 0x7f7efc05fdc0 secure :-1 s=READY pgs=21 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f1c0095e0 tx=0x7f7f1c009260 comp rx=0 tx=0).stop 2026-02-13T03:58:37.268 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.253+0000 7f7f2d18f6c0 1 -- 10.20.193.92:0/3978408429 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7f200bc140 msgr2=0x7f7f2011d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.268 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.253+0000 7f7f2d18f6c0 1 --2- 10.20.193.92:0/3978408429 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7f200bc140 0x7f7f2011d440 secure :-1 s=READY pgs=15 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7f1000b440 tx=0x7f7f1000b910 comp rx=0 tx=0).stop 2026-02-13T03:58:37.268 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.254+0000 7f7f2d18f6c0 1 -- 10.20.193.92:0/3978408429 shutdown_connections 2026-02-13T03:58:37.268 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.254+0000 7f7f2d18f6c0 1 --2- 10.20.193.92:0/3978408429 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7f200bcaf0 0x7f7f200a6720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.268 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.254+0000 7f7f2d18f6c0 1 --2- 10.20.193.92:0/3978408429 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7f200bc140 0x7f7f2011d440 unknown :-1 s=CLOSED pgs=15 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.268 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.254+0000 7f7f2d18f6c0 1 --2- 10.20.193.92:0/3978408429 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f7efc03f910 0x7f7efc05fdc0 unknown :-1 s=CLOSED pgs=21 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.268 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.254+0000 7f7f2d18f6c0 1 --2- 10.20.193.92:0/3978408429 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7f200bafc0 0x7f7f200a5ee0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.269 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.254+0000 7f7f2d18f6c0 1 -- 10.20.193.92:0/3978408429 >> 10.20.193.92:0/3978408429 conn(0x7f7f2000bef0 msgr2=0x7f7f2009c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:37.269 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.254+0000 7f7f2d18f6c0 1 -- 10.20.193.92:0/3978408429 shutdown_connections 2026-02-13T03:58:37.269 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.254+0000 7f7f2d18f6c0 1 -- 10.20.193.92:0/3978408429 wait complete. 2026-02-13T03:58:37.269 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.246+0000 7f49e087d6c0 1 -- 10.20.193.92:0/2820354456 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f49c4056550 con 0x7f49dc134920 2026-02-13T03:58:37.269 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.254+0000 7f49daffd6c0 1 --2- 10.20.193.92:0/2820354456 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f49b003f990 0x7f49b005fe40 secure :-1 s=READY pgs=24 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49d000bc00 tx=0x7f49d00023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:37.279 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.276+0000 7f66967fc6c0 1 -- 10.20.193.92:0/3831284443 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6680005310 con 0x7f66ac0c41a0 2026-02-13T03:58:37.281 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.279+0000 7f66b0ff96c0 1 -- 10.20.193.92:0/3831284443 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f66a40033e0 con 0x7f66ac0c41a0 2026-02-13T03:58:37.284 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.281+0000 7f0d671156c0 1 -- 10.20.193.92:0/1252560099 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0d60113dc0 msgr2=0x7f0d601141b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.284 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.281+0000 7f0d671156c0 1 --2- 10.20.193.92:0/1252560099 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0d60113dc0 0x7f0d601141b0 secure :-1 s=READY pgs=16 gs=1 cs=0 l=1 c_cookie=9267543224197714926 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0d5800aa40 tx=0x7f0d5802fe70 comp rx=0 tx=0).stop 2026-02-13T03:58:37.284 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.281+0000 7f0d671156c0 1 -- 10.20.193.92:0/1252560099 shutdown_connections 2026-02-13T03:58:37.284 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.281+0000 7f0d671156c0 1 --2- 10.20.193.92:0/1252560099 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f0d60115120 0x7f0d601155c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.284 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.281+0000 7f0d671156c0 1 --2- 10.20.193.92:0/1252560099 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0d601146f0 0x7f0d60114b60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.284 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.281+0000 7f0d671156c0 1 --2- 10.20.193.92:0/1252560099 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0d60113dc0 0x7f0d601141b0 unknown :-1 s=CLOSED pgs=16 gs=1 cs=0 l=1 c_cookie=9267543224197714926 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.284 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.281+0000 7f0d671156c0 1 -- 10.20.193.92:0/1252560099 >> 10.20.193.92:0/1252560099 conn(0x7f0d6005b8e0 msgr2=0x7f0d6005bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:37.284 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.281+0000 7f0d671156c0 1 -- 10.20.193.92:0/1252560099 shutdown_connections 2026-02-13T03:58:37.285 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.281+0000 7f0d671156c0 1 -- 10.20.193.92:0/1252560099 wait complete. 2026-02-13T03:58:37.285 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.282+0000 7f0d671156c0 1 Processor -- start 2026-02-13T03:58:37.285 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.282+0000 7f0d671156c0 1 -- start start 2026-02-13T03:58:37.286 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.282+0000 7f49e18836c0 1 -- 10.20.193.92:0/2820354456 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49dc179b40 con 0x7f49dc134920 2026-02-13T03:58:37.286 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.283+0000 7f0d671156c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0d60113dc0 0x7f0d600fea70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.287 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.283+0000 7f0d671156c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f0d601146f0 0x7f0d600ff0c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.287 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.284+0000 7f0d671156c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0d60115120 0x7f0d600ffcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.287 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.284+0000 7f0d656876c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0d60115120 0x7f0d600ffcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.287 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.284+0000 7f0d656876c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0d60115120 0x7f0d600ffcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:47872/0 (socket says 10.20.193.92:47872) 2026-02-13T03:58:37.288 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.284+0000 7f0d671156c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0d60100440 con 0x7f0d60115120 2026-02-13T03:58:37.288 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.284+0000 7f0d671156c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0d601005b0 con 0x7f0d60113dc0 2026-02-13T03:58:37.288 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.284+0000 7f0d671156c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f0d60100770 con 0x7f0d601146f0 2026-02-13T03:58:37.288 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.285+0000 7f0d64e866c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0d60113dc0 0x7f0d600fea70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.288 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.285+0000 7f0d656876c0 1 -- 10.20.193.92:0/3998355078 learned_addr learned my addr 10.20.193.92:0/3998355078 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T03:58:37.289 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.285+0000 7f0d5ffff6c0 1 --2- 10.20.193.92:0/3998355078 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f0d601146f0 0x7f0d600ff0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.289 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.285+0000 7f0d656876c0 1 -- 10.20.193.92:0/3998355078 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f0d601146f0 msgr2=0x7f0d600ff0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.289 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.285+0000 7f0d656876c0 1 --2- 10.20.193.92:0/3998355078 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f0d601146f0 0x7f0d600ff0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.289 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.285+0000 7f0d656876c0 1 -- 10.20.193.92:0/3998355078 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0d60113dc0 msgr2=0x7f0d600fea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.289 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.285+0000 7f0d656876c0 1 --2- 10.20.193.92:0/3998355078 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0d60113dc0 0x7f0d600fea70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.290 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.285+0000 7f0d656876c0 1 -- 10.20.193.92:0/3998355078 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d5800a660 con 0x7f0d60115120 2026-02-13T03:58:37.290 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.286+0000 7f0d656876c0 1 --2- 10.20.193.92:0/3998355078 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0d60115120 0x7f0d600ffcb0 secure :-1 s=READY pgs=105 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0d54005dc0 tx=0x7f0d5400bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:37.292 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.290+0000 7f0d5dffb6c0 1 -- 10.20.193.92:0/3998355078 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0d54004250 con 0x7f0d60115120 2026-02-13T03:58:37.292 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.290+0000 7f0d5dffb6c0 1 -- 10.20.193.92:0/3998355078 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f0d54009070 con 0x7f0d60115120 2026-02-13T03:58:37.293 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.290+0000 7f0d5dffb6c0 1 -- 10.20.193.92:0/3998355078 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0d540071c0 con 0x7f0d60115120 2026-02-13T03:58:37.293 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.290+0000 7f0d671156c0 1 -- 10.20.193.92:0/3998355078 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d60100a50 con 0x7f0d60115120 2026-02-13T03:58:37.294 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.292+0000 7f0d671156c0 1 -- 10.20.193.92:0/3998355078 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d60101010 con 0x7f0d60115120 2026-02-13T03:58:37.300 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.293+0000 7f0d5dffb6c0 1 -- 10.20.193.92:0/3998355078 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7f0d540043b0 con 0x7f0d60115120 2026-02-13T03:58:37.300 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.293+0000 7f0d5dffb6c0 1 --2- 10.20.193.92:0/3998355078 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f0d4403f990 0x7f0d4405fe40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.300 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.293+0000 7f0d5dffb6c0 1 -- 10.20.193.92:0/3998355078 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f0d54051260 con 0x7f0d60115120 2026-02-13T03:58:37.300 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.297+0000 7f0d64e866c0 1 --2- 10.20.193.92:0/3998355078 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f0d4403f990 0x7f0d4405fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.300 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.298+0000 7f0d64e866c0 1 --2- 10.20.193.92:0/3998355078 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f0d4403f990 0x7f0d4405fe40 secure :-1 s=READY pgs=25 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0d5800a990 tx=0x7f0d58002470 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:37.301 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.285+0000 7f117ca2f6c0 1 -- 10.20.193.92:0/1834119391 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f113c005b40 con 0x7f1178155310 2026-02-13T03:58:37.301 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.290+0000 7f11677fe6c0 1 -- 10.20.193.92:0/1834119391 <== mon.1 v2:10.20.193.158:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v22)=0 v22) ==== 119+0+0 (secure 0 0 0) 0x7f1170032040 con 0x7f1178155310 2026-02-13T03:58:37.309 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.306+0000 7f117ca2f6c0 1 -- 10.20.193.92:0/1834119391 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f115803f9a0 msgr2=0x7f115805fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.310 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.306+0000 7f117ca2f6c0 1 --2- 10.20.193.92:0/1834119391 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f115803f9a0 0x7f115805fe50 secure :-1 s=READY pgs=22 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f116c004750 tx=0x7f116c009260 comp rx=0 tx=0).stop 2026-02-13T03:58:37.310 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.306+0000 7f117ca2f6c0 1 -- 10.20.193.92:0/1834119391 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1178155310 msgr2=0x7f1178105150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.310 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.306+0000 7f117ca2f6c0 1 --2- 10.20.193.92:0/1834119391 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1178155310 0x7f1178105150 secure :-1 s=READY pgs=16 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1170031c10 tx=0x7f1170031ee0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.310 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.306+0000 7f117ca2f6c0 1 -- 10.20.193.92:0/1834119391 shutdown_connections 2026-02-13T03:58:37.310 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.306+0000 7f117ca2f6c0 1 --2- 10.20.193.92:0/1834119391 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1178155310 0x7f1178105150 unknown :-1 s=CLOSED pgs=16 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.310 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.306+0000 7f117ca2f6c0 1 --2- 10.20.193.92:0/1834119391 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1178134770 0x7f11781756f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.310 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.306+0000 7f117ca2f6c0 1 --2- 10.20.193.92:0/1834119391 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f115803f9a0 0x7f115805fe50 unknown :-1 s=CLOSED pgs=22 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.310 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.306+0000 7f117ca2f6c0 1 --2- 10.20.193.92:0/1834119391 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1178113dc0 0x7f1178154bd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.310 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.306+0000 7f117ca2f6c0 1 -- 10.20.193.92:0/1834119391 >> 10.20.193.92:0/1834119391 conn(0x7f117805b700 msgr2=0x7f11780f6000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:37.310 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.306+0000 7f117ca2f6c0 1 -- 10.20.193.92:0/1834119391 shutdown_connections 2026-02-13T03:58:37.311 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1fefccae-0890-11f1-bcc5-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='trial092') 2026-02-13T03:58:37.312 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1fefccae-0890-11f1-bcc5-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='trial092') 2026-02-13T03:58:37.312 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.306+0000 7f117ca2f6c0 1 -- 10.20.193.92:0/1834119391 wait complete. 2026-02-13T03:58:37.319 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.288+0000 7f49e087d6c0 1 -- 10.20.193.92:0/2820354456 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f49c40077c0 con 0x7f49dc134920 2026-02-13T03:58:37.319 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.316+0000 7f0d671156c0 1 -- 10.20.193.92:0/3998355078 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d6017e1b0 con 0x7f0d60115120 2026-02-13T03:58:37.323 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.319+0000 7f0d5dffb6c0 1 -- 10.20.193.92:0/3998355078 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f0d5400f020 con 0x7f0d60115120 2026-02-13T03:58:37.365 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:37 trial099 ceph-mon[27808]: from='client.? ' entity='client.admin' 2026-02-13T03:58:37.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:37 trial099 ceph-mon[27808]: from='client.? ' entity='client.admin' 2026-02-13T03:58:37.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:37 trial099 ceph-mon[27808]: from='client.? ' entity='client.admin' 2026-02-13T03:58:37.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:37 trial099 ceph-mon[27808]: from='client.? ' entity='client.admin' 2026-02-13T03:58:37.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:37 trial099 ceph-mon[27808]: mgrmap e12: x(active, since 2s) 2026-02-13T03:58:37.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:37 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/843142928' entity='client.admin' 2026-02-13T03:58:37.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:37 trial099 ceph-mon[27808]: from='client.? ' entity='client.admin' 2026-02-13T03:58:37.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:37 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/2163778126' entity='client.admin' 2026-02-13T03:58:37.368 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.360+0000 7fd2affff6c0 1 -- 10.20.193.92:0/339256128 <== mon.1 v2:10.20.193.158:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd2b00071c0 con 0x7fd2b80c3e30 2026-02-13T03:58:37.368 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.360+0000 7fd2c67446c0 1 -- 10.20.193.92:0/339256128 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd2b80c3e30 msgr2=0x7fd2b80c4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.368 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.360+0000 7fd2c67446c0 1 --2- 10.20.193.92:0/339256128 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd2b80c3e30 0x7fd2b80c4220 secure :-1 s=READY pgs=17 gs=2 cs=0 l=1 c_cookie=11307246391658577340 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2b0009970 tx=0x7fd2b002ed50 comp rx=0 tx=0).stop 2026-02-13T03:58:37.369 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.364+0000 7fd2c67446c0 1 -- 10.20.193.92:0/339256128 shutdown_connections 2026-02-13T03:58:37.369 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.366+0000 7fd2c67446c0 1 --2- 10.20.193.92:0/339256128 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fd2b80c4fb0 0x7fd2b8127440 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.369 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.366+0000 7fd2c67446c0 1 --2- 10.20.193.92:0/339256128 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd2b8018280 0x7fd2b80c5860 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.369 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.366+0000 7fd2c67446c0 1 --2- 10.20.193.92:0/339256128 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd2b80c3e30 0x7fd2b80c4220 unknown :-1 s=CLOSED pgs=17 gs=2 cs=0 l=1 c_cookie=11307246391658577340 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.373 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.366+0000 7fd2c67446c0 1 -- 10.20.193.92:0/339256128 >> 10.20.193.92:0/339256128 conn(0x7fd2b80a1550 msgr2=0x7fd2b80c1960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:37.374 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.367+0000 7fd2c67446c0 1 -- 10.20.193.92:0/339256128 shutdown_connections 2026-02-13T03:58:37.374 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.367+0000 7fd2c67446c0 1 -- 10.20.193.92:0/339256128 wait complete. 2026-02-13T03:58:37.374 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.368+0000 7fd2c67446c0 1 Processor -- start 2026-02-13T03:58:37.374 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.368+0000 7fd2c67446c0 1 -- start start 2026-02-13T03:58:37.374 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.369+0000 7fd2c67446c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd2b8018280 0x7fd2b8112440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.374 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.369+0000 7fd2c67446c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd2b80c3e30 0x7fd2b8112a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.374 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.369+0000 7fd2c67446c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fd2b80c4fb0 0x7fd2b8113680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.374 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.369+0000 7fd2c67446c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b8113e10 con 0x7fd2b80c3e30 2026-02-13T03:58:37.374 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.369+0000 7fd2c67446c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b8113f80 con 0x7fd2b80c4fb0 2026-02-13T03:58:37.374 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.369+0000 7fd2c67446c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fd2b8114140 con 0x7fd2b8018280 2026-02-13T03:58:37.375 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.369+0000 7fd2c57426c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd2b8018280 0x7fd2b8112440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.375 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.369+0000 7fd2c57426c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd2b8018280 0x7fd2b8112440 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:51652/0 (socket says 10.20.193.92:51652) 2026-02-13T03:58:37.375 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.369+0000 7fd2c57426c0 1 -- 10.20.193.92:0/2943013611 learned_addr learned my addr 10.20.193.92:0/2943013611 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T03:58:37.375 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.369+0000 7fd2c4f416c0 1 --2- 10.20.193.92:0/2943013611 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd2b80c3e30 0x7fd2b8112a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.375 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.369+0000 7fd2c5f436c0 1 --2- 10.20.193.92:0/2943013611 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fd2b80c4fb0 0x7fd2b8113680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.375 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.370+0000 7fd2c57426c0 1 -- 10.20.193.92:0/2943013611 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fd2b80c4fb0 msgr2=0x7fd2b8113680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.375 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.370+0000 7fd2c57426c0 1 --2- 10.20.193.92:0/2943013611 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fd2b80c4fb0 0x7fd2b8113680 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.375 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.370+0000 7fd2c57426c0 1 -- 10.20.193.92:0/2943013611 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd2b80c3e30 msgr2=0x7fd2b8112a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.375 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.370+0000 7fd2c57426c0 1 --2- 10.20.193.92:0/2943013611 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd2b80c3e30 0x7fd2b8112a90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.375 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.370+0000 7fd2c57426c0 1 -- 10.20.193.92:0/2943013611 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2b0009590 con 0x7fd2b8018280 2026-02-13T03:58:37.375 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.370+0000 7fd2c4f416c0 1 --2- 10.20.193.92:0/2943013611 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd2b80c3e30 0x7fd2b8112a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:58:37.376 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.370+0000 7fd2c57426c0 1 --2- 10.20.193.92:0/2943013611 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd2b8018280 0x7fd2b8112440 secure :-1 s=READY pgs=18 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2b0005ae0 tx=0x7fd2b00047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:37.376 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.370+0000 7fd2ae7fc6c0 1 -- 10.20.193.92:0/2943013611 <== mon.1 v2:10.20.193.158:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd2b002fe80 con 0x7fd2b8018280 2026-02-13T03:58:37.377 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.371+0000 7fd2c67446c0 1 -- 10.20.193.92:0/2943013611 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2b81143c0 con 0x7fd2b8018280 2026-02-13T03:58:37.377 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.371+0000 7fd2ae7fc6c0 1 -- 10.20.193.92:0/2943013611 <== mon.1 v2:10.20.193.158:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fd2b00073f0 con 0x7fd2b8018280 2026-02-13T03:58:37.377 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.371+0000 7fd2ae7fc6c0 1 -- 10.20.193.92:0/2943013611 <== mon.1 v2:10.20.193.158:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd2b00313f0 con 0x7fd2b8018280 2026-02-13T03:58:37.377 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.371+0000 7fd2c67446c0 1 -- 10.20.193.92:0/2943013611 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2b8114920 con 0x7fd2b8018280 2026-02-13T03:58:37.377 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.372+0000 7fd2ae7fc6c0 1 -- 10.20.193.92:0/2943013611 <== mon.1 v2:10.20.193.158:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7fd2b0002a40 con 0x7fd2b8018280 2026-02-13T03:58:37.377 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.373+0000 7fd2c67446c0 1 -- 10.20.193.92:0/2943013611 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2b812e810 con 0x7fd2b8018280 2026-02-13T03:58:37.377 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.373+0000 7fd2ae7fc6c0 1 --2- 10.20.193.92:0/2943013611 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fd29003f940 0x7fd29005fdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.377 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.373+0000 7fd2ae7fc6c0 1 -- 10.20.193.92:0/2943013611 <== mon.1 v2:10.20.193.158:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fd2b0036830 con 0x7fd2b8018280 2026-02-13T03:58:37.378 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.373+0000 7fd2c4f416c0 1 --2- 10.20.193.92:0/2943013611 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fd29003f940 0x7fd29005fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.378 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.374+0000 7fd2c4f416c0 1 --2- 10.20.193.92:0/2943013611 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fd29003f940 0x7fd29005fdf0 secure :-1 s=READY pgs=26 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2b80186b0 tx=0x7fd2b4009060 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:37.385 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.376+0000 7fd2ae7fc6c0 1 -- 10.20.193.92:0/2943013611 <== mon.1 v2:10.20.193.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd2b0032040 con 0x7fd2b8018280 2026-02-13T03:58:37.394 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.391+0000 7fbf261096c0 1 -- 10.20.193.92:0/4112216443 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fbf20113dc0 msgr2=0x7fbf201341a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.394 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.391+0000 7fbf261096c0 1 --2- 10.20.193.92:0/4112216443 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fbf20113dc0 0x7fbf201341a0 secure :-1 s=READY pgs=19 gs=1 cs=0 l=1 c_cookie=9200441503761465118 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf1800ef50 tx=0x7fbf18034340 comp rx=0 tx=0).stop 2026-02-13T03:58:37.394 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.392+0000 7fbf261096c0 1 -- 10.20.193.92:0/4112216443 shutdown_connections 2026-02-13T03:58:37.395 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.392+0000 7fbf261096c0 1 --2- 10.20.193.92:0/4112216443 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fbf20155340 0x7fbf201757f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.395 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.392+0000 7fbf261096c0 1 --2- 10.20.193.92:0/4112216443 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbf201347c0 0x7fbf20154c00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.395 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.392+0000 7fbf261096c0 1 --2- 10.20.193.92:0/4112216443 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fbf20113dc0 0x7fbf201341a0 unknown :-1 s=CLOSED pgs=19 gs=1 cs=0 l=1 c_cookie=9200441503761465118 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.395 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.392+0000 7fbf261096c0 1 -- 10.20.193.92:0/4112216443 >> 10.20.193.92:0/4112216443 conn(0x7fbf2005b720 msgr2=0x7fbf2005bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:37.410 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.407+0000 7f50977fe6c0 1 -- 10.20.193.92:0/803410713 <== mon.1 v2:10.20.193.158:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5088004520 con 0x7f5098113dc0 2026-02-13T03:58:37.410 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.407+0000 7f509f0d06c0 1 -- 10.20.193.92:0/803410713 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f5098113dc0 msgr2=0x7f50981141b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.412 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.407+0000 7f509f0d06c0 1 --2- 10.20.193.92:0/803410713 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f5098113dc0 0x7f50981141b0 secure :-1 s=READY pgs=20 gs=1 cs=0 l=1 c_cookie=601877950528760169 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5088009970 tx=0x7f508802eda0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.412 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.408+0000 7f509f0d06c0 1 -- 10.20.193.92:0/803410713 shutdown_connections 2026-02-13T03:58:37.412 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.408+0000 7f509f0d06c0 1 --2- 10.20.193.92:0/803410713 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f50981146f0 0x7f5098114b60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.412 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.408+0000 7f509f0d06c0 1 --2- 10.20.193.92:0/803410713 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5098115120 0x7f50981155c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.412 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.408+0000 7f509f0d06c0 1 --2- 10.20.193.92:0/803410713 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f5098113dc0 0x7f50981141b0 unknown :-1 s=CLOSED pgs=20 gs=1 cs=0 l=1 c_cookie=601877950528760169 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.413 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.408+0000 7f509f0d06c0 1 -- 10.20.193.92:0/803410713 >> 10.20.193.92:0/803410713 conn(0x7f509805b8e0 msgr2=0x7f509805bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:37.413 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.408+0000 7f509f0d06c0 1 -- 10.20.193.92:0/803410713 shutdown_connections 2026-02-13T03:58:37.413 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.408+0000 7f509f0d06c0 1 -- 10.20.193.92:0/803410713 wait complete. 2026-02-13T03:58:37.413 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.409+0000 7f509f0d06c0 1 Processor -- start 2026-02-13T03:58:37.413 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.410+0000 7f509f0d06c0 1 -- start start 2026-02-13T03:58:37.413 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.410+0000 7f509f0d06c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5098113dc0 0x7f50980fec00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.414 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.410+0000 7f509f0d06c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f50981146f0 0x7f50980ff250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.414 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.412+0000 7f509f0d06c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5098115120 0x7f50980ffe40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.415 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.412+0000 7f5097fff6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f50981146f0 0x7f50980ff250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.415 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.412+0000 7f5097fff6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f50981146f0 0x7f50980ff250 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:51680/0 (socket says 10.20.193.92:51680) 2026-02-13T03:58:37.415 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.412+0000 7f509f0d06c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f50981005d0 con 0x7f5098113dc0 2026-02-13T03:58:37.415 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.412+0000 7f509f0d06c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f5098100740 con 0x7f5098115120 2026-02-13T03:58:37.416 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.412+0000 7f509f0d06c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f5098100900 con 0x7f50981146f0 2026-02-13T03:58:37.416 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.412+0000 7f509d6426c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5098115120 0x7f50980ffe40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.416 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.412+0000 7f509ce416c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5098113dc0 0x7f50980fec00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.417 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.412+0000 7f509ce416c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5098113dc0 0x7f50980fec00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:47914/0 (socket says 10.20.193.92:47914) 2026-02-13T03:58:37.418 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.412+0000 7f509ce416c0 1 -- 10.20.193.92:0/2352038227 learned_addr learned my addr 10.20.193.92:0/2352038227 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T03:58:37.418 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.413+0000 7f509d6426c0 1 -- 10.20.193.92:0/2352038227 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f50981146f0 msgr2=0x7f50980ff250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.418 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.413+0000 7f509d6426c0 1 --2- 10.20.193.92:0/2352038227 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f50981146f0 0x7f50980ff250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.418 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.413+0000 7f509d6426c0 1 -- 10.20.193.92:0/2352038227 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5098113dc0 msgr2=0x7f50980fec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.418 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.413+0000 7f509d6426c0 1 --2- 10.20.193.92:0/2352038227 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5098113dc0 0x7f50980fec00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.418 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.413+0000 7f509d6426c0 1 -- 10.20.193.92:0/2352038227 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5088009590 con 0x7f5098115120 2026-02-13T03:58:37.418 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.415+0000 7f509d6426c0 1 --2- 10.20.193.92:0/2352038227 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5098115120 0x7f50980ffe40 secure :-1 s=READY pgs=17 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f508c006fd0 tx=0x7f508c00cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:37.420 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.417+0000 7f5095ffb6c0 1 -- 10.20.193.92:0/2352038227 <== mon.2 v2:10.20.193.99:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f508c003c40 con 0x7f5098115120 2026-02-13T03:58:37.420 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.417+0000 7f5095ffb6c0 1 -- 10.20.193.92:0/2352038227 <== mon.2 v2:10.20.193.99:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f508c00a070 con 0x7f5098115120 2026-02-13T03:58:37.420 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.417+0000 7f509f0d06c0 1 -- 10.20.193.92:0/2352038227 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5098100be0 con 0x7f5098115120 2026-02-13T03:58:37.420 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.417+0000 7f5095ffb6c0 1 -- 10.20.193.92:0/2352038227 <== mon.2 v2:10.20.193.99:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f508c0081c0 con 0x7f5098115120 2026-02-13T03:58:37.421 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.419+0000 7f5095ffb6c0 1 -- 10.20.193.92:0/2352038227 <== mon.2 v2:10.20.193.99:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7f508c008350 con 0x7f5098115120 2026-02-13T03:58:37.422 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.419+0000 7fbf261096c0 1 -- 10.20.193.92:0/4112216443 shutdown_connections 2026-02-13T03:58:37.422 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.419+0000 7fbf261096c0 1 -- 10.20.193.92:0/4112216443 wait complete. 2026-02-13T03:58:37.445 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.443+0000 7f509f0d06c0 1 -- 10.20.193.92:0/2352038227 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5098179ef0 con 0x7f5098115120 2026-02-13T03:58:37.446 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.443+0000 7f66967fc6c0 1 -- 10.20.193.92:0/3831284443 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f66800055c0 con 0x7f66ac0c41a0 2026-02-13T03:58:37.447 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.444+0000 7f506b7fe6c0 1 -- 10.20.193.92:0/2352038227 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5058005310 con 0x7f5098115120 2026-02-13T03:58:37.448 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.445+0000 7f5095ffb6c0 1 --2- 10.20.193.92:0/2352038227 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f507803f990 0x7f507805fe40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.448 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.445+0000 7f5095ffb6c0 1 -- 10.20.193.92:0/2352038227 <== mon.2 v2:10.20.193.99:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f508c0545c0 con 0x7f5098115120 2026-02-13T03:58:37.448 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.445+0000 7fbf261096c0 1 Processor -- start 2026-02-13T03:58:37.449 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.445+0000 7f509ce416c0 1 --2- 10.20.193.92:0/2352038227 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f507803f990 0x7f507805fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.450 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.447+0000 7fbf261096c0 1 -- start start 2026-02-13T03:58:37.452 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.450+0000 7f5095ffb6c0 1 -- 10.20.193.92:0/2352038227 <== mon.2 v2:10.20.193.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f508c009460 con 0x7f5098115120 2026-02-13T03:58:37.453 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.450+0000 7f509ce416c0 1 --2- 10.20.193.92:0/2352038227 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f507803f990 0x7f507805fe40 secure :-1 s=READY pgs=27 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50880092e0 tx=0x7f5088005ae0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:37.453 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.451+0000 7f66b0ff96c0 1 -- 10.20.193.92:0/3831284443 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v23)=0 v23) ==== 120+0+0 (secure 0 0 0) 0x7f66a40033e0 con 0x7f66ac0c41a0 2026-02-13T03:58:37.454 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.451+0000 7fbf261096c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbf20113dc0 0x7fbf20154c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.454 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.451+0000 7fbf261096c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fbf201347c0 0x7fbf20175790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.455 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.452+0000 7fbf261096c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fbf20155340 0x7fbf200ff8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.456 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.452+0000 7fbf261096c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbf20100030 con 0x7fbf20113dc0 2026-02-13T03:58:37.456 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.452+0000 7fbf261096c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fbf201001a0 con 0x7fbf201347c0 2026-02-13T03:58:37.456 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.452+0000 7fbf261096c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fbf201007e0 con 0x7fbf20155340 2026-02-13T03:58:37.459 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.455+0000 7fbf1ffff6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fbf20155340 0x7fbf200ff8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.459 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.455+0000 7fbf1ffff6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fbf20155340 0x7fbf200ff8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:51696/0 (socket says 10.20.193.92:51696) 2026-02-13T03:58:37.459 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.455+0000 7fbf1ffff6c0 1 -- 10.20.193.92:0/2703774974 learned_addr learned my addr 10.20.193.92:0/2703774974 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T03:58:37.459 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.456+0000 7fbf1ffff6c0 1 -- 10.20.193.92:0/2703774974 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fbf201347c0 msgr2=0x7fbf20175790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.459 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.456+0000 7fbf1ffff6c0 1 --2- 10.20.193.92:0/2703774974 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fbf201347c0 0x7fbf20175790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.459 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.456+0000 7fbf1ffff6c0 1 -- 10.20.193.92:0/2703774974 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbf20113dc0 msgr2=0x7fbf20154c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.460 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.456+0000 7fbf1f7fe6c0 1 --2- 10.20.193.92:0/2703774974 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbf20113dc0 0x7fbf20154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.460 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.456+0000 7fbf1ffff6c0 1 --2- 10.20.193.92:0/2703774974 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbf20113dc0 0x7fbf20154c00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.460 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.456+0000 7fbf1ffff6c0 1 -- 10.20.193.92:0/2703774974 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf1800eb70 con 0x7fbf20155340 2026-02-13T03:58:37.460 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.457+0000 7fbf1f7fe6c0 1 --2- 10.20.193.92:0/2703774974 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbf20113dc0 0x7fbf20154c00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:58:37.460 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.457+0000 7fbf1ffff6c0 1 --2- 10.20.193.92:0/2703774974 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fbf20155340 0x7fbf200ff8a0 secure :-1 s=READY pgs=21 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf14009fd0 tx=0x7fbf1400bb60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:37.463 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.459+0000 7f66967fc6c0 1 -- 10.20.193.92:0/3831284443 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f668403f990 msgr2=0x7f668405fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.463 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.459+0000 7f66967fc6c0 1 --2- 10.20.193.92:0/3831284443 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f668403f990 0x7f668405fe40 secure :-1 s=READY pgs=23 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66a0004770 tx=0x7f66a0006c90 comp rx=0 tx=0).stop 2026-02-13T03:58:37.463 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.459+0000 7f66967fc6c0 1 -- 10.20.193.92:0/3831284443 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f66ac0c41a0 msgr2=0x7f66ac107520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.463 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.459+0000 7f66967fc6c0 1 --2- 10.20.193.92:0/3831284443 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f66ac0c41a0 0x7f66ac107520 secure :-1 s=READY pgs=104 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66a400b6c0 tx=0x7f66a400bb90 comp rx=0 tx=0).stop 2026-02-13T03:58:37.463 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.459+0000 7f66967fc6c0 1 -- 10.20.193.92:0/3831284443 shutdown_connections 2026-02-13T03:58:37.463 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.459+0000 7f66967fc6c0 1 --2- 10.20.193.92:0/3831284443 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f668403f990 0x7f668405fe40 unknown :-1 s=CLOSED pgs=23 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.463 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.459+0000 7f66967fc6c0 1 --2- 10.20.193.92:0/3831284443 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f66ac107a60 0x7f66ac0a5b10 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.463 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.459+0000 7f66967fc6c0 1 --2- 10.20.193.92:0/3831284443 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f66ac0c41a0 0x7f66ac107520 unknown :-1 s=CLOSED pgs=104 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.463 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.459+0000 7f66967fc6c0 1 --2- 10.20.193.92:0/3831284443 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f66ac0c3870 0x7f66ac0a52b0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.463 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.459+0000 7f66967fc6c0 1 -- 10.20.193.92:0/3831284443 >> 10.20.193.92:0/3831284443 conn(0x7f66ac0a1550 msgr2=0x7f66ac12bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:37.463 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.459+0000 7f66967fc6c0 1 -- 10.20.193.92:0/3831284443 shutdown_connections 2026-02-13T03:58:37.464 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.459+0000 7f66967fc6c0 1 -- 10.20.193.92:0/3831284443 wait complete. 2026-02-13T03:58:37.481 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.477+0000 7f31953746c0 1 -- 10.20.193.92:0/3733193146 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f31880c3df0 msgr2=0x7f31880c41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.481 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.477+0000 7f31953746c0 1 --2- 10.20.193.92:0/3733193146 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f31880c3df0 0x7f31880c41e0 secure :-1 s=READY pgs=106 gs=1 cs=0 l=1 c_cookie=16627151778418264940 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f31800075a0 tx=0x7f318002fea0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.483 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.478+0000 7f31953746c0 1 -- 10.20.193.92:0/3733193146 shutdown_connections 2026-02-13T03:58:37.483 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.478+0000 7f31953746c0 1 --2- 10.20.193.92:0/3733193146 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f31880c5920 0x7f31881262b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.483 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.478+0000 7f31953746c0 1 --2- 10.20.193.92:0/3733193146 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f31880c4f70 0x7f31880c53e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.483 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.478+0000 7f31953746c0 1 --2- 10.20.193.92:0/3733193146 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f31880c3df0 0x7f31880c41e0 unknown :-1 s=CLOSED pgs=106 gs=1 cs=0 l=1 c_cookie=16627151778418264940 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.483 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.478+0000 7f31953746c0 1 -- 10.20.193.92:0/3733193146 >> 10.20.193.92:0/3733193146 conn(0x7f31880a10b0 msgr2=0x7f31880c14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:37.483 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.478+0000 7f31953746c0 1 -- 10.20.193.92:0/3733193146 shutdown_connections 2026-02-13T03:58:37.483 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.478+0000 7f31953746c0 1 -- 10.20.193.92:0/3733193146 wait complete. 2026-02-13T03:58:37.484 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.480+0000 7f31953746c0 1 Processor -- start 2026-02-13T03:58:37.484 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.480+0000 7f31953746c0 1 -- start start 2026-02-13T03:58:37.484 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.480+0000 7f31953746c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f31880c3df0 0x7f31880afd30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.484 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.480+0000 7f31953746c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f31880c4f70 0x7f31881262b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.484 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.480+0000 7f31953746c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f31880c5920 0x7f31880b0590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.485 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.481+0000 7f3187fff6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f31880c3df0 0x7f31880afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.485 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.481+0000 7f3187fff6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f31880c3df0 0x7f31880afd30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:51724/0 (socket says 10.20.193.92:51724) 2026-02-13T03:58:37.485 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.481+0000 7f31966016c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f31880c5920 0x7f31880b0590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.485 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.481+0000 7f31966016c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f31880c5920 0x7f31880b0590 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:47934/0 (socket says 10.20.193.92:47934) 2026-02-13T03:58:37.485 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.481+0000 7f31953746c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f31880b11c0 con 0x7f31880c5920 2026-02-13T03:58:37.485 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.481+0000 7f31953746c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f31880b1330 con 0x7f31880c4f70 2026-02-13T03:58:37.485 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.481+0000 7f31953746c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f31880b14f0 con 0x7f31880c3df0 2026-02-13T03:58:37.485 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.481+0000 7fbf1cff96c0 1 -- 10.20.193.92:0/2703774974 <== mon.1 v2:10.20.193.158:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf14004250 con 0x7fbf20155340 2026-02-13T03:58:37.486 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.481+0000 7f3187fff6c0 1 -- 10.20.193.92:0/3458270009 learned_addr learned my addr 10.20.193.92:0/3458270009 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T03:58:37.487 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.481+0000 7f31966016c0 1 -- 10.20.193.92:0/3458270009 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f31880c3df0 msgr2=0x7f31880afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.487 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.481+0000 7f31966016c0 1 --2- 10.20.193.92:0/3458270009 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f31880c3df0 0x7f31880afd30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.487 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.481+0000 7f31966016c0 1 -- 10.20.193.92:0/3458270009 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f31880c4f70 msgr2=0x7f31881262b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T03:58:37.487 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.481+0000 7f31966016c0 1 --2- 10.20.193.92:0/3458270009 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f31880c4f70 0x7f31881262b0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.487 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.481+0000 7f31966016c0 1 -- 10.20.193.92:0/3458270009 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f319004beb0 con 0x7f31880c5920 2026-02-13T03:58:37.487 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.482+0000 7f3187fff6c0 1 --2- 10.20.193.92:0/3458270009 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f31880c3df0 0x7f31880afd30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2026-02-13T03:58:37.487 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.482+0000 7f31966016c0 1 --2- 10.20.193.92:0/3458270009 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f31880c5920 0x7f31880b0590 secure :-1 s=READY pgs=107 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3190052b90 tx=0x7f319005cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:37.487 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.482+0000 7f31857fa6c0 1 -- 10.20.193.92:0/3458270009 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f319004ca20 con 0x7f31880c5920 2026-02-13T03:58:37.488 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.481+0000 7fbf1cff96c0 1 -- 10.20.193.92:0/2703774974 <== mon.1 v2:10.20.193.158:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fbf14009070 con 0x7fbf20155340 2026-02-13T03:58:37.488 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.482+0000 7f31953746c0 1 -- 10.20.193.92:0/3458270009 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31800071c0 con 0x7f31880c5920 2026-02-13T03:58:37.488 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.482+0000 7f31953746c0 1 -- 10.20.193.92:0/3458270009 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31880b1af0 con 0x7f31880c5920 2026-02-13T03:58:37.488 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.483+0000 7f31857fa6c0 1 -- 10.20.193.92:0/3458270009 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f319004cb80 con 0x7f31880c5920 2026-02-13T03:58:37.488 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.483+0000 7f31857fa6c0 1 -- 10.20.193.92:0/3458270009 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f319004ca20 con 0x7f31880c5920 2026-02-13T03:58:37.489 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.481+0000 7fbf1cff96c0 1 -- 10.20.193.92:0/2703774974 <== mon.1 v2:10.20.193.158:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf140071c0 con 0x7fbf20155340 2026-02-13T03:58:37.489 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.482+0000 7fbf261096c0 1 -- 10.20.193.92:0/2703774974 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf20100a70 con 0x7fbf20155340 2026-02-13T03:58:37.489 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.482+0000 7fbf261096c0 1 -- 10.20.193.92:0/2703774974 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf20100f00 con 0x7fbf20155340 2026-02-13T03:58:37.490 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.484+0000 7f31857fa6c0 1 -- 10.20.193.92:0/3458270009 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7f319005ebc0 con 0x7f31880c5920 2026-02-13T03:58:37.490 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.485+0000 7f31953746c0 1 -- 10.20.193.92:0/3458270009 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31880b1dd0 con 0x7f31880c5920 2026-02-13T03:58:37.490 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.485+0000 7f31857fa6c0 1 --2- 10.20.193.92:0/3458270009 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f316803f9a0 0x7f316805fe50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.490 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.485+0000 7f31857fa6c0 1 -- 10.20.193.92:0/3458270009 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f31900a1ab0 con 0x7f31880c5920 2026-02-13T03:58:37.490 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.486+0000 7fbf1cff96c0 1 -- 10.20.193.92:0/2703774974 <== mon.1 v2:10.20.193.158:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7fbf14007350 con 0x7fbf20155340 2026-02-13T03:58:37.491 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.486+0000 7fbf1cff96c0 1 --2- 10.20.193.92:0/2703774974 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fbef003f990 0x7fbef005fe40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.491 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.486+0000 7fbf1cff96c0 1 -- 10.20.193.92:0/2703774974 <== mon.1 v2:10.20.193.158:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fbf140525c0 con 0x7fbf20155340 2026-02-13T03:58:37.491 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.489+0000 7f3187fff6c0 1 --2- 10.20.193.92:0/3458270009 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f316803f9a0 0x7f316805fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.491 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.489+0000 7f31857fa6c0 1 -- 10.20.193.92:0/3458270009 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f319004ccf0 con 0x7f31880c5920 2026-02-13T03:58:37.492 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.489+0000 7fbf1f7fe6c0 1 --2- 10.20.193.92:0/2703774974 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fbef003f990 0x7fbef005fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.496 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.493+0000 7fbefe7fc6c0 1 -- 10.20.193.92:0/2703774974 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbeec005310 con 0x7fbf20155340 2026-02-13T03:58:37.497 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.495+0000 7fbf1f7fe6c0 1 --2- 10.20.193.92:0/2703774974 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fbef003f990 0x7fbef005fe40 secure :-1 s=READY pgs=29 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf1800eea0 tx=0x7fbf18002470 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:37.500 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.497+0000 7f3187fff6c0 1 --2- 10.20.193.92:0/3458270009 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f316803f9a0 0x7f316805fe50 secure :-1 s=READY pgs=28 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3180004830 tx=0x7f31800047c0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:37.502 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.500+0000 7fbf1cff96c0 1 -- 10.20.193.92:0/2703774974 <== mon.1 v2:10.20.193.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fbf140143f0 con 0x7fbf20155340 2026-02-13T03:58:37.511 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.508+0000 7f27daee46c0 1 -- 10.20.193.92:0/1016535869 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f27d405e1b0 msgr2=0x7f27d405e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.511 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.508+0000 7f27daee46c0 1 --2- 10.20.193.92:0/1016535869 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f27d405e1b0 0x7f27d405e5a0 secure :-1 s=READY pgs=18 gs=1 cs=0 l=1 c_cookie=11149106640150437332 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27c400a9f0 tx=0x7f27c402fda0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.511 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.509+0000 7f27daee46c0 1 -- 10.20.193.92:0/1016535869 shutdown_connections 2026-02-13T03:58:37.512 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.508+0000 7f17263c46c0 1 -- 10.20.193.92:0/1440644227 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f172005f190 msgr2=0x7f172005f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.512 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.508+0000 7f17263c46c0 1 --2- 10.20.193.92:0/1440644227 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f172005f190 0x7f172005f600 secure :-1 s=READY pgs=108 gs=2 cs=0 l=1 c_cookie=15570992937106856685 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1710009b00 tx=0x7f171002f760 comp rx=0 tx=0).stop 2026-02-13T03:58:37.512 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.509+0000 7f27daee46c0 1 --2- 10.20.193.92:0/1016535869 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f27d405f330 0x7f27d4060ef0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.513 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.509+0000 7f27daee46c0 1 --2- 10.20.193.92:0/1016535869 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f27d405f790 0x7f27d405fc00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.513 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.509+0000 7f27daee46c0 1 --2- 10.20.193.92:0/1016535869 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f27d405e1b0 0x7f27d405e5a0 unknown :-1 s=CLOSED pgs=18 gs=1 cs=0 l=1 c_cookie=11149106640150437332 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.515 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.511+0000 7f27daee46c0 1 -- 10.20.193.92:0/1016535869 >> 10.20.193.92:0/1016535869 conn(0x7f27d405b8e0 msgr2=0x7f27d405bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:37.515 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.511+0000 7f27daee46c0 1 -- 10.20.193.92:0/1016535869 shutdown_connections 2026-02-13T03:58:37.515 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.511+0000 7f27daee46c0 1 -- 10.20.193.92:0/1016535869 wait complete. 2026-02-13T03:58:37.515 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.512+0000 7f27daee46c0 1 Processor -- start 2026-02-13T03:58:37.517 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.512+0000 7f27daee46c0 1 -- start start 2026-02-13T03:58:37.517 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.515+0000 7f27daee46c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f27d405e1b0 0x7f27d41c18b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.519 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.516+0000 7f27d8c596c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f27d405e1b0 0x7f27d41c18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.519 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.516+0000 7f27d8c596c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f27d405e1b0 0x7f27d41c18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:59712/0 (socket says 10.20.193.92:59712) 2026-02-13T03:58:37.519 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.516+0000 7f27d8c596c0 1 -- 10.20.193.92:0/2234513606 learned_addr learned my addr 10.20.193.92:0/2234513606 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T03:58:37.520 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.517+0000 7f27daee46c0 1 --2- 10.20.193.92:0/2234513606 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f27d405f330 0x7f27d41c1f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.520 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.511+0000 7f17263c46c0 1 -- 10.20.193.92:0/1440644227 shutdown_connections 2026-02-13T03:58:37.521 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.511+0000 7f17263c46c0 1 --2- 10.20.193.92:0/1440644227 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f172005fb40 0x7f17200604a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.521 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.511+0000 7f17263c46c0 1 --2- 10.20.193.92:0/1440644227 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f172005f190 0x7f172005f600 unknown :-1 s=CLOSED pgs=108 gs=2 cs=0 l=1 c_cookie=15570992937106856685 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.521 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.511+0000 7f17263c46c0 1 --2- 10.20.193.92:0/1440644227 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f172005e010 0x7f172005e400 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.521 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.511+0000 7f17263c46c0 1 -- 10.20.193.92:0/1440644227 >> 10.20.193.92:0/1440644227 conn(0x7f172005b720 msgr2=0x7f172005bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:37.521 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.511+0000 7f17263c46c0 1 -- 10.20.193.92:0/1440644227 shutdown_connections 2026-02-13T03:58:37.521 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.511+0000 7f17263c46c0 1 -- 10.20.193.92:0/1440644227 wait complete. 2026-02-13T03:58:37.521 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.512+0000 7f17263c46c0 1 Processor -- start 2026-02-13T03:58:37.521 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.512+0000 7f17263c46c0 1 -- start start 2026-02-13T03:58:37.521 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.513+0000 7f17263c46c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f172005e010 0x7f1720068010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.521 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.513+0000 7f17263c46c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f172005f190 0x7f1720068660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.522 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.513+0000 7f17263c46c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f172005fb40 0x7f1720069250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.522 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.513+0000 7f17263c46c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f17200699e0 con 0x7f172005e010 2026-02-13T03:58:37.522 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.513+0000 7f17263c46c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1720069b50 con 0x7f172005fb40 2026-02-13T03:58:37.522 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.513+0000 7f17263c46c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f1720069d10 con 0x7f172005f190 2026-02-13T03:58:37.522 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.513+0000 7f17253c26c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f172005e010 0x7f1720068010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.522 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.513+0000 7f1725bc36c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f172005fb40 0x7f1720069250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.522 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.513+0000 7f1725bc36c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f172005fb40 0x7f1720069250 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:59700/0 (socket says 10.20.193.92:59700) 2026-02-13T03:58:37.522 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.513+0000 7f1725bc36c0 1 -- 10.20.193.92:0/1572548766 learned_addr learned my addr 10.20.193.92:0/1572548766 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T03:58:37.522 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.513+0000 7f1724bc16c0 1 --2- 10.20.193.92:0/1572548766 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f172005f190 0x7f1720068660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.522 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.514+0000 7f17253c26c0 1 -- 10.20.193.92:0/1572548766 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f172005f190 msgr2=0x7f1720068660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.522 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.514+0000 7f17253c26c0 1 --2- 10.20.193.92:0/1572548766 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f172005f190 0x7f1720068660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.522 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.514+0000 7f17253c26c0 1 -- 10.20.193.92:0/1572548766 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f172005fb40 msgr2=0x7f1720069250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.523 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.514+0000 7f17253c26c0 1 --2- 10.20.193.92:0/1572548766 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f172005fb40 0x7f1720069250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.523 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.514+0000 7f17253c26c0 1 -- 10.20.193.92:0/1572548766 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17100094c0 con 0x7f172005e010 2026-02-13T03:58:37.523 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.514+0000 7f17253c26c0 1 --2- 10.20.193.92:0/1572548766 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f172005e010 0x7f1720068010 secure :-1 s=READY pgs=109 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f171c004750 tx=0x7f171c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:37.523 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.515+0000 7f17167fc6c0 1 -- 10.20.193.92:0/1572548766 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f171c004a80 con 0x7f172005e010 2026-02-13T03:58:37.523 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.515+0000 7f17263c46c0 1 -- 10.20.193.92:0/1572548766 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1720069f90 con 0x7f172005e010 2026-02-13T03:58:37.523 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.515+0000 7f17167fc6c0 1 -- 10.20.193.92:0/1572548766 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f171c009030 con 0x7f172005e010 2026-02-13T03:58:37.523 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.515+0000 7f17167fc6c0 1 -- 10.20.193.92:0/1572548766 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f171c004a80 con 0x7f172005e010 2026-02-13T03:58:37.523 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.515+0000 7f17263c46c0 1 -- 10.20.193.92:0/1572548766 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f172006a520 con 0x7f172005e010 2026-02-13T03:58:37.523 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.517+0000 7f17167fc6c0 1 -- 10.20.193.92:0/1572548766 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7f171c004030 con 0x7f172005e010 2026-02-13T03:58:37.523 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.517+0000 7f17167fc6c0 1 --2- 10.20.193.92:0/1572548766 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f170803f9a0 0x7f170805fe50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.523 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.518+0000 7f1724bc16c0 1 --2- 10.20.193.92:0/1572548766 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f170803f9a0 0x7f170805fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.524 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.518+0000 7f17167fc6c0 1 -- 10.20.193.92:0/1572548766 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f171c004e20 con 0x7f172005e010 2026-02-13T03:58:37.524 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.518+0000 7f17263c46c0 1 -- 10.20.193.92:0/1572548766 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1720064840 con 0x7f172005e010 2026-02-13T03:58:37.524 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.519+0000 7f27daee46c0 1 --2- 10.20.193.92:0/2234513606 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f27d405f790 0x7f27d41c2af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.525 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.519+0000 7f27d3fff6c0 1 --2- 10.20.193.92:0/2234513606 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f27d405f330 0x7f27d41c1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.525 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.519+0000 7f27daee46c0 1 -- 10.20.193.92:0/2234513606 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f27d41c3280 con 0x7f27d405f790 2026-02-13T03:58:37.525 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.519+0000 7f27daee46c0 1 -- 10.20.193.92:0/2234513606 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f27d41c33f0 con 0x7f27d405e1b0 2026-02-13T03:58:37.525 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.519+0000 7f27daee46c0 1 -- 10.20.193.92:0/2234513606 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f27d41c35b0 con 0x7f27d405f330 2026-02-13T03:58:37.525 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.522+0000 7f27d945a6c0 1 --2- 10.20.193.92:0/2234513606 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f27d405f790 0x7f27d41c2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.526 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.522+0000 7f1724bc16c0 1 --2- 10.20.193.92:0/1572548766 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f170803f9a0 0x7f170805fe50 secure :-1 s=READY pgs=30 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1710009a50 tx=0x7f17100023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:37.526 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.522+0000 7f17167fc6c0 1 -- 10.20.193.92:0/1572548766 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f171c00cca0 con 0x7f172005e010 2026-02-13T03:58:37.526 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.522+0000 7f27d8c596c0 1 -- 10.20.193.92:0/2234513606 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f27d405f330 msgr2=0x7f27d41c1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.526 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.522+0000 7f27d8c596c0 1 --2- 10.20.193.92:0/2234513606 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f27d405f330 0x7f27d41c1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.527 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.523+0000 7f0d671156c0 1 -- 10.20.193.92:0/3998355078 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f0d240051e0 con 0x7f0d60115120 2026-02-13T03:58:37.528 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.522+0000 7f27d8c596c0 1 -- 10.20.193.92:0/2234513606 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f27d405f790 msgr2=0x7f27d41c2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.528 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.522+0000 7f27d8c596c0 1 --2- 10.20.193.92:0/2234513606 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f27d405f790 0x7f27d41c2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.528 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.522+0000 7f27d8c596c0 1 -- 10.20.193.92:0/2234513606 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27c400a610 con 0x7f27d405e1b0 2026-02-13T03:58:37.528 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.524+0000 7f27d8c596c0 1 --2- 10.20.193.92:0/2234513606 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f27d405e1b0 0x7f27d41c18b0 secure :-1 s=READY pgs=19 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27c4030bf0 tx=0x7f27c4002960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:37.528 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.525+0000 7f27d1ffb6c0 1 -- 10.20.193.92:0/2234513606 <== mon.2 v2:10.20.193.99:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f27c4004550 con 0x7f27d405e1b0 2026-02-13T03:58:37.528 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.525+0000 7f27daee46c0 1 -- 10.20.193.92:0/2234513606 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27d41c3830 con 0x7f27d405e1b0 2026-02-13T03:58:37.529 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.525+0000 7f27daee46c0 1 -- 10.20.193.92:0/2234513606 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27d4223d40 con 0x7f27d405e1b0 2026-02-13T03:58:37.529 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.525+0000 7f27d1ffb6c0 1 -- 10.20.193.92:0/2234513606 <== mon.2 v2:10.20.193.99:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f27c40076f0 con 0x7f27d405e1b0 2026-02-13T03:58:37.529 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.525+0000 7f27d1ffb6c0 1 -- 10.20.193.92:0/2234513606 <== mon.2 v2:10.20.193.99:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f27c4004550 con 0x7f27d405e1b0 2026-02-13T03:58:37.534 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.531+0000 7f0d5dffb6c0 1 -- 10.20.193.92:0/3998355078 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v24)=0 v24) ==== 122+0+0 (secure 0 0 0) 0x7f0d54003030 con 0x7f0d60115120 2026-02-13T03:58:37.537 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.534+0000 7f27daee46c0 1 -- 10.20.193.92:0/2234513606 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27d40648e0 con 0x7f27d405e1b0 2026-02-13T03:58:37.537 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.535+0000 7f27d1ffb6c0 1 -- 10.20.193.92:0/2234513606 <== mon.2 v2:10.20.193.99:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7f27c40071c0 con 0x7f27d405e1b0 2026-02-13T03:58:37.538 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.535+0000 7f27d1ffb6c0 1 --2- 10.20.193.92:0/2234513606 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f27a403f9a0 0x7f27a405fe50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.538 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.535+0000 7f27d1ffb6c0 1 -- 10.20.193.92:0/2234513606 <== mon.2 v2:10.20.193.99:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f27c4075580 con 0x7f27d405e1b0 2026-02-13T03:58:37.542 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.540+0000 7f27d1ffb6c0 1 -- 10.20.193.92:0/2234513606 <== mon.2 v2:10.20.193.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f27c4036c60 con 0x7f27d405e1b0 2026-02-13T03:58:37.543 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.540+0000 7f49e18836c0 1 -- 10.20.193.92:0/2820354456 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command([{prefix=config set, name=debug_cephsqlite}] v 0) -- 0x7f49dc179430 con 0x7f49dc134920 2026-02-13T03:58:37.543 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.541+0000 7f27d3fff6c0 1 --2- 10.20.193.92:0/2234513606 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f27a403f9a0 0x7f27a405fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.546 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.544+0000 7f27d3fff6c0 1 --2- 10.20.193.92:0/2234513606 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f27a403f9a0 0x7f27a405fe50 secure :-1 s=READY pgs=31 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27c8004750 tx=0x7f27c8009390 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:37.549 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.546+0000 7f0d671156c0 1 -- 10.20.193.92:0/3998355078 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f0d4403f990 msgr2=0x7f0d4405fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.549 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.546+0000 7f0d671156c0 1 --2- 10.20.193.92:0/3998355078 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f0d4403f990 0x7f0d4405fe40 secure :-1 s=READY pgs=25 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0d5800a990 tx=0x7f0d58002470 comp rx=0 tx=0).stop 2026-02-13T03:58:37.549 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.546+0000 7f0d671156c0 1 -- 10.20.193.92:0/3998355078 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0d60115120 msgr2=0x7f0d600ffcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.549 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.546+0000 7f0d671156c0 1 --2- 10.20.193.92:0/3998355078 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0d60115120 0x7f0d600ffcb0 secure :-1 s=READY pgs=105 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0d54005dc0 tx=0x7f0d5400bed0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.549 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.546+0000 7f0d671156c0 1 -- 10.20.193.92:0/3998355078 shutdown_connections 2026-02-13T03:58:37.549 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.546+0000 7f0d671156c0 1 --2- 10.20.193.92:0/3998355078 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0d60115120 0x7f0d600ffcb0 unknown :-1 s=CLOSED pgs=105 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.550 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.546+0000 7f0d671156c0 1 --2- 10.20.193.92:0/3998355078 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f0d601146f0 0x7f0d600ff0c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.550 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.546+0000 7f0d671156c0 1 --2- 10.20.193.92:0/3998355078 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f0d4403f990 0x7f0d4405fe40 unknown :-1 s=CLOSED pgs=25 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.550 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.546+0000 7f0d671156c0 1 --2- 10.20.193.92:0/3998355078 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0d60113dc0 0x7f0d600fea70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.550 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.546+0000 7f0d671156c0 1 -- 10.20.193.92:0/3998355078 >> 10.20.193.92:0/3998355078 conn(0x7f0d6005b8e0 msgr2=0x7f0d600f50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:37.550 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.547+0000 7f0d671156c0 1 -- 10.20.193.92:0/3998355078 shutdown_connections 2026-02-13T03:58:37.550 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.547+0000 7f0d671156c0 1 -- 10.20.193.92:0/3998355078 wait complete. 2026-02-13T03:58:37.552 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.549+0000 7fca9c0546c0 1 -- 10.20.193.92:0/3912537471 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fca94113dc0 msgr2=0x7fca941341a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.552 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.549+0000 7fca9c0546c0 1 --2- 10.20.193.92:0/3912537471 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fca94113dc0 0x7fca941341a0 secure :-1 s=READY pgs=20 gs=1 cs=0 l=1 c_cookie=16558955034615977297 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca88009970 tx=0x7fca8802ed10 comp rx=0 tx=0).stop 2026-02-13T03:58:37.552 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.549+0000 7fca9adc76c0 1 -- 10.20.193.92:0/3912537471 <== mon.2 v2:10.20.193.99:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fca880071c0 con 0x7fca94113dc0 2026-02-13T03:58:37.553 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.547+0000 7f49e087d6c0 1 -- 10.20.193.92:0/2820354456 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_cephsqlite}]=0 v25)=0 v25) ==== 115+0+0 (secure 0 0 0) 0x7f49c400a040 con 0x7f49dc134920 2026-02-13T03:58:37.556 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.553+0000 7fca9c0546c0 1 -- 10.20.193.92:0/3912537471 shutdown_connections 2026-02-13T03:58:37.556 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.553+0000 7fca9c0546c0 1 --2- 10.20.193.92:0/3912537471 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fca94155310 0x7fca941757c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.556 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.553+0000 7fca9c0546c0 1 --2- 10.20.193.92:0/3912537471 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fca94134770 0x7fca94154bd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.557 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.553+0000 7fca9c0546c0 1 --2- 10.20.193.92:0/3912537471 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fca94113dc0 0x7fca941341a0 unknown :-1 s=CLOSED pgs=20 gs=1 cs=0 l=1 c_cookie=16558955034615977297 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.557 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.553+0000 7fca9c0546c0 1 -- 10.20.193.92:0/3912537471 >> 10.20.193.92:0/3912537471 conn(0x7fca9405b8e0 msgr2=0x7fca9405bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:37.557 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.554+0000 7fca9c0546c0 1 -- 10.20.193.92:0/3912537471 shutdown_connections 2026-02-13T03:58:37.557 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.554+0000 7fca9c0546c0 1 -- 10.20.193.92:0/3912537471 wait complete. 2026-02-13T03:58:37.558 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.555+0000 7fca9c0546c0 1 Processor -- start 2026-02-13T03:58:37.558 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.555+0000 7fca9c0546c0 1 -- start start 2026-02-13T03:58:37.558 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.555+0000 7fca9c0546c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fca94113dc0 0x7fca941341a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.559 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.556+0000 7fca9c0546c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fca94134770 0x7fca941757c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.559 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.556+0000 7fca9c0546c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fca94155310 0x7fca94135100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.559 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.556+0000 7fca9c0546c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fca94135890 con 0x7fca94134770 2026-02-13T03:58:37.559 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.556+0000 7fca9c0546c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fca94135a00 con 0x7fca94113dc0 2026-02-13T03:58:37.560 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.556+0000 7fca9c0546c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fca94135ce0 con 0x7fca94155310 2026-02-13T03:58:37.560 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.556+0000 7fca995c46c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fca94113dc0 0x7fca941341a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.560 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.556+0000 7fca98dc36c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fca94134770 0x7fca941757c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.560 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.556+0000 7fca98dc36c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fca94134770 0x7fca941757c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:47970/0 (socket says 10.20.193.92:47970) 2026-02-13T03:58:37.560 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.556+0000 7fca99dc56c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fca94155310 0x7fca94135100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.560 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.556+0000 7fca99dc56c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fca94155310 0x7fca94135100 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:51760/0 (socket says 10.20.193.92:51760) 2026-02-13T03:58:37.560 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.556+0000 7fca99dc56c0 1 -- 10.20.193.92:0/2856696346 learned_addr learned my addr 10.20.193.92:0/2856696346 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T03:58:37.561 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.557+0000 7f49e18836c0 1 -- 10.20.193.92:0/2820354456 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f49b003f990 msgr2=0x7f49b005fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.561 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.557+0000 7f49e18836c0 1 --2- 10.20.193.92:0/2820354456 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f49b003f990 0x7f49b005fe40 secure :-1 s=READY pgs=24 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49d000bc00 tx=0x7f49d00023a0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.561 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.557+0000 7f49e18836c0 1 -- 10.20.193.92:0/2820354456 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f49dc134920 msgr2=0x7f49dc154d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.561 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.557+0000 7f49e18836c0 1 --2- 10.20.193.92:0/2820354456 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f49dc134920 0x7f49dc154d40 secure :-1 s=READY pgs=102 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49c400ba30 tx=0x7f49c400bf00 comp rx=0 tx=0).stop 2026-02-13T03:58:37.562 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.557+0000 7fca98dc36c0 1 -- 10.20.193.92:0/2856696346 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fca94155310 msgr2=0x7fca94135100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.562 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.557+0000 7fca98dc36c0 1 --2- 10.20.193.92:0/2856696346 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fca94155310 0x7fca94135100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.562 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.557+0000 7fca98dc36c0 1 -- 10.20.193.92:0/2856696346 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fca94113dc0 msgr2=0x7fca941341a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.562 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.558+0000 7f49e18836c0 1 -- 10.20.193.92:0/2820354456 shutdown_connections 2026-02-13T03:58:37.563 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.558+0000 7f49e18836c0 1 --2- 10.20.193.92:0/2820354456 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f49dc1554e0 0x7f49dc0ff880 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.563 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.558+0000 7f49e18836c0 1 --2- 10.20.193.92:0/2820354456 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f49dc134920 0x7f49dc154d40 unknown :-1 s=CLOSED pgs=102 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.563 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.558+0000 7f49e18836c0 1 --2- 10.20.193.92:0/2820354456 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f49b003f990 0x7f49b005fe40 unknown :-1 s=CLOSED pgs=24 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.563 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.558+0000 7f49e18836c0 1 --2- 10.20.193.92:0/2820354456 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f49dc113f70 0x7f49dc175990 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.563 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.558+0000 7f49e18836c0 1 -- 10.20.193.92:0/2820354456 >> 10.20.193.92:0/2820354456 conn(0x7f49dc05b8e0 msgr2=0x7f49dc0f60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:37.563 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.557+0000 7fca98dc36c0 1 --2- 10.20.193.92:0/2856696346 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fca94113dc0 0x7fca941341a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.564 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.557+0000 7fca98dc36c0 1 -- 10.20.193.92:0/2856696346 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca88009590 con 0x7fca94134770 2026-02-13T03:58:37.564 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.558+0000 7fca995c46c0 1 --2- 10.20.193.92:0/2856696346 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fca94113dc0 0x7fca941341a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:58:37.564 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.558+0000 7fca98dc36c0 1 --2- 10.20.193.92:0/2856696346 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fca94134770 0x7fca941757c0 secure :-1 s=READY pgs=110 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca7c00b640 tx=0x7fca7c00bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:37.569 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.567+0000 7f49e18836c0 1 -- 10.20.193.92:0/2820354456 shutdown_connections 2026-02-13T03:58:37.570 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.567+0000 7f49e18836c0 1 -- 10.20.193.92:0/2820354456 wait complete. 2026-02-13T03:58:37.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:37 trial158 ceph-mon[27763]: from='client.? ' entity='client.admin' 2026-02-13T03:58:37.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:37 trial158 ceph-mon[27763]: from='client.? ' entity='client.admin' 2026-02-13T03:58:37.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:37 trial158 ceph-mon[27763]: from='client.? ' entity='client.admin' 2026-02-13T03:58:37.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:37 trial158 ceph-mon[27763]: from='client.? ' entity='client.admin' 2026-02-13T03:58:37.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:37 trial158 ceph-mon[27763]: mgrmap e12: x(active, since 2s) 2026-02-13T03:58:37.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:37 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/843142928' entity='client.admin' 2026-02-13T03:58:37.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:37 trial158 ceph-mon[27763]: from='client.? ' entity='client.admin' 2026-02-13T03:58:37.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:37 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/2163778126' entity='client.admin' 2026-02-13T03:58:37.584 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.575+0000 7fca82ffd6c0 1 -- 10.20.193.92:0/2856696346 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fca7c0044a0 con 0x7fca94134770 2026-02-13T03:58:37.584 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.575+0000 7fca82ffd6c0 1 -- 10.20.193.92:0/2856696346 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fca7c009030 con 0x7fca94134770 2026-02-13T03:58:37.584 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.575+0000 7fca82ffd6c0 1 -- 10.20.193.92:0/2856696346 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fca7c00ce60 con 0x7fca94134770 2026-02-13T03:58:37.584 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.581+0000 7fca9c0546c0 1 -- 10.20.193.92:0/2856696346 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca94135fc0 con 0x7fca94134770 2026-02-13T03:58:37.586 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.583+0000 7fca9c0546c0 1 -- 10.20.193.92:0/2856696346 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca94136420 con 0x7fca94134770 2026-02-13T03:58:37.592 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.582+0000 7fd2c67446c0 1 -- 10.20.193.92:0/2943013611 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fd2b8046790 con 0x7fd2b8018280 2026-02-13T03:58:37.592 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.585+0000 7fd2ae7fc6c0 1 -- 10.20.193.92:0/2943013611 <== mon.1 v2:10.20.193.158:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v26)=0 v26) ==== 120+0+0 (secure 0 0 0) 0x7fd2b00321e0 con 0x7fd2b8018280 2026-02-13T03:58:37.600 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.597+0000 7fd2c67446c0 1 -- 10.20.193.92:0/2943013611 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fd29003f940 msgr2=0x7fd29005fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.600 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.597+0000 7fd2c67446c0 1 --2- 10.20.193.92:0/2943013611 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fd29003f940 0x7fd29005fdf0 secure :-1 s=READY pgs=26 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2b80186b0 tx=0x7fd2b4009060 comp rx=0 tx=0).stop 2026-02-13T03:58:37.600 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.597+0000 7fd2c67446c0 1 -- 10.20.193.92:0/2943013611 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd2b8018280 msgr2=0x7fd2b8112440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.600 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.597+0000 7fd2c67446c0 1 --2- 10.20.193.92:0/2943013611 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd2b8018280 0x7fd2b8112440 secure :-1 s=READY pgs=18 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2b0005ae0 tx=0x7fd2b00047c0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.603 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.596+0000 7fca82ffd6c0 1 -- 10.20.193.92:0/2856696346 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7fca7c00c410 con 0x7fca94134770 2026-02-13T03:58:37.603 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.596+0000 7fca82ffd6c0 1 --2- 10.20.193.92:0/2856696346 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fca6c03f980 0x7fca6c05fe30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.604 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.596+0000 7fca82ffd6c0 1 -- 10.20.193.92:0/2856696346 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fca7c0555d0 con 0x7fca94134770 2026-02-13T03:58:37.604 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.596+0000 7fca80ff96c0 1 -- 10.20.193.92:0/2856696346 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca941799f0 con 0x7fca94134770 2026-02-13T03:58:37.604 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.597+0000 7fca995c46c0 1 --2- 10.20.193.92:0/2856696346 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fca6c03f980 0x7fca6c05fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.612 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.600+0000 7fca995c46c0 1 --2- 10.20.193.92:0/2856696346 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fca6c03f980 0x7fca6c05fe30 secure :-1 s=READY pgs=32 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca8802f220 tx=0x7fca88005ae0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:37.613 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.600+0000 7fca82ffd6c0 1 -- 10.20.193.92:0/2856696346 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fca7c007550 con 0x7fca94134770 2026-02-13T03:58:37.623 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.620+0000 7f219fa686c0 1 -- 10.20.193.92:0/3439507473 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2198115120 msgr2=0x7f21981155c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.625 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.620+0000 7f219fa686c0 1 --2- 10.20.193.92:0/3439507473 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2198115120 0x7f21981155c0 secure :-1 s=READY pgs=21 gs=1 cs=0 l=1 c_cookie=2636785356485188176 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f219401be50 tx=0x7f21940412c0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.625 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.621+0000 7f219fa686c0 1 -- 10.20.193.92:0/3439507473 shutdown_connections 2026-02-13T03:58:37.626 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.621+0000 7f219fa686c0 1 --2- 10.20.193.92:0/3439507473 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2198115120 0x7f21981155c0 unknown :-1 s=CLOSED pgs=21 gs=1 cs=0 l=1 c_cookie=2636785356485188176 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.627 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.621+0000 7f219fa686c0 1 --2- 10.20.193.92:0/3439507473 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f21981146f0 0x7f2198114b60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.627 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.623+0000 7f219fa686c0 1 --2- 10.20.193.92:0/3439507473 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2198113dc0 0x7f21981141b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.627 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.623+0000 7f219fa686c0 1 -- 10.20.193.92:0/3439507473 >> 10.20.193.92:0/3439507473 conn(0x7f219805b8e0 msgr2=0x7f219805bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:37.628 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.623+0000 7f219fa686c0 1 -- 10.20.193.92:0/3439507473 shutdown_connections 2026-02-13T03:58:37.628 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.623+0000 7f219fa686c0 1 -- 10.20.193.92:0/3439507473 wait complete. 2026-02-13T03:58:37.628 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.625+0000 7f219fa686c0 1 Processor -- start 2026-02-13T03:58:37.629 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.625+0000 7f219fa686c0 1 -- start start 2026-02-13T03:58:37.632 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.629+0000 7f219fa686c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2198113dc0 0x7f21980fe850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.633 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.630+0000 7f219d7d96c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2198113dc0 0x7f21980fe850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.633 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.630+0000 7f219d7d96c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2198113dc0 0x7f21980fe850 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:47992/0 (socket says 10.20.193.92:47992) 2026-02-13T03:58:37.634 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.631+0000 7f219d7d96c0 1 -- 10.20.193.92:0/2135263860 learned_addr learned my addr 10.20.193.92:0/2135263860 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T03:58:37.634 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.631+0000 7f219fa686c0 1 --2- 10.20.193.92:0/2135263860 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f21981146f0 0x7f21980feea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.635 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.632+0000 7f219cfd86c0 1 --2- 10.20.193.92:0/2135263860 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f21981146f0 0x7f21980feea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.637 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.634+0000 7f219fa686c0 1 --2- 10.20.193.92:0/2135263860 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2198115120 0x7f21980ffa90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.638 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.635+0000 7f219fa686c0 1 -- 10.20.193.92:0/2135263860 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2198100220 con 0x7f2198113dc0 2026-02-13T03:58:37.639 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.635+0000 7f219dfda6c0 1 --2- 10.20.193.92:0/2135263860 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2198115120 0x7f21980ffa90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.640 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.637+0000 7f219fa686c0 1 -- 10.20.193.92:0/2135263860 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2198100390 con 0x7f2198115120 2026-02-13T03:58:37.640 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.637+0000 7f219fa686c0 1 -- 10.20.193.92:0/2135263860 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f2198100550 con 0x7f21981146f0 2026-02-13T03:58:37.648 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.644+0000 7f219d7d96c0 1 -- 10.20.193.92:0/2135263860 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f21981146f0 msgr2=0x7f21980feea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.648 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.644+0000 7f219d7d96c0 1 --2- 10.20.193.92:0/2135263860 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f21981146f0 0x7f21980feea0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.648 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.644+0000 7f219d7d96c0 1 -- 10.20.193.92:0/2135263860 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2198115120 msgr2=0x7f21980ffa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.648 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.644+0000 7f219d7d96c0 1 --2- 10.20.193.92:0/2135263860 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2198115120 0x7f21980ffa90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.648 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.644+0000 7f219d7d96c0 1 -- 10.20.193.92:0/2135263860 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f219401ba70 con 0x7f2198113dc0 2026-02-13T03:58:37.649 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.644+0000 7f219d7d96c0 1 --2- 10.20.193.92:0/2135263860 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2198113dc0 0x7f21980fe850 secure :-1 s=READY pgs=111 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2188009490 tx=0x7f218800bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:37.649 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.645+0000 7f219cfd86c0 1 --2- 10.20.193.92:0/2135263860 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f21981146f0 0x7f21980feea0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:58:37.649 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.645+0000 7f219dfda6c0 1 --2- 10.20.193.92:0/2135263860 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2198115120 0x7f21980ffa90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:58:37.651 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.631+0000 7f31953746c0 1 -- 10.20.193.92:0/3458270009 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f31880b16b0 con 0x7f31880c5920 2026-02-13T03:58:37.651 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.634+0000 7f31857fa6c0 1 -- 10.20.193.92:0/3458270009 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v27)=0 v27) ==== 125+0+0 (secure 0 0 0) 0x7f3190058030 con 0x7f31880c5920 2026-02-13T03:58:37.651 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.639+0000 7f31953746c0 1 -- 10.20.193.92:0/3458270009 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f316803f9a0 msgr2=0x7f316805fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.651 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.639+0000 7f31953746c0 1 --2- 10.20.193.92:0/3458270009 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f316803f9a0 0x7f316805fe50 secure :-1 s=READY pgs=28 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3180004830 tx=0x7f31800047c0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.651 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.639+0000 7f31953746c0 1 -- 10.20.193.92:0/3458270009 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f31880c5920 msgr2=0x7f31880b0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.651 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.639+0000 7f31953746c0 1 --2- 10.20.193.92:0/3458270009 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f31880c5920 0x7f31880b0590 secure :-1 s=READY pgs=107 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3190052b90 tx=0x7f319005cc20 comp rx=0 tx=0).stop 2026-02-13T03:58:37.651 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.639+0000 7f31953746c0 1 -- 10.20.193.92:0/3458270009 shutdown_connections 2026-02-13T03:58:37.651 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.639+0000 7f31953746c0 1 --2- 10.20.193.92:0/3458270009 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f316803f9a0 0x7f316805fe50 unknown :-1 s=CLOSED pgs=28 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.651 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.639+0000 7f31953746c0 1 --2- 10.20.193.92:0/3458270009 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f31880c4f70 0x7f31881262b0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.651 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.639+0000 7f31953746c0 1 --2- 10.20.193.92:0/3458270009 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f31880c5920 0x7f31880b0590 unknown :-1 s=CLOSED pgs=107 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.652 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.639+0000 7f31953746c0 1 --2- 10.20.193.92:0/3458270009 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f31880c3df0 0x7f31880afd30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.652 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.639+0000 7f31953746c0 1 -- 10.20.193.92:0/3458270009 >> 10.20.193.92:0/3458270009 conn(0x7f31880a10b0 msgr2=0x7f318812a360 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:37.652 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.639+0000 7f31953746c0 1 -- 10.20.193.92:0/3458270009 shutdown_connections 2026-02-13T03:58:37.652 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.639+0000 7f31953746c0 1 -- 10.20.193.92:0/3458270009 wait complete. 2026-02-13T03:58:37.653 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.651+0000 7fd2c67446c0 1 -- 10.20.193.92:0/2943013611 shutdown_connections 2026-02-13T03:58:37.653 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.651+0000 7fd2c67446c0 1 --2- 10.20.193.92:0/2943013611 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fd29003f940 0x7fd29005fdf0 unknown :-1 s=CLOSED pgs=26 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.653 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.651+0000 7fd2c67446c0 1 --2- 10.20.193.92:0/2943013611 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fd2b80c4fb0 0x7fd2b8113680 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.653 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.651+0000 7fd2c67446c0 1 --2- 10.20.193.92:0/2943013611 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd2b80c3e30 0x7fd2b8112a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.653 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.651+0000 7fd2c67446c0 1 --2- 10.20.193.92:0/2943013611 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd2b8018280 0x7fd2b8112440 unknown :-1 s=CLOSED pgs=18 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.653 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.651+0000 7fd2c67446c0 1 -- 10.20.193.92:0/2943013611 >> 10.20.193.92:0/2943013611 conn(0x7fd2b80a1550 msgr2=0x7fd2b80c1930 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:37.654 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.651+0000 7fd2c67446c0 1 -- 10.20.193.92:0/2943013611 shutdown_connections 2026-02-13T03:58:37.654 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.651+0000 7fd2c67446c0 1 -- 10.20.193.92:0/2943013611 wait complete. 2026-02-13T03:58:37.655 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.648+0000 7f21867fc6c0 1 -- 10.20.193.92:0/2135263860 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2188004a80 con 0x7f2198113dc0 2026-02-13T03:58:37.670 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.648+0000 7f21867fc6c0 1 -- 10.20.193.92:0/2135263860 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f2188009030 con 0x7f2198113dc0 2026-02-13T03:58:37.670 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.649+0000 7f21867fc6c0 1 -- 10.20.193.92:0/2135263860 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f21880071c0 con 0x7f2198113dc0 2026-02-13T03:58:37.670 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.649+0000 7f219fa686c0 1 -- 10.20.193.92:0/2135263860 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2198100830 con 0x7f2198113dc0 2026-02-13T03:58:37.671 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.649+0000 7f219fa686c0 1 -- 10.20.193.92:0/2135263860 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2198100d70 con 0x7f2198113dc0 2026-02-13T03:58:37.671 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.651+0000 7f21867fc6c0 1 -- 10.20.193.92:0/2135263860 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7f2188004060 con 0x7f2198113dc0 2026-02-13T03:58:37.671 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.652+0000 7f21867fc6c0 1 --2- 10.20.193.92:0/2135263860 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f217403f940 0x7f217405fdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.671 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.652+0000 7f219cfd86c0 1 --2- 10.20.193.92:0/2135263860 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f217403f940 0x7f217405fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.671 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.652+0000 7f219cfd86c0 1 --2- 10.20.193.92:0/2135263860 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f217403f940 0x7f217405fdf0 secure :-1 s=READY pgs=33 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f218c004750 tx=0x7f218c005f10 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:37.671 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.652+0000 7f21867fc6c0 1 -- 10.20.193.92:0/2135263860 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f2188004be0 con 0x7f2198113dc0 2026-02-13T03:58:37.671 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.653+0000 7f219fa686c0 1 -- 10.20.193.92:0/2135263860 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2198119bd0 con 0x7f2198113dc0 2026-02-13T03:58:37.671 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.655+0000 7f21867fc6c0 1 -- 10.20.193.92:0/2135263860 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f21880074f0 con 0x7f2198113dc0 2026-02-13T03:58:37.685 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.682+0000 7fbefe7fc6c0 1 -- 10.20.193.92:0/2703774974 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command([{prefix=config set, name=debug_mgr}] v 0) -- 0x7fbf201823b0 con 0x7fbf20155340 2026-02-13T03:58:37.689 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.687+0000 7fbf1cff96c0 1 -- 10.20.193.92:0/2703774974 <== mon.1 v2:10.20.193.158:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mgr}]=0 v27)=0 v27) ==== 108+0+0 (secure 0 0 0) 0x7fbf140143f0 con 0x7fbf20155340 2026-02-13T03:58:37.696 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.693+0000 7fbefe7fc6c0 1 -- 10.20.193.92:0/2703774974 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fbef003f990 msgr2=0x7fbef005fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.696 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.693+0000 7fbefe7fc6c0 1 --2- 10.20.193.92:0/2703774974 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fbef003f990 0x7fbef005fe40 secure :-1 s=READY pgs=29 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf1800eea0 tx=0x7fbf18002470 comp rx=0 tx=0).stop 2026-02-13T03:58:37.696 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.693+0000 7fbefe7fc6c0 1 -- 10.20.193.92:0/2703774974 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fbf20155340 msgr2=0x7fbf200ff8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.696 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.693+0000 7fbefe7fc6c0 1 --2- 10.20.193.92:0/2703774974 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fbf20155340 0x7fbf200ff8a0 secure :-1 s=READY pgs=21 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf14009fd0 tx=0x7fbf1400bb60 comp rx=0 tx=0).stop 2026-02-13T03:58:37.716 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.713+0000 7fca80ff96c0 1 -- 10.20.193.92:0/2856696346 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7fca94178be0 con 0x7fca94134770 2026-02-13T03:58:37.746 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.734+0000 7fbefe7fc6c0 1 -- 10.20.193.92:0/2703774974 shutdown_connections 2026-02-13T03:58:37.746 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.736+0000 7fbefe7fc6c0 1 --2- 10.20.193.92:0/2703774974 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fbef003f990 0x7fbef005fe40 unknown :-1 s=CLOSED pgs=29 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.746 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.736+0000 7fbefe7fc6c0 1 --2- 10.20.193.92:0/2703774974 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fbf201347c0 0x7fbf20175790 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.746 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.736+0000 7fbefe7fc6c0 1 --2- 10.20.193.92:0/2703774974 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fbf20155340 0x7fbf200ff8a0 unknown :-1 s=CLOSED pgs=21 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.746 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.736+0000 7fbefe7fc6c0 1 --2- 10.20.193.92:0/2703774974 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbf20113dc0 0x7fbf20154c00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.746 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.736+0000 7fbefe7fc6c0 1 -- 10.20.193.92:0/2703774974 >> 10.20.193.92:0/2703774974 conn(0x7fbf2005b720 msgr2=0x7fbf200f60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:37.746 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.736+0000 7fbefe7fc6c0 1 -- 10.20.193.92:0/2703774974 shutdown_connections 2026-02-13T03:58:37.746 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.736+0000 7fbefe7fc6c0 1 -- 10.20.193.92:0/2703774974 wait complete. 2026-02-13T03:58:37.747 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.738+0000 7fca82ffd6c0 1 -- 10.20.193.92:0/2856696346 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v28)=0 v28) ==== 119+0+0 (secure 0 0 0) 0x7fca7c0088c0 con 0x7fca94134770 2026-02-13T03:58:37.747 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.743+0000 7f096c1f36c0 1 -- 10.20.193.92:0/1701809802 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f095c0c3e40 msgr2=0x7f095c0c4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.747 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.743+0000 7f096c1f36c0 1 --2- 10.20.193.92:0/1701809802 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f095c0c3e40 0x7f095c0c4230 secure :-1 s=READY pgs=112 gs=1 cs=0 l=1 c_cookie=10251290648055027913 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f09540098a0 tx=0x7f095402ec90 comp rx=0 tx=0).stop 2026-02-13T03:58:37.747 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.744+0000 7f096c1f36c0 1 -- 10.20.193.92:0/1701809802 shutdown_connections 2026-02-13T03:58:37.747 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.744+0000 7f096c1f36c0 1 --2- 10.20.193.92:0/1701809802 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f095c0c4fc0 0x7f095c0c5430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.748 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.744+0000 7f096c1f36c0 1 --2- 10.20.193.92:0/1701809802 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f095c0c5970 0x7f095c126300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.748 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.744+0000 7f096c1f36c0 1 --2- 10.20.193.92:0/1701809802 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f095c0c3e40 0x7f095c0c4230 unknown :-1 s=CLOSED pgs=112 gs=1 cs=0 l=1 c_cookie=10251290648055027913 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.748 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.744+0000 7f096c1f36c0 1 -- 10.20.193.92:0/1701809802 >> 10.20.193.92:0/1701809802 conn(0x7f095c0a10e0 msgr2=0x7f095c0c1510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:37.748 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.744+0000 7f096c1f36c0 1 -- 10.20.193.92:0/1701809802 shutdown_connections 2026-02-13T03:58:37.748 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.745+0000 7f096c1f36c0 1 -- 10.20.193.92:0/1701809802 wait complete. 2026-02-13T03:58:37.749 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.746+0000 7f096c1f36c0 1 Processor -- start 2026-02-13T03:58:37.749 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.747+0000 7f096c1f36c0 1 -- start start 2026-02-13T03:58:37.750 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.747+0000 7f096c1f36c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f095c0c3e40 0x7f095c0cae50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.750 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.748+0000 7f096c1f36c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f095c0c4fc0 0x7f095c0cb4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.751 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.748+0000 7f096c1f36c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f095c0c5970 0x7f095c0cc090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.751 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.748+0000 7f096c1f36c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f095c0cc820 con 0x7f095c0c3e40 2026-02-13T03:58:37.751 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.748+0000 7f096c1f36c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f095c0cc990 con 0x7f095c0c5970 2026-02-13T03:58:37.751 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.748+0000 7f096c1f36c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f095c0ccb50 con 0x7f095c0c4fc0 2026-02-13T03:58:37.751 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.749+0000 7f09697636c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f095c0c4fc0 0x7f095c0cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.752 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.749+0000 7f0969f646c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f095c0c3e40 0x7f095c0cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.752 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.749+0000 7f0969f646c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f095c0c3e40 0x7f095c0cae50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:48008/0 (socket says 10.20.193.92:48008) 2026-02-13T03:58:37.752 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.749+0000 7f0969f646c0 1 -- 10.20.193.92:0/2325982563 learned_addr learned my addr 10.20.193.92:0/2325982563 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T03:58:37.752 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.749+0000 7f096a7656c0 1 --2- 10.20.193.92:0/2325982563 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f095c0c5970 0x7f095c0cc090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.753 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.750+0000 7f09697636c0 1 -- 10.20.193.92:0/2325982563 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f095c0c5970 msgr2=0x7f095c0cc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.753 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.750+0000 7f09697636c0 1 --2- 10.20.193.92:0/2325982563 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f095c0c5970 0x7f095c0cc090 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.753 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.750+0000 7f09697636c0 1 -- 10.20.193.92:0/2325982563 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f095c0c3e40 msgr2=0x7f095c0cae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.753 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.750+0000 7f09697636c0 1 --2- 10.20.193.92:0/2325982563 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f095c0c3e40 0x7f095c0cae50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.753 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.750+0000 7f09697636c0 1 -- 10.20.193.92:0/2325982563 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09540094c0 con 0x7f095c0c4fc0 2026-02-13T03:58:37.754 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.751+0000 7f0969f646c0 1 --2- 10.20.193.92:0/2325982563 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f095c0c3e40 0x7f095c0cae50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T03:58:37.754 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.751+0000 7f09697636c0 1 --2- 10.20.193.92:0/2325982563 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f095c0c4fc0 0x7f095c0cb4a0 secure :-1 s=READY pgs=22 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0958004750 tx=0x7f095800bbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:37.754 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.751+0000 7f0952ffd6c0 1 -- 10.20.193.92:0/2325982563 <== mon.1 v2:10.20.193.158:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0958004a80 con 0x7f095c0c4fc0 2026-02-13T03:58:37.754 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.751+0000 7f0952ffd6c0 1 -- 10.20.193.92:0/2325982563 <== mon.1 v2:10.20.193.158:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f0958009030 con 0x7f095c0c4fc0 2026-02-13T03:58:37.755 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.752+0000 7f096c1f36c0 1 -- 10.20.193.92:0/2325982563 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f095c0cce30 con 0x7f095c0c4fc0 2026-02-13T03:58:37.755 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.752+0000 7f0952ffd6c0 1 -- 10.20.193.92:0/2325982563 <== mon.1 v2:10.20.193.158:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f09580071c0 con 0x7f095c0c4fc0 2026-02-13T03:58:37.755 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.752+0000 7f096c1f36c0 1 -- 10.20.193.92:0/2325982563 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f095c10d390 con 0x7f095c0c4fc0 2026-02-13T03:58:37.757 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.754+0000 7f0952ffd6c0 1 -- 10.20.193.92:0/2325982563 <== mon.1 v2:10.20.193.158:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7f0958007390 con 0x7f095c0c4fc0 2026-02-13T03:58:37.757 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.747+0000 7fca80ff96c0 1 -- 10.20.193.92:0/2856696346 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fca6c03f980 msgr2=0x7fca6c05fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.758 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.747+0000 7fca80ff96c0 1 --2- 10.20.193.92:0/2856696346 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fca6c03f980 0x7fca6c05fe30 secure :-1 s=READY pgs=32 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca8802f220 tx=0x7fca88005ae0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.758 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.747+0000 7fca80ff96c0 1 -- 10.20.193.92:0/2856696346 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fca94134770 msgr2=0x7fca941757c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.758 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.747+0000 7fca80ff96c0 1 --2- 10.20.193.92:0/2856696346 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fca94134770 0x7fca941757c0 secure :-1 s=READY pgs=110 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca7c00b640 tx=0x7fca7c00bb10 comp rx=0 tx=0).stop 2026-02-13T03:58:37.758 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.747+0000 7fca80ff96c0 1 -- 10.20.193.92:0/2856696346 shutdown_connections 2026-02-13T03:58:37.758 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.747+0000 7fca80ff96c0 1 --2- 10.20.193.92:0/2856696346 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fca94155310 0x7fca94135100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.758 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.747+0000 7fca80ff96c0 1 --2- 10.20.193.92:0/2856696346 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fca94134770 0x7fca941757c0 unknown :-1 s=CLOSED pgs=110 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.758 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.747+0000 7fca80ff96c0 1 --2- 10.20.193.92:0/2856696346 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fca6c03f980 0x7fca6c05fe30 unknown :-1 s=CLOSED pgs=32 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.758 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.747+0000 7fca80ff96c0 1 --2- 10.20.193.92:0/2856696346 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fca94113dc0 0x7fca941341a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.758 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.747+0000 7fca80ff96c0 1 -- 10.20.193.92:0/2856696346 >> 10.20.193.92:0/2856696346 conn(0x7fca9405b8e0 msgr2=0x7fca9417c810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:37.758 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.747+0000 7fca80ff96c0 1 -- 10.20.193.92:0/2856696346 shutdown_connections 2026-02-13T03:58:37.758 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.747+0000 7fca80ff96c0 1 -- 10.20.193.92:0/2856696346 wait complete. 2026-02-13T03:58:37.759 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.755+0000 7f0950ff96c0 1 -- 10.20.193.92:0/2325982563 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f092c005310 con 0x7f095c0c4fc0 2026-02-13T03:58:37.759 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.756+0000 7f0952ffd6c0 1 --2- 10.20.193.92:0/2325982563 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f094003f940 0x7f094005fdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.759 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.756+0000 7f0952ffd6c0 1 -- 10.20.193.92:0/2325982563 <== mon.1 v2:10.20.193.158:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f0958051350 con 0x7f095c0c4fc0 2026-02-13T03:58:37.759 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.757+0000 7f0969f646c0 1 --2- 10.20.193.92:0/2325982563 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f094003f940 0x7f094005fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.760 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.757+0000 7f0969f646c0 1 --2- 10.20.193.92:0/2325982563 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f094003f940 0x7f094005fdf0 secure :-1 s=READY pgs=34 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f09540023e0 tx=0x7f095402fb40 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:37.763 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.761+0000 7f27daee46c0 1 -- 10.20.193.92:0/2234513606 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f27d4223ff0 con 0x7f27d405e1b0 2026-02-13T03:58:37.770 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.767+0000 7f17263c46c0 1 -- 10.20.193.92:0/1572548766 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7f1720064060 con 0x7f172005e010 2026-02-13T03:58:37.770 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.768+0000 7f17167fc6c0 1 -- 10.20.193.92:0/1572548766 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v28)=0 v28) ==== 106+0+0 (secure 0 0 0) 0x7f171c00ce40 con 0x7f172005e010 2026-02-13T03:58:37.775 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.767+0000 7f0952ffd6c0 1 -- 10.20.193.92:0/2325982563 <== mon.1 v2:10.20.193.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f0958013030 con 0x7f095c0c4fc0 2026-02-13T03:58:37.775 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.772+0000 7f17263c46c0 1 -- 10.20.193.92:0/1572548766 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f170803f9a0 msgr2=0x7f170805fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.775 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.772+0000 7f17263c46c0 1 --2- 10.20.193.92:0/1572548766 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f170803f9a0 0x7f170805fe50 secure :-1 s=READY pgs=30 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1710009a50 tx=0x7f17100023a0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.776 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.772+0000 7f17263c46c0 1 -- 10.20.193.92:0/1572548766 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f172005e010 msgr2=0x7f1720068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.776 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.772+0000 7f17263c46c0 1 --2- 10.20.193.92:0/1572548766 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f172005e010 0x7f1720068010 secure :-1 s=READY pgs=109 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f171c004750 tx=0x7f171c00be50 comp rx=0 tx=0).stop 2026-02-13T03:58:37.778 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.775+0000 7f17263c46c0 1 -- 10.20.193.92:0/1572548766 shutdown_connections 2026-02-13T03:58:37.779 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.775+0000 7f17263c46c0 1 --2- 10.20.193.92:0/1572548766 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f170803f9a0 0x7f170805fe50 unknown :-1 s=CLOSED pgs=30 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.779 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.775+0000 7f17263c46c0 1 --2- 10.20.193.92:0/1572548766 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f172005fb40 0x7f1720069250 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.779 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.775+0000 7f17263c46c0 1 --2- 10.20.193.92:0/1572548766 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f172005f190 0x7f1720068660 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.779 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.775+0000 7f17263c46c0 1 --2- 10.20.193.92:0/1572548766 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f172005e010 0x7f1720068010 unknown :-1 s=CLOSED pgs=109 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.779 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.775+0000 7f17263c46c0 1 -- 10.20.193.92:0/1572548766 >> 10.20.193.92:0/1572548766 conn(0x7f172005b720 msgr2=0x7f172005c310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:37.786 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.777+0000 7f17263c46c0 1 -- 10.20.193.92:0/1572548766 shutdown_connections 2026-02-13T03:58:37.794 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.777+0000 7f17263c46c0 1 -- 10.20.193.92:0/1572548766 wait complete. 2026-02-13T03:58:37.802 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.800+0000 7f27d1ffb6c0 1 -- 10.20.193.92:0/2234513606 <== mon.2 v2:10.20.193.99:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v29)=0 v29) ==== 111+0+0 (secure 0 0 0) 0x7f27c4036c60 con 0x7f27d405e1b0 2026-02-13T03:58:37.806 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.803+0000 7f27daee46c0 1 -- 10.20.193.92:0/2234513606 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f27a403f9a0 msgr2=0x7f27a405fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.806 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.803+0000 7f27daee46c0 1 --2- 10.20.193.92:0/2234513606 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f27a403f9a0 0x7f27a405fe50 secure :-1 s=READY pgs=31 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27c8004750 tx=0x7f27c8009390 comp rx=0 tx=0).stop 2026-02-13T03:58:37.806 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.803+0000 7f27daee46c0 1 -- 10.20.193.92:0/2234513606 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f27d405e1b0 msgr2=0x7f27d41c18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.806 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.803+0000 7f27daee46c0 1 --2- 10.20.193.92:0/2234513606 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f27d405e1b0 0x7f27d41c18b0 secure :-1 s=READY pgs=19 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f27c4030bf0 tx=0x7f27c4002960 comp rx=0 tx=0).stop 2026-02-13T03:58:37.806 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.803+0000 7f27daee46c0 1 -- 10.20.193.92:0/2234513606 shutdown_connections 2026-02-13T03:58:37.806 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.803+0000 7f27daee46c0 1 --2- 10.20.193.92:0/2234513606 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f27d405f790 0x7f27d41c2af0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.807 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.803+0000 7f27daee46c0 1 --2- 10.20.193.92:0/2234513606 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f27d405f330 0x7f27d41c1f00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.807 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.803+0000 7f27daee46c0 1 --2- 10.20.193.92:0/2234513606 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f27a403f9a0 0x7f27a405fe50 unknown :-1 s=CLOSED pgs=31 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.807 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.803+0000 7f27daee46c0 1 --2- 10.20.193.92:0/2234513606 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f27d405e1b0 0x7f27d41c18b0 unknown :-1 s=CLOSED pgs=19 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.807 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.803+0000 7f27daee46c0 1 -- 10.20.193.92:0/2234513606 >> 10.20.193.92:0/2234513606 conn(0x7f27d405b8e0 msgr2=0x7f27d4064af0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:37.808 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.804+0000 7f27daee46c0 1 -- 10.20.193.92:0/2234513606 shutdown_connections 2026-02-13T03:58:37.808 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.804+0000 7f27daee46c0 1 -- 10.20.193.92:0/2234513606 wait complete. 2026-02-13T03:58:37.834 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.812+0000 7f219fa686c0 1 -- 10.20.193.92:0/2135263860 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f21980f7740 con 0x7f2198113dc0 2026-02-13T03:58:37.841 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.835+0000 7f21867fc6c0 1 -- 10.20.193.92:0/2135263860 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v30)=0 v30) ==== 121+0+0 (secure 0 0 0) 0x7f21880074f0 con 0x7f2198113dc0 2026-02-13T03:58:37.865 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.862+0000 7f219fa686c0 1 -- 10.20.193.92:0/2135263860 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f217403f940 msgr2=0x7f217405fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.865 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.862+0000 7f219fa686c0 1 --2- 10.20.193.92:0/2135263860 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f217403f940 0x7f217405fdf0 secure :-1 s=READY pgs=33 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f218c004750 tx=0x7f218c005f10 comp rx=0 tx=0).stop 2026-02-13T03:58:37.865 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.862+0000 7f219fa686c0 1 -- 10.20.193.92:0/2135263860 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2198113dc0 msgr2=0x7f21980fe850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.865 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.862+0000 7f219fa686c0 1 --2- 10.20.193.92:0/2135263860 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2198113dc0 0x7f21980fe850 secure :-1 s=READY pgs=111 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2188009490 tx=0x7f218800bca0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.866 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.863+0000 7f219fa686c0 1 -- 10.20.193.92:0/2135263860 shutdown_connections 2026-02-13T03:58:37.866 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.863+0000 7f219fa686c0 1 --2- 10.20.193.92:0/2135263860 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f217403f940 0x7f217405fdf0 unknown :-1 s=CLOSED pgs=33 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.866 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.863+0000 7f219fa686c0 1 --2- 10.20.193.92:0/2135263860 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2198115120 0x7f21980ffa90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.866 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.863+0000 7f219fa686c0 1 --2- 10.20.193.92:0/2135263860 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f21981146f0 0x7f21980feea0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.866 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.863+0000 7f219fa686c0 1 --2- 10.20.193.92:0/2135263860 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2198113dc0 0x7f21980fe850 unknown :-1 s=CLOSED pgs=111 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.866 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.863+0000 7f219fa686c0 1 -- 10.20.193.92:0/2135263860 >> 10.20.193.92:0/2135263860 conn(0x7f219805b8e0 msgr2=0x7f21980f4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:37.866 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.863+0000 7f219fa686c0 1 -- 10.20.193.92:0/2135263860 shutdown_connections 2026-02-13T03:58:37.867 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.864+0000 7f219fa686c0 1 -- 10.20.193.92:0/2135263860 wait complete. 2026-02-13T03:58:37.910 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.908+0000 7f0950ff96c0 1 -- 10.20.193.92:0/2325982563 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f092c0055c0 con 0x7f095c0c4fc0 2026-02-13T03:58:37.915 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.911+0000 7f6fa58966c0 1 -- 10.20.193.92:0/2609540824 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6fa0155340 msgr2=0x7f6fa01757f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.915 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.911+0000 7f6fa58966c0 1 --2- 10.20.193.92:0/2609540824 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6fa0155340 0x7f6fa01757f0 secure :-1 s=READY pgs=113 gs=3 cs=0 l=1 c_cookie=1431977633328243005 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f90006fd0 tx=0x7f6f9002ffd0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.915 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.912+0000 7f6fa58966c0 1 -- 10.20.193.92:0/2609540824 shutdown_connections 2026-02-13T03:58:37.915 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.912+0000 7f6fa58966c0 1 --2- 10.20.193.92:0/2609540824 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f6fa01347c0 0x7f6fa0154c00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.915 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.912+0000 7f6fa58966c0 1 --2- 10.20.193.92:0/2609540824 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6fa0155340 0x7f6fa01757f0 unknown :-1 s=CLOSED pgs=113 gs=3 cs=0 l=1 c_cookie=1431977633328243005 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.915 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.912+0000 7f6fa58966c0 1 --2- 10.20.193.92:0/2609540824 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f6fa0113dc0 0x7f6fa01341a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.915 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.912+0000 7f6fa58966c0 1 -- 10.20.193.92:0/2609540824 >> 10.20.193.92:0/2609540824 conn(0x7f6fa005b720 msgr2=0x7f6fa005bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:37.918 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.912+0000 7f6fa58966c0 1 -- 10.20.193.92:0/2609540824 shutdown_connections 2026-02-13T03:58:37.918 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.912+0000 7f6fa58966c0 1 -- 10.20.193.92:0/2609540824 wait complete. 2026-02-13T03:58:37.919 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.914+0000 7f6fa58966c0 1 Processor -- start 2026-02-13T03:58:37.919 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.914+0000 7f6fa58966c0 1 -- start start 2026-02-13T03:58:37.919 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.914+0000 7f6fa58966c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6fa0113dc0 0x7f6fa0154c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.919 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.914+0000 7f6fa58966c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f6fa01347c0 0x7f6fa0175720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.919 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.914+0000 7f6fa58966c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f6fa0155340 0x7f6fa0108240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.919 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.914+0000 7f6fa58966c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa01089d0 con 0x7f6fa0113dc0 2026-02-13T03:58:37.919 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.914+0000 7f6fa58966c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa0108b40 con 0x7f6fa01347c0 2026-02-13T03:58:37.919 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.914+0000 7f6fa58966c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f6fa0109220 con 0x7f6fa0155340 2026-02-13T03:58:37.919 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.915+0000 7f6fa50956c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f6fa0155340 0x7f6fa0108240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.919 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.915+0000 7f6fa50956c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f6fa0155340 0x7f6fa0108240 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:51818/0 (socket says 10.20.193.92:51818) 2026-02-13T03:58:37.919 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.915+0000 7f6fa50956c0 1 -- 10.20.193.92:0/1692118240 learned_addr learned my addr 10.20.193.92:0/1692118240 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T03:58:37.920 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.916+0000 7f6fa48946c0 1 --2- 10.20.193.92:0/1692118240 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6fa0113dc0 0x7f6fa0154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.920 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.916+0000 7f6f9ffff6c0 1 --2- 10.20.193.92:0/1692118240 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f6fa01347c0 0x7f6fa0175720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.920 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.918+0000 7f6fa50956c0 1 -- 10.20.193.92:0/1692118240 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f6fa01347c0 msgr2=0x7f6fa0175720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.921 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.918+0000 7f6fa50956c0 1 --2- 10.20.193.92:0/1692118240 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f6fa01347c0 0x7f6fa0175720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.921 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.918+0000 7f6fa50956c0 1 -- 10.20.193.92:0/1692118240 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6fa0113dc0 msgr2=0x7f6fa0154c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.922 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.918+0000 7f506b7fe6c0 1 -- 10.20.193.92:0/2352038227 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_size}] v 0) -- 0x7f50580055c0 con 0x7f5098115120 2026-02-13T03:58:37.922 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.918+0000 7f6fa50956c0 1 --2- 10.20.193.92:0/1692118240 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6fa0113dc0 0x7f6fa0154c00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.922 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.918+0000 7f6fa50956c0 1 -- 10.20.193.92:0/1692118240 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f9000a5b0 con 0x7f6fa0155340 2026-02-13T03:58:37.923 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.918+0000 7f6fa48946c0 1 --2- 10.20.193.92:0/1692118240 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6fa0113dc0 0x7f6fa0154c00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:58:37.923 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.920+0000 7f6f9ffff6c0 1 --2- 10.20.193.92:0/1692118240 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f6fa01347c0 0x7f6fa0175720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:58:37.927 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.924+0000 7fa5fd15d6c0 1 -- 10.20.193.92:0/3298121152 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa5f8113dc0 msgr2=0x7fa5f81341a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.927 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.924+0000 7fa5fd15d6c0 1 --2- 10.20.193.92:0/3298121152 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa5f8113dc0 0x7fa5f81341a0 secure :-1 s=READY pgs=114 gs=1 cs=0 l=1 c_cookie=12692702220155518322 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5ec009970 tx=0x7fa5ec02f600 comp rx=0 tx=0).stop 2026-02-13T03:58:37.931 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.925+0000 7f6fa50956c0 1 --2- 10.20.193.92:0/1692118240 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f6fa0155340 0x7f6fa0108240 secure :-1 s=READY pgs=23 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f9000a2e0 tx=0x7f6f90005360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:37.931 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.926+0000 7f6f9dffb6c0 1 -- 10.20.193.92:0/1692118240 <== mon.1 v2:10.20.193.158:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6f90003a30 con 0x7f6fa0155340 2026-02-13T03:58:37.931 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.926+0000 7f6fa58966c0 1 -- 10.20.193.92:0/1692118240 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fa01094a0 con 0x7f6fa0155340 2026-02-13T03:58:37.931 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.926+0000 7f6fa58966c0 1 -- 10.20.193.92:0/1692118240 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fa0109970 con 0x7f6fa0155340 2026-02-13T03:58:37.931 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.926+0000 7f6f9dffb6c0 1 -- 10.20.193.92:0/1692118240 <== mon.1 v2:10.20.193.158:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f6f90005760 con 0x7f6fa0155340 2026-02-13T03:58:37.931 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.926+0000 7f6f9dffb6c0 1 -- 10.20.193.92:0/1692118240 <== mon.1 v2:10.20.193.158:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6f90003a30 con 0x7f6fa0155340 2026-02-13T03:58:37.931 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.927+0000 7f6f877fe6c0 1 -- 10.20.193.92:0/1692118240 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fa0179a20 con 0x7f6fa0155340 2026-02-13T03:58:37.931 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.927+0000 7f6f9dffb6c0 1 -- 10.20.193.92:0/1692118240 <== mon.1 v2:10.20.193.158:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7f6f90008670 con 0x7f6fa0155340 2026-02-13T03:58:37.932 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.928+0000 7f6f9dffb6c0 1 --2- 10.20.193.92:0/1692118240 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f6f8003f9a0 0x7f6f8005fe50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.932 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.928+0000 7f0952ffd6c0 1 -- 10.20.193.92:0/2325982563 <== mon.1 v2:10.20.193.158:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v32)=0 v32) ==== 129+0+0 (secure 0 0 0) 0x7f095800d040 con 0x7f095c0c4fc0 2026-02-13T03:58:37.932 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.928+0000 7f6f9dffb6c0 1 -- 10.20.193.92:0/1692118240 <== mon.1 v2:10.20.193.158:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f6f900762d0 con 0x7f6fa0155340 2026-02-13T03:58:37.933 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.928+0000 7f6fa48946c0 1 --2- 10.20.193.92:0/1692118240 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f6f8003f9a0 0x7f6f8005fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.933 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.929+0000 7fa5fd15d6c0 1 -- 10.20.193.92:0/3298121152 shutdown_connections 2026-02-13T03:58:37.933 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.929+0000 7fa5fd15d6c0 1 --2- 10.20.193.92:0/3298121152 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa5f8134770 0x7fa5f8154bf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.933 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.929+0000 7fa5fd15d6c0 1 --2- 10.20.193.92:0/3298121152 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa5f8155380 0x7fa5f8175830 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.933 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.929+0000 7fa5fd15d6c0 1 --2- 10.20.193.92:0/3298121152 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa5f8113dc0 0x7fa5f81341a0 unknown :-1 s=CLOSED pgs=114 gs=1 cs=0 l=1 c_cookie=12692702220155518322 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.934 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.929+0000 7fa5fd15d6c0 1 -- 10.20.193.92:0/3298121152 >> 10.20.193.92:0/3298121152 conn(0x7fa5f805b720 msgr2=0x7fa5f805bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:37.934 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.930+0000 7fa5fd15d6c0 1 -- 10.20.193.92:0/3298121152 shutdown_connections 2026-02-13T03:58:37.934 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.930+0000 7fa5fd15d6c0 1 -- 10.20.193.92:0/3298121152 wait complete. 2026-02-13T03:58:37.934 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.931+0000 7f6fa48946c0 1 --2- 10.20.193.92:0/1692118240 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f6f8003f9a0 0x7f6f8005fe50 secure :-1 s=READY pgs=35 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f94004750 tx=0x7f6f94009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:37.935 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.931+0000 7fa5fd15d6c0 1 Processor -- start 2026-02-13T03:58:37.935 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.932+0000 7fa5fd15d6c0 1 -- start start 2026-02-13T03:58:37.935 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.933+0000 7fa5fd15d6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa5f8113dc0 0x7fa5f8175810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.935 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.933+0000 7fa5fd15d6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa5f8134770 0x7fa5f8154bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.936 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.933+0000 7fa5fd15d6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa5f8155380 0x7fa5f8115d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.936 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.933+0000 7fa5fd15d6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f8114410 con 0x7fa5f8113dc0 2026-02-13T03:58:37.936 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.933+0000 7fa5fd15d6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f8114580 con 0x7fa5f8155380 2026-02-13T03:58:37.937 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.933+0000 7fa5fd15d6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fa5f8114740 con 0x7fa5f8134770 2026-02-13T03:58:37.937 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.934+0000 7fa5f65756c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa5f8134770 0x7fa5f8154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.937 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.934+0000 7fa5f75776c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa5f8155380 0x7fa5f8115d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.938 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.934+0000 7fa5f6d766c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa5f8113dc0 0x7fa5f8175810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.938 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.935+0000 7fa5f6d766c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa5f8113dc0 0x7fa5f8175810 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:48066/0 (socket says 10.20.193.92:48066) 2026-02-13T03:58:37.938 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.935+0000 7fa5f6d766c0 1 -- 10.20.193.92:0/2504168312 learned_addr learned my addr 10.20.193.92:0/2504168312 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T03:58:37.939 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.936+0000 7fa5f6d766c0 1 -- 10.20.193.92:0/2504168312 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa5f8134770 msgr2=0x7fa5f8154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.939 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.936+0000 7fa5f6d766c0 1 --2- 10.20.193.92:0/2504168312 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa5f8134770 0x7fa5f8154bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.939 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.936+0000 7f6f9dffb6c0 1 -- 10.20.193.92:0/1692118240 <== mon.1 v2:10.20.193.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6f90039e40 con 0x7f6fa0155340 2026-02-13T03:58:37.940 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.936+0000 7fa5f6d766c0 1 -- 10.20.193.92:0/2504168312 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa5f8155380 msgr2=0x7fa5f8115d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.940 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.936+0000 7fa5f6d766c0 1 --2- 10.20.193.92:0/2504168312 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa5f8155380 0x7fa5f8115d30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.940 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.936+0000 7fa5f6d766c0 1 -- 10.20.193.92:0/2504168312 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5ec009590 con 0x7fa5f8113dc0 2026-02-13T03:58:37.940 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.936+0000 7fa5f65756c0 1 --2- 10.20.193.92:0/2504168312 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa5f8134770 0x7fa5f8154bd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T03:58:37.940 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.936+0000 7fa5f75776c0 1 --2- 10.20.193.92:0/2504168312 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa5f8155380 0x7fa5f8115d30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T03:58:37.940 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.936+0000 7fa5f6d766c0 1 --2- 10.20.193.92:0/2504168312 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa5f8113dc0 0x7fa5f8175810 secure :-1 s=READY pgs=116 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5ec0098c0 tx=0x7fa5ec005540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:37.947 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.926+0000 7fd10749b6c0 1 -- 10.20.193.92:0/3037462703 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fd0f80c4fc0 msgr2=0x7fd0f80c5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.947 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.926+0000 7fd10749b6c0 1 --2- 10.20.193.92:0/3037462703 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fd0f80c4fc0 0x7fd0f80c5430 secure :-1 s=READY pgs=22 gs=2 cs=0 l=1 c_cookie=6669381170172208304 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0f4009970 tx=0x7fd0f402ed50 comp rx=0 tx=0).stop 2026-02-13T03:58:37.947 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.927+0000 7fd10749b6c0 1 -- 10.20.193.92:0/3037462703 shutdown_connections 2026-02-13T03:58:37.947 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.927+0000 7fd10749b6c0 1 --2- 10.20.193.92:0/3037462703 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fd0f80c4fc0 0x7fd0f80c5430 unknown :-1 s=CLOSED pgs=22 gs=2 cs=0 l=1 c_cookie=6669381170172208304 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.947 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.927+0000 7fd10749b6c0 1 --2- 10.20.193.92:0/3037462703 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd0f80c5970 0x7fd0f8126300 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.947 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.927+0000 7fd10749b6c0 1 --2- 10.20.193.92:0/3037462703 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd0f80c3e40 0x7fd0f80c4230 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.947 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.927+0000 7fd10749b6c0 1 -- 10.20.193.92:0/3037462703 >> 10.20.193.92:0/3037462703 conn(0x7fd0f80a10e0 msgr2=0x7fd0f80c1510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:37.947 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.927+0000 7fd10749b6c0 1 -- 10.20.193.92:0/3037462703 shutdown_connections 2026-02-13T03:58:37.947 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.927+0000 7fd10749b6c0 1 -- 10.20.193.92:0/3037462703 wait complete. 2026-02-13T03:58:37.948 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.928+0000 7fd10749b6c0 1 Processor -- start 2026-02-13T03:58:37.948 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.928+0000 7fd10749b6c0 1 -- start start 2026-02-13T03:58:37.948 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.929+0000 7fd10749b6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd0f80c3e40 0x7fd0f8129940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.948 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.929+0000 7fd10749b6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd0f80c4fc0 0x7fd0f8129f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.948 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.929+0000 7fd10749b6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fd0f80c5970 0x7fd0f8128240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.948 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.929+0000 7fd10749b6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd0f8128780 con 0x7fd0f80c4fc0 2026-02-13T03:58:37.948 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.929+0000 7fd104a0b6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd0f80c4fc0 0x7fd0f8129f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.948 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.929+0000 7fd104a0b6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd0f80c4fc0 0x7fd0f8129f90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:48048/0 (socket says 10.20.193.92:48048) 2026-02-13T03:58:37.948 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.929+0000 7fd104a0b6c0 1 -- 10.20.193.92:0/2208261066 learned_addr learned my addr 10.20.193.92:0/2208261066 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T03:58:37.948 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.929+0000 7fd10749b6c0 1 -- 10.20.193.92:0/2208261066 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd0f81288f0 con 0x7fd0f80c5970 2026-02-13T03:58:37.948 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.929+0000 7fd10749b6c0 1 -- 10.20.193.92:0/2208261066 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fd0f8128ab0 con 0x7fd0f80c3e40 2026-02-13T03:58:37.949 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.929+0000 7fd10520c6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd0f80c3e40 0x7fd0f8129940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.949 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.930+0000 7fd105a0d6c0 1 --2- 10.20.193.92:0/2208261066 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fd0f80c5970 0x7fd0f8128240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.949 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.930+0000 7fd104a0b6c0 1 -- 10.20.193.92:0/2208261066 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd0f80c3e40 msgr2=0x7fd0f8129940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.949 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.930+0000 7fd104a0b6c0 1 --2- 10.20.193.92:0/2208261066 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd0f80c3e40 0x7fd0f8129940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.949 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.930+0000 7fd104a0b6c0 1 -- 10.20.193.92:0/2208261066 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fd0f80c5970 msgr2=0x7fd0f8128240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.949 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.930+0000 7fd104a0b6c0 1 --2- 10.20.193.92:0/2208261066 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fd0f80c5970 0x7fd0f8128240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.949 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.930+0000 7fd104a0b6c0 1 -- 10.20.193.92:0/2208261066 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0f4009590 con 0x7fd0f80c4fc0 2026-02-13T03:58:37.949 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.930+0000 7fd104a0b6c0 1 --2- 10.20.193.92:0/2208261066 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd0f80c4fc0 0x7fd0f8129f90 secure :-1 s=READY pgs=115 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0f40098c0 tx=0x7fd0f40072b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:37.949 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.930+0000 7fd0ee7fc6c0 1 -- 10.20.193.92:0/2208261066 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd0f40026b0 con 0x7fd0f80c4fc0 2026-02-13T03:58:37.949 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.931+0000 7fd0ee7fc6c0 1 -- 10.20.193.92:0/2208261066 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fd0f4002d40 con 0x7fd0f80c4fc0 2026-02-13T03:58:37.949 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.931+0000 7fd0ee7fc6c0 1 -- 10.20.193.92:0/2208261066 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd0f40312b0 con 0x7fd0f80c4fc0 2026-02-13T03:58:37.949 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.931+0000 7fd10749b6c0 1 -- 10.20.193.92:0/2208261066 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0f8128d30 con 0x7fd0f80c4fc0 2026-02-13T03:58:37.950 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.931+0000 7fd10749b6c0 1 -- 10.20.193.92:0/2208261066 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0f80acc40 con 0x7fd0f80c4fc0 2026-02-13T03:58:37.950 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.933+0000 7fd10749b6c0 1 -- 10.20.193.92:0/2208261066 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0c8005310 con 0x7fd0f80c4fc0 2026-02-13T03:58:37.950 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.933+0000 7fd0ee7fc6c0 1 -- 10.20.193.92:0/2208261066 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7fd0f4002810 con 0x7fd0f80c4fc0 2026-02-13T03:58:37.950 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.936+0000 7f0950ff96c0 1 -- 10.20.193.92:0/2325982563 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f094003f940 msgr2=0x7f094005fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.950 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.936+0000 7f0950ff96c0 1 --2- 10.20.193.92:0/2325982563 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f094003f940 0x7f094005fdf0 secure :-1 s=READY pgs=34 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f09540023e0 tx=0x7f095402fb40 comp rx=0 tx=0).stop 2026-02-13T03:58:37.950 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.936+0000 7f0950ff96c0 1 -- 10.20.193.92:0/2325982563 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f095c0c4fc0 msgr2=0x7f095c0cb4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.950 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.936+0000 7f0950ff96c0 1 --2- 10.20.193.92:0/2325982563 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f095c0c4fc0 0x7f095c0cb4a0 secure :-1 s=READY pgs=22 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0958004750 tx=0x7f095800bbf0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.950 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.936+0000 7f0950ff96c0 1 -- 10.20.193.92:0/2325982563 shutdown_connections 2026-02-13T03:58:37.951 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.936+0000 7f0950ff96c0 1 --2- 10.20.193.92:0/2325982563 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f094003f940 0x7f094005fdf0 unknown :-1 s=CLOSED pgs=34 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.951 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.936+0000 7f0950ff96c0 1 --2- 10.20.193.92:0/2325982563 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f095c0c5970 0x7f095c0cc090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.951 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.936+0000 7f0950ff96c0 1 --2- 10.20.193.92:0/2325982563 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f095c0c4fc0 0x7f095c0cb4a0 unknown :-1 s=CLOSED pgs=22 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.951 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.936+0000 7f0950ff96c0 1 --2- 10.20.193.92:0/2325982563 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f095c0c3e40 0x7f095c0cae50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.951 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.936+0000 7f0950ff96c0 1 -- 10.20.193.92:0/2325982563 >> 10.20.193.92:0/2325982563 conn(0x7f095c0a10e0 msgr2=0x7f095c0c14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:37.951 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.936+0000 7f0950ff96c0 1 -- 10.20.193.92:0/2325982563 shutdown_connections 2026-02-13T03:58:37.951 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.936+0000 7f0950ff96c0 1 -- 10.20.193.92:0/2325982563 wait complete. 2026-02-13T03:58:37.951 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.944+0000 7fd0ee7fc6c0 1 --2- 10.20.193.92:0/2208261066 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fd0dc03f910 0x7fd0dc05fdc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.952 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.944+0000 7fd0ee7fc6c0 1 -- 10.20.193.92:0/2208261066 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fd0f40754c0 con 0x7fd0f80c4fc0 2026-02-13T03:58:37.952 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.944+0000 7fa5d7fff6c0 1 -- 10.20.193.92:0/2504168312 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa5ec00b270 con 0x7fa5f8113dc0 2026-02-13T03:58:37.952 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.944+0000 7fd0ee7fc6c0 1 -- 10.20.193.92:0/2208261066 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd0f4034640 con 0x7fd0f80c4fc0 2026-02-13T03:58:37.953 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.944+0000 7fa5d7fff6c0 1 -- 10.20.193.92:0/2504168312 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fa5ec0026b0 con 0x7fa5f8113dc0 2026-02-13T03:58:37.953 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.944+0000 7fa5d7fff6c0 1 -- 10.20.193.92:0/2504168312 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa5ec0356d0 con 0x7fa5f8113dc0 2026-02-13T03:58:37.953 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.944+0000 7fa5fd15d6c0 1 -- 10.20.193.92:0/2504168312 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5f81149c0 con 0x7fa5f8113dc0 2026-02-13T03:58:37.953 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.944+0000 7fa5fd15d6c0 1 -- 10.20.193.92:0/2504168312 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5f8114e40 con 0x7fa5f8113dc0 2026-02-13T03:58:37.953 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.950+0000 7fa5fd15d6c0 1 -- 10.20.193.92:0/2504168312 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5f8115120 con 0x7fa5f8113dc0 2026-02-13T03:58:37.955 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.928+0000 7f5095ffb6c0 1 -- 10.20.193.92:0/2352038227 <== mon.2 v2:10.20.193.99:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_size}]=0 v31)=0 v31) ==== 118+0+0 (secure 0 0 0) 0x7f508c004880 con 0x7f5098115120 2026-02-13T03:58:37.958 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.952+0000 7fa5d7fff6c0 1 -- 10.20.193.92:0/2504168312 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7fa5ec00b3d0 con 0x7fa5f8113dc0 2026-02-13T03:58:37.958 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.952+0000 7fd10520c6c0 1 --2- 10.20.193.92:0/2208261066 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fd0dc03f910 0x7fd0dc05fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.959 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.952+0000 7fa5d7fff6c0 1 --2- 10.20.193.92:0/2504168312 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa5cc03f910 0x7fa5cc05fdc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.959 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.952+0000 7fa5f65756c0 1 --2- 10.20.193.92:0/2504168312 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa5cc03f910 0x7fa5cc05fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.959 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.952+0000 7fa5f65756c0 1 --2- 10.20.193.92:0/2504168312 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa5cc03f910 0x7fa5cc05fdc0 secure :-1 s=READY pgs=36 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5e0004750 tx=0x7fa5e0009190 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:37.959 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.952+0000 7fd10520c6c0 1 --2- 10.20.193.92:0/2208261066 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fd0dc03f910 0x7fd0dc05fdc0 secure :-1 s=READY pgs=37 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0f0005980 tx=0x7fd0f0009290 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:37.960 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.952+0000 7fa5d7fff6c0 1 -- 10.20.193.92:0/2504168312 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fa5ec008540 con 0x7fa5f8113dc0 2026-02-13T03:58:37.961 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.957+0000 7fa5d7fff6c0 1 -- 10.20.193.92:0/2504168312 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa5ec002d50 con 0x7fa5f8113dc0 2026-02-13T03:58:37.972 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.968+0000 7f506b7fe6c0 1 -- 10.20.193.92:0/2352038227 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f507803f990 msgr2=0x7f507805fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.972 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.968+0000 7f506b7fe6c0 1 --2- 10.20.193.92:0/2352038227 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f507803f990 0x7f507805fe40 secure :-1 s=READY pgs=27 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50880092e0 tx=0x7f5088005ae0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.972 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.968+0000 7f506b7fe6c0 1 -- 10.20.193.92:0/2352038227 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5098115120 msgr2=0x7f50980ffe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.972 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.968+0000 7f506b7fe6c0 1 --2- 10.20.193.92:0/2352038227 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5098115120 0x7f50980ffe40 secure :-1 s=READY pgs=17 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f508c006fd0 tx=0x7f508c00cbf0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.973 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.968+0000 7f506b7fe6c0 1 -- 10.20.193.92:0/2352038227 shutdown_connections 2026-02-13T03:58:37.973 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.968+0000 7f506b7fe6c0 1 --2- 10.20.193.92:0/2352038227 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f507803f990 0x7f507805fe40 unknown :-1 s=CLOSED pgs=27 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.973 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.968+0000 7f506b7fe6c0 1 --2- 10.20.193.92:0/2352038227 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5098115120 0x7f50980ffe40 unknown :-1 s=CLOSED pgs=17 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.973 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.968+0000 7f506b7fe6c0 1 --2- 10.20.193.92:0/2352038227 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f50981146f0 0x7f50980ff250 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.973 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.968+0000 7f506b7fe6c0 1 --2- 10.20.193.92:0/2352038227 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5098113dc0 0x7f50980fec00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.973 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.968+0000 7f506b7fe6c0 1 -- 10.20.193.92:0/2352038227 >> 10.20.193.92:0/2352038227 conn(0x7f509805b8e0 msgr2=0x7f50980f50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:37.974 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.968+0000 7f506b7fe6c0 1 -- 10.20.193.92:0/2352038227 shutdown_connections 2026-02-13T03:58:37.974 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.968+0000 7f506b7fe6c0 1 -- 10.20.193.92:0/2352038227 wait complete. 2026-02-13T03:58:37.996 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.981+0000 7fe3607476c0 1 -- 10.20.193.92:0/24566082 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe3581109f0 msgr2=0x7fe358171380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.996 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.981+0000 7fe3607476c0 1 --2- 10.20.193.92:0/24566082 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe3581109f0 0x7fe358171380 secure :-1 s=READY pgs=117 gs=2 cs=0 l=1 c_cookie=12635920439849325370 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe354006fd0 tx=0x7fe35402fd70 comp rx=0 tx=0).stop 2026-02-13T03:58:37.996 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.982+0000 7fe3607476c0 1 -- 10.20.193.92:0/24566082 shutdown_connections 2026-02-13T03:58:37.996 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.982+0000 7fe3607476c0 1 --2- 10.20.193.92:0/24566082 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe3581109f0 0x7fe358171380 unknown :-1 s=CLOSED pgs=117 gs=2 cs=0 l=1 c_cookie=12635920439849325370 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.996 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.982+0000 7fe3607476c0 1 --2- 10.20.193.92:0/24566082 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe358110040 0x7fe3581104b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.996 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.982+0000 7fe3607476c0 1 --2- 10.20.193.92:0/24566082 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe35810eec0 0x7fe35810f2b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.996 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.982+0000 7fe3607476c0 1 -- 10.20.193.92:0/24566082 >> 10.20.193.92:0/24566082 conn(0x7fe3580ec5c0 msgr2=0x7fe35810c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:37.996 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.982+0000 7fe3607476c0 1 -- 10.20.193.92:0/24566082 shutdown_connections 2026-02-13T03:58:37.997 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.982+0000 7fe3607476c0 1 -- 10.20.193.92:0/24566082 wait complete. 2026-02-13T03:58:37.997 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.984+0000 7fe3607476c0 1 Processor -- start 2026-02-13T03:58:37.997 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.984+0000 7fe3607476c0 1 -- start start 2026-02-13T03:58:37.997 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.984+0000 7fe3607476c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe35810eec0 0x7fe3580f8140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.997 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.984+0000 7fe3607476c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe358110040 0x7fe358171360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.997 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.984+0000 7fe3607476c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe3581109f0 0x7fe3580f8980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.997 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.984+0000 7fe3607476c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe3580f95d0 con 0x7fe35810eec0 2026-02-13T03:58:37.997 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.984+0000 7fe35dcb76c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe358110040 0x7fe358171360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.997 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.984+0000 7fe35dcb76c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe358110040 0x7fe358171360 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:51868/0 (socket says 10.20.193.92:51868) 2026-02-13T03:58:37.997 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.984+0000 7fe35dcb76c0 1 -- 10.20.193.92:0/1179128057 learned_addr learned my addr 10.20.193.92:0/1179128057 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T03:58:37.997 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.984+0000 7fe35ecb96c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe3581109f0 0x7fe3580f8980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.998 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.985+0000 7fe3607476c0 1 -- 10.20.193.92:0/1179128057 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe3580f9740 con 0x7fe3581109f0 2026-02-13T03:58:37.998 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.985+0000 7fe3607476c0 1 -- 10.20.193.92:0/1179128057 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fe3580f9900 con 0x7fe358110040 2026-02-13T03:58:37.998 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.985+0000 7fe35e4b86c0 1 --2- 10.20.193.92:0/1179128057 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe35810eec0 0x7fe3580f8140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:37.998 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.985+0000 7fe35e4b86c0 1 -- 10.20.193.92:0/1179128057 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe358110040 msgr2=0x7fe358171360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.998 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.985+0000 7fe35e4b86c0 1 --2- 10.20.193.92:0/1179128057 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe358110040 0x7fe358171360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.998 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.985+0000 7fe35e4b86c0 1 -- 10.20.193.92:0/1179128057 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe3581109f0 msgr2=0x7fe3580f8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:37.998 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.985+0000 7fe35e4b86c0 1 --2- 10.20.193.92:0/1179128057 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe3581109f0 0x7fe3580f8980 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:37.998 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.985+0000 7fe35e4b86c0 1 -- 10.20.193.92:0/1179128057 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe35400a5b0 con 0x7fe35810eec0 2026-02-13T03:58:37.998 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.985+0000 7fe35e4b86c0 1 --2- 10.20.193.92:0/1179128057 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe35810eec0 0x7fe3580f8140 secure :-1 s=READY pgs=118 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe34800b9c0 tx=0x7fe34800be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:37.998 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.985+0000 7fe3477fe6c0 1 -- 10.20.193.92:0/1179128057 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe348004a80 con 0x7fe35810eec0 2026-02-13T03:58:37.998 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.985+0000 7fe3477fe6c0 1 -- 10.20.193.92:0/1179128057 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fe348009030 con 0x7fe35810eec0 2026-02-13T03:58:37.998 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.985+0000 7fe3477fe6c0 1 -- 10.20.193.92:0/1179128057 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe348004a80 con 0x7fe35810eec0 2026-02-13T03:58:37.999 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.986+0000 7fe3607476c0 1 -- 10.20.193.92:0/1179128057 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3580f9b80 con 0x7fe35810eec0 2026-02-13T03:58:37.999 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.987+0000 7fe3607476c0 1 -- 10.20.193.92:0/1179128057 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3580fa010 con 0x7fe35810eec0 2026-02-13T03:58:37.999 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.989+0000 7fe3477fe6c0 1 -- 10.20.193.92:0/1179128057 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7fe348005000 con 0x7fe35810eec0 2026-02-13T03:58:37.999 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.989+0000 7fe3477fe6c0 1 --2- 10.20.193.92:0/1179128057 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fe32803f9a0 0x7fe32805fe50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:37.999 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.990+0000 7fe3457fa6c0 1 -- 10.20.193.92:0/1179128057 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe358175670 con 0x7fe35810eec0 2026-02-13T03:58:37.999 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.990+0000 7fe3477fe6c0 1 -- 10.20.193.92:0/1179128057 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fe348055550 con 0x7fe35810eec0 2026-02-13T03:58:37.999 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.990+0000 7fe35dcb76c0 1 --2- 10.20.193.92:0/1179128057 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fe32803f9a0 0x7fe32805fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:38.000 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.992+0000 7fe3477fe6c0 1 -- 10.20.193.92:0/1179128057 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe348010250 con 0x7fe35810eec0 2026-02-13T03:58:38.000 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:37.992+0000 7fe35dcb76c0 1 --2- 10.20.193.92:0/1179128057 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fe32803f9a0 0x7fe32805fe50 secure :-1 s=READY pgs=38 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe34c005b40 tx=0x7fe34c009510 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:38.068 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.065+0000 7f6f877fe6c0 1 -- 10.20.193.92:0/1692118240 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f6f6c0051d0 con 0x7f6fa0155340 2026-02-13T03:58:38.071 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.068+0000 7fa5fd15d6c0 1 -- 10.20.193.92:0/2504168312 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7fa5f817a320 con 0x7fa5f8113dc0 2026-02-13T03:58:38.071 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.069+0000 7f6f9dffb6c0 1 -- 10.20.193.92:0/1692118240 <== mon.1 v2:10.20.193.158:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v33)=0 v33) ==== 121+0+0 (secure 0 0 0) 0x7f6f90039e40 con 0x7f6fa0155340 2026-02-13T03:58:38.074 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.071+0000 7f6f877fe6c0 1 -- 10.20.193.92:0/1692118240 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f6f8003f9a0 msgr2=0x7f6f8005fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:38.074 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.071+0000 7f6f877fe6c0 1 --2- 10.20.193.92:0/1692118240 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f6f8003f9a0 0x7f6f8005fe50 secure :-1 s=READY pgs=35 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f94004750 tx=0x7f6f94009260 comp rx=0 tx=0).stop 2026-02-13T03:58:38.074 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.071+0000 7f6f877fe6c0 1 -- 10.20.193.92:0/1692118240 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f6fa0155340 msgr2=0x7f6fa0108240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:38.074 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.071+0000 7f6f877fe6c0 1 --2- 10.20.193.92:0/1692118240 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f6fa0155340 0x7f6fa0108240 secure :-1 s=READY pgs=23 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6f9000a2e0 tx=0x7f6f90005360 comp rx=0 tx=0).stop 2026-02-13T03:58:38.075 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.072+0000 7f6f877fe6c0 1 -- 10.20.193.92:0/1692118240 shutdown_connections 2026-02-13T03:58:38.075 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.072+0000 7f6f877fe6c0 1 --2- 10.20.193.92:0/1692118240 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f6f8003f9a0 0x7f6f8005fe50 unknown :-1 s=CLOSED pgs=35 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:38.075 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.072+0000 7f6f877fe6c0 1 --2- 10.20.193.92:0/1692118240 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f6fa01347c0 0x7f6fa0175720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:38.075 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.072+0000 7f6f877fe6c0 1 --2- 10.20.193.92:0/1692118240 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f6fa0155340 0x7f6fa0108240 unknown :-1 s=CLOSED pgs=23 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:38.075 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.072+0000 7f6f877fe6c0 1 --2- 10.20.193.92:0/1692118240 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6fa0113dc0 0x7f6fa0154c00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:38.075 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.072+0000 7f6f877fe6c0 1 -- 10.20.193.92:0/1692118240 >> 10.20.193.92:0/1692118240 conn(0x7f6fa005b720 msgr2=0x7f6fa00f60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:38.075 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.072+0000 7f6f877fe6c0 1 -- 10.20.193.92:0/1692118240 shutdown_connections 2026-02-13T03:58:38.076 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.072+0000 7f6f877fe6c0 1 -- 10.20.193.92:0/1692118240 wait complete. 2026-02-13T03:58:38.076 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.073+0000 7fa5d7fff6c0 1 -- 10.20.193.92:0/2504168312 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v34)=0 v34) ==== 138+0+0 (secure 0 0 0) 0x7fa5ec039060 con 0x7fa5f8113dc0 2026-02-13T03:58:38.079 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.076+0000 7fa5fd15d6c0 1 -- 10.20.193.92:0/2504168312 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa5cc03f910 msgr2=0x7fa5cc05fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:38.079 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.076+0000 7fa5fd15d6c0 1 --2- 10.20.193.92:0/2504168312 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa5cc03f910 0x7fa5cc05fdc0 secure :-1 s=READY pgs=36 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5e0004750 tx=0x7fa5e0009190 comp rx=0 tx=0).stop 2026-02-13T03:58:38.080 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.076+0000 7fa5fd15d6c0 1 -- 10.20.193.92:0/2504168312 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa5f8113dc0 msgr2=0x7fa5f8175810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:38.080 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.076+0000 7fa5fd15d6c0 1 --2- 10.20.193.92:0/2504168312 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa5f8113dc0 0x7fa5f8175810 secure :-1 s=READY pgs=116 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa5ec0098c0 tx=0x7fa5ec005540 comp rx=0 tx=0).stop 2026-02-13T03:58:38.081 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.078+0000 7fa5fd15d6c0 1 -- 10.20.193.92:0/2504168312 shutdown_connections 2026-02-13T03:58:38.081 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.078+0000 7fa5fd15d6c0 1 --2- 10.20.193.92:0/2504168312 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa5cc03f910 0x7fa5cc05fdc0 unknown :-1 s=CLOSED pgs=36 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:38.081 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.078+0000 7fa5fd15d6c0 1 --2- 10.20.193.92:0/2504168312 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa5f8155380 0x7fa5f8115d30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:38.081 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.078+0000 7fa5fd15d6c0 1 --2- 10.20.193.92:0/2504168312 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa5f8134770 0x7fa5f8154bd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:38.082 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.078+0000 7fa5fd15d6c0 1 --2- 10.20.193.92:0/2504168312 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa5f8113dc0 0x7fa5f8175810 unknown :-1 s=CLOSED pgs=116 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:38.082 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.078+0000 7fa5fd15d6c0 1 -- 10.20.193.92:0/2504168312 >> 10.20.193.92:0/2504168312 conn(0x7fa5f805b720 msgr2=0x7fa5f8117500 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:38.082 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.078+0000 7fa5fd15d6c0 1 -- 10.20.193.92:0/2504168312 shutdown_connections 2026-02-13T03:58:38.082 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.079+0000 7fa5fd15d6c0 1 -- 10.20.193.92:0/2504168312 wait complete. 2026-02-13T03:58:38.110 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1fefccae-0890-11f1-bcc5-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='trial092') 2026-02-13T03:58:38.110 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1fefccae-0890-11f1-bcc5-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='trial092') 2026-02-13T03:58:38.116 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.114+0000 7fe3457fa6c0 1 -- 10.20.193.92:0/1179128057 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7fe358174f30 con 0x7fe35810eec0 2026-02-13T03:58:38.119 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.116+0000 7fe3477fe6c0 1 -- 10.20.193.92:0/1179128057 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v35)=0 v35) ==== 133+0+0 (secure 0 0 0) 0x7fe348008880 con 0x7fe35810eec0 2026-02-13T03:58:38.121 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.116+0000 7fe3457fa6c0 1 -- 10.20.193.92:0/1179128057 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fe32803f9a0 msgr2=0x7fe32805fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:38.122 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.116+0000 7fe3457fa6c0 1 --2- 10.20.193.92:0/1179128057 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fe32803f9a0 0x7fe32805fe50 secure :-1 s=READY pgs=38 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe34c005b40 tx=0x7fe34c009510 comp rx=0 tx=0).stop 2026-02-13T03:58:38.122 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.116+0000 7fe3457fa6c0 1 -- 10.20.193.92:0/1179128057 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe35810eec0 msgr2=0x7fe3580f8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:38.122 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.116+0000 7fe3457fa6c0 1 --2- 10.20.193.92:0/1179128057 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe35810eec0 0x7fe3580f8140 secure :-1 s=READY pgs=118 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe34800b9c0 tx=0x7fe34800be90 comp rx=0 tx=0).stop 2026-02-13T03:58:38.123 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.116+0000 7fe3457fa6c0 1 -- 10.20.193.92:0/1179128057 shutdown_connections 2026-02-13T03:58:38.124 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.116+0000 7fe3457fa6c0 1 --2- 10.20.193.92:0/1179128057 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fe32803f9a0 0x7fe32805fe50 unknown :-1 s=CLOSED pgs=38 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:38.124 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.116+0000 7fe3457fa6c0 1 --2- 10.20.193.92:0/1179128057 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe3581109f0 0x7fe3580f8980 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:38.124 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.116+0000 7fe3457fa6c0 1 --2- 10.20.193.92:0/1179128057 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe358110040 0x7fe358171360 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:38.124 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.116+0000 7fe3457fa6c0 1 --2- 10.20.193.92:0/1179128057 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe35810eec0 0x7fe3580f8140 unknown :-1 s=CLOSED pgs=118 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:38.124 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.116+0000 7fe3457fa6c0 1 -- 10.20.193.92:0/1179128057 >> 10.20.193.92:0/1179128057 conn(0x7fe3580ec5c0 msgr2=0x7fe3580ee270 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:38.124 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.121+0000 7fe3457fa6c0 1 -- 10.20.193.92:0/1179128057 shutdown_connections 2026-02-13T03:58:38.124 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.121+0000 7fe3457fa6c0 1 -- 10.20.193.92:0/1179128057 wait complete. 2026-02-13T03:58:38.124 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.121+0000 7fd10749b6c0 1 -- 10.20.193.92:0/2208261066 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7fd0c8005b40 con 0x7fd0f80c4fc0 2026-02-13T03:58:38.126 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.124+0000 7fd0ee7fc6c0 1 -- 10.20.193.92:0/2208261066 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v36)=0 v36) ==== 121+0+0 (secure 0 0 0) 0x7fd0f4034640 con 0x7fd0f80c4fc0 2026-02-13T03:58:38.129 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.124+0000 7fd10749b6c0 1 -- 10.20.193.92:0/2208261066 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fd0dc03f910 msgr2=0x7fd0dc05fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:38.129 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.124+0000 7fd10749b6c0 1 --2- 10.20.193.92:0/2208261066 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fd0dc03f910 0x7fd0dc05fdc0 secure :-1 s=READY pgs=37 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0f0005980 tx=0x7fd0f0009290 comp rx=0 tx=0).stop 2026-02-13T03:58:38.129 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.124+0000 7fd10749b6c0 1 -- 10.20.193.92:0/2208261066 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd0f80c4fc0 msgr2=0x7fd0f8129f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:38.129 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.124+0000 7fd10749b6c0 1 --2- 10.20.193.92:0/2208261066 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd0f80c4fc0 0x7fd0f8129f90 secure :-1 s=READY pgs=115 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0f40098c0 tx=0x7fd0f40072b0 comp rx=0 tx=0).stop 2026-02-13T03:58:38.129 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.124+0000 7fd10749b6c0 1 -- 10.20.193.92:0/2208261066 shutdown_connections 2026-02-13T03:58:38.130 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.124+0000 7fd10749b6c0 1 --2- 10.20.193.92:0/2208261066 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fd0dc03f910 0x7fd0dc05fdc0 unknown :-1 s=CLOSED pgs=37 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:38.130 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.124+0000 7fd10749b6c0 1 --2- 10.20.193.92:0/2208261066 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fd0f80c5970 0x7fd0f8128240 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:38.130 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.124+0000 7fd10749b6c0 1 --2- 10.20.193.92:0/2208261066 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd0f80c4fc0 0x7fd0f8129f90 unknown :-1 s=CLOSED pgs=115 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:38.130 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.124+0000 7fd10749b6c0 1 --2- 10.20.193.92:0/2208261066 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd0f80c3e40 0x7fd0f8129940 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:38.130 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.124+0000 7fd10749b6c0 1 -- 10.20.193.92:0/2208261066 >> 10.20.193.92:0/2208261066 conn(0x7fd0f80a10e0 msgr2=0x7fd0f80a2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:38.130 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.124+0000 7fd10749b6c0 1 -- 10.20.193.92:0/2208261066 shutdown_connections 2026-02-13T03:58:38.130 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:38.124+0000 7fd10749b6c0 1 -- 10.20.193.92:0/2208261066 wait complete. 2026-02-13T03:58:38.279 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:38 trial092 ceph-mon[23047]: from='client.? ' entity='client.admin' 2026-02-13T03:58:38.279 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:38 trial092 ceph-mon[23047]: from='client.? ' entity='client.admin' 2026-02-13T03:58:38.279 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:38 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:38.279 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:38 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:38.279 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:38 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial092", "name": "osd_memory_target"} : dispatch 2026-02-13T03:58:38.279 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:38 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:38.279 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:38 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:58:38.280 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:38 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/3831284443' entity='client.admin' 2026-02-13T03:58:38.280 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:38 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/3998355078' entity='client.admin' 2026-02-13T03:58:38.280 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:38 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/2820354456' entity='client.admin' 2026-02-13T03:58:38.280 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:38 trial092 ceph-mon[23047]: from='client.? ' entity='client.admin' 2026-02-13T03:58:38.280 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:38 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/3458270009' entity='client.admin' 2026-02-13T03:58:38.280 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:38 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/2856696346' entity='client.admin' 2026-02-13T03:58:38.280 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:38 trial092 ceph-mon[23047]: from='client.? ' entity='client.admin' 2026-02-13T03:58:38.280 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:38 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/2135263860' entity='client.admin' 2026-02-13T03:58:38.280 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:38 trial092 ceph-mon[23047]: from='client.? ' entity='client.admin' 2026-02-13T03:58:38.280 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:38 trial092 ceph-mon[23047]: from='client.? ' entity='client.admin' 2026-02-13T03:58:38.280 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:38 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:38.280 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:38 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:38.281 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:38 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:38.281 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:38 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:38.281 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:38 trial092 ceph-mon[23047]: from='client.? ' entity='client.admin' 2026-02-13T03:58:38.281 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:38 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/2504168312' entity='client.admin' 2026-02-13T03:58:38.281 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:38 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1179128057' entity='client.admin' 2026-02-13T03:58:38.281 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:38 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/2208261066' entity='client.admin' 2026-02-13T03:58:38.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:38 trial158 ceph-mon[27763]: from='client.? ' entity='client.admin' 2026-02-13T03:58:38.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:38 trial158 ceph-mon[27763]: from='client.? ' entity='client.admin' 2026-02-13T03:58:38.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:38 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:38.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:38 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:38.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:38 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial092", "name": "osd_memory_target"} : dispatch 2026-02-13T03:58:38.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:38 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:38.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:38 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:58:38.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:38 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/3831284443' entity='client.admin' 2026-02-13T03:58:38.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:38 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/3998355078' entity='client.admin' 2026-02-13T03:58:38.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:38 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/2820354456' entity='client.admin' 2026-02-13T03:58:38.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:38 trial158 ceph-mon[27763]: from='client.? ' entity='client.admin' 2026-02-13T03:58:38.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:38 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/3458270009' entity='client.admin' 2026-02-13T03:58:38.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:38 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/2856696346' entity='client.admin' 2026-02-13T03:58:38.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:38 trial158 ceph-mon[27763]: from='client.? ' entity='client.admin' 2026-02-13T03:58:38.581 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:38 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/2135263860' entity='client.admin' 2026-02-13T03:58:38.581 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:38 trial158 ceph-mon[27763]: from='client.? ' entity='client.admin' 2026-02-13T03:58:38.581 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:38 trial158 ceph-mon[27763]: from='client.? ' entity='client.admin' 2026-02-13T03:58:38.581 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:38 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:38.581 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:38 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:38.581 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:38 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:38.581 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:38 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:38.581 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:38 trial158 ceph-mon[27763]: from='client.? ' entity='client.admin' 2026-02-13T03:58:38.581 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:38 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/2504168312' entity='client.admin' 2026-02-13T03:58:38.581 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:38 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/1179128057' entity='client.admin' 2026-02-13T03:58:38.581 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:38 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/2208261066' entity='client.admin' 2026-02-13T03:58:38.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:38 trial099 ceph-mon[27808]: from='client.? ' entity='client.admin' 2026-02-13T03:58:38.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:38 trial099 ceph-mon[27808]: from='client.? ' entity='client.admin' 2026-02-13T03:58:38.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:38 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:38.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:38 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:38.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:38 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:trial092", "name": "osd_memory_target"} : dispatch 2026-02-13T03:58:38.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:38 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:38.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:38 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:58:38.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:38 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/3831284443' entity='client.admin' 2026-02-13T03:58:38.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:38 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/3998355078' entity='client.admin' 2026-02-13T03:58:38.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:38 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/2820354456' entity='client.admin' 2026-02-13T03:58:38.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:38 trial099 ceph-mon[27808]: from='client.? ' entity='client.admin' 2026-02-13T03:58:38.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:38 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/3458270009' entity='client.admin' 2026-02-13T03:58:38.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:38 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/2856696346' entity='client.admin' 2026-02-13T03:58:38.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:38 trial099 ceph-mon[27808]: from='client.? ' entity='client.admin' 2026-02-13T03:58:38.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:38 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/2135263860' entity='client.admin' 2026-02-13T03:58:38.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:38 trial099 ceph-mon[27808]: from='client.? ' entity='client.admin' 2026-02-13T03:58:38.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:38 trial099 ceph-mon[27808]: from='client.? ' entity='client.admin' 2026-02-13T03:58:38.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:38 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:38.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:38 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:38.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:38 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:38.618 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:38 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:38.618 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:38 trial099 ceph-mon[27808]: from='client.? ' entity='client.admin' 2026-02-13T03:58:38.618 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:38 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/2504168312' entity='client.admin' 2026-02-13T03:58:38.618 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:38 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/1179128057' entity='client.admin' 2026-02-13T03:58:38.618 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:38 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/2208261066' entity='client.admin' 2026-02-13T03:58:38.620 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1fefccae-0890-11f1-bcc5-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='trial092') 2026-02-13T03:58:38.620 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1fefccae-0890-11f1-bcc5-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='trial092') 2026-02-13T03:58:38.620 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1fefccae-0890-11f1-bcc5-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='trial092') 2026-02-13T03:58:38.625 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1fefccae-0890-11f1-bcc5-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='trial092') 2026-02-13T03:58:38.626 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1fefccae-0890-11f1-bcc5-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='trial092') 2026-02-13T03:58:38.626 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1fefccae-0890-11f1-bcc5-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='trial092') 2026-02-13T03:58:38.626 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1fefccae-0890-11f1-bcc5-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='trial092') 2026-02-13T03:58:38.626 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1fefccae-0890-11f1-bcc5-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='trial092') 2026-02-13T03:58:38.626 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1fefccae-0890-11f1-bcc5-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_cephsqlite', '20'], check_status=True, hostname='trial092') 2026-02-13T03:58:38.626 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1fefccae-0890-11f1-bcc5-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='trial092') 2026-02-13T03:58:38.627 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1fefccae-0890-11f1-bcc5-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='trial092') 2026-02-13T03:58:38.627 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1fefccae-0890-11f1-bcc5-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='trial092') 2026-02-13T03:58:38.627 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1fefccae-0890-11f1-bcc5-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/allow_m_granularity', 'True'], check_status=True, hostname='trial092') 2026-02-13T03:58:38.645 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1fefccae-0890-11f1-bcc5-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/dump_on_update', 'True'], check_status=True, hostname='trial092') 2026-02-13T03:58:38.645 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1fefccae-0890-11f1-bcc5-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'mgr/snap_schedule/log_level', 'debug'], check_status=True, hostname='trial092') 2026-02-13T03:58:38.646 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1fefccae-0890-11f1-bcc5-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='trial092') 2026-02-13T03:58:38.646 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1fefccae-0890-11f1-bcc5-d404e6e7d460', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='trial092') 2026-02-13T03:58:38.646 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '1fefccae-0890-11f1-bcc5-d404e6e7d460', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='trial092') 2026-02-13T03:58:38.647 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph config dump 2026-02-13T03:58:38.870 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:58:39.064 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.060+0000 7fc293fff6c0 1 -- 10.20.193.92:0/1683672885 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc29410fa50 msgr2=0x7fc294114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:39.064 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.060+0000 7fc293fff6c0 1 --2- 10.20.193.92:0/1683672885 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc29410fa50 0x7fc294114a90 secure :-1 s=READY pgs=119 gs=1 cs=0 l=1 c_cookie=14223296480227289945 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc27c0099a0 tx=0x7fc27c02ed00 comp rx=0 tx=0).stop 2026-02-13T03:58:39.064 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.060+0000 7fc293fff6c0 1 -- 10.20.193.92:0/1683672885 shutdown_connections 2026-02-13T03:58:39.064 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.060+0000 7fc293fff6c0 1 --2- 10.20.193.92:0/1683672885 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fc294115270 0x7fc294175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:39.065 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.060+0000 7fc293fff6c0 1 --2- 10.20.193.92:0/1683672885 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc29410fa50 0x7fc294114a90 unknown :-1 s=CLOSED pgs=119 gs=1 cs=0 l=1 c_cookie=14223296480227289945 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:39.065 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.060+0000 7fc293fff6c0 1 --2- 10.20.193.92:0/1683672885 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fc29410f060 0x7fc29410f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:39.065 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.060+0000 7fc293fff6c0 1 -- 10.20.193.92:0/1683672885 >> 10.20.193.92:0/1683672885 conn(0x7fc2940ec980 msgr2=0x7fc29410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:39.065 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.060+0000 7fc293fff6c0 1 -- 10.20.193.92:0/1683672885 shutdown_connections 2026-02-13T03:58:39.065 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.060+0000 7fc293fff6c0 1 -- 10.20.193.92:0/1683672885 wait complete. 2026-02-13T03:58:39.065 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.060+0000 7fc293fff6c0 1 Processor -- start 2026-02-13T03:58:39.065 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.060+0000 7fc293fff6c0 1 -- start start 2026-02-13T03:58:39.065 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.061+0000 7fc293fff6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fc29410f060 0x7fc294066730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:39.065 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.061+0000 7fc293fff6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc294115270 0x7fc294175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:39.065 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.061+0000 7fc293fff6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fc294062990 0x7fc294062e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:39.066 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.061+0000 7fc293fff6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc2940635a0 con 0x7fc294115270 2026-02-13T03:58:39.066 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.061+0000 7fc293fff6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc294063710 con 0x7fc294062990 2026-02-13T03:58:39.066 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.061+0000 7fc293fff6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fc2940ff110 con 0x7fc29410f060 2026-02-13T03:58:39.066 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.061+0000 7fc292ffd6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fc29410f060 0x7fc294066730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:39.066 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.061+0000 7fc2937fe6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fc294062990 0x7fc294062e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:39.066 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.061+0000 7fc292ffd6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fc29410f060 0x7fc294066730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:51890/0 (socket says 10.20.193.92:51890) 2026-02-13T03:58:39.066 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.061+0000 7fc292ffd6c0 1 -- 10.20.193.92:0/2147252562 learned_addr learned my addr 10.20.193.92:0/2147252562 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T03:58:39.066 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.061+0000 7fc2927fc6c0 1 --2- 10.20.193.92:0/2147252562 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc294115270 0x7fc294175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:39.066 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.061+0000 7fc2937fe6c0 1 -- 10.20.193.92:0/2147252562 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fc29410f060 msgr2=0x7fc294066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:39.066 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.061+0000 7fc2937fe6c0 1 --2- 10.20.193.92:0/2147252562 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fc29410f060 0x7fc294066730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:39.066 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.061+0000 7fc2937fe6c0 1 -- 10.20.193.92:0/2147252562 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc294115270 msgr2=0x7fc294175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:39.067 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.062+0000 7fc2937fe6c0 1 --2- 10.20.193.92:0/2147252562 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc294115270 0x7fc294175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:39.067 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.062+0000 7fc2937fe6c0 1 -- 10.20.193.92:0/2147252562 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc27c009590 con 0x7fc294062990 2026-02-13T03:58:39.067 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.062+0000 7fc2927fc6c0 1 --2- 10.20.193.92:0/2147252562 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc294115270 0x7fc294175b10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T03:58:39.068 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.062+0000 7fc2937fe6c0 1 --2- 10.20.193.92:0/2147252562 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fc294062990 0x7fc294062e10 secure :-1 s=READY pgs=23 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc28400c6c0 tx=0x7fc28400cb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:39.069 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.062+0000 7fc2988d26c0 1 -- 10.20.193.92:0/2147252562 <== mon.2 v2:10.20.193.99:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc284005340 con 0x7fc294062990 2026-02-13T03:58:39.069 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.062+0000 7fc2988d26c0 1 -- 10.20.193.92:0/2147252562 <== mon.2 v2:10.20.193.99:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fc284003d40 con 0x7fc294062990 2026-02-13T03:58:39.069 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.062+0000 7fc293fff6c0 1 -- 10.20.193.92:0/2147252562 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2940ff3f0 con 0x7fc294062990 2026-02-13T03:58:39.069 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.062+0000 7fc293fff6c0 1 -- 10.20.193.92:0/2147252562 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2940ff880 con 0x7fc294062990 2026-02-13T03:58:39.069 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.062+0000 7fc2988d26c0 1 -- 10.20.193.92:0/2147252562 <== mon.2 v2:10.20.193.99:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc28400ddd0 con 0x7fc294062990 2026-02-13T03:58:39.069 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.063+0000 7fc2727fc6c0 1 -- 10.20.193.92:0/2147252562 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc294110330 con 0x7fc294062990 2026-02-13T03:58:39.069 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.063+0000 7fc2988d26c0 1 -- 10.20.193.92:0/2147252562 <== mon.2 v2:10.20.193.99:3300/0 4 ==== mgrmap(e 12) ==== 52831+0+0 (secure 0 0 0) 0x7fc284003810 con 0x7fc294062990 2026-02-13T03:58:39.069 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.064+0000 7fc2988d26c0 1 --2- 10.20.193.92:0/2147252562 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fc26803f940 0x7fc26805fdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:39.069 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.064+0000 7fc2988d26c0 1 -- 10.20.193.92:0/2147252562 <== mon.2 v2:10.20.193.99:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7fc284052330 con 0x7fc294062990 2026-02-13T03:58:39.069 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.064+0000 7fc292ffd6c0 1 --2- 10.20.193.92:0/2147252562 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fc26803f940 0x7fc26805fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:39.070 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.065+0000 7fc292ffd6c0 1 --2- 10.20.193.92:0/2147252562 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fc26803f940 0x7fc26805fdf0 secure :-1 s=READY pgs=39 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc288009260 tx=0x7fc288009440 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:39.070 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.065+0000 7fc2988d26c0 1 -- 10.20.193.92:0/2147252562 <== mon.2 v2:10.20.193.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc284006220 con 0x7fc294062990 2026-02-13T03:58:39.169 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.166+0000 7fc2727fc6c0 1 -- 10.20.193.92:0/2147252562 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fc294063c90 con 0x7fc294062990 2026-02-13T03:58:39.169 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.166+0000 7fc2988d26c0 1 -- 10.20.193.92:0/2147252562 <== mon.2 v2:10.20.193.99:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v36) ==== 59+0+19936 (secure 0 0 0) 0x7fc284006030 con 0x7fc294062990 2026-02-13T03:58:39.170 INFO:teuthology.orchestra.run.trial092.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-13T03:58:39.170 INFO:teuthology.orchestra.run.trial092.stdout:global dev auth_debug true 2026-02-13T03:58:39.171 INFO:teuthology.orchestra.run.trial092.stdout:global basic container_image quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 * 2026-02-13T03:58:39.171 INFO:teuthology.orchestra.run.trial092.stdout:global dev debug_asserts_on_shutdown true 2026-02-13T03:58:39.171 INFO:teuthology.orchestra.run.trial092.stdout:global basic log_to_file true 2026-02-13T03:58:39.171 INFO:teuthology.orchestra.run.trial092.stdout:global basic log_to_journald false 2026-02-13T03:58:39.171 INFO:teuthology.orchestra.run.trial092.stdout:global basic log_to_stderr false 2026-02-13T03:58:39.171 INFO:teuthology.orchestra.run.trial092.stdout:global advanced mon_allow_pool_delete true 2026-02-13T03:58:39.171 INFO:teuthology.orchestra.run.trial092.stdout:global advanced mon_clock_drift_allowed 1.000000 2026-02-13T03:58:39.171 INFO:teuthology.orchestra.run.trial092.stdout:global advanced mon_cluster_log_to_file true 2026-02-13T03:58:39.171 INFO:teuthology.orchestra.run.trial092.stdout:global advanced mon_max_pg_per_osd 10000 2026-02-13T03:58:39.171 INFO:teuthology.orchestra.run.trial092.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2026-02-13T03:58:39.172 INFO:teuthology.orchestra.run.trial092.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2026-02-13T03:58:39.172 INFO:teuthology.orchestra.run.trial092.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2026-02-13T03:58:39.172 INFO:teuthology.orchestra.run.trial092.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2026-02-13T03:58:39.172 INFO:teuthology.orchestra.run.trial092.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2026-02-13T03:58:39.172 INFO:teuthology.orchestra.run.trial092.stdout:global advanced mon_warn_on_too_few_osds false 2026-02-13T03:58:39.172 INFO:teuthology.orchestra.run.trial092.stdout:global dev ms_die_on_bug true 2026-02-13T03:58:39.172 INFO:teuthology.orchestra.run.trial092.stdout:global dev ms_die_on_old_message true 2026-02-13T03:58:39.172 INFO:teuthology.orchestra.run.trial092.stdout:global dev ms_die_on_skipped_message false 2026-02-13T03:58:39.172 INFO:teuthology.orchestra.run.trial092.stdout:global advanced osd_pool_default_erasure_code_profile plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-13T03:58:39.172 INFO:teuthology.orchestra.run.trial092.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2026-02-13T03:58:39.172 INFO:teuthology.orchestra.run.trial092.stdout:global advanced public_network 10.20.192.0/20 * 2026-02-13T03:58:39.172 INFO:teuthology.orchestra.run.trial092.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2026-02-13T03:58:39.173 INFO:teuthology.orchestra.run.trial092.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2026-02-13T03:58:39.173 INFO:teuthology.orchestra.run.trial092.stdout:mon advanced auth_service_ticket_ttl 240.000000 2026-02-13T03:58:39.173 INFO:teuthology.orchestra.run.trial092.stdout:mon advanced debug_mon 20/20 2026-02-13T03:58:39.173 INFO:teuthology.orchestra.run.trial092.stdout:mon advanced debug_ms 1/1 2026-02-13T03:58:39.173 INFO:teuthology.orchestra.run.trial092.stdout:mon advanced debug_paxos 20/20 2026-02-13T03:58:39.173 INFO:teuthology.orchestra.run.trial092.stdout:mon advanced mon_data_avail_warn 5 2026-02-13T03:58:39.173 INFO:teuthology.orchestra.run.trial092.stdout:mon advanced mon_down_mkfs_grace 300 2026-02-13T03:58:39.173 INFO:teuthology.orchestra.run.trial092.stdout:mon advanced mon_mgr_mkfs_grace 240 2026-02-13T03:58:39.173 INFO:teuthology.orchestra.run.trial092.stdout:mon advanced mon_op_complaint_time 120 2026-02-13T03:58:39.173 INFO:teuthology.orchestra.run.trial092.stdout:mon dev mon_osd_prime_pg_temp true 2026-02-13T03:58:39.173 INFO:teuthology.orchestra.run.trial092.stdout:mon advanced mon_osd_reporter_subtree_level osd 2026-02-13T03:58:39.173 INFO:teuthology.orchestra.run.trial092.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2026-02-13T03:58:39.174 INFO:teuthology.orchestra.run.trial092.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2026-02-13T03:58:39.174 INFO:teuthology.orchestra.run.trial092.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2026-02-13T03:58:39.174 INFO:teuthology.orchestra.run.trial092.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2026-02-13T03:58:39.174 INFO:teuthology.orchestra.run.trial092.stdout:mgr advanced cephsqlite_lock_renewal_timeout 900000 2026-02-13T03:58:39.174 INFO:teuthology.orchestra.run.trial092.stdout:mgr advanced client_mount_timeout 30 2026-02-13T03:58:39.174 INFO:teuthology.orchestra.run.trial092.stdout:mgr advanced debug_cephsqlite 20/20 2026-02-13T03:58:39.174 INFO:teuthology.orchestra.run.trial092.stdout:mgr advanced debug_client 20/20 2026-02-13T03:58:39.174 INFO:teuthology.orchestra.run.trial092.stdout:mgr advanced debug_mgr 20/20 2026-02-13T03:58:39.174 INFO:teuthology.orchestra.run.trial092.stdout:mgr advanced debug_ms 1/1 2026-02-13T03:58:39.174 INFO:teuthology.orchestra.run.trial092.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2026-02-13T03:58:39.174 INFO:teuthology.orchestra.run.trial092.stdout:mgr advanced mgr/cephadm/container_init True * 2026-02-13T03:58:39.174 INFO:teuthology.orchestra.run.trial092.stdout:mgr advanced mgr/cephadm/migration_current 8 * 2026-02-13T03:58:39.175 INFO:teuthology.orchestra.run.trial092.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2026-02-13T03:58:39.175 INFO:teuthology.orchestra.run.trial092.stdout:mgr advanced mgr/snap_schedule/allow_m_granularity true 2026-02-13T03:58:39.175 INFO:teuthology.orchestra.run.trial092.stdout:mgr advanced mgr/snap_schedule/dump_on_update true 2026-02-13T03:58:39.175 INFO:teuthology.orchestra.run.trial092.stdout:mgr advanced mgr/snap_schedule/log_level debug 2026-02-13T03:58:39.175 INFO:teuthology.orchestra.run.trial092.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2026-02-13T03:58:39.175 INFO:teuthology.orchestra.run.trial092.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2026-02-13T03:58:39.175 INFO:teuthology.orchestra.run.trial092.stdout:mgr dev mon_warn_on_pool_no_app false 2026-02-13T03:58:39.175 INFO:teuthology.orchestra.run.trial092.stdout:osd dev bdev_debug_aio true 2026-02-13T03:58:39.175 INFO:teuthology.orchestra.run.trial092.stdout:osd dev bluestore_block_size 96636764160 * 2026-02-13T03:58:39.175 INFO:teuthology.orchestra.run.trial092.stdout:osd advanced bluestore_compression_mode aggressive 2026-02-13T03:58:39.175 INFO:teuthology.orchestra.run.trial092.stdout:osd dev bluestore_fsck_on_mount true 2026-02-13T03:58:39.175 INFO:teuthology.orchestra.run.trial092.stdout:osd advanced debug_bluefs 20/20 2026-02-13T03:58:39.175 INFO:teuthology.orchestra.run.trial092.stdout:osd advanced debug_bluestore 20/20 2026-02-13T03:58:39.176 INFO:teuthology.orchestra.run.trial092.stdout:osd advanced debug_ms 1/1 2026-02-13T03:58:39.176 INFO:teuthology.orchestra.run.trial092.stdout:osd advanced debug_osd 20/20 2026-02-13T03:58:39.176 INFO:teuthology.orchestra.run.trial092.stdout:osd advanced debug_rocksdb 10/10 2026-02-13T03:58:39.176 INFO:teuthology.orchestra.run.trial092.stdout:osd dev osd_debug_misdirected_ops true 2026-02-13T03:58:39.176 INFO:teuthology.orchestra.run.trial092.stdout:osd dev osd_debug_op_order true 2026-02-13T03:58:39.176 INFO:teuthology.orchestra.run.trial092.stdout:osd dev osd_debug_pg_log_writeout true 2026-02-13T03:58:39.176 INFO:teuthology.orchestra.run.trial092.stdout:osd dev osd_debug_shutdown true 2026-02-13T03:58:39.176 INFO:teuthology.orchestra.run.trial092.stdout:osd dev osd_debug_verify_cached_snaps true 2026-02-13T03:58:39.176 INFO:teuthology.orchestra.run.trial092.stdout:osd dev osd_debug_verify_missing_on_start true 2026-02-13T03:58:39.176 INFO:teuthology.orchestra.run.trial092.stdout:osd dev osd_debug_verify_stray_on_activate true 2026-02-13T03:58:39.176 INFO:teuthology.orchestra.run.trial092.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2026-02-13T03:58:39.176 INFO:teuthology.orchestra.run.trial092.stdout:osd advanced osd_failsafe_full_ratio 0.950000 2026-02-13T03:58:39.176 INFO:teuthology.orchestra.run.trial092.stdout:osd advanced osd_max_omap_entries_per_request 10 2026-02-13T03:58:39.177 INFO:teuthology.orchestra.run.trial092.stdout:osd advanced osd_mclock_profile high_recovery_ops 2026-02-13T03:58:39.177 INFO:teuthology.orchestra.run.trial092.stdout:osd dev osd_mclock_skip_benchmark true 2026-02-13T03:58:39.177 INFO:teuthology.orchestra.run.trial092.stdout:osd advanced osd_memory_target_autotune true 2026-02-13T03:58:39.177 INFO:teuthology.orchestra.run.trial092.stdout:osd advanced osd_objectstore bluestore * 2026-02-13T03:58:39.177 INFO:teuthology.orchestra.run.trial092.stdout:osd advanced osd_op_complaint_time 180.000000 2026-02-13T03:58:39.177 INFO:teuthology.orchestra.run.trial092.stdout:osd advanced osd_op_queue debug_random * 2026-02-13T03:58:39.177 INFO:teuthology.orchestra.run.trial092.stdout:osd advanced osd_op_queue_cut_off debug_random * 2026-02-13T03:58:39.177 INFO:teuthology.orchestra.run.trial092.stdout:osd advanced osd_recover_clone_overlap true 2026-02-13T03:58:39.177 INFO:teuthology.orchestra.run.trial092.stdout:osd advanced osd_recovery_max_chunk 1048576 2026-02-13T03:58:39.177 INFO:teuthology.orchestra.run.trial092.stdout:osd advanced osd_scrub_load_threshold 5.000000 2026-02-13T03:58:39.177 INFO:teuthology.orchestra.run.trial092.stdout:osd advanced osd_scrub_max_interval 600.000000 2026-02-13T03:58:39.177 INFO:teuthology.orchestra.run.trial092.stdout:osd advanced osd_shutdown_pgref_assert true 2026-02-13T03:58:39.177 INFO:teuthology.orchestra.run.trial092.stdout:mds advanced debug_mds 20/20 2026-02-13T03:58:39.178 INFO:teuthology.orchestra.run.trial092.stdout:mds advanced debug_mds_balancer 20/20 2026-02-13T03:58:39.178 INFO:teuthology.orchestra.run.trial092.stdout:mds advanced debug_ms 2/2 2026-02-13T03:58:39.178 INFO:teuthology.orchestra.run.trial092.stdout:mds advanced mds_bal_fragment_size_max 10000 2026-02-13T03:58:39.178 INFO:teuthology.orchestra.run.trial092.stdout:mds advanced mds_bal_merge_size 5 2026-02-13T03:58:39.178 INFO:teuthology.orchestra.run.trial092.stdout:mds advanced mds_bal_replicate_threshold 1.000000 2026-02-13T03:58:39.178 INFO:teuthology.orchestra.run.trial092.stdout:mds advanced mds_bal_split_bits 3 2026-02-13T03:58:39.178 INFO:teuthology.orchestra.run.trial092.stdout:mds advanced mds_bal_split_size 100 2026-02-13T03:58:39.178 INFO:teuthology.orchestra.run.trial092.stdout:mds dev mds_debug_frag true 2026-02-13T03:58:39.178 INFO:teuthology.orchestra.run.trial092.stdout:mds dev mds_debug_scatterstat true 2026-02-13T03:58:39.178 INFO:teuthology.orchestra.run.trial092.stdout:mds advanced mds_op_complaint_time 180.000000 2026-02-13T03:58:39.178 INFO:teuthology.orchestra.run.trial092.stdout:mds dev mds_verify_scatter true 2026-02-13T03:58:39.178 INFO:teuthology.orchestra.run.trial092.stdout:mds advanced osd_op_complaint_time 180.000000 2026-02-13T03:58:39.179 INFO:teuthology.orchestra.run.trial092.stdout:mds advanced rados_mon_op_timeout 900 2026-02-13T03:58:39.179 INFO:teuthology.orchestra.run.trial092.stdout:mds advanced rados_osd_op_timeout 900 2026-02-13T03:58:39.179 INFO:teuthology.orchestra.run.trial092.stdout:client dev client_fscrypt_dummy_encryption true 2026-02-13T03:58:39.179 INFO:teuthology.orchestra.run.trial092.stdout:client advanced client_mount_timeout 600 2026-02-13T03:58:39.179 INFO:teuthology.orchestra.run.trial092.stdout:client advanced debug_client 20/20 2026-02-13T03:58:39.179 INFO:teuthology.orchestra.run.trial092.stdout:client advanced debug_ms 1/1 2026-02-13T03:58:39.179 INFO:teuthology.orchestra.run.trial092.stdout:client advanced fuse_default_permissions false * 2026-02-13T03:58:39.179 INFO:teuthology.orchestra.run.trial092.stdout:client advanced fuse_set_user_groups true 2026-02-13T03:58:39.179 INFO:teuthology.orchestra.run.trial092.stdout:client advanced rados_mon_op_timeout 900 2026-02-13T03:58:39.179 INFO:teuthology.orchestra.run.trial092.stdout:client advanced rados_osd_op_timeout 900 2026-02-13T03:58:39.179 INFO:teuthology.orchestra.run.trial092.stdout:client.rgw advanced rgw_cache_enabled true 2026-02-13T03:58:39.179 INFO:teuthology.orchestra.run.trial092.stdout:client.rgw advanced rgw_enable_ops_log true 2026-02-13T03:58:39.179 INFO:teuthology.orchestra.run.trial092.stdout:client.rgw advanced rgw_enable_usage_log true 2026-02-13T03:58:39.180 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.168+0000 7fc2727fc6c0 1 -- 10.20.193.92:0/2147252562 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fc26803f940 msgr2=0x7fc26805fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:39.181 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.168+0000 7fc2727fc6c0 1 --2- 10.20.193.92:0/2147252562 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fc26803f940 0x7fc26805fdf0 secure :-1 s=READY pgs=39 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc288009260 tx=0x7fc288009440 comp rx=0 tx=0).stop 2026-02-13T03:58:39.181 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.168+0000 7fc2727fc6c0 1 -- 10.20.193.92:0/2147252562 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fc294062990 msgr2=0x7fc294062e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:39.181 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.168+0000 7fc2727fc6c0 1 --2- 10.20.193.92:0/2147252562 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fc294062990 0x7fc294062e10 secure :-1 s=READY pgs=23 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc28400c6c0 tx=0x7fc28400cb90 comp rx=0 tx=0).stop 2026-02-13T03:58:39.181 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.169+0000 7fc2727fc6c0 1 -- 10.20.193.92:0/2147252562 shutdown_connections 2026-02-13T03:58:39.181 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.169+0000 7fc2727fc6c0 1 --2- 10.20.193.92:0/2147252562 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fc26803f940 0x7fc26805fdf0 unknown :-1 s=CLOSED pgs=39 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:39.181 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.169+0000 7fc2727fc6c0 1 --2- 10.20.193.92:0/2147252562 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fc294062990 0x7fc294062e10 unknown :-1 s=CLOSED pgs=23 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:39.181 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.169+0000 7fc2727fc6c0 1 --2- 10.20.193.92:0/2147252562 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc294115270 0x7fc294175b10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:39.181 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.169+0000 7fc2727fc6c0 1 --2- 10.20.193.92:0/2147252562 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fc29410f060 0x7fc294066730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:39.181 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.169+0000 7fc2727fc6c0 1 -- 10.20.193.92:0/2147252562 >> 10.20.193.92:0/2147252562 conn(0x7fc2940ec980 msgr2=0x7fc29410d680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:39.181 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.169+0000 7fc2727fc6c0 1 -- 10.20.193.92:0/2147252562 shutdown_connections 2026-02-13T03:58:39.181 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:39.169+0000 7fc2727fc6c0 1 -- 10.20.193.92:0/2147252562 wait complete. 2026-02-13T03:58:39.273 INFO:tasks.cephadm:Deploying OSDs... 2026-02-13T03:58:39.273 DEBUG:teuthology.orchestra.run.trial092:> set -ex 2026-02-13T03:58:39.274 DEBUG:teuthology.orchestra.run.trial092:> dd if=/scratch_devs of=/dev/stdout 2026-02-13T03:58:39.312 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-13T03:58:39.313 DEBUG:teuthology.orchestra.run.trial092:> stat /dev/vg_nvme/lv_1 2026-02-13T03:58:39.389 INFO:teuthology.orchestra.run.trial092.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-13T03:58:39.389 INFO:teuthology.orchestra.run.trial092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T03:58:39.389 INFO:teuthology.orchestra.run.trial092.stdout:Device: 6h/6d Inode: 1080 Links: 1 2026-02-13T03:58:39.390 INFO:teuthology.orchestra.run.trial092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T03:58:39.390 INFO:teuthology.orchestra.run.trial092.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T03:58:39.390 INFO:teuthology.orchestra.run.trial092.stdout:Access: 2026-02-13 03:58:10.419812091 +0000 2026-02-13T03:58:39.390 INFO:teuthology.orchestra.run.trial092.stdout:Modify: 2026-02-13 03:56:20.876211868 +0000 2026-02-13T03:58:39.390 INFO:teuthology.orchestra.run.trial092.stdout:Change: 2026-02-13 03:56:20.876211868 +0000 2026-02-13T03:58:39.390 INFO:teuthology.orchestra.run.trial092.stdout: Birth: 2026-02-13 03:56:20.876211868 +0000 2026-02-13T03:58:39.390 DEBUG:teuthology.orchestra.run.trial092:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-13T03:58:39.424 INFO:journalctl@ceph.mgr.z.trial158.stdout:Feb 13 03:58:39 trial158 systemd[1]: Starting Ceph mgr.z for 1fefccae-0890-11f1-bcc5-d404e6e7d460... 2026-02-13T03:58:39.482 INFO:teuthology.orchestra.run.trial092.stderr:1+0 records in 2026-02-13T03:58:39.483 INFO:teuthology.orchestra.run.trial092.stderr:1+0 records out 2026-02-13T03:58:39.483 INFO:teuthology.orchestra.run.trial092.stderr:512 bytes copied, 0.000221291 s, 2.3 MB/s 2026-02-13T03:58:39.485 DEBUG:teuthology.orchestra.run.trial092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-13T03:58:39.524 DEBUG:teuthology.orchestra.run.trial092:> stat /dev/vg_nvme/lv_2 2026-02-13T03:58:39.602 INFO:teuthology.orchestra.run.trial092.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-13T03:58:39.602 INFO:teuthology.orchestra.run.trial092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T03:58:39.602 INFO:teuthology.orchestra.run.trial092.stdout:Device: 6h/6d Inode: 1076 Links: 1 2026-02-13T03:58:39.602 INFO:teuthology.orchestra.run.trial092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T03:58:39.602 INFO:teuthology.orchestra.run.trial092.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T03:58:39.602 INFO:teuthology.orchestra.run.trial092.stdout:Access: 2026-02-13 03:58:10.419812091 +0000 2026-02-13T03:58:39.602 INFO:teuthology.orchestra.run.trial092.stdout:Modify: 2026-02-13 03:56:20.875684911 +0000 2026-02-13T03:58:39.603 INFO:teuthology.orchestra.run.trial092.stdout:Change: 2026-02-13 03:56:20.875684911 +0000 2026-02-13T03:58:39.603 INFO:teuthology.orchestra.run.trial092.stdout: Birth: 2026-02-13 03:56:20.875684911 +0000 2026-02-13T03:58:39.603 DEBUG:teuthology.orchestra.run.trial092:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-13T03:58:39.696 INFO:teuthology.orchestra.run.trial092.stderr:1+0 records in 2026-02-13T03:58:39.696 INFO:teuthology.orchestra.run.trial092.stderr:1+0 records out 2026-02-13T03:58:39.696 INFO:teuthology.orchestra.run.trial092.stderr:512 bytes copied, 0.00022078 s, 2.3 MB/s 2026-02-13T03:58:39.698 DEBUG:teuthology.orchestra.run.trial092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-13T03:58:39.739 DEBUG:teuthology.orchestra.run.trial092:> stat /dev/vg_nvme/lv_3 2026-02-13T03:58:39.795 INFO:journalctl@ceph.mgr.z.trial158.stdout:Feb 13 03:58:39 trial158 podman[29925]: 2026-02-13 03:58:39.50881623 +0000 UTC m=+0.017031190 container create 9a8e473b93200a74745309920d9d46e90c1ba454fdfd3c899dcb929a6c6dabe9 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-z, io.buildah.version=1.33.7, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, version=10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, OSD_FLAVOR=default, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation) 2026-02-13T03:58:39.795 INFO:journalctl@ceph.mgr.z.trial158.stdout:Feb 13 03:58:39 trial158 podman[29925]: 2026-02-13 03:58:39.537487655 +0000 UTC m=+0.045702625 container init 9a8e473b93200a74745309920d9d46e90c1ba454fdfd3c899dcb929a6c6dabe9 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-z, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, name=rockylinux, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, OSD_FLAVOR=default, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.version=10, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-13T03:58:39.796 INFO:journalctl@ceph.mgr.z.trial158.stdout:Feb 13 03:58:39 trial158 podman[29925]: 2026-02-13 03:58:39.539838353 +0000 UTC m=+0.048053313 container start 9a8e473b93200a74745309920d9d46e90c1ba454fdfd3c899dcb929a6c6dabe9 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-z, summary=Rocky Linux Base image, OSD_FLAVOR=default, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.title=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-pdonnell-testing-20260210.171210, io.buildah.version=1.33.7, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, name=rockylinux, license=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/, version=10) 2026-02-13T03:58:39.796 INFO:journalctl@ceph.mgr.z.trial158.stdout:Feb 13 03:58:39 trial158 bash[29925]: 9a8e473b93200a74745309920d9d46e90c1ba454fdfd3c899dcb929a6c6dabe9 2026-02-13T03:58:39.796 INFO:journalctl@ceph.mgr.z.trial158.stdout:Feb 13 03:58:39 trial158 podman[29925]: 2026-02-13 03:58:39.501870167 +0000 UTC m=+0.010085117 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T03:58:39.796 INFO:journalctl@ceph.mgr.z.trial158.stdout:Feb 13 03:58:39 trial158 systemd[1]: Started Ceph mgr.z for 1fefccae-0890-11f1-bcc5-d404e6e7d460. 2026-02-13T03:58:39.796 INFO:journalctl@ceph.mgr.z.trial158.stdout:Feb 13 03:58:39 trial158 ceph-mgr[29951]: -- 10.20.193.158:0/1287199815 <== mon.1 v2:10.20.193.158:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557b388bfa00 con 0x557b38993400 2026-02-13T03:58:39.796 INFO:journalctl@ceph.mgr.z.trial158.stdout:Feb 13 03:58:39 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-z[29947]: 2026-02-13T03:58:39.563+0000 7fb0accbafc0 -1 mgr[py] Loading module stats in main interpreter 2026-02-13T03:58:39.796 INFO:journalctl@ceph.mgr.z.trial158.stdout:Feb 13 03:58:39 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-z[29947]: 2026-02-13T03:58:39.603+0000 7fb0accbafc0 -1 mgr[py] Loading module dashboard in main interpreter 2026-02-13T03:58:39.817 INFO:teuthology.orchestra.run.trial092.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-13T03:58:39.817 INFO:teuthology.orchestra.run.trial092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T03:58:39.817 INFO:teuthology.orchestra.run.trial092.stdout:Device: 6h/6d Inode: 1081 Links: 1 2026-02-13T03:58:39.817 INFO:teuthology.orchestra.run.trial092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T03:58:39.817 INFO:teuthology.orchestra.run.trial092.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T03:58:39.817 INFO:teuthology.orchestra.run.trial092.stdout:Access: 2026-02-13 03:58:10.419812091 +0000 2026-02-13T03:58:39.817 INFO:teuthology.orchestra.run.trial092.stdout:Modify: 2026-02-13 03:56:20.876211868 +0000 2026-02-13T03:58:39.817 INFO:teuthology.orchestra.run.trial092.stdout:Change: 2026-02-13 03:56:20.876211868 +0000 2026-02-13T03:58:39.817 INFO:teuthology.orchestra.run.trial092.stdout: Birth: 2026-02-13 03:56:20.876211868 +0000 2026-02-13T03:58:39.818 DEBUG:teuthology.orchestra.run.trial092:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-13T03:58:39.909 INFO:teuthology.orchestra.run.trial092.stderr:1+0 records in 2026-02-13T03:58:39.909 INFO:teuthology.orchestra.run.trial092.stderr:1+0 records out 2026-02-13T03:58:39.909 INFO:teuthology.orchestra.run.trial092.stderr:512 bytes copied, 0.000313903 s, 1.6 MB/s 2026-02-13T03:58:39.912 DEBUG:teuthology.orchestra.run.trial092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-13T03:58:39.951 DEBUG:teuthology.orchestra.run.trial092:> stat /dev/vg_nvme/lv_4 2026-02-13T03:58:40.028 INFO:teuthology.orchestra.run.trial092.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-13T03:58:40.029 INFO:teuthology.orchestra.run.trial092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T03:58:40.029 INFO:teuthology.orchestra.run.trial092.stdout:Device: 6h/6d Inode: 1095 Links: 1 2026-02-13T03:58:40.029 INFO:teuthology.orchestra.run.trial092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T03:58:40.029 INFO:teuthology.orchestra.run.trial092.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T03:58:40.029 INFO:teuthology.orchestra.run.trial092.stdout:Access: 2026-02-13 03:58:10.419812091 +0000 2026-02-13T03:58:40.029 INFO:teuthology.orchestra.run.trial092.stdout:Modify: 2026-02-13 03:56:20.878211833 +0000 2026-02-13T03:58:40.029 INFO:teuthology.orchestra.run.trial092.stdout:Change: 2026-02-13 03:56:20.878211833 +0000 2026-02-13T03:58:40.029 INFO:teuthology.orchestra.run.trial092.stdout: Birth: 2026-02-13 03:56:20.878211833 +0000 2026-02-13T03:58:40.030 DEBUG:teuthology.orchestra.run.trial092:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-13T03:58:40.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:39 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:40.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:39 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:40.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:39 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:40.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:39 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T03:58:40.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:39 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T03:58:40.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:39 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T03:58:40.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:39 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:40.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:39 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/2147252562' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-13T03:58:40.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:39 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:40.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:39 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:40.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:39 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:40.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:39 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T03:58:40.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:39 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T03:58:40.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:39 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T03:58:40.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:39 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:40.081 INFO:journalctl@ceph.mgr.z.trial158.stdout:Feb 13 03:58:39 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-z[29947]: 2026-02-13T03:58:39.856+0000 7fb0accbafc0 -1 mgr[py] Loading module mirroring in main interpreter 2026-02-13T03:58:40.081 INFO:journalctl@ceph.mgr.z.trial158.stdout:Feb 13 03:58:39 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-z[29947]: 2026-02-13T03:58:39.866+0000 7fb0accbafc0 -1 mgr[py] Loading module snap_schedule in main interpreter 2026-02-13T03:58:40.081 INFO:journalctl@ceph.mgr.z.trial158.stdout:Feb 13 03:58:39 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-z[29947]: 2026-02-13T03:58:39.872+0000 7fb0accbafc0 -1 mgr[py] Loading module prometheus in main interpreter 2026-02-13T03:58:40.081 INFO:journalctl@ceph.mgr.z.trial158.stdout:Feb 13 03:58:39 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-z[29947]: 2026-02-13T03:58:39.878+0000 7fb0accbafc0 -1 mgr[py] Loading module balancer in main interpreter 2026-02-13T03:58:40.081 INFO:journalctl@ceph.mgr.z.trial158.stdout:Feb 13 03:58:39 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-z[29947]: 2026-02-13T03:58:39.884+0000 7fb0accbafc0 -1 mgr[py] Loading module rbd_support in main interpreter 2026-02-13T03:58:40.081 INFO:journalctl@ceph.mgr.z.trial158.stdout:Feb 13 03:58:39 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-z[29947]: 2026-02-13T03:58:39.896+0000 7fb0accbafc0 -1 mgr[py] Loading module smb in main interpreter 2026-02-13T03:58:40.081 INFO:journalctl@ceph.mgr.z.trial158.stdout:Feb 13 03:58:39 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-z[29947]: 2026-02-13T03:58:39.921+0000 7fb0accbafc0 -1 mgr[py] Loading module devicehealth in main interpreter 2026-02-13T03:58:40.081 INFO:journalctl@ceph.mgr.z.trial158.stdout:Feb 13 03:58:39 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-z[29947]: 2026-02-13T03:58:39.924+0000 7fb0accbafc0 -1 mgr[py] Loading module alerts in main interpreter 2026-02-13T03:58:40.081 INFO:journalctl@ceph.mgr.z.trial158.stdout:Feb 13 03:58:39 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-z[29947]: 2026-02-13T03:58:39.925+0000 7fb0accbafc0 -1 mgr[py] Loading module telemetry in main interpreter 2026-02-13T03:58:40.082 INFO:journalctl@ceph.mgr.z.trial158.stdout:Feb 13 03:58:39 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-z[29947]: 2026-02-13T03:58:39.932+0000 7fb0accbafc0 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-13T03:58:40.082 INFO:journalctl@ceph.mgr.z.trial158.stdout:Feb 13 03:58:39 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-z[29947]: 2026-02-13T03:58:39.969+0000 7fb0accbafc0 -1 mgr[py] Loading module status in main interpreter 2026-02-13T03:58:40.082 INFO:journalctl@ceph.mgr.z.trial158.stdout:Feb 13 03:58:39 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-z[29947]: 2026-02-13T03:58:39.971+0000 7fb0accbafc0 -1 mgr[py] Loading module rgw in main interpreter 2026-02-13T03:58:40.082 INFO:journalctl@ceph.mgr.z.trial158.stdout:Feb 13 03:58:39 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-z[29947]: 2026-02-13T03:58:39.975+0000 7fb0accbafc0 -1 mgr[py] Loading module insights in main interpreter 2026-02-13T03:58:40.082 INFO:journalctl@ceph.mgr.z.trial158.stdout:Feb 13 03:58:39 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-z[29947]: 2026-02-13T03:58:39.977+0000 7fb0accbafc0 -1 mgr[py] Loading module iostat in main interpreter 2026-02-13T03:58:40.082 INFO:journalctl@ceph.mgr.z.trial158.stdout:Feb 13 03:58:39 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-z[29947]: 2026-02-13T03:58:39.977+0000 7fb0accbafc0 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-13T03:58:40.082 INFO:journalctl@ceph.mgr.z.trial158.stdout:Feb 13 03:58:39 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-z[29947]: 2026-02-13T03:58:39.980+0000 7fb0accbafc0 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-13T03:58:40.082 INFO:journalctl@ceph.mgr.z.trial158.stdout:Feb 13 03:58:39 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-z[29947]: 2026-02-13T03:58:39.981+0000 7fb0accbafc0 -1 mgr[py] Loading module crash in main interpreter 2026-02-13T03:58:40.082 INFO:journalctl@ceph.mgr.z.trial158.stdout:Feb 13 03:58:39 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-z[29947]: 2026-02-13T03:58:39.984+0000 7fb0accbafc0 -1 mgr[py] Loading module progress in main interpreter 2026-02-13T03:58:40.082 INFO:journalctl@ceph.mgr.z.trial158.stdout:Feb 13 03:58:39 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-z[29947]: 2026-02-13T03:58:39.986+0000 7fb0accbafc0 -1 mgr[py] Loading module rook in main interpreter 2026-02-13T03:58:40.096 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:39 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:40.096 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:39 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:40.096 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:39 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:40.096 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:39 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T03:58:40.096 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:39 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T03:58:40.097 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:39 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T03:58:40.097 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:39 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:40.097 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:39 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/2147252562' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-13T03:58:40.097 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:39 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:40.097 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:39 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:40.097 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:39 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:40.097 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:39 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T03:58:40.097 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:39 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T03:58:40.097 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:39 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T03:58:40.097 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:39 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:40.117 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:39 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:40.117 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:39 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:40.117 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:39 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:40.117 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:39 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T03:58:40.117 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:39 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T03:58:40.117 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:39 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T03:58:40.117 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:39 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:40.117 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:39 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/2147252562' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2026-02-13T03:58:40.117 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:39 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:40.118 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:39 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:40.118 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:39 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:40.118 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:39 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T03:58:40.118 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:39 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2026-02-13T03:58:40.118 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:39 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T03:58:40.118 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:39 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:40.121 INFO:teuthology.orchestra.run.trial092.stderr:1+0 records in 2026-02-13T03:58:40.122 INFO:teuthology.orchestra.run.trial092.stderr:1+0 records out 2026-02-13T03:58:40.122 INFO:teuthology.orchestra.run.trial092.stderr:512 bytes copied, 0.000212004 s, 2.4 MB/s 2026-02-13T03:58:40.124 DEBUG:teuthology.orchestra.run.trial092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-13T03:58:40.164 DEBUG:teuthology.orchestra.run.trial099:> set -ex 2026-02-13T03:58:40.164 DEBUG:teuthology.orchestra.run.trial099:> dd if=/scratch_devs of=/dev/stdout 2026-02-13T03:58:40.182 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-13T03:58:40.182 DEBUG:teuthology.orchestra.run.trial099:> stat /dev/vg_nvme/lv_1 2026-02-13T03:58:40.238 INFO:teuthology.orchestra.run.trial099.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-13T03:58:40.238 INFO:teuthology.orchestra.run.trial099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T03:58:40.238 INFO:teuthology.orchestra.run.trial099.stdout:Device: 6h/6d Inode: 1302 Links: 1 2026-02-13T03:58:40.238 INFO:teuthology.orchestra.run.trial099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T03:58:40.238 INFO:teuthology.orchestra.run.trial099.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T03:58:40.238 INFO:teuthology.orchestra.run.trial099.stdout:Access: 2026-02-13 03:58:40.188174913 +0000 2026-02-13T03:58:40.238 INFO:teuthology.orchestra.run.trial099.stdout:Modify: 2026-02-13 03:56:19.884045460 +0000 2026-02-13T03:58:40.238 INFO:teuthology.orchestra.run.trial099.stdout:Change: 2026-02-13 03:56:19.884045460 +0000 2026-02-13T03:58:40.238 INFO:teuthology.orchestra.run.trial099.stdout: Birth: 2026-02-13 03:56:19.884045460 +0000 2026-02-13T03:58:40.238 DEBUG:teuthology.orchestra.run.trial099:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-13T03:58:40.306 INFO:teuthology.orchestra.run.trial099.stderr:1+0 records in 2026-02-13T03:58:40.306 INFO:teuthology.orchestra.run.trial099.stderr:1+0 records out 2026-02-13T03:58:40.306 INFO:teuthology.orchestra.run.trial099.stderr:512 bytes copied, 0.000173581 s, 2.9 MB/s 2026-02-13T03:58:40.307 DEBUG:teuthology.orchestra.run.trial099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-13T03:58:40.346 INFO:journalctl@ceph.mgr.y.trial099.stdout:Feb 13 03:58:40 trial099 podman[29918]: 2026-02-13 03:58:40.344920301 +0000 UTC m=+0.044127534 container init 4b331aa3956eca798e144e2991219921e756f112986752e8fe16788c6b5d754e (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-y, org.opencontainers.image.authors=Ceph Release Team , name=rockylinux, OSD_FLAVOR=default, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, summary=Rocky Linux Base image, license=BSD-3-Clause, org.opencontainers.image.version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, vendor=Rocky Enterprise Software Foundation, ceph=True, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation) 2026-02-13T03:58:40.363 DEBUG:teuthology.orchestra.run.trial099:> stat /dev/vg_nvme/lv_2 2026-02-13T03:58:40.418 INFO:teuthology.orchestra.run.trial099.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-13T03:58:40.418 INFO:teuthology.orchestra.run.trial099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T03:58:40.418 INFO:teuthology.orchestra.run.trial099.stdout:Device: 6h/6d Inode: 1293 Links: 1 2026-02-13T03:58:40.418 INFO:teuthology.orchestra.run.trial099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T03:58:40.418 INFO:teuthology.orchestra.run.trial099.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T03:58:40.418 INFO:teuthology.orchestra.run.trial099.stdout:Access: 2026-02-13 03:58:40.188174913 +0000 2026-02-13T03:58:40.419 INFO:teuthology.orchestra.run.trial099.stdout:Modify: 2026-02-13 03:56:19.884045460 +0000 2026-02-13T03:58:40.419 INFO:teuthology.orchestra.run.trial099.stdout:Change: 2026-02-13 03:56:19.884045460 +0000 2026-02-13T03:58:40.419 INFO:teuthology.orchestra.run.trial099.stdout: Birth: 2026-02-13 03:56:19.884045460 +0000 2026-02-13T03:58:40.419 DEBUG:teuthology.orchestra.run.trial099:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-13T03:58:40.483 INFO:teuthology.orchestra.run.trial099.stderr:1+0 records in 2026-02-13T03:58:40.483 INFO:teuthology.orchestra.run.trial099.stderr:1+0 records out 2026-02-13T03:58:40.483 INFO:teuthology.orchestra.run.trial099.stderr:512 bytes copied, 0.000145319 s, 3.5 MB/s 2026-02-13T03:58:40.485 DEBUG:teuthology.orchestra.run.trial099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-13T03:58:40.541 DEBUG:teuthology.orchestra.run.trial099:> stat /dev/vg_nvme/lv_3 2026-02-13T03:58:40.579 INFO:journalctl@ceph.mgr.z.trial158.stdout:Feb 13 03:58:40 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-z[29947]: 2026-02-13T03:58:40.154+0000 7fb0accbafc0 -1 mgr[py] Loading module nfs in main interpreter 2026-02-13T03:58:40.579 INFO:journalctl@ceph.mgr.z.trial158.stdout:Feb 13 03:58:40 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-z[29947]: 2026-02-13T03:58:40.154+0000 7fb0accbafc0 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-13T03:58:40.579 INFO:journalctl@ceph.mgr.z.trial158.stdout:Feb 13 03:58:40 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-z[29947]: 2026-02-13T03:58:40.156+0000 7fb0accbafc0 -1 mgr[py] Loading module selftest in main interpreter 2026-02-13T03:58:40.579 INFO:journalctl@ceph.mgr.z.trial158.stdout:Feb 13 03:58:40 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-z[29947]: 2026-02-13T03:58:40.158+0000 7fb0accbafc0 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-13T03:58:40.579 INFO:journalctl@ceph.mgr.z.trial158.stdout:Feb 13 03:58:40 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-z[29947]: 2026-02-13T03:58:40.160+0000 7fb0accbafc0 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-13T03:58:40.579 INFO:journalctl@ceph.mgr.z.trial158.stdout:Feb 13 03:58:40 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-z[29947]: 2026-02-13T03:58:40.160+0000 7fb0accbafc0 -1 mgr[py] Loading module orchestrator in main interpreter 2026-02-13T03:58:40.579 INFO:journalctl@ceph.mgr.z.trial158.stdout:Feb 13 03:58:40 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-z[29947]: 2026-02-13T03:58:40.160+0000 7fb0accbafc0 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-13T03:58:40.579 INFO:journalctl@ceph.mgr.z.trial158.stdout:Feb 13 03:58:40 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-z[29947]: 2026-02-13T03:58:40.302+0000 7fb0accbafc0 -1 mgr[py] Loading module volumes in main interpreter 2026-02-13T03:58:40.579 INFO:journalctl@ceph.mgr.z.trial158.stdout:Feb 13 03:58:40 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-z[29947]: 2026-02-13T03:58:40.330+0000 7fb0accbafc0 -1 mgr[py] Loading module k8sevents in main interpreter 2026-02-13T03:58:40.579 INFO:journalctl@ceph.mgr.z.trial158.stdout:Feb 13 03:58:40 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-z[29947]: 2026-02-13T03:58:40.334+0000 7fb0accbafc0 -1 mgr[py] Loading module mds_autoscaler in main interpreter 2026-02-13T03:58:40.579 INFO:journalctl@ceph.mgr.z.trial158.stdout:Feb 13 03:58:40 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-z[29947]: 2026-02-13T03:58:40.335+0000 7fb0accbafc0 -1 mgr[py] Loading module localpool in main interpreter 2026-02-13T03:58:40.579 INFO:journalctl@ceph.mgr.z.trial158.stdout:Feb 13 03:58:40 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-z[29947]: 2026-02-13T03:58:40.335+0000 7fb0accbafc0 -1 mgr[py] Loading module influx in main interpreter 2026-02-13T03:58:40.596 INFO:teuthology.orchestra.run.trial099.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-13T03:58:40.596 INFO:teuthology.orchestra.run.trial099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T03:58:40.596 INFO:teuthology.orchestra.run.trial099.stdout:Device: 6h/6d Inode: 1311 Links: 1 2026-02-13T03:58:40.596 INFO:teuthology.orchestra.run.trial099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T03:58:40.596 INFO:teuthology.orchestra.run.trial099.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T03:58:40.596 INFO:teuthology.orchestra.run.trial099.stdout:Access: 2026-02-13 03:58:40.188174913 +0000 2026-02-13T03:58:40.596 INFO:teuthology.orchestra.run.trial099.stdout:Modify: 2026-02-13 03:56:19.885045440 +0000 2026-02-13T03:58:40.596 INFO:teuthology.orchestra.run.trial099.stdout:Change: 2026-02-13 03:56:19.885045440 +0000 2026-02-13T03:58:40.596 INFO:teuthology.orchestra.run.trial099.stdout: Birth: 2026-02-13 03:56:19.885045440 +0000 2026-02-13T03:58:40.596 DEBUG:teuthology.orchestra.run.trial099:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-13T03:58:40.615 INFO:journalctl@ceph.mgr.y.trial099.stdout:Feb 13 03:58:40 trial099 podman[29918]: 2026-02-13 03:58:40.347244319 +0000 UTC m=+0.046451552 container start 4b331aa3956eca798e144e2991219921e756f112986752e8fe16788c6b5d754e (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-y, OSD_FLAVOR=default, license=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, summary=Rocky Linux Base image, org.opencontainers.image.title=rockylinux, name=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.version=10, ceph=True, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-13T03:58:40.615 INFO:journalctl@ceph.mgr.y.trial099.stdout:Feb 13 03:58:40 trial099 bash[29918]: 4b331aa3956eca798e144e2991219921e756f112986752e8fe16788c6b5d754e 2026-02-13T03:58:40.615 INFO:journalctl@ceph.mgr.y.trial099.stdout:Feb 13 03:58:40 trial099 podman[29918]: 2026-02-13 03:58:40.31132096 +0000 UTC m=+0.010528193 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T03:58:40.616 INFO:journalctl@ceph.mgr.y.trial099.stdout:Feb 13 03:58:40 trial099 systemd[1]: Started Ceph mgr.y for 1fefccae-0890-11f1-bcc5-d404e6e7d460. 2026-02-13T03:58:40.616 INFO:journalctl@ceph.mgr.y.trial099.stdout:Feb 13 03:58:40 trial099 ceph-mgr[29949]: -- 10.20.193.99:0/3609919606 <== mon.2 v2:10.20.193.99:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55de00df7a00 con 0x55de00ecb400 2026-02-13T03:58:40.616 INFO:journalctl@ceph.mgr.y.trial099.stdout:Feb 13 03:58:40 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-y[29944]: 2026-02-13T03:58:40.372+0000 7fce45042fc0 -1 mgr[py] Loading module stats in main interpreter 2026-02-13T03:58:40.616 INFO:journalctl@ceph.mgr.y.trial099.stdout:Feb 13 03:58:40 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-y[29944]: 2026-02-13T03:58:40.412+0000 7fce45042fc0 -1 mgr[py] Loading module dashboard in main interpreter 2026-02-13T03:58:40.637 INFO:teuthology.orchestra.run.trial099.stderr:1+0 records in 2026-02-13T03:58:40.637 INFO:teuthology.orchestra.run.trial099.stderr:1+0 records out 2026-02-13T03:58:40.638 INFO:teuthology.orchestra.run.trial099.stderr:512 bytes copied, 0.000254741 s, 2.0 MB/s 2026-02-13T03:58:40.639 DEBUG:teuthology.orchestra.run.trial099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-13T03:58:40.695 DEBUG:teuthology.orchestra.run.trial099:> stat /dev/vg_nvme/lv_4 2026-02-13T03:58:40.752 INFO:teuthology.orchestra.run.trial099.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-13T03:58:40.752 INFO:teuthology.orchestra.run.trial099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T03:58:40.753 INFO:teuthology.orchestra.run.trial099.stdout:Device: 6h/6d Inode: 1305 Links: 1 2026-02-13T03:58:40.753 INFO:teuthology.orchestra.run.trial099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T03:58:40.753 INFO:teuthology.orchestra.run.trial099.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T03:58:40.753 INFO:teuthology.orchestra.run.trial099.stdout:Access: 2026-02-13 03:58:40.188174913 +0000 2026-02-13T03:58:40.753 INFO:teuthology.orchestra.run.trial099.stdout:Modify: 2026-02-13 03:56:19.885045440 +0000 2026-02-13T03:58:40.753 INFO:teuthology.orchestra.run.trial099.stdout:Change: 2026-02-13 03:56:19.885045440 +0000 2026-02-13T03:58:40.753 INFO:teuthology.orchestra.run.trial099.stdout: Birth: 2026-02-13 03:56:19.885045440 +0000 2026-02-13T03:58:40.754 DEBUG:teuthology.orchestra.run.trial099:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-13T03:58:40.819 INFO:teuthology.orchestra.run.trial099.stderr:1+0 records in 2026-02-13T03:58:40.819 INFO:teuthology.orchestra.run.trial099.stderr:1+0 records out 2026-02-13T03:58:40.820 INFO:teuthology.orchestra.run.trial099.stderr:512 bytes copied, 0.000240214 s, 2.1 MB/s 2026-02-13T03:58:40.821 DEBUG:teuthology.orchestra.run.trial099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-13T03:58:40.878 DEBUG:teuthology.orchestra.run.trial158:> set -ex 2026-02-13T03:58:40.878 DEBUG:teuthology.orchestra.run.trial158:> dd if=/scratch_devs of=/dev/stdout 2026-02-13T03:58:40.890 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:40 trial099 ceph-mon[27808]: Standby manager daemon z started 2026-02-13T03:58:40.890 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:40 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:40.890 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:40 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:40.890 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:40 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:40.890 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:40 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:40.890 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:40 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:58:40.890 INFO:journalctl@ceph.mgr.y.trial099.stdout:Feb 13 03:58:40 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-y[29944]: 2026-02-13T03:58:40.672+0000 7fce45042fc0 -1 mgr[py] Loading module mirroring in main interpreter 2026-02-13T03:58:40.890 INFO:journalctl@ceph.mgr.y.trial099.stdout:Feb 13 03:58:40 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-y[29944]: 2026-02-13T03:58:40.682+0000 7fce45042fc0 -1 mgr[py] Loading module snap_schedule in main interpreter 2026-02-13T03:58:40.891 INFO:journalctl@ceph.mgr.y.trial099.stdout:Feb 13 03:58:40 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-y[29944]: 2026-02-13T03:58:40.688+0000 7fce45042fc0 -1 mgr[py] Loading module prometheus in main interpreter 2026-02-13T03:58:40.891 INFO:journalctl@ceph.mgr.y.trial099.stdout:Feb 13 03:58:40 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-y[29944]: 2026-02-13T03:58:40.695+0000 7fce45042fc0 -1 mgr[py] Loading module balancer in main interpreter 2026-02-13T03:58:40.891 INFO:journalctl@ceph.mgr.y.trial099.stdout:Feb 13 03:58:40 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-y[29944]: 2026-02-13T03:58:40.701+0000 7fce45042fc0 -1 mgr[py] Loading module rbd_support in main interpreter 2026-02-13T03:58:40.891 INFO:journalctl@ceph.mgr.y.trial099.stdout:Feb 13 03:58:40 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-y[29944]: 2026-02-13T03:58:40.713+0000 7fce45042fc0 -1 mgr[py] Loading module smb in main interpreter 2026-02-13T03:58:40.891 INFO:journalctl@ceph.mgr.y.trial099.stdout:Feb 13 03:58:40 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-y[29944]: 2026-02-13T03:58:40.738+0000 7fce45042fc0 -1 mgr[py] Loading module devicehealth in main interpreter 2026-02-13T03:58:40.891 INFO:journalctl@ceph.mgr.y.trial099.stdout:Feb 13 03:58:40 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-y[29944]: 2026-02-13T03:58:40.741+0000 7fce45042fc0 -1 mgr[py] Loading module alerts in main interpreter 2026-02-13T03:58:40.891 INFO:journalctl@ceph.mgr.y.trial099.stdout:Feb 13 03:58:40 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-y[29944]: 2026-02-13T03:58:40.743+0000 7fce45042fc0 -1 mgr[py] Loading module telemetry in main interpreter 2026-02-13T03:58:40.891 INFO:journalctl@ceph.mgr.y.trial099.stdout:Feb 13 03:58:40 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-y[29944]: 2026-02-13T03:58:40.750+0000 7fce45042fc0 -1 mgr[py] Loading module diskprediction_local in main interpreter 2026-02-13T03:58:40.891 INFO:journalctl@ceph.mgr.y.trial099.stdout:Feb 13 03:58:40 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-y[29944]: 2026-02-13T03:58:40.789+0000 7fce45042fc0 -1 mgr[py] Loading module status in main interpreter 2026-02-13T03:58:40.891 INFO:journalctl@ceph.mgr.y.trial099.stdout:Feb 13 03:58:40 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-y[29944]: 2026-02-13T03:58:40.791+0000 7fce45042fc0 -1 mgr[py] Loading module rgw in main interpreter 2026-02-13T03:58:40.891 INFO:journalctl@ceph.mgr.y.trial099.stdout:Feb 13 03:58:40 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-y[29944]: 2026-02-13T03:58:40.795+0000 7fce45042fc0 -1 mgr[py] Loading module insights in main interpreter 2026-02-13T03:58:40.891 INFO:journalctl@ceph.mgr.y.trial099.stdout:Feb 13 03:58:40 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-y[29944]: 2026-02-13T03:58:40.797+0000 7fce45042fc0 -1 mgr[py] Loading module iostat in main interpreter 2026-02-13T03:58:40.891 INFO:journalctl@ceph.mgr.y.trial099.stdout:Feb 13 03:58:40 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-y[29944]: 2026-02-13T03:58:40.797+0000 7fce45042fc0 -1 mgr[py] Loading module pg_autoscaler in main interpreter 2026-02-13T03:58:40.891 INFO:journalctl@ceph.mgr.y.trial099.stdout:Feb 13 03:58:40 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-y[29944]: 2026-02-13T03:58:40.801+0000 7fce45042fc0 -1 mgr[py] Loading module osd_perf_query in main interpreter 2026-02-13T03:58:40.891 INFO:journalctl@ceph.mgr.y.trial099.stdout:Feb 13 03:58:40 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-y[29944]: 2026-02-13T03:58:40.802+0000 7fce45042fc0 -1 mgr[py] Loading module crash in main interpreter 2026-02-13T03:58:40.891 INFO:journalctl@ceph.mgr.y.trial099.stdout:Feb 13 03:58:40 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-y[29944]: 2026-02-13T03:58:40.804+0000 7fce45042fc0 -1 mgr[py] Loading module progress in main interpreter 2026-02-13T03:58:40.891 INFO:journalctl@ceph.mgr.y.trial099.stdout:Feb 13 03:58:40 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-y[29944]: 2026-02-13T03:58:40.807+0000 7fce45042fc0 -1 mgr[py] Loading module rook in main interpreter 2026-02-13T03:58:40.895 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-13T03:58:40.895 DEBUG:teuthology.orchestra.run.trial158:> stat /dev/vg_nvme/lv_1 2026-02-13T03:58:40.953 INFO:teuthology.orchestra.run.trial158.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-13T03:58:40.953 INFO:teuthology.orchestra.run.trial158.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T03:58:40.953 INFO:teuthology.orchestra.run.trial158.stdout:Device: 6h/6d Inode: 1311 Links: 1 2026-02-13T03:58:40.953 INFO:teuthology.orchestra.run.trial158.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T03:58:40.953 INFO:teuthology.orchestra.run.trial158.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T03:58:40.953 INFO:teuthology.orchestra.run.trial158.stdout:Access: 2026-02-13 03:58:39.383378221 +0000 2026-02-13T03:58:40.953 INFO:teuthology.orchestra.run.trial158.stdout:Modify: 2026-02-13 03:56:20.196001215 +0000 2026-02-13T03:58:40.953 INFO:teuthology.orchestra.run.trial158.stdout:Change: 2026-02-13 03:56:20.196001215 +0000 2026-02-13T03:58:40.953 INFO:teuthology.orchestra.run.trial158.stdout: Birth: 2026-02-13 03:56:20.196001215 +0000 2026-02-13T03:58:40.954 DEBUG:teuthology.orchestra.run.trial158:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-13T03:58:41.019 INFO:teuthology.orchestra.run.trial158.stderr:1+0 records in 2026-02-13T03:58:41.020 INFO:teuthology.orchestra.run.trial158.stderr:1+0 records out 2026-02-13T03:58:41.020 INFO:teuthology.orchestra.run.trial158.stderr:512 bytes copied, 0.000185021 s, 2.8 MB/s 2026-02-13T03:58:41.021 DEBUG:teuthology.orchestra.run.trial158:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-13T03:58:41.078 DEBUG:teuthology.orchestra.run.trial158:> stat /dev/vg_nvme/lv_2 2026-02-13T03:58:41.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:40 trial158 ceph-mon[27763]: Standby manager daemon z started 2026-02-13T03:58:41.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:40 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:41.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:40 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:41.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:40 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:41.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:40 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:41.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:40 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:58:41.096 INFO:teuthology.orchestra.run.trial158.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-13T03:58:41.096 INFO:teuthology.orchestra.run.trial158.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T03:58:41.096 INFO:teuthology.orchestra.run.trial158.stdout:Device: 6h/6d Inode: 1291 Links: 1 2026-02-13T03:58:41.096 INFO:teuthology.orchestra.run.trial158.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T03:58:41.096 INFO:teuthology.orchestra.run.trial158.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T03:58:41.096 INFO:teuthology.orchestra.run.trial158.stdout:Access: 2026-02-13 03:58:39.384378238 +0000 2026-02-13T03:58:41.096 INFO:teuthology.orchestra.run.trial158.stdout:Modify: 2026-02-13 03:56:20.195001231 +0000 2026-02-13T03:58:41.097 INFO:teuthology.orchestra.run.trial158.stdout:Change: 2026-02-13 03:56:20.195001231 +0000 2026-02-13T03:58:41.097 INFO:teuthology.orchestra.run.trial158.stdout: Birth: 2026-02-13 03:56:20.195001231 +0000 2026-02-13T03:58:41.097 DEBUG:teuthology.orchestra.run.trial158:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-13T03:58:41.147 INFO:journalctl@ceph.mgr.y.trial099.stdout:Feb 13 03:58:40 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-y[29944]: 2026-02-13T03:58:40.993+0000 7fce45042fc0 -1 mgr[py] Loading module nfs in main interpreter 2026-02-13T03:58:41.147 INFO:journalctl@ceph.mgr.y.trial099.stdout:Feb 13 03:58:40 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-y[29944]: 2026-02-13T03:58:40.993+0000 7fce45042fc0 -1 mgr[py] Loading module telegraf in main interpreter 2026-02-13T03:58:41.147 INFO:journalctl@ceph.mgr.y.trial099.stdout:Feb 13 03:58:40 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-y[29944]: 2026-02-13T03:58:40.995+0000 7fce45042fc0 -1 mgr[py] Loading module selftest in main interpreter 2026-02-13T03:58:41.147 INFO:journalctl@ceph.mgr.y.trial099.stdout:Feb 13 03:58:40 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-y[29944]: 2026-02-13T03:58:40.998+0000 7fce45042fc0 -1 mgr[py] Loading module test_orchestrator in main interpreter 2026-02-13T03:58:41.147 INFO:journalctl@ceph.mgr.y.trial099.stdout:Feb 13 03:58:41 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-y[29944]: 2026-02-13T03:58:40.999+0000 7fce45042fc0 -1 mgr[py] Loading module osd_support in main interpreter 2026-02-13T03:58:41.147 INFO:journalctl@ceph.mgr.y.trial099.stdout:Feb 13 03:58:41 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-y[29944]: 2026-02-13T03:58:41.000+0000 7fce45042fc0 -1 mgr[py] Loading module orchestrator in main interpreter 2026-02-13T03:58:41.148 INFO:journalctl@ceph.mgr.y.trial099.stdout:Feb 13 03:58:41 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-y[29944]: 2026-02-13T03:58:41.000+0000 7fce45042fc0 -1 mgr[py] Loading module cephadm in main interpreter 2026-02-13T03:58:41.148 INFO:journalctl@ceph.mgr.y.trial099.stdout:Feb 13 03:58:41 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-y[29944]: 2026-02-13T03:58:41.144+0000 7fce45042fc0 -1 mgr[py] Loading module volumes in main interpreter 2026-02-13T03:58:41.160 INFO:teuthology.orchestra.run.trial158.stderr:1+0 records in 2026-02-13T03:58:41.160 INFO:teuthology.orchestra.run.trial158.stderr:1+0 records out 2026-02-13T03:58:41.160 INFO:teuthology.orchestra.run.trial158.stderr:512 bytes copied, 0.000150876 s, 3.4 MB/s 2026-02-13T03:58:41.162 DEBUG:teuthology.orchestra.run.trial158:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-13T03:58:41.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:40 trial092 ceph-mon[23047]: Standby manager daemon z started 2026-02-13T03:58:41.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:40 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:41.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:40 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:41.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:40 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:41.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:40 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:41.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:40 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:58:41.218 DEBUG:teuthology.orchestra.run.trial158:> stat /dev/vg_nvme/lv_3 2026-02-13T03:58:41.275 INFO:teuthology.orchestra.run.trial158.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-13T03:58:41.275 INFO:teuthology.orchestra.run.trial158.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T03:58:41.275 INFO:teuthology.orchestra.run.trial158.stdout:Device: 6h/6d Inode: 1304 Links: 1 2026-02-13T03:58:41.275 INFO:teuthology.orchestra.run.trial158.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T03:58:41.275 INFO:teuthology.orchestra.run.trial158.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T03:58:41.276 INFO:teuthology.orchestra.run.trial158.stdout:Access: 2026-02-13 03:58:39.384378238 +0000 2026-02-13T03:58:41.276 INFO:teuthology.orchestra.run.trial158.stdout:Modify: 2026-02-13 03:56:20.195001231 +0000 2026-02-13T03:58:41.276 INFO:teuthology.orchestra.run.trial158.stdout:Change: 2026-02-13 03:56:20.195001231 +0000 2026-02-13T03:58:41.276 INFO:teuthology.orchestra.run.trial158.stdout: Birth: 2026-02-13 03:56:20.195001231 +0000 2026-02-13T03:58:41.276 DEBUG:teuthology.orchestra.run.trial158:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-13T03:58:41.339 INFO:teuthology.orchestra.run.trial158.stderr:1+0 records in 2026-02-13T03:58:41.340 INFO:teuthology.orchestra.run.trial158.stderr:1+0 records out 2026-02-13T03:58:41.340 INFO:teuthology.orchestra.run.trial158.stderr:512 bytes copied, 0.000238272 s, 2.1 MB/s 2026-02-13T03:58:41.341 DEBUG:teuthology.orchestra.run.trial158:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-13T03:58:41.399 DEBUG:teuthology.orchestra.run.trial158:> stat /dev/vg_nvme/lv_4 2026-02-13T03:58:41.454 INFO:teuthology.orchestra.run.trial158.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-13T03:58:41.454 INFO:teuthology.orchestra.run.trial158.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-13T03:58:41.454 INFO:teuthology.orchestra.run.trial158.stdout:Device: 6h/6d Inode: 1289 Links: 1 2026-02-13T03:58:41.454 INFO:teuthology.orchestra.run.trial158.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-13T03:58:41.454 INFO:teuthology.orchestra.run.trial158.stdout:Context: system_u:object_r:device_t:s0 2026-02-13T03:58:41.454 INFO:teuthology.orchestra.run.trial158.stdout:Access: 2026-02-13 03:58:39.384378238 +0000 2026-02-13T03:58:41.454 INFO:teuthology.orchestra.run.trial158.stdout:Modify: 2026-02-13 03:56:20.195001231 +0000 2026-02-13T03:58:41.455 INFO:teuthology.orchestra.run.trial158.stdout:Change: 2026-02-13 03:56:20.195001231 +0000 2026-02-13T03:58:41.455 INFO:teuthology.orchestra.run.trial158.stdout: Birth: 2026-02-13 03:56:20.195001231 +0000 2026-02-13T03:58:41.455 DEBUG:teuthology.orchestra.run.trial158:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-13T03:58:41.517 INFO:teuthology.orchestra.run.trial158.stderr:1+0 records in 2026-02-13T03:58:41.517 INFO:teuthology.orchestra.run.trial158.stderr:1+0 records out 2026-02-13T03:58:41.517 INFO:teuthology.orchestra.run.trial158.stderr:512 bytes copied, 0.000147259 s, 3.5 MB/s 2026-02-13T03:58:41.518 DEBUG:teuthology.orchestra.run.trial158:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-13T03:58:41.576 INFO:tasks.cephadm:Deploying osd.0 on trial092 with /dev/vg_nvme/lv_4... 2026-02-13T03:58:41.576 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-13T03:58:41.616 INFO:journalctl@ceph.mgr.y.trial099.stdout:Feb 13 03:58:41 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-y[29944]: 2026-02-13T03:58:41.173+0000 7fce45042fc0 -1 mgr[py] Loading module k8sevents in main interpreter 2026-02-13T03:58:41.616 INFO:journalctl@ceph.mgr.y.trial099.stdout:Feb 13 03:58:41 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-y[29944]: 2026-02-13T03:58:41.177+0000 7fce45042fc0 -1 mgr[py] Loading module mds_autoscaler in main interpreter 2026-02-13T03:58:41.616 INFO:journalctl@ceph.mgr.y.trial099.stdout:Feb 13 03:58:41 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-y[29944]: 2026-02-13T03:58:41.178+0000 7fce45042fc0 -1 mgr[py] Loading module localpool in main interpreter 2026-02-13T03:58:41.616 INFO:journalctl@ceph.mgr.y.trial099.stdout:Feb 13 03:58:41 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-y[29944]: 2026-02-13T03:58:41.178+0000 7fce45042fc0 -1 mgr[py] Loading module influx in main interpreter 2026-02-13T03:58:41.762 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:58:42.057 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:41 trial099 ceph-mon[27808]: mgrmap e13: x(active, since 6s), standbys: z 2026-02-13T03:58:42.057 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:41 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2026-02-13T03:58:42.057 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:41 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:42.057 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:41 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:42.057 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:41 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:42.058 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:41 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:42.058 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:41 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:42.058 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:41 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:58:42.058 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:41 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:42.058 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:41 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T03:58:42.058 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:41 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T03:58:42.058 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:41 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:42.058 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:41 trial099 ceph-mon[27808]: Standby manager daemon y started 2026-02-13T03:58:42.058 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:41 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:42.058 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:41 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:42.058 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:41 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T03:58:42.059 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:41 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T03:58:42.059 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:41 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:42.078 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:41 trial092 ceph-mon[23047]: mgrmap e13: x(active, since 6s), standbys: z 2026-02-13T03:58:42.078 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:41 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2026-02-13T03:58:42.078 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:41 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:42.078 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:41 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:42.078 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:41 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:42.078 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:41 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:42.078 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:41 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:42.079 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:41 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:58:42.079 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:41 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:42.079 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:41 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T03:58:42.079 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:41 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T03:58:42.079 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:41 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:42.079 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:41 trial092 ceph-mon[23047]: Standby manager daemon y started 2026-02-13T03:58:42.079 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:41 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:42.079 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:41 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:42.079 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:41 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T03:58:42.079 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:41 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T03:58:42.079 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:41 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:42.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:41 trial158 ceph-mon[27763]: mgrmap e13: x(active, since 6s), standbys: z 2026-02-13T03:58:42.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:41 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2026-02-13T03:58:42.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:41 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:42.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:41 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:42.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:41 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:42.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:41 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:42.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:41 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:42.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:41 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:58:42.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:41 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:42.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:41 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2026-02-13T03:58:42.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:41 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2026-02-13T03:58:42.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:41 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:42.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:41 trial158 ceph-mon[27763]: Standby manager daemon y started 2026-02-13T03:58:42.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:41 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:42.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:41 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:42.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:41 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T03:58:42.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:41 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T03:58:42.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:41 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:42.648 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T03:58:42.672 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph orch daemon add osd trial092:vg_nvme/lv_4 --skip-validation 2026-02-13T03:58:42.857 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:58:43.047 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:43.044+0000 7f95aef076c0 1 -- 10.20.193.92:0/1893445354 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f95a8114190 msgr2=0x7f95a8119140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:43.048 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:43.044+0000 7f95aef076c0 1 --2- 10.20.193.92:0/1893445354 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f95a8114190 0x7f95a8119140 secure :-1 s=READY pgs=120 gs=1 cs=0 l=1 c_cookie=9981268659136766050 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9590009970 tx=0x7f959002ed50 comp rx=0 tx=0).stop 2026-02-13T03:58:43.048 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:43.044+0000 7f95aef076c0 1 -- 10.20.193.92:0/1893445354 shutdown_connections 2026-02-13T03:58:43.048 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:43.044+0000 7f95aef076c0 1 --2- 10.20.193.92:0/1893445354 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f95a81198f0 0x7f95a817a2c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:43.048 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:43.044+0000 7f95aef076c0 1 --2- 10.20.193.92:0/1893445354 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f95a8114190 0x7f95a8119140 unknown :-1 s=CLOSED pgs=120 gs=1 cs=0 l=1 c_cookie=9981268659136766050 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:43.048 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:43.044+0000 7f95aef076c0 1 --2- 10.20.193.92:0/1893445354 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f95a81137a0 0x7f95a8113b70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:43.048 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:43.044+0000 7f95aef076c0 1 -- 10.20.193.92:0/1893445354 >> 10.20.193.92:0/1893445354 conn(0x7f95a8060760 msgr2=0x7f95a8060d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:43.048 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:43.044+0000 7f95aef076c0 1 -- 10.20.193.92:0/1893445354 shutdown_connections 2026-02-13T03:58:43.048 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:43.044+0000 7f95aef076c0 1 -- 10.20.193.92:0/1893445354 wait complete. 2026-02-13T03:58:43.048 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:43.045+0000 7f95aef076c0 1 Processor -- start 2026-02-13T03:58:43.049 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:43.045+0000 7f95aef076c0 1 -- start start 2026-02-13T03:58:43.050 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:43.045+0000 7f95aef076c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f95a81137a0 0x7f95a81215c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:43.050 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:43.045+0000 7f95aef076c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f95a81198f0 0x7f95a8121b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:43.050 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:43.045+0000 7f95aef076c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f95a8126ec0 0x7f95a8127360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:43.050 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:43.045+0000 7f95aef076c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f95a81278d0 con 0x7f95a8126ec0 2026-02-13T03:58:43.050 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:43.045+0000 7f95aef076c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f95a8127a40 con 0x7f95a81137a0 2026-02-13T03:58:43.051 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:43.045+0000 7f95aef076c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f95a8127c00 con 0x7f95a81198f0 2026-02-13T03:58:43.051 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:43.045+0000 7f95acc786c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f95a81137a0 0x7f95a81215c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:43.051 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:43.045+0000 7f959ffff6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f95a81198f0 0x7f95a8121b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:43.051 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:43.045+0000 7f95ad4796c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f95a8126ec0 0x7f95a8127360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:43.051 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:43.045+0000 7f95acc786c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f95a81137a0 0x7f95a81215c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:59884/0 (socket says 10.20.193.92:59884) 2026-02-13T03:58:43.051 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:43.045+0000 7f95acc786c0 1 -- 10.20.193.92:0/2698631254 learned_addr learned my addr 10.20.193.92:0/2698631254 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T03:58:43.051 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:43.046+0000 7f95ad4796c0 1 -- 10.20.193.92:0/2698631254 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f95a81198f0 msgr2=0x7f95a8121b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:43.051 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:43.046+0000 7f95ad4796c0 1 --2- 10.20.193.92:0/2698631254 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f95a81198f0 0x7f95a8121b00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:43.051 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:43.046+0000 7f95ad4796c0 1 -- 10.20.193.92:0/2698631254 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f95a81137a0 msgr2=0x7f95a81215c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:43.051 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:43.046+0000 7f95ad4796c0 1 --2- 10.20.193.92:0/2698631254 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f95a81137a0 0x7f95a81215c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:43.051 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:43.046+0000 7f95ad4796c0 1 -- 10.20.193.92:0/2698631254 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9590009590 con 0x7f95a8126ec0 2026-02-13T03:58:43.052 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:43.046+0000 7f95ad4796c0 1 --2- 10.20.193.92:0/2698631254 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f95a8126ec0 0x7f95a8127360 secure :-1 s=READY pgs=121 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95a400c6c0 tx=0x7f95a400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:43.052 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:43.046+0000 7f959dffb6c0 1 -- 10.20.193.92:0/2698631254 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f95a4005340 con 0x7f95a8126ec0 2026-02-13T03:58:43.052 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:43.046+0000 7f959dffb6c0 1 -- 10.20.193.92:0/2698631254 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f95a4003d40 con 0x7f95a8126ec0 2026-02-13T03:58:43.052 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:43.046+0000 7f959dffb6c0 1 -- 10.20.193.92:0/2698631254 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f95a400de30 con 0x7f95a8126ec0 2026-02-13T03:58:43.052 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:43.046+0000 7f95aef076c0 1 -- 10.20.193.92:0/2698631254 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95a81680b0 con 0x7f95a8126ec0 2026-02-13T03:58:43.052 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:43.046+0000 7f95aef076c0 1 -- 10.20.193.92:0/2698631254 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95a8168540 con 0x7f95a8126ec0 2026-02-13T03:58:43.052 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:43.047+0000 7f95aef076c0 1 -- 10.20.193.92:0/2698631254 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95a81149e0 con 0x7f95a8126ec0 2026-02-13T03:58:43.053 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:43.049+0000 7f959dffb6c0 1 -- 10.20.193.92:0/2698631254 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 14) ==== 157027+0+0 (secure 0 0 0) 0x7f95a400d410 con 0x7f95a8126ec0 2026-02-13T03:58:43.053 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:43.050+0000 7f959dffb6c0 1 --2- 10.20.193.92:0/2698631254 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f95840b55c0 0x7f95840d5a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:43.053 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:43.051+0000 7f959dffb6c0 1 -- 10.20.193.92:0/2698631254 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1150+0+0 (secure 0 0 0) 0x7f95a40e2da0 con 0x7f95a8126ec0 2026-02-13T03:58:43.054 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:43.051+0000 7f95acc786c0 1 --2- 10.20.193.92:0/2698631254 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f95840b55c0 0x7f95840d5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:43.054 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:43.051+0000 7f959dffb6c0 1 -- 10.20.193.92:0/2698631254 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f95a40e31d0 con 0x7f95a8126ec0 2026-02-13T03:58:43.054 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:43.051+0000 7f95acc786c0 1 --2- 10.20.193.92:0/2698631254 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f95840b55c0 0x7f95840d5a70 secure :-1 s=READY pgs=44 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9598009260 tx=0x7f9598009440 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:43.159 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:43.157+0000 7f95aef076c0 1 -- 10.20.193.92:0/2698631254 --> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial092:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f95a8122710 con 0x7f95840b55c0 2026-02-13T03:58:43.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:42 trial158 ceph-mon[27763]: mgrmap e14: x(active, since 8s), standbys: z, y 2026-02-13T03:58:43.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:42 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2026-02-13T03:58:43.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:42 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:43.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:42 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:43.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:42 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T03:58:43.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:42 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T03:58:43.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:42 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:43.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:42 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:43.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:42 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:43.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:42 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:58:43.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:42 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:43.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:42 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:58:43.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:42 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:43.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:42 trial099 ceph-mon[27808]: mgrmap e14: x(active, since 8s), standbys: z, y 2026-02-13T03:58:43.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:42 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2026-02-13T03:58:43.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:42 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:43.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:42 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:43.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:42 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T03:58:43.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:42 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T03:58:43.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:42 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:43.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:42 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:43.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:42 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:43.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:42 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:58:43.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:42 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:43.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:42 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:58:43.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:42 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:43.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:42 trial092 ceph-mon[23047]: mgrmap e14: x(active, since 8s), standbys: z, y 2026-02-13T03:58:43.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:42 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2026-02-13T03:58:43.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:42 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:43.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:42 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:43.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:42 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2026-02-13T03:58:43.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:42 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2026-02-13T03:58:43.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:42 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:43.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:42 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:43.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:42 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:43.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:42 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:58:43.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:42 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:43.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:42 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:58:43.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:42 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:44.164 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:44 trial092 ceph-mon[23047]: from='client.14385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial092:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:58:44.165 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:44 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:44.165 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:44 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:44.165 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:44 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:58:44.165 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:44 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:58:44.165 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:44 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:58:44.165 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:44 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:44.165 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:44 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:44.165 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:44 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:44.165 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:44 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:44.166 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:44 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:58:44.166 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:44 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:44.166 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:44 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:58:44.166 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:44 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:58:44.166 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:44 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:44.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:44 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:44.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:44 trial158 ceph-mon[27763]: from='client.14385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial092:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:58:44.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:44 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:44.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:44 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:44.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:44 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:58:44.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:44 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:58:44.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:44 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:58:44.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:44 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:44.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:44 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:44.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:44 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:44.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:44 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:44.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:44 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:58:44.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:44 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:44.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:44 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:58:44.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:44 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:58:44.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:44 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:44.581 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:44 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:44.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:44 trial099 ceph-mon[27808]: from='client.14385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial092:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:58:44.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:44 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:44.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:44 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:44.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:44 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:58:44.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:44 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:58:44.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:44 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:58:44.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:44 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:44.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:44 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:44.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:44 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:44.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:44 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:44.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:44 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:58:44.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:44 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:44.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:44 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:58:44.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:44 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:58:44.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:44 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:44.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:44 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:45.165 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:45 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/2455334569' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8527c214-a46e-4505-b9a0-dc55e7cf6b55"} : dispatch 2026-02-13T03:58:45.165 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:45 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/2455334569' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8527c214-a46e-4505-b9a0-dc55e7cf6b55"}]': finished 2026-02-13T03:58:45.166 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:45 trial092 ceph-mon[23047]: osdmap e5: 1 total, 0 up, 1 in 2026-02-13T03:58:45.166 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:45 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:58:45.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:45 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/2455334569' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8527c214-a46e-4505-b9a0-dc55e7cf6b55"} : dispatch 2026-02-13T03:58:45.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:45 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/2455334569' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8527c214-a46e-4505-b9a0-dc55e7cf6b55"}]': finished 2026-02-13T03:58:45.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:45 trial158 ceph-mon[27763]: osdmap e5: 1 total, 0 up, 1 in 2026-02-13T03:58:45.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:45 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:58:45.615 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:45 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/2455334569' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8527c214-a46e-4505-b9a0-dc55e7cf6b55"} : dispatch 2026-02-13T03:58:45.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:45 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/2455334569' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8527c214-a46e-4505-b9a0-dc55e7cf6b55"}]': finished 2026-02-13T03:58:45.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:45 trial099 ceph-mon[27808]: osdmap e5: 1 total, 0 up, 1 in 2026-02-13T03:58:45.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:45 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:58:46.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:46 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/4226198605' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:58:46.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:46 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/4226198605' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:58:46.615 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:46 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/4226198605' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:58:48.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:48 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-13T03:58:48.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:48 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:48.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:48 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-13T03:58:48.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:48 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:48.865 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:48 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2026-02-13T03:58:48.865 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:48 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:52.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:51 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:58:52.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:51 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:52.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:51 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:52.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:51 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:58:52.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:51 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:52.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:51 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:52.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:51 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:58:52.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:51 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:52.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:51 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:53.050 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:53.047+0000 7f95ae7026c0 1 -- 10.20.193.92:0/2698631254 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=5}) -- 0x7f9580003570 con 0x7f95a8126ec0 2026-02-13T03:58:53.050 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:53.047+0000 7f959dffb6c0 1 -- 10.20.193.92:0/2698631254 <== mon.0 v2:10.20.193.92:3300/0 7 ==== osd_map(5..5 src has 1..5) ==== 324+0+0 (secure 0 0 0) 0x7f95a40ab070 con 0x7f95a8126ec0 2026-02-13T03:58:53.321 INFO:teuthology.orchestra.run.trial092.stdout:Created osd(s) 0 on host 'trial092' 2026-02-13T03:58:53.321 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:53.318+0000 7f959dffb6c0 1 -- 10.20.193.92:0/2698631254 <== mgr.14187 v2:10.20.193.92:6800/4191527999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f95a8122710 con 0x7f95840b55c0 2026-02-13T03:58:53.324 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:53.321+0000 7f95aef076c0 1 -- 10.20.193.92:0/2698631254 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f95840b55c0 msgr2=0x7f95840d5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:53.324 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:53.321+0000 7f95aef076c0 1 --2- 10.20.193.92:0/2698631254 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f95840b55c0 0x7f95840d5a70 secure :-1 s=READY pgs=44 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9598009260 tx=0x7f9598009440 comp rx=0 tx=0).stop 2026-02-13T03:58:53.324 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:53.321+0000 7f95aef076c0 1 -- 10.20.193.92:0/2698631254 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f95a8126ec0 msgr2=0x7f95a8127360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:53.324 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:53.321+0000 7f95aef076c0 1 --2- 10.20.193.92:0/2698631254 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f95a8126ec0 0x7f95a8127360 secure :-1 s=READY pgs=121 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95a400c6c0 tx=0x7f95a400cb90 comp rx=0 tx=0).stop 2026-02-13T03:58:53.324 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:53.321+0000 7f95aef076c0 1 -- 10.20.193.92:0/2698631254 shutdown_connections 2026-02-13T03:58:53.324 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:53.321+0000 7f95aef076c0 1 --2- 10.20.193.92:0/2698631254 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f95a8126ec0 0x7f95a8127360 unknown :-1 s=CLOSED pgs=121 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:53.324 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:53.321+0000 7f95aef076c0 1 --2- 10.20.193.92:0/2698631254 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f95a81198f0 0x7f95a8121b00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:53.325 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:53.321+0000 7f95aef076c0 1 --2- 10.20.193.92:0/2698631254 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f95840b55c0 0x7f95840d5a70 unknown :-1 s=CLOSED pgs=44 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:53.325 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:53.321+0000 7f95aef076c0 1 --2- 10.20.193.92:0/2698631254 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f95a81137a0 0x7f95a81215c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:53.325 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:53.321+0000 7f95aef076c0 1 -- 10.20.193.92:0/2698631254 >> 10.20.193.92:0/2698631254 conn(0x7f95a8060760 msgr2=0x7f95a81177a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:53.325 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:53.321+0000 7f95aef076c0 1 -- 10.20.193.92:0/2698631254 shutdown_connections 2026-02-13T03:58:53.325 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:58:53.321+0000 7f95aef076c0 1 -- 10.20.193.92:0/2698631254 wait complete. 2026-02-13T03:58:53.425 DEBUG:teuthology.orchestra.run.trial092:osd.0> sudo journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@osd.0.service 2026-02-13T03:58:53.429 INFO:tasks.cephadm:Deploying osd.1 on trial099 with /dev/vg_nvme/lv_4... 2026-02-13T03:58:53.429 DEBUG:teuthology.orchestra.run.trial099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-13T03:58:53.549 INFO:teuthology.orchestra.run.trial099.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.b/config 2026-02-13T03:58:53.955 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:53 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:53.956 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:53 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:53.956 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:53 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:53.956 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:53 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:58:53.956 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:53 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:53.956 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:53 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:58:53.956 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:53 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:58:53.956 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:53 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:53.956 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:53 trial099 ceph-mon[27808]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-13T03:58:53.956 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:53 trial099 ceph-mon[27808]: from='osd.0 [v2:10.20.193.92:6802/2375200644,v1:10.20.193.92:6803/2375200644]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-13T03:58:53.956 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:53 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:53.957 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:53 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:54.003 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-13T03:58:54.024 DEBUG:teuthology.orchestra.run.trial099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph orch daemon add osd trial099:vg_nvme/lv_4 --skip-validation 2026-02-13T03:58:54.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:53 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:54.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:53 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:54.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:53 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:54.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:53 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:58:54.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:53 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:54.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:53 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:58:54.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:53 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:58:54.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:53 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:54.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:53 trial158 ceph-mon[27763]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-13T03:58:54.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:53 trial158 ceph-mon[27763]: from='osd.0 [v2:10.20.193.92:6802/2375200644,v1:10.20.193.92:6803/2375200644]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-13T03:58:54.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:53 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:54.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:53 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:54.140 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:53 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:54.140 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:53 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:54.140 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:53 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:54.140 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:53 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:58:54.141 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:53 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:54.141 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:53 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:58:54.141 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:53 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:58:54.141 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:53 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:54.141 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:53 trial092 ceph-mon[23047]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-13T03:58:54.141 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:53 trial092 ceph-mon[23047]: from='osd.0 [v2:10.20.193.92:6802/2375200644,v1:10.20.193.92:6803/2375200644]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2026-02-13T03:58:54.141 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:53 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:54.141 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:53 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:54.142 INFO:teuthology.orchestra.run.trial099.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.b/config 2026-02-13T03:58:54.266 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:58:54.260+0000 7f9715bed6c0 1 -- 10.20.193.99:0/3011302681 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9710115440 msgr2=0x7f9710175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:54.266 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:58:54.260+0000 7f9715bed6c0 1 --2- 10.20.193.99:0/3011302681 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9710115440 0x7f9710175de0 secure :-1 s=READY pgs=28 gs=1 cs=0 l=1 c_cookie=250223744150752420 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f970400aa40 tx=0x7f970402fde0 comp rx=0 tx=0).stop 2026-02-13T03:58:54.266 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:58:54.260+0000 7f9715bed6c0 1 -- 10.20.193.99:0/3011302681 shutdown_connections 2026-02-13T03:58:54.266 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:58:54.260+0000 7f9715bed6c0 1 --2- 10.20.193.99:0/3011302681 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9710115440 0x7f9710175de0 unknown :-1 s=CLOSED pgs=28 gs=1 cs=0 l=1 c_cookie=250223744150752420 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:54.266 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:58:54.260+0000 7f9715bed6c0 1 --2- 10.20.193.99:0/3011302681 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f971010fc20 0x7f9710114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:54.266 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:58:54.260+0000 7f9715bed6c0 1 --2- 10.20.193.99:0/3011302681 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f971010f230 0x7f971010f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:54.266 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:58:54.260+0000 7f9715bed6c0 1 -- 10.20.193.99:0/3011302681 >> 10.20.193.99:0/3011302681 conn(0x7f97100ecb30 msgr2=0x7f971010cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:58:54.267 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:58:54.260+0000 7f9715bed6c0 1 -- 10.20.193.99:0/3011302681 shutdown_connections 2026-02-13T03:58:54.267 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:58:54.260+0000 7f9715bed6c0 1 -- 10.20.193.99:0/3011302681 wait complete. 2026-02-13T03:58:54.267 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:58:54.260+0000 7f9715bed6c0 1 Processor -- start 2026-02-13T03:58:54.267 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:58:54.260+0000 7f9715bed6c0 1 -- start start 2026-02-13T03:58:54.267 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:58:54.260+0000 7f9715bed6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f971010f230 0x7f971011cf20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:54.267 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:58:54.260+0000 7f9715bed6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9710115440 0x7f971011d460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:54.267 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:58:54.260+0000 7f9715bed6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9710122820 0x7f9710122cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:54.267 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:58:54.260+0000 7f9715bed6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9710123230 con 0x7f9710115440 2026-02-13T03:58:54.267 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:58:54.260+0000 7f9715bed6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f97101233a0 con 0x7f9710122820 2026-02-13T03:58:54.267 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:58:54.260+0000 7f9715bed6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f9710123560 con 0x7f971010f230 2026-02-13T03:58:54.267 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:58:54.260+0000 7f970ffff6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9710122820 0x7f9710122cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:54.268 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:58:54.261+0000 7f970ffff6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9710122820 0x7f9710122cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.99:41968/0 (socket says 10.20.193.99:41968) 2026-02-13T03:58:54.268 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:58:54.261+0000 7f970ffff6c0 1 -- 10.20.193.99:0/3084878519 learned_addr learned my addr 10.20.193.99:0/3084878519 (peer_addr_for_me v2:10.20.193.99:0/0) 2026-02-13T03:58:54.268 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:58:54.261+0000 7f970effd6c0 1 --2- 10.20.193.99:0/3084878519 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9710115440 0x7f971011d460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:54.268 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:58:54.261+0000 7f970ffff6c0 1 -- 10.20.193.99:0/3084878519 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f971010f230 msgr2=0x7f971011cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:54.268 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:58:54.261+0000 7f970f7fe6c0 1 --2- 10.20.193.99:0/3084878519 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f971010f230 0x7f971011cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:54.268 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:58:54.261+0000 7f970ffff6c0 1 --2- 10.20.193.99:0/3084878519 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f971010f230 0x7f971011cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:54.268 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:58:54.261+0000 7f970ffff6c0 1 -- 10.20.193.99:0/3084878519 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9710115440 msgr2=0x7f971011d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:58:54.268 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:58:54.261+0000 7f970ffff6c0 1 --2- 10.20.193.99:0/3084878519 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9710115440 0x7f971011d460 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:58:54.268 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:58:54.261+0000 7f970ffff6c0 1 -- 10.20.193.99:0/3084878519 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f970400a660 con 0x7f9710122820 2026-02-13T03:58:54.268 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:58:54.261+0000 7f970f7fe6c0 1 --2- 10.20.193.99:0/3084878519 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f971010f230 0x7f971011cf20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:58:54.268 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:58:54.261+0000 7f970effd6c0 1 --2- 10.20.193.99:0/3084878519 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9710115440 0x7f971011d460 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:58:54.268 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:58:54.261+0000 7f970ffff6c0 1 --2- 10.20.193.99:0/3084878519 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9710122820 0x7f9710122cc0 secure :-1 s=READY pgs=29 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f970400a390 tx=0x7f97040058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:54.269 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:58:54.261+0000 7f970cff96c0 1 -- 10.20.193.99:0/3084878519 <== mon.2 v2:10.20.193.99:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9704030af0 con 0x7f9710122820 2026-02-13T03:58:54.269 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:58:54.261+0000 7f970cff96c0 1 -- 10.20.193.99:0/3084878519 <== mon.2 v2:10.20.193.99:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f9704030e00 con 0x7f9710122820 2026-02-13T03:58:54.269 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:58:54.261+0000 7f9715bed6c0 1 -- 10.20.193.99:0/3084878519 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97101639b0 con 0x7f9710122820 2026-02-13T03:58:54.269 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:58:54.261+0000 7f970cff96c0 1 -- 10.20.193.99:0/3084878519 <== mon.2 v2:10.20.193.99:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97040322b0 con 0x7f9710122820 2026-02-13T03:58:54.269 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:58:54.261+0000 7f9715bed6c0 1 -- 10.20.193.99:0/3084878519 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9710163de0 con 0x7f9710122820 2026-02-13T03:58:54.269 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:58:54.261+0000 7f9715bed6c0 1 -- 10.20.193.99:0/3084878519 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9710110500 con 0x7f9710122820 2026-02-13T03:58:54.269 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:58:54.263+0000 7f970cff96c0 1 -- 10.20.193.99:0/3084878519 <== mon.2 v2:10.20.193.99:3300/0 4 ==== mgrmap(e 14) ==== 157027+0+0 (secure 0 0 0) 0x7f9704008670 con 0x7f9710122820 2026-02-13T03:58:54.270 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:58:54.263+0000 7f970cff96c0 1 --2- 10.20.193.99:0/3084878519 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f96d80b5640 0x7f96d80d5af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:58:54.270 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:58:54.263+0000 7f970cff96c0 1 -- 10.20.193.99:0/3084878519 <== mon.2 v2:10.20.193.99:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1356+0+0 (secure 0 0 0) 0x7f97041073c0 con 0x7f9710122820 2026-02-13T03:58:54.270 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:58:54.263+0000 7f970f7fe6c0 1 --2- 10.20.193.99:0/3084878519 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f96d80b5640 0x7f96d80d5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:58:54.270 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:58:54.264+0000 7f970f7fe6c0 1 --2- 10.20.193.99:0/3084878519 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f96d80b5640 0x7f96d80d5af0 secure :-1 s=READY pgs=47 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f96fc004750 tx=0x7f96fc005f10 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:58:54.271 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:58:54.264+0000 7f970cff96c0 1 -- 10.20.193.99:0/3084878519 <== mon.2 v2:10.20.193.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f97040cb930 con 0x7f9710122820 2026-02-13T03:58:54.364 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:58:54.361+0000 7f9715bed6c0 1 -- 10.20.193.99:0/3084878519 --> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial099:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f971011e100 con 0x7f96d80b5640 2026-02-13T03:58:54.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:54 trial092 ceph-mon[23047]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-13T03:58:54.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:54 trial092 ceph-mon[23047]: osdmap e6: 1 total, 0 up, 1 in 2026-02-13T03:58:54.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:54 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:58:54.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:54 trial092 ceph-mon[23047]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial092", "root=default"]} : dispatch 2026-02-13T03:58:54.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:54 trial092 ceph-mon[23047]: from='osd.0 [v2:10.20.193.92:6802/2375200644,v1:10.20.193.92:6803/2375200644]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial092", "root=default"]} : dispatch 2026-02-13T03:58:54.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:54 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:58:54.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:54 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:54.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:54 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:54.935 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:54 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:58:54.935 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:54 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:58:54.935 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:54 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:54.935 INFO:journalctl@ceph.osd.0.trial092.stdout:Feb 13 03:58:54 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-0[35814]: 2026-02-13T03:58:54.726+0000 7f4b297ef6c0 -1 osd.0 0 waiting for initial osdmap 2026-02-13T03:58:54.935 INFO:journalctl@ceph.osd.0.trial092.stdout:Feb 13 03:58:54 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-0[35814]: 2026-02-13T03:58:54.729+0000 7f4b256b36c0 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T03:58:54.981 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:54 trial099 ceph-mon[27808]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-13T03:58:54.981 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:54 trial099 ceph-mon[27808]: osdmap e6: 1 total, 0 up, 1 in 2026-02-13T03:58:54.981 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:54 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:58:54.981 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:54 trial099 ceph-mon[27808]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial092", "root=default"]} : dispatch 2026-02-13T03:58:54.982 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:54 trial099 ceph-mon[27808]: from='osd.0 [v2:10.20.193.92:6802/2375200644,v1:10.20.193.92:6803/2375200644]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial092", "root=default"]} : dispatch 2026-02-13T03:58:54.982 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:54 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:58:54.982 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:54 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:54.982 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:54 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:54.982 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:54 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:58:54.982 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:54 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:58:54.982 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:54 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:55.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:54 trial158 ceph-mon[27763]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2026-02-13T03:58:55.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:54 trial158 ceph-mon[27763]: osdmap e6: 1 total, 0 up, 1 in 2026-02-13T03:58:55.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:54 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:58:55.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:54 trial158 ceph-mon[27763]: from='osd.0 ' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial092", "root=default"]} : dispatch 2026-02-13T03:58:55.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:54 trial158 ceph-mon[27763]: from='osd.0 [v2:10.20.193.92:6802/2375200644,v1:10.20.193.92:6803/2375200644]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial092", "root=default"]} : dispatch 2026-02-13T03:58:55.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:54 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:58:55.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:54 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:55.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:54 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:55.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:54 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:58:55.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:54 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:58:55.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:54 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:55.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:55 trial099 ceph-mon[27808]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:58:55.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:55 trial099 ceph-mon[27808]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial099:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:58:55.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:55 trial099 ceph-mon[27808]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:58:55.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:55 trial099 ceph-mon[27808]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial092", "root=default"]}]': finished 2026-02-13T03:58:55.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:55 trial099 ceph-mon[27808]: osdmap e7: 1 total, 0 up, 1 in 2026-02-13T03:58:55.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:55 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:58:55.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:55 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:58:55.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:55 trial099 ceph-mon[27808]: from='client.? 10.20.193.99:0/532179225' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "253e5e0e-8571-4add-81e5-ca92934b8171"} : dispatch 2026-02-13T03:58:55.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:55 trial099 ceph-mon[27808]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "253e5e0e-8571-4add-81e5-ca92934b8171"} : dispatch 2026-02-13T03:58:55.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:55 trial099 ceph-mon[27808]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "253e5e0e-8571-4add-81e5-ca92934b8171"}]': finished 2026-02-13T03:58:55.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:55 trial099 ceph-mon[27808]: osd.0 [v2:10.20.193.92:6802/2375200644,v1:10.20.193.92:6803/2375200644] boot 2026-02-13T03:58:55.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:55 trial099 ceph-mon[27808]: osdmap e8: 2 total, 1 up, 2 in 2026-02-13T03:58:55.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:55 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:58:55.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:55 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:58:55.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:55 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:55.868 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:55 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:55.868 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:55 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T03:58:55.868 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:55 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:55.868 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:55 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:55.868 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:55 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:58:55.868 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:55 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:55.868 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:55 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:58:55.868 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:55 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:58:55.868 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:55 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:55.868 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:55 trial099 ceph-mon[27808]: from='client.? 10.20.193.99:0/3978639089' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:58:56.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:55 trial158 ceph-mon[27763]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:58:56.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:55 trial158 ceph-mon[27763]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial099:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:58:56.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:55 trial158 ceph-mon[27763]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:58:56.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:55 trial158 ceph-mon[27763]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial092", "root=default"]}]': finished 2026-02-13T03:58:56.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:55 trial158 ceph-mon[27763]: osdmap e7: 1 total, 0 up, 1 in 2026-02-13T03:58:56.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:55 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:58:56.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:55 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:58:56.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:55 trial158 ceph-mon[27763]: from='client.? 10.20.193.99:0/532179225' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "253e5e0e-8571-4add-81e5-ca92934b8171"} : dispatch 2026-02-13T03:58:56.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:55 trial158 ceph-mon[27763]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "253e5e0e-8571-4add-81e5-ca92934b8171"} : dispatch 2026-02-13T03:58:56.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:55 trial158 ceph-mon[27763]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "253e5e0e-8571-4add-81e5-ca92934b8171"}]': finished 2026-02-13T03:58:56.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:55 trial158 ceph-mon[27763]: osd.0 [v2:10.20.193.92:6802/2375200644,v1:10.20.193.92:6803/2375200644] boot 2026-02-13T03:58:56.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:55 trial158 ceph-mon[27763]: osdmap e8: 2 total, 1 up, 2 in 2026-02-13T03:58:56.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:55 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:58:56.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:55 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:58:56.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:55 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:56.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:55 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:56.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:55 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T03:58:56.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:55 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:56.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:55 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:56.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:55 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:58:56.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:55 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:56.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:55 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:58:56.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:55 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:58:56.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:55 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:56.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:55 trial158 ceph-mon[27763]: from='client.? 10.20.193.99:0/3978639089' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:58:56.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:55 trial092 ceph-mon[23047]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:58:56.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:55 trial092 ceph-mon[23047]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial099:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:58:56.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:55 trial092 ceph-mon[23047]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:58:56.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:55 trial092 ceph-mon[23047]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.6836, "args": ["host=trial092", "root=default"]}]': finished 2026-02-13T03:58:56.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:55 trial092 ceph-mon[23047]: osdmap e7: 1 total, 0 up, 1 in 2026-02-13T03:58:56.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:55 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:58:56.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:55 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:58:56.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:55 trial092 ceph-mon[23047]: from='client.? 10.20.193.99:0/532179225' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "253e5e0e-8571-4add-81e5-ca92934b8171"} : dispatch 2026-02-13T03:58:56.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:55 trial092 ceph-mon[23047]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "253e5e0e-8571-4add-81e5-ca92934b8171"} : dispatch 2026-02-13T03:58:56.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:55 trial092 ceph-mon[23047]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "253e5e0e-8571-4add-81e5-ca92934b8171"}]': finished 2026-02-13T03:58:56.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:55 trial092 ceph-mon[23047]: osd.0 [v2:10.20.193.92:6802/2375200644,v1:10.20.193.92:6803/2375200644] boot 2026-02-13T03:58:56.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:55 trial092 ceph-mon[23047]: osdmap e8: 2 total, 1 up, 2 in 2026-02-13T03:58:56.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:55 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2026-02-13T03:58:56.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:55 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:58:56.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:55 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:56.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:55 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:56.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:55 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T03:58:56.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:55 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:56.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:55 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:56.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:55 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:58:56.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:55 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:56.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:55 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:58:56.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:55 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:58:56.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:55 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:56.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:55 trial092 ceph-mon[23047]: from='client.? 10.20.193.99:0/3978639089' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:58:56.849 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:56 trial099 ceph-mon[27808]: purged_snaps scrub starts 2026-02-13T03:58:56.849 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:56 trial099 ceph-mon[27808]: purged_snaps scrub ok 2026-02-13T03:58:56.849 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:56 trial099 ceph-mon[27808]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:58:56.849 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:56 trial099 ceph-mon[27808]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:58:56.849 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:56 trial099 ceph-mon[27808]: Cluster is now healthy 2026-02-13T03:58:57.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:56 trial158 ceph-mon[27763]: purged_snaps scrub starts 2026-02-13T03:58:57.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:56 trial158 ceph-mon[27763]: purged_snaps scrub ok 2026-02-13T03:58:57.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:56 trial158 ceph-mon[27763]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:58:57.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:56 trial158 ceph-mon[27763]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:58:57.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:56 trial158 ceph-mon[27763]: Cluster is now healthy 2026-02-13T03:58:57.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:56 trial092 ceph-mon[23047]: purged_snaps scrub starts 2026-02-13T03:58:57.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:56 trial092 ceph-mon[23047]: purged_snaps scrub ok 2026-02-13T03:58:57.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:56 trial092 ceph-mon[23047]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2026-02-13T03:58:57.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:56 trial092 ceph-mon[23047]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:58:57.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:56 trial092 ceph-mon[23047]: Cluster is now healthy 2026-02-13T03:58:57.877 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:57 trial099 ceph-mon[27808]: osdmap e9: 2 total, 1 up, 2 in 2026-02-13T03:58:57.877 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:57 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:58:57.877 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:57 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:58:57.877 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:57 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:57.878 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:57 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:57.878 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:57 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:57.878 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:57 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:58:57.878 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:57 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:57.878 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:57 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:58:57.878 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:57 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:58:57.878 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:57 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:57.878 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:57 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-13T03:58:57.878 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:57 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:58.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:57 trial158 ceph-mon[27763]: osdmap e9: 2 total, 1 up, 2 in 2026-02-13T03:58:58.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:57 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:58:58.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:57 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:58:58.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:57 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:58.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:57 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:58.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:57 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:58.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:57 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:58:58.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:57 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:58.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:57 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:58:58.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:57 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:58:58.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:57 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:58.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:57 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-13T03:58:58.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:57 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:58.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:57 trial092 ceph-mon[23047]: osdmap e9: 2 total, 1 up, 2 in 2026-02-13T03:58:58.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:57 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:58:58.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:57 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:58:58.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:57 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:58.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:57 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:58.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:57 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:58.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:57 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:58:58.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:57 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:58:58.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:57 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:58:58.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:57 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:58:58.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:57 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:58.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:57 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2026-02-13T03:58:58.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:57 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:58:59.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:58 trial158 ceph-mon[27763]: pgmap v10: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:58:59.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:58 trial158 ceph-mon[27763]: pgmap v11: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:58:59.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:58 trial158 ceph-mon[27763]: pgmap v12: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:58:59.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:58 trial099 ceph-mon[27808]: pgmap v10: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:58:59.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:58 trial099 ceph-mon[27808]: pgmap v11: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:58:59.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:58 trial099 ceph-mon[27808]: pgmap v12: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:58:59.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:58 trial092 ceph-mon[23047]: pgmap v10: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:58:59.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:58 trial092 ceph-mon[23047]: pgmap v11: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:58:59.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:58 trial092 ceph-mon[23047]: pgmap v12: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:59:00.028 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:59 trial099 ceph-mon[27808]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:59:00.028 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:59 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:00.028 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:59 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:00.028 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:58:59 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:00.078 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:59 trial158 ceph-mon[27763]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:59:00.078 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:59 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:00.078 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:59 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:00.078 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:58:59 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:00.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:59 trial092 ceph-mon[23047]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:59:00.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:59 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:00.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:59 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:00.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:58:59 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:00.737 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:00.734+0000 7f970cff96c0 1 -- 10.20.193.99:0/3084878519 <== mgr.14187 v2:10.20.193.92:6800/4191527999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f96fc004020 con 0x7f96d80b5640 2026-02-13T03:59:00.737 INFO:teuthology.orchestra.run.trial099.stdout:Created osd(s) 1 on host 'trial099' 2026-02-13T03:59:00.739 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:00.737+0000 7f9715bed6c0 1 -- 10.20.193.99:0/3084878519 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f96d80b5640 msgr2=0x7f96d80d5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:59:00.740 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:00.737+0000 7f9715bed6c0 1 --2- 10.20.193.99:0/3084878519 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f96d80b5640 0x7f96d80d5af0 secure :-1 s=READY pgs=47 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f96fc004750 tx=0x7f96fc005f10 comp rx=0 tx=0).stop 2026-02-13T03:59:00.740 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:00.737+0000 7f9715bed6c0 1 -- 10.20.193.99:0/3084878519 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9710122820 msgr2=0x7f9710122cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:59:00.740 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:00.737+0000 7f9715bed6c0 1 --2- 10.20.193.99:0/3084878519 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9710122820 0x7f9710122cc0 secure :-1 s=READY pgs=29 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f970400a390 tx=0x7f97040058a0 comp rx=0 tx=0).stop 2026-02-13T03:59:00.740 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:00.737+0000 7f9715bed6c0 1 -- 10.20.193.99:0/3084878519 shutdown_connections 2026-02-13T03:59:00.740 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:00.737+0000 7f9715bed6c0 1 --2- 10.20.193.99:0/3084878519 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f96d80b5640 0x7f96d80d5af0 unknown :-1 s=CLOSED pgs=47 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:00.740 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:00.737+0000 7f9715bed6c0 1 --2- 10.20.193.99:0/3084878519 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9710122820 0x7f9710122cc0 unknown :-1 s=CLOSED pgs=29 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:00.740 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:00.737+0000 7f9715bed6c0 1 --2- 10.20.193.99:0/3084878519 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9710115440 0x7f971011d460 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:00.740 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:00.737+0000 7f9715bed6c0 1 --2- 10.20.193.99:0/3084878519 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f971010f230 0x7f971011cf20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:00.740 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:00.737+0000 7f9715bed6c0 1 -- 10.20.193.99:0/3084878519 >> 10.20.193.99:0/3084878519 conn(0x7f97100ecb30 msgr2=0x7f971010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:59:00.740 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:00.737+0000 7f9715bed6c0 1 -- 10.20.193.99:0/3084878519 shutdown_connections 2026-02-13T03:59:00.740 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:00.737+0000 7f9715bed6c0 1 -- 10.20.193.99:0/3084878519 wait complete. 2026-02-13T03:59:00.779 DEBUG:teuthology.orchestra.run.trial099:osd.1> sudo journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@osd.1.service 2026-02-13T03:59:00.781 INFO:tasks.cephadm:Deploying osd.2 on trial158 with /dev/vg_nvme/lv_4... 2026-02-13T03:59:00.781 DEBUG:teuthology.orchestra.run.trial158:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_4 2026-02-13T03:59:00.834 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:00 trial099 ceph-mon[27808]: pgmap v13: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:59:00.835 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:00 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:00.835 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:00 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:00.835 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:00 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:00.835 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:00 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:00.835 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:00 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:00.835 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:00 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:00.835 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:00 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:00.835 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:00 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:00.835 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:00 trial099 ceph-mon[27808]: from='osd.1 [v2:10.20.193.99:6800/3943455734,v1:10.20.193.99:6801/3943455734]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T03:59:00.835 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:00 trial099 ceph-mon[27808]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T03:59:00.835 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:00 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:00.835 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:00 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:00.900 INFO:teuthology.orchestra.run.trial158.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.c/config 2026-02-13T03:59:00.999 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:00 trial158 ceph-mon[27763]: pgmap v13: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:59:00.999 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:00 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:00.999 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:00 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:00.999 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:00 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:00.999 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:00 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:00.999 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:00 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:00.999 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:00 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:00.999 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:00 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:00.999 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:00 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:01.000 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:00 trial158 ceph-mon[27763]: from='osd.1 [v2:10.20.193.99:6800/3943455734,v1:10.20.193.99:6801/3943455734]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T03:59:01.000 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:00 trial158 ceph-mon[27763]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T03:59:01.000 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:00 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:01.000 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:00 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:01.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:00 trial092 ceph-mon[23047]: pgmap v13: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:59:01.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:00 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:01.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:00 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:01.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:00 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:01.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:00 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:01.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:00 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:01.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:00 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:01.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:00 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:01.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:00 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:01.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:00 trial092 ceph-mon[23047]: from='osd.1 [v2:10.20.193.99:6800/3943455734,v1:10.20.193.99:6801/3943455734]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T03:59:01.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:00 trial092 ceph-mon[23047]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2026-02-13T03:59:01.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:00 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:01.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:00 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:01.363 INFO:teuthology.orchestra.run.trial158.stdout: 2026-02-13T03:59:01.381 DEBUG:teuthology.orchestra.run.trial158:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph orch daemon add osd trial158:vg_nvme/lv_4 --skip-validation 2026-02-13T03:59:01.500 INFO:teuthology.orchestra.run.trial158.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.c/config 2026-02-13T03:59:01.618 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:01.613+0000 7f11fd3046c0 1 -- 10.20.193.158:0/287596500 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f11f810fbf0 msgr2=0x7f11f8114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:59:01.618 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:01.613+0000 7f11fd3046c0 1 --2- 10.20.193.158:0/287596500 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f11f810fbf0 0x7f11f8114c30 secure :-1 s=READY pgs=27 gs=1 cs=0 l=1 c_cookie=5656877766052277267 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f11dc0099a0 tx=0x7f11dc02ed20 comp rx=0 tx=0).stop 2026-02-13T03:59:01.618 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:01.613+0000 7f11fd3046c0 1 -- 10.20.193.158:0/287596500 shutdown_connections 2026-02-13T03:59:01.618 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:01.613+0000 7f11fd3046c0 1 --2- 10.20.193.158:0/287596500 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f11f8115410 0x7f11f8175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:01.618 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:01.613+0000 7f11fd3046c0 1 --2- 10.20.193.158:0/287596500 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f11f810fbf0 0x7f11f8114c30 unknown :-1 s=CLOSED pgs=27 gs=1 cs=0 l=1 c_cookie=5656877766052277267 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:01.619 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:01.613+0000 7f11fd3046c0 1 --2- 10.20.193.158:0/287596500 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f11f810f200 0x7f11f810f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:01.619 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:01.613+0000 7f11fd3046c0 1 -- 10.20.193.158:0/287596500 >> 10.20.193.158:0/287596500 conn(0x7f11f80ecb00 msgr2=0x7f11f810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:59:01.619 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:01.613+0000 7f11fd3046c0 1 -- 10.20.193.158:0/287596500 shutdown_connections 2026-02-13T03:59:01.619 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:01.614+0000 7f11fd3046c0 1 -- 10.20.193.158:0/287596500 wait complete. 2026-02-13T03:59:01.619 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:01.614+0000 7f11fd3046c0 1 Processor -- start 2026-02-13T03:59:01.619 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:01.614+0000 7f11fd3046c0 1 -- start start 2026-02-13T03:59:01.619 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:01.614+0000 7f11fd3046c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f11f810f200 0x7f11f80f49e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:59:01.619 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:01.614+0000 7f11fd3046c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f11f8115410 0x7f11f8175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:59:01.619 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:01.614+0000 7f11fd3046c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f11f80f5010 0x7f11f80fa2e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:59:01.619 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:01.614+0000 7f11fd3046c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f11f80f5700 con 0x7f11f80f5010 2026-02-13T03:59:01.620 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:01.614+0000 7f11fd3046c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f11f80fa820 con 0x7f11f8115410 2026-02-13T03:59:01.620 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:01.614+0000 7f11fd3046c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f11f80fa9e0 con 0x7f11f810f200 2026-02-13T03:59:01.620 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:01.614+0000 7f11f6ffd6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f11f810f200 0x7f11f80f49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:59:01.620 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:01.614+0000 7f11f6ffd6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f11f810f200 0x7f11f80f49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.158:39404/0 (socket says 10.20.193.158:39404) 2026-02-13T03:59:01.620 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:01.614+0000 7f11f6ffd6c0 1 -- 10.20.193.158:0/1001134043 learned_addr learned my addr 10.20.193.158:0/1001134043 (peer_addr_for_me v2:10.20.193.158:0/0) 2026-02-13T03:59:01.620 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:01.614+0000 7f11f67fc6c0 1 --2- 10.20.193.158:0/1001134043 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f11f8115410 0x7f11f8175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:59:01.620 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:01.614+0000 7f11f6ffd6c0 1 -- 10.20.193.158:0/1001134043 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f11f8115410 msgr2=0x7f11f8175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:59:01.620 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:01.614+0000 7f11f6ffd6c0 1 --2- 10.20.193.158:0/1001134043 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f11f8115410 0x7f11f8175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:01.620 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:01.614+0000 7f11f77fe6c0 1 --2- 10.20.193.158:0/1001134043 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f11f80f5010 0x7f11f80fa2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:59:01.620 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:01.614+0000 7f11f6ffd6c0 1 -- 10.20.193.158:0/1001134043 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f11f80f5010 msgr2=0x7f11f80fa2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:59:01.620 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:01.614+0000 7f11f6ffd6c0 1 --2- 10.20.193.158:0/1001134043 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f11f80f5010 0x7f11f80fa2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:01.620 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:01.614+0000 7f11f6ffd6c0 1 -- 10.20.193.158:0/1001134043 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11dc009590 con 0x7f11f810f200 2026-02-13T03:59:01.621 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:01.614+0000 7f11f67fc6c0 1 --2- 10.20.193.158:0/1001134043 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f11f8115410 0x7f11f8175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:59:01.621 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:01.614+0000 7f11f77fe6c0 1 --2- 10.20.193.158:0/1001134043 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f11f80f5010 0x7f11f80fa2e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:59:01.621 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:01.614+0000 7f11f6ffd6c0 1 --2- 10.20.193.158:0/1001134043 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f11f810f200 0x7f11f80f49e0 secure :-1 s=READY pgs=28 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f11e400b6f0 tx=0x7f11e400bbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:59:01.621 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:01.614+0000 7f11effff6c0 1 -- 10.20.193.158:0/1001134043 <== mon.1 v2:10.20.193.158:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f11e40044a0 con 0x7f11f810f200 2026-02-13T03:59:01.621 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:01.614+0000 7f11effff6c0 1 -- 10.20.193.158:0/1001134043 <== mon.1 v2:10.20.193.158:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f11e400be80 con 0x7f11f810f200 2026-02-13T03:59:01.621 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:01.614+0000 7f11fd3046c0 1 -- 10.20.193.158:0/1001134043 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11f80facc0 con 0x7f11f810f200 2026-02-13T03:59:01.621 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:01.614+0000 7f11effff6c0 1 -- 10.20.193.158:0/1001134043 <== mon.1 v2:10.20.193.158:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f11e400e070 con 0x7f11f810f200 2026-02-13T03:59:01.621 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:01.614+0000 7f11fd3046c0 1 -- 10.20.193.158:0/1001134043 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11f80fb450 con 0x7f11f810f200 2026-02-13T03:59:01.621 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:01.615+0000 7f11fd3046c0 1 -- 10.20.193.158:0/1001134043 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11f81104d0 con 0x7f11f810f200 2026-02-13T03:59:01.621 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:01.616+0000 7f11effff6c0 1 -- 10.20.193.158:0/1001134043 <== mon.1 v2:10.20.193.158:3300/0 4 ==== mgrmap(e 14) ==== 157027+0+0 (secure 0 0 0) 0x7f11e400c530 con 0x7f11f810f200 2026-02-13T03:59:01.622 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:01.617+0000 7f11effff6c0 1 --2- 10.20.193.158:0/1001134043 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f11c00b5640 0x7f11c00d5af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:59:01.622 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:01.617+0000 7f11effff6c0 1 -- 10.20.193.158:0/1001134043 <== mon.1 v2:10.20.193.158:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1896+0+0 (secure 0 0 0) 0x7f11e40e1fc0 con 0x7f11f810f200 2026-02-13T03:59:01.623 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:01.617+0000 7f11f67fc6c0 1 --2- 10.20.193.158:0/1001134043 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f11c00b5640 0x7f11c00d5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:59:01.623 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:01.617+0000 7f11effff6c0 1 -- 10.20.193.158:0/1001134043 <== mon.1 v2:10.20.193.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f11e40a63e0 con 0x7f11f810f200 2026-02-13T03:59:01.623 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:01.618+0000 7f11f67fc6c0 1 --2- 10.20.193.158:0/1001134043 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f11c00b5640 0x7f11c00d5af0 secure :-1 s=READY pgs=52 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f11dc0072f0 tx=0x7f11dc005ae0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:59:01.715 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:01.713+0000 7f11fd3046c0 1 -- 10.20.193.158:0/1001134043 --> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial158:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f11f80f5b30 con 0x7f11c00b5640 2026-02-13T03:59:01.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:01 trial158 ceph-mon[27763]: pgmap v14: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:59:01.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:01 trial158 ceph-mon[27763]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:59:01.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:01 trial158 ceph-mon[27763]: Cluster is now healthy 2026-02-13T03:59:01.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:01 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:01.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:01 trial158 ceph-mon[27763]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-13T03:59:01.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:01 trial158 ceph-mon[27763]: from='osd.1 [v2:10.20.193.99:6800/3943455734,v1:10.20.193.99:6801/3943455734]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial099", "root=default"]} : dispatch 2026-02-13T03:59:01.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:01 trial158 ceph-mon[27763]: osdmap e10: 2 total, 1 up, 2 in 2026-02-13T03:59:01.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:01 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:59:01.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:01 trial158 ceph-mon[27763]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial099", "root=default"]} : dispatch 2026-02-13T03:59:01.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:01 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:01.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:01 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:01.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:01 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:01.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:01 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:01.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:01 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:02.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:01 trial099 ceph-mon[27808]: pgmap v14: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:59:02.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:01 trial099 ceph-mon[27808]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:59:02.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:01 trial099 ceph-mon[27808]: Cluster is now healthy 2026-02-13T03:59:02.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:01 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:02.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:01 trial099 ceph-mon[27808]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-13T03:59:02.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:01 trial099 ceph-mon[27808]: from='osd.1 [v2:10.20.193.99:6800/3943455734,v1:10.20.193.99:6801/3943455734]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial099", "root=default"]} : dispatch 2026-02-13T03:59:02.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:01 trial099 ceph-mon[27808]: osdmap e10: 2 total, 1 up, 2 in 2026-02-13T03:59:02.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:01 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:59:02.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:01 trial099 ceph-mon[27808]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial099", "root=default"]} : dispatch 2026-02-13T03:59:02.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:01 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:02.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:01 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:02.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:01 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:02.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:01 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:02.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:01 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:02.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:01 trial092 ceph-mon[23047]: pgmap v14: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:59:02.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:01 trial092 ceph-mon[23047]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:59:02.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:01 trial092 ceph-mon[23047]: Cluster is now healthy 2026-02-13T03:59:02.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:01 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:02.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:01 trial092 ceph-mon[23047]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2026-02-13T03:59:02.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:01 trial092 ceph-mon[23047]: from='osd.1 [v2:10.20.193.99:6800/3943455734,v1:10.20.193.99:6801/3943455734]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial099", "root=default"]} : dispatch 2026-02-13T03:59:02.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:01 trial092 ceph-mon[23047]: osdmap e10: 2 total, 1 up, 2 in 2026-02-13T03:59:02.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:01 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:59:02.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:01 trial092 ceph-mon[23047]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial099", "root=default"]} : dispatch 2026-02-13T03:59:02.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:01 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:02.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:01 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:02.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:01 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:02.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:01 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:02.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:01 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:02.616 INFO:journalctl@ceph.osd.1.trial099.stdout:Feb 13 03:59:02 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-1[33772]: 2026-02-13T03:59:02.298+0000 7f49c1b3a6c0 -1 osd.1 0 waiting for initial osdmap 2026-02-13T03:59:02.616 INFO:journalctl@ceph.osd.1.trial099.stdout:Feb 13 03:59:02 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-1[33772]: 2026-02-13T03:59:02.301+0000 7f49b99f66c0 -1 osd.1 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T03:59:03.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:02 trial158 ceph-mon[27763]: pgmap v15: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:59:03.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:02 trial158 ceph-mon[27763]: from='client.24298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial158:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:59:03.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:02 trial158 ceph-mon[27763]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:59:03.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:02 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:03.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:02 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:03.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:02 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T03:59:03.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:02 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:03.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:02 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:03.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:02 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:03.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:02 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:03.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:02 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:03.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:02 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:03.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:02 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:03.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:02 trial158 ceph-mon[27763]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial099", "root=default"]}]': finished 2026-02-13T03:59:03.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:02 trial158 ceph-mon[27763]: osdmap e11: 2 total, 1 up, 2 in 2026-02-13T03:59:03.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:02 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:59:03.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:02 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:59:03.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:02 trial158 ceph-mon[27763]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e94c2f5c-ce8a-484e-9cf3-e436edc16bdc"} : dispatch 2026-02-13T03:59:03.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:02 trial158 ceph-mon[27763]: from='client.? 10.20.193.158:0/2255398284' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e94c2f5c-ce8a-484e-9cf3-e436edc16bdc"} : dispatch 2026-02-13T03:59:03.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:02 trial158 ceph-mon[27763]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e94c2f5c-ce8a-484e-9cf3-e436edc16bdc"}]': finished 2026-02-13T03:59:03.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:02 trial158 ceph-mon[27763]: osd.1 [v2:10.20.193.99:6800/3943455734,v1:10.20.193.99:6801/3943455734] boot 2026-02-13T03:59:03.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:02 trial158 ceph-mon[27763]: osdmap e12: 3 total, 2 up, 3 in 2026-02-13T03:59:03.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:02 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:59:03.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:02 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:59:03.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:02 trial099 ceph-mon[27808]: pgmap v15: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:59:03.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:02 trial099 ceph-mon[27808]: from='client.24298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial158:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:59:03.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:02 trial099 ceph-mon[27808]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:59:03.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:02 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:03.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:02 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:03.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:02 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T03:59:03.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:02 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:03.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:02 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:03.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:02 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:03.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:02 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:03.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:02 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:03.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:02 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:03.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:02 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:03.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:02 trial099 ceph-mon[27808]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial099", "root=default"]}]': finished 2026-02-13T03:59:03.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:02 trial099 ceph-mon[27808]: osdmap e11: 2 total, 1 up, 2 in 2026-02-13T03:59:03.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:02 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:59:03.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:02 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:59:03.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:02 trial099 ceph-mon[27808]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e94c2f5c-ce8a-484e-9cf3-e436edc16bdc"} : dispatch 2026-02-13T03:59:03.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:02 trial099 ceph-mon[27808]: from='client.? 10.20.193.158:0/2255398284' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e94c2f5c-ce8a-484e-9cf3-e436edc16bdc"} : dispatch 2026-02-13T03:59:03.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:02 trial099 ceph-mon[27808]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e94c2f5c-ce8a-484e-9cf3-e436edc16bdc"}]': finished 2026-02-13T03:59:03.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:02 trial099 ceph-mon[27808]: osd.1 [v2:10.20.193.99:6800/3943455734,v1:10.20.193.99:6801/3943455734] boot 2026-02-13T03:59:03.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:02 trial099 ceph-mon[27808]: osdmap e12: 3 total, 2 up, 3 in 2026-02-13T03:59:03.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:02 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:59:03.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:02 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:59:03.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:02 trial092 ceph-mon[23047]: pgmap v15: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:59:03.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:02 trial092 ceph-mon[23047]: from='client.24298 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial158:vg_nvme/lv_4", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:59:03.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:02 trial092 ceph-mon[23047]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:59:03.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:02 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:03.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:02 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:03.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:02 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T03:59:03.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:02 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:03.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:02 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:03.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:02 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:03.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:02 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:03.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:02 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:03.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:02 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:03.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:02 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:03.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:02 trial092 ceph-mon[23047]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.6836, "args": ["host=trial099", "root=default"]}]': finished 2026-02-13T03:59:03.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:02 trial092 ceph-mon[23047]: osdmap e11: 2 total, 1 up, 2 in 2026-02-13T03:59:03.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:02 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:59:03.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:02 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:59:03.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:02 trial092 ceph-mon[23047]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e94c2f5c-ce8a-484e-9cf3-e436edc16bdc"} : dispatch 2026-02-13T03:59:03.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:02 trial092 ceph-mon[23047]: from='client.? 10.20.193.158:0/2255398284' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "e94c2f5c-ce8a-484e-9cf3-e436edc16bdc"} : dispatch 2026-02-13T03:59:03.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:02 trial092 ceph-mon[23047]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e94c2f5c-ce8a-484e-9cf3-e436edc16bdc"}]': finished 2026-02-13T03:59:03.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:02 trial092 ceph-mon[23047]: osd.1 [v2:10.20.193.99:6800/3943455734,v1:10.20.193.99:6801/3943455734] boot 2026-02-13T03:59:03.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:02 trial092 ceph-mon[23047]: osdmap e12: 3 total, 2 up, 3 in 2026-02-13T03:59:03.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:02 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2026-02-13T03:59:03.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:02 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:59:04.028 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:03 trial158 ceph-mon[27763]: purged_snaps scrub starts 2026-02-13T03:59:04.029 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:03 trial158 ceph-mon[27763]: purged_snaps scrub ok 2026-02-13T03:59:04.029 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:03 trial158 ceph-mon[27763]: pgmap v17: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:59:04.029 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:03 trial158 ceph-mon[27763]: from='client.? 10.20.193.158:0/3631714317' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:59:04.029 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:03 trial158 ceph-mon[27763]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:59:04.029 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:03 trial158 ceph-mon[27763]: Cluster is now healthy 2026-02-13T03:59:04.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:03 trial099 ceph-mon[27808]: purged_snaps scrub starts 2026-02-13T03:59:04.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:03 trial099 ceph-mon[27808]: purged_snaps scrub ok 2026-02-13T03:59:04.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:03 trial099 ceph-mon[27808]: pgmap v17: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:59:04.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:03 trial099 ceph-mon[27808]: from='client.? 10.20.193.158:0/3631714317' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:59:04.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:03 trial099 ceph-mon[27808]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:59:04.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:03 trial099 ceph-mon[27808]: Cluster is now healthy 2026-02-13T03:59:04.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:03 trial092 ceph-mon[23047]: purged_snaps scrub starts 2026-02-13T03:59:04.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:03 trial092 ceph-mon[23047]: purged_snaps scrub ok 2026-02-13T03:59:04.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:03 trial092 ceph-mon[23047]: pgmap v17: 0 pgs: ; 0 B data, 26 MiB used, 700 GiB / 700 GiB avail 2026-02-13T03:59:04.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:03 trial092 ceph-mon[23047]: from='client.? 10.20.193.158:0/3631714317' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:59:04.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:03 trial092 ceph-mon[23047]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:59:04.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:03 trial092 ceph-mon[23047]: Cluster is now healthy 2026-02-13T03:59:05.122 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:04 trial158 ceph-mon[27763]: pgmap v20: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:59:05.122 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:04 trial158 ceph-mon[27763]: osdmap e13: 3 total, 2 up, 3 in 2026-02-13T03:59:05.122 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:04 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:59:05.122 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:04 trial158 ceph-mon[27763]: pgmap v22: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:59:05.122 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:04 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:05.122 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:04 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:05.122 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:04 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:05.122 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:04 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:05.122 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:04 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:05.122 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:04 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:05.123 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:04 trial158 ceph-mon[27763]: pgmap v23: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:59:05.123 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:04 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:05.123 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:04 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:05.123 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:04 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:05.123 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:04 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-13T03:59:05.123 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:04 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:05.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:04 trial092 ceph-mon[23047]: pgmap v20: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:59:05.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:04 trial092 ceph-mon[23047]: osdmap e13: 3 total, 2 up, 3 in 2026-02-13T03:59:05.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:04 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:59:05.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:04 trial092 ceph-mon[23047]: pgmap v22: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:59:05.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:04 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:05.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:04 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:05.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:04 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:05.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:04 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:05.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:04 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:05.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:04 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:05.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:04 trial092 ceph-mon[23047]: pgmap v23: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:59:05.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:04 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:05.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:04 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:05.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:04 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:05.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:04 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-13T03:59:05.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:04 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:05.365 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:04 trial099 ceph-mon[27808]: pgmap v20: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:59:05.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:04 trial099 ceph-mon[27808]: osdmap e13: 3 total, 2 up, 3 in 2026-02-13T03:59:05.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:04 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:59:05.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:04 trial099 ceph-mon[27808]: pgmap v22: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:59:05.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:04 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:05.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:04 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:05.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:04 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:05.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:04 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:05.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:04 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:05.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:04 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:05.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:04 trial099 ceph-mon[27808]: pgmap v23: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:59:05.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:04 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:05.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:04 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:05.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:04 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:05.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:04 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2026-02-13T03:59:05.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:04 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:06.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:05 trial092 ceph-mon[23047]: pgmap v24: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:59:06.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:05 trial158 ceph-mon[27763]: pgmap v24: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:59:06.365 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:05 trial099 ceph-mon[27808]: pgmap v24: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:59:07.176 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:06 trial158 ceph-mon[27763]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:59:07.176 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:06 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:07.176 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:06 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:07.176 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:06 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:07.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:06 trial092 ceph-mon[23047]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:59:07.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:06 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:07.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:06 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:07.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:06 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:07.365 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:06 trial099 ceph-mon[27808]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:59:07.365 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:06 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:07.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:06 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:07.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:06 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:07.775 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:07.773+0000 7f11effff6c0 1 -- 10.20.193.158:0/1001134043 <== mgr.14187 v2:10.20.193.92:6800/4191527999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f11f80f5b30 con 0x7f11c00b5640 2026-02-13T03:59:07.775 INFO:teuthology.orchestra.run.trial158.stdout:Created osd(s) 2 on host 'trial158' 2026-02-13T03:59:07.777 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:07.775+0000 7f11fd3046c0 1 -- 10.20.193.158:0/1001134043 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f11c00b5640 msgr2=0x7f11c00d5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:59:07.777 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:07.775+0000 7f11fd3046c0 1 --2- 10.20.193.158:0/1001134043 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f11c00b5640 0x7f11c00d5af0 secure :-1 s=READY pgs=52 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f11dc0072f0 tx=0x7f11dc005ae0 comp rx=0 tx=0).stop 2026-02-13T03:59:07.777 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:07.775+0000 7f11fd3046c0 1 -- 10.20.193.158:0/1001134043 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f11f810f200 msgr2=0x7f11f80f49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:59:07.777 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:07.775+0000 7f11fd3046c0 1 --2- 10.20.193.158:0/1001134043 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f11f810f200 0x7f11f80f49e0 secure :-1 s=READY pgs=28 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f11e400b6f0 tx=0x7f11e400bbc0 comp rx=0 tx=0).stop 2026-02-13T03:59:07.778 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:07.775+0000 7f11fd3046c0 1 -- 10.20.193.158:0/1001134043 shutdown_connections 2026-02-13T03:59:07.778 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:07.775+0000 7f11fd3046c0 1 --2- 10.20.193.158:0/1001134043 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f11c00b5640 0x7f11c00d5af0 unknown :-1 s=CLOSED pgs=52 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:07.778 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:07.775+0000 7f11fd3046c0 1 --2- 10.20.193.158:0/1001134043 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f11f8115410 0x7f11f8175cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:07.778 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:07.775+0000 7f11fd3046c0 1 --2- 10.20.193.158:0/1001134043 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f11f80f5010 0x7f11f80fa2e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:07.778 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:07.775+0000 7f11fd3046c0 1 --2- 10.20.193.158:0/1001134043 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f11f810f200 0x7f11f80f49e0 unknown :-1 s=CLOSED pgs=28 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:07.778 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:07.775+0000 7f11fd3046c0 1 -- 10.20.193.158:0/1001134043 >> 10.20.193.158:0/1001134043 conn(0x7f11f80ecb00 msgr2=0x7f11f8113a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:59:07.778 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:07.775+0000 7f11fd3046c0 1 -- 10.20.193.158:0/1001134043 shutdown_connections 2026-02-13T03:59:07.778 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:07.775+0000 7f11fd3046c0 1 -- 10.20.193.158:0/1001134043 wait complete. 2026-02-13T03:59:07.817 DEBUG:teuthology.orchestra.run.trial158:osd.2> sudo journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@osd.2.service 2026-02-13T03:59:07.819 INFO:tasks.cephadm:Deploying osd.3 on trial092 with /dev/vg_nvme/lv_3... 2026-02-13T03:59:07.819 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-13T03:59:08.006 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:59:08.387 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:08 trial092 ceph-mon[23047]: pgmap v25: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:59:08.387 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:08 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:08.387 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:08 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:08.387 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:08 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:08.387 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:08 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:08.387 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:08 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:08.387 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:08 trial092 ceph-mon[23047]: pgmap v26: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:59:08.387 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:08 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:08.387 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:08 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:08.387 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:08 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:08.387 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:08 trial092 ceph-mon[23047]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T03:59:08.388 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:08 trial092 ceph-mon[23047]: from='osd.2 [v2:10.20.193.158:6800/676925869,v1:10.20.193.158:6801/676925869]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T03:59:08.388 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:08 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:08.388 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:08 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:08.388 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:08 trial092 ceph-mon[23047]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:59:08.388 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:08 trial092 ceph-mon[23047]: Cluster is now healthy 2026-02-13T03:59:08.388 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:08 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:08.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:08 trial099 ceph-mon[27808]: pgmap v25: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:59:08.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:08 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:08.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:08 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:08.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:08 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:08.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:08 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:08.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:08 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:08.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:08 trial099 ceph-mon[27808]: pgmap v26: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:59:08.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:08 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:08.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:08 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:08.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:08 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:08.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:08 trial099 ceph-mon[27808]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T03:59:08.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:08 trial099 ceph-mon[27808]: from='osd.2 [v2:10.20.193.158:6800/676925869,v1:10.20.193.158:6801/676925869]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T03:59:08.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:08 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:08.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:08 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:08.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:08 trial099 ceph-mon[27808]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:59:08.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:08 trial099 ceph-mon[27808]: Cluster is now healthy 2026-02-13T03:59:08.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:08 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:08.640 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:08 trial158 ceph-mon[27763]: pgmap v25: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:59:08.640 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:08 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:08.640 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:08 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:08.640 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:08 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:08.640 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:08 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:08.640 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:08 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:08.640 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:08 trial158 ceph-mon[27763]: pgmap v26: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:59:08.640 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:08 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:08.640 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:08 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:08.640 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:08 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:08.641 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:08 trial158 ceph-mon[27763]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T03:59:08.641 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:08 trial158 ceph-mon[27763]: from='osd.2 [v2:10.20.193.158:6800/676925869,v1:10.20.193.158:6801/676925869]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2026-02-13T03:59:08.641 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:08 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:08.641 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:08 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:08.641 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:08 trial158 ceph-mon[27763]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:59:08.641 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:08 trial158 ceph-mon[27763]: Cluster is now healthy 2026-02-13T03:59:08.641 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:08 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:08.895 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T03:59:08.918 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph orch daemon add osd trial092:vg_nvme/lv_3 --skip-validation 2026-02-13T03:59:09.106 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:59:09.303 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:09.300+0000 7f8edf5776c0 1 -- 10.20.193.92:0/1508082047 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8ee0118f30 msgr2=0x7f8ee0119380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:59:09.303 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:09.300+0000 7f8edf5776c0 1 --2- 10.20.193.92:0/1508082047 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8ee0118f30 0x7f8ee0119380 secure :-1 s=READY pgs=37 gs=2 cs=0 l=1 c_cookie=31969491350703917 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ec8009970 tx=0x7f8ec802ed10 comp rx=0 tx=0).stop 2026-02-13T03:59:09.303 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:09.301+0000 7f8edf5776c0 1 -- 10.20.193.92:0/1508082047 shutdown_connections 2026-02-13T03:59:09.303 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:09.301+0000 7f8edf5776c0 1 --2- 10.20.193.92:0/1508082047 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8ee0118f30 0x7f8ee0119380 unknown :-1 s=CLOSED pgs=37 gs=2 cs=0 l=1 c_cookie=31969491350703917 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:09.303 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:09.301+0000 7f8edf5776c0 1 --2- 10.20.193.92:0/1508082047 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8ee01199a0 0x7f8ee0116df0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:09.303 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:09.301+0000 7f8edf5776c0 1 --2- 10.20.193.92:0/1508082047 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f8ee011b3f0 0x7f8ee011b7c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:09.303 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:09.301+0000 7f8edf5776c0 1 -- 10.20.193.92:0/1508082047 >> 10.20.193.92:0/1508082047 conn(0x7f8ee005b290 msgr2=0x7f8ee005b690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:59:09.304 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:09.301+0000 7f8edf5776c0 1 -- 10.20.193.92:0/1508082047 shutdown_connections 2026-02-13T03:59:09.304 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:09.301+0000 7f8edf5776c0 1 -- 10.20.193.92:0/1508082047 wait complete. 2026-02-13T03:59:09.304 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:09.301+0000 7f8edf5776c0 1 Processor -- start 2026-02-13T03:59:09.304 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:09.301+0000 7f8edf5776c0 1 -- start start 2026-02-13T03:59:09.304 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:09.302+0000 7f8edf5776c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8ee0118f30 0x7f8ee00fda50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:59:09.305 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:09.302+0000 7f8edf5776c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f8ee01199a0 0x7f8ee00fdf90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:59:09.305 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:09.302+0000 7f8edf5776c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8ee011b3f0 0x7f8ee0103350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:59:09.305 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:09.302+0000 7f8edf5776c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee01039a0 con 0x7f8ee011b3f0 2026-02-13T03:59:09.305 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:09.302+0000 7f8edf5776c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee0103b10 con 0x7f8ee0118f30 2026-02-13T03:59:09.305 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:09.302+0000 7f8edf5776c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee0103cd0 con 0x7f8ee01199a0 2026-02-13T03:59:09.305 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:09.302+0000 7f8eddd746c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f8ee01199a0 0x7f8ee00fdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:59:09.305 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:09.302+0000 7f8ede5756c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8ee0118f30 0x7f8ee00fda50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:59:09.305 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:09.302+0000 7f8ede5756c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8ee0118f30 0x7f8ee00fda50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:41696/0 (socket says 10.20.193.92:41696) 2026-02-13T03:59:09.305 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:09.302+0000 7f8ede5756c0 1 -- 10.20.193.92:0/1092574395 learned_addr learned my addr 10.20.193.92:0/1092574395 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T03:59:09.305 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:09.302+0000 7f8ede5756c0 1 -- 10.20.193.92:0/1092574395 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f8ee01199a0 msgr2=0x7f8ee00fdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:59:09.305 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:09.302+0000 7f8ede5756c0 1 --2- 10.20.193.92:0/1092574395 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f8ee01199a0 0x7f8ee00fdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:09.305 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:09.302+0000 7f8ede5756c0 1 -- 10.20.193.92:0/1092574395 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8ee011b3f0 msgr2=0x7f8ee0103350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:59:09.305 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:09.302+0000 7f8ede5756c0 1 --2- 10.20.193.92:0/1092574395 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8ee011b3f0 0x7f8ee0103350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:09.305 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:09.302+0000 7f8ede5756c0 1 -- 10.20.193.92:0/1092574395 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ec8009590 con 0x7f8ee0118f30 2026-02-13T03:59:09.305 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:09.302+0000 7f8ede5756c0 1 --2- 10.20.193.92:0/1092574395 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8ee0118f30 0x7f8ee00fda50 secure :-1 s=READY pgs=38 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ed4009490 tx=0x7f8ed400bc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:59:09.306 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:09.302+0000 7f8ec77fe6c0 1 -- 10.20.193.92:0/1092574395 <== mon.2 v2:10.20.193.99:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8ed4004a80 con 0x7f8ee0118f30 2026-02-13T03:59:09.306 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:09.302+0000 7f8ec77fe6c0 1 -- 10.20.193.92:0/1092574395 <== mon.2 v2:10.20.193.99:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f8ed4009030 con 0x7f8ee0118f30 2026-02-13T03:59:09.306 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:09.302+0000 7f8edf5776c0 1 -- 10.20.193.92:0/1092574395 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ee0103fb0 con 0x7f8ee0118f30 2026-02-13T03:59:09.306 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:09.302+0000 7f8ec77fe6c0 1 -- 10.20.193.92:0/1092574395 <== mon.2 v2:10.20.193.99:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8ed40071c0 con 0x7f8ee0118f30 2026-02-13T03:59:09.306 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:09.303+0000 7f8edf5776c0 1 -- 10.20.193.92:0/1092574395 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ee0104670 con 0x7f8ee0118f30 2026-02-13T03:59:09.306 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:09.303+0000 7f8edf5776c0 1 -- 10.20.193.92:0/1092574395 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ee005e670 con 0x7f8ee0118f30 2026-02-13T03:59:09.307 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:09.305+0000 7f8ec77fe6c0 1 -- 10.20.193.92:0/1092574395 <== mon.2 v2:10.20.193.99:3300/0 4 ==== mgrmap(e 14) ==== 157027+0+0 (secure 0 0 0) 0x7f8ed4004e90 con 0x7f8ee0118f30 2026-02-13T03:59:09.309 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:09.307+0000 7f8ec77fe6c0 1 --2- 10.20.193.92:0/1092574395 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f8eb80b5640 0x7f8eb80d5af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:59:09.309 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:09.307+0000 7f8ec77fe6c0 1 -- 10.20.193.92:0/1092574395 <== mon.2 v2:10.20.193.99:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2436+0+0 (secure 0 0 0) 0x7f8ed40e23a0 con 0x7f8ee0118f30 2026-02-13T03:59:09.309 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:09.307+0000 7f8ec77fe6c0 1 -- 10.20.193.92:0/1092574395 <== mon.2 v2:10.20.193.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f8ed40e27d0 con 0x7f8ee0118f30 2026-02-13T03:59:09.309 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:09.307+0000 7f8eddd746c0 1 --2- 10.20.193.92:0/1092574395 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f8eb80b5640 0x7f8eb80d5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:59:09.310 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:09.308+0000 7f8eddd746c0 1 --2- 10.20.193.92:0/1092574395 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f8eb80b5640 0x7f8eb80d5af0 secure :-1 s=READY pgs=57 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ee01043e0 tx=0x7f8ec80023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:59:09.417 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:09.415+0000 7f8edf5776c0 1 -- 10.20.193.92:0/1092574395 --> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial092:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f8ee0186160 con 0x7f8eb80b5640 2026-02-13T03:59:09.511 INFO:journalctl@ceph.osd.2.trial158.stdout:Feb 13 03:59:09 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-2[33876]: 2026-02-13T03:59:09.340+0000 7f90f8d3e6c0 -1 osd.2 0 waiting for initial osdmap 2026-02-13T03:59:09.511 INFO:journalctl@ceph.osd.2.trial158.stdout:Feb 13 03:59:09 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-2[33876]: 2026-02-13T03:59:09.343+0000 7f90f4c026c0 -1 osd.2 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T03:59:09.512 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:09 trial158 ceph-mon[27763]: pgmap v27: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:59:09.512 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:09 trial158 ceph-mon[27763]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-13T03:59:09.512 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:09 trial158 ceph-mon[27763]: osdmap e14: 3 total, 2 up, 3 in 2026-02-13T03:59:09.512 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:09 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:59:09.512 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:09 trial158 ceph-mon[27763]: from='osd.2 [v2:10.20.193.158:6800/676925869,v1:10.20.193.158:6801/676925869]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial158", "root=default"]} : dispatch 2026-02-13T03:59:09.512 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:09 trial158 ceph-mon[27763]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial158", "root=default"]} : dispatch 2026-02-13T03:59:09.512 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:09 trial158 ceph-mon[27763]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:59:09.513 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:09 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:09.513 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:09 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:09.513 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:09 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T03:59:09.513 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:09 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:09.513 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:09 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:09.513 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:09 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:09.513 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:09 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:09.513 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:09 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:09.514 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:09 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:09.514 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:09 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:09.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:09 trial099 ceph-mon[27808]: pgmap v27: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:59:09.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:09 trial099 ceph-mon[27808]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-13T03:59:09.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:09 trial099 ceph-mon[27808]: osdmap e14: 3 total, 2 up, 3 in 2026-02-13T03:59:09.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:09 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:59:09.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:09 trial099 ceph-mon[27808]: from='osd.2 [v2:10.20.193.158:6800/676925869,v1:10.20.193.158:6801/676925869]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial158", "root=default"]} : dispatch 2026-02-13T03:59:09.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:09 trial099 ceph-mon[27808]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial158", "root=default"]} : dispatch 2026-02-13T03:59:09.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:09 trial099 ceph-mon[27808]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:59:09.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:09 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:09.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:09 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:09.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:09 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T03:59:09.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:09 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:09.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:09 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:09.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:09 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:09.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:09 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:09.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:09 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:09.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:09 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:09.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:09 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:09.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:09 trial092 ceph-mon[23047]: pgmap v27: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:59:09.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:09 trial092 ceph-mon[23047]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2026-02-13T03:59:09.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:09 trial092 ceph-mon[23047]: osdmap e14: 3 total, 2 up, 3 in 2026-02-13T03:59:09.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:09 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:59:09.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:09 trial092 ceph-mon[23047]: from='osd.2 [v2:10.20.193.158:6800/676925869,v1:10.20.193.158:6801/676925869]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial158", "root=default"]} : dispatch 2026-02-13T03:59:09.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:09 trial092 ceph-mon[23047]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial158", "root=default"]} : dispatch 2026-02-13T03:59:09.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:09 trial092 ceph-mon[23047]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:59:09.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:09 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:09.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:09 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:09.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:09 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T03:59:09.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:09 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:09.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:09 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:09.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:09 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:09.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:09 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:09.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:09 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:09.685 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:09 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:09.685 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:09 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:10.345 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:10 trial092 ceph-mon[23047]: pgmap v29: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:59:10.346 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:10 trial092 ceph-mon[23047]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial158", "root=default"]}]': finished 2026-02-13T03:59:10.346 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:10 trial092 ceph-mon[23047]: osdmap e15: 3 total, 2 up, 3 in 2026-02-13T03:59:10.346 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:10 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:59:10.346 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:10 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:59:10.346 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:10 trial092 ceph-mon[23047]: from='client.24326 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial092:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:59:10.346 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:10 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:10.346 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:10 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:10.346 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:10 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:10.346 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:10 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:10.347 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:10 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:10.347 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:10 trial092 ceph-mon[23047]: pgmap v31: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:59:10.347 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:10 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:10.347 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:10 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:10.347 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:10 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:10.347 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:10 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:10.347 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:10 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:10.347 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:10 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:10.347 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:10 trial092 ceph-mon[23047]: pgmap v32: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:59:10.347 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:10 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:10.347 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:10 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:10.347 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:10 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:10.348 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:10 trial092 ceph-mon[23047]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:59:10.348 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:10 trial092 ceph-mon[23047]: Cluster is now healthy 2026-02-13T03:59:10.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:10 trial099 ceph-mon[27808]: pgmap v29: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:59:10.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:10 trial099 ceph-mon[27808]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial158", "root=default"]}]': finished 2026-02-13T03:59:10.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:10 trial099 ceph-mon[27808]: osdmap e15: 3 total, 2 up, 3 in 2026-02-13T03:59:10.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:10 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:59:10.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:10 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:59:10.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:10 trial099 ceph-mon[27808]: from='client.24326 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial092:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:59:10.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:10 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:10.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:10 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:10.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:10 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:10.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:10 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:10.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:10 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:10.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:10 trial099 ceph-mon[27808]: pgmap v31: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:59:10.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:10 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:10.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:10 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:10.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:10 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:10.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:10 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:10.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:10 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:10.618 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:10 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:10.618 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:10 trial099 ceph-mon[27808]: pgmap v32: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:59:10.618 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:10 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:10.618 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:10 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:10.618 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:10 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:10.618 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:10 trial099 ceph-mon[27808]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:59:10.618 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:10 trial099 ceph-mon[27808]: Cluster is now healthy 2026-02-13T03:59:10.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:10 trial158 ceph-mon[27763]: pgmap v29: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:59:10.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:10 trial158 ceph-mon[27763]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.6836, "args": ["host=trial158", "root=default"]}]': finished 2026-02-13T03:59:10.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:10 trial158 ceph-mon[27763]: osdmap e15: 3 total, 2 up, 3 in 2026-02-13T03:59:10.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:10 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:59:10.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:10 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:59:10.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:10 trial158 ceph-mon[27763]: from='client.24326 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial092:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:59:10.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:10 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:10.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:10 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:10.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:10 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:10.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:10 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:10.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:10 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:10.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:10 trial158 ceph-mon[27763]: pgmap v31: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:59:10.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:10 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:10.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:10 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:10.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:10 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:10.831 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:10 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:10.831 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:10 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:10.831 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:10 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:10.831 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:10 trial158 ceph-mon[27763]: pgmap v32: 0 pgs: ; 0 B data, 53 MiB used, 1.4 TiB / 1.4 TiB avail 2026-02-13T03:59:10.831 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:10 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:10.831 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:10 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:10.831 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:10 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:10.831 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:10 trial158 ceph-mon[27763]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:59:10.831 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:10 trial158 ceph-mon[27763]: Cluster is now healthy 2026-02-13T03:59:11.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:11 trial099 ceph-mon[27808]: purged_snaps scrub starts 2026-02-13T03:59:11.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:11 trial099 ceph-mon[27808]: purged_snaps scrub ok 2026-02-13T03:59:11.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:11 trial099 ceph-mon[27808]: osd.2 [v2:10.20.193.158:6800/676925869,v1:10.20.193.158:6801/676925869] boot 2026-02-13T03:59:11.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:11 trial099 ceph-mon[27808]: osdmap e16: 3 total, 3 up, 3 in 2026-02-13T03:59:11.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:11 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:59:11.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:11 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/3688112421' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "91080154-0bd8-4e06-832e-1590d7784229"} : dispatch 2026-02-13T03:59:11.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:11 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/3688112421' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "91080154-0bd8-4e06-832e-1590d7784229"}]': finished 2026-02-13T03:59:11.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:11 trial099 ceph-mon[27808]: osdmap e17: 4 total, 3 up, 4 in 2026-02-13T03:59:11.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:11 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:59:11.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:11 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/2319347552' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:59:11.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:11 trial092 ceph-mon[23047]: purged_snaps scrub starts 2026-02-13T03:59:11.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:11 trial092 ceph-mon[23047]: purged_snaps scrub ok 2026-02-13T03:59:11.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:11 trial092 ceph-mon[23047]: osd.2 [v2:10.20.193.158:6800/676925869,v1:10.20.193.158:6801/676925869] boot 2026-02-13T03:59:11.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:11 trial092 ceph-mon[23047]: osdmap e16: 3 total, 3 up, 3 in 2026-02-13T03:59:11.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:11 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:59:11.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:11 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/3688112421' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "91080154-0bd8-4e06-832e-1590d7784229"} : dispatch 2026-02-13T03:59:11.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:11 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/3688112421' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "91080154-0bd8-4e06-832e-1590d7784229"}]': finished 2026-02-13T03:59:11.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:11 trial092 ceph-mon[23047]: osdmap e17: 4 total, 3 up, 4 in 2026-02-13T03:59:11.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:11 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:59:11.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:11 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/2319347552' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:59:11.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:11 trial158 ceph-mon[27763]: purged_snaps scrub starts 2026-02-13T03:59:11.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:11 trial158 ceph-mon[27763]: purged_snaps scrub ok 2026-02-13T03:59:11.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:11 trial158 ceph-mon[27763]: osd.2 [v2:10.20.193.158:6800/676925869,v1:10.20.193.158:6801/676925869] boot 2026-02-13T03:59:11.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:11 trial158 ceph-mon[27763]: osdmap e16: 3 total, 3 up, 3 in 2026-02-13T03:59:11.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:11 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2026-02-13T03:59:11.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:11 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/3688112421' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "91080154-0bd8-4e06-832e-1590d7784229"} : dispatch 2026-02-13T03:59:11.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:11 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/3688112421' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "91080154-0bd8-4e06-832e-1590d7784229"}]': finished 2026-02-13T03:59:11.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:11 trial158 ceph-mon[27763]: osdmap e17: 4 total, 3 up, 4 in 2026-02-13T03:59:11.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:11 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:59:11.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:11 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/2319347552' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:59:12.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:12 trial092 ceph-mon[23047]: pgmap v35: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:59:12.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:12 trial092 ceph-mon[23047]: osdmap e18: 4 total, 3 up, 4 in 2026-02-13T03:59:12.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:12 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:59:12.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:12 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-13T03:59:13.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:12 trial158 ceph-mon[27763]: pgmap v35: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:59:13.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:12 trial158 ceph-mon[27763]: osdmap e18: 4 total, 3 up, 4 in 2026-02-13T03:59:13.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:12 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:59:13.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:12 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-13T03:59:13.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:12 trial099 ceph-mon[27808]: pgmap v35: 0 pgs: ; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:59:13.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:12 trial099 ceph-mon[27808]: osdmap e18: 4 total, 3 up, 4 in 2026-02-13T03:59:13.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:12 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:59:13.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:12 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2026-02-13T03:59:13.830 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:13 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-13T03:59:13.830 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:13 trial092 ceph-mon[23047]: osdmap e19: 4 total, 3 up, 4 in 2026-02-13T03:59:13.830 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:13 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:59:13.830 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:13 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-13T03:59:13.831 INFO:journalctl@ceph.osd.0.trial092.stdout:Feb 13 03:59:13 trial092 sudo[40863]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-13T03:59:13.831 INFO:journalctl@ceph.osd.0.trial092.stdout:Feb 13 03:59:13 trial092 sudo[40863]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T03:59:13.831 INFO:journalctl@ceph.osd.0.trial092.stdout:Feb 13 03:59:13 trial092 sudo[40863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T03:59:13.831 INFO:journalctl@ceph.osd.0.trial092.stdout:Feb 13 03:59:13 trial092 sudo[40863]: pam_unix(sudo:session): session closed for user root 2026-02-13T03:59:13.831 INFO:journalctl@ceph.osd.0.trial092.stdout:Feb 13 03:59:13 trial092 sudo[40868]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-13T03:59:13.831 INFO:journalctl@ceph.osd.0.trial092.stdout:Feb 13 03:59:13 trial092 sudo[40868]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T03:59:13.831 INFO:journalctl@ceph.osd.0.trial092.stdout:Feb 13 03:59:13 trial092 sudo[40868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T03:59:13.831 INFO:journalctl@ceph.osd.0.trial092.stdout:Feb 13 03:59:13 trial092 sudo[40868]: pam_unix(sudo:session): session closed for user root 2026-02-13T03:59:13.991 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:13 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-13T03:59:13.991 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:13 trial158 ceph-mon[27763]: osdmap e19: 4 total, 3 up, 4 in 2026-02-13T03:59:13.991 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:13 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:59:13.992 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:13 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-13T03:59:13.992 INFO:journalctl@ceph.osd.2.trial158.stdout:Feb 13 03:59:13 trial158 sudo[37033]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-13T03:59:13.992 INFO:journalctl@ceph.osd.2.trial158.stdout:Feb 13 03:59:13 trial158 sudo[37033]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T03:59:13.992 INFO:journalctl@ceph.osd.2.trial158.stdout:Feb 13 03:59:13 trial158 sudo[37033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T03:59:13.992 INFO:journalctl@ceph.osd.2.trial158.stdout:Feb 13 03:59:13 trial158 sudo[37033]: pam_unix(sudo:session): session closed for user root 2026-02-13T03:59:13.992 INFO:journalctl@ceph.osd.2.trial158.stdout:Feb 13 03:59:13 trial158 sudo[37037]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-13T03:59:13.992 INFO:journalctl@ceph.osd.2.trial158.stdout:Feb 13 03:59:13 trial158 sudo[37037]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T03:59:13.993 INFO:journalctl@ceph.osd.2.trial158.stdout:Feb 13 03:59:13 trial158 sudo[37037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T03:59:13.993 INFO:journalctl@ceph.osd.2.trial158.stdout:Feb 13 03:59:13 trial158 sudo[37037]: pam_unix(sudo:session): session closed for user root 2026-02-13T03:59:14.017 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:13 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2026-02-13T03:59:14.017 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:13 trial099 ceph-mon[27808]: osdmap e19: 4 total, 3 up, 4 in 2026-02-13T03:59:14.018 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:13 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:59:14.018 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:13 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2026-02-13T03:59:14.018 INFO:journalctl@ceph.osd.1.trial099.stdout:Feb 13 03:59:13 trial099 sudo[37109]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme2n1 2026-02-13T03:59:14.018 INFO:journalctl@ceph.osd.1.trial099.stdout:Feb 13 03:59:13 trial099 sudo[37109]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T03:59:14.018 INFO:journalctl@ceph.osd.1.trial099.stdout:Feb 13 03:59:13 trial099 sudo[37109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T03:59:14.018 INFO:journalctl@ceph.osd.1.trial099.stdout:Feb 13 03:59:13 trial099 sudo[37109]: pam_unix(sudo:session): session closed for user root 2026-02-13T03:59:14.019 INFO:journalctl@ceph.osd.1.trial099.stdout:Feb 13 03:59:13 trial099 sudo[37113]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme2n1 2026-02-13T03:59:14.019 INFO:journalctl@ceph.osd.1.trial099.stdout:Feb 13 03:59:13 trial099 sudo[37113]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T03:59:14.019 INFO:journalctl@ceph.osd.1.trial099.stdout:Feb 13 03:59:13 trial099 sudo[37113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T03:59:14.019 INFO:journalctl@ceph.osd.1.trial099.stdout:Feb 13 03:59:13 trial099 sudo[37113]: pam_unix(sudo:session): session closed for user root 2026-02-13T03:59:14.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:13 trial092 sudo[40885]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme1n1 2026-02-13T03:59:14.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:13 trial092 sudo[40885]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T03:59:14.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:13 trial092 sudo[40885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T03:59:14.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:13 trial092 sudo[40885]: pam_unix(sudo:session): session closed for user root 2026-02-13T03:59:14.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:13 trial092 sudo[40889]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme1n1 2026-02-13T03:59:14.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:13 trial092 sudo[40889]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T03:59:14.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:13 trial092 sudo[40889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T03:59:14.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:13 trial092 sudo[40889]: pam_unix(sudo:session): session closed for user root 2026-02-13T03:59:14.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:13 trial158 sudo[37041]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2026-02-13T03:59:14.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:13 trial158 sudo[37041]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T03:59:14.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:13 trial158 sudo[37041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T03:59:14.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:13 trial158 sudo[37041]: pam_unix(sudo:session): session closed for user root 2026-02-13T03:59:14.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:14 trial158 sudo[37045]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme0n1 2026-02-13T03:59:14.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:14 trial158 sudo[37045]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T03:59:14.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:14 trial158 sudo[37045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T03:59:14.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:14 trial158 sudo[37045]: pam_unix(sudo:session): session closed for user root 2026-02-13T03:59:14.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:14 trial099 sudo[37117]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2026-02-13T03:59:14.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:14 trial099 sudo[37117]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T03:59:14.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:14 trial099 sudo[37117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T03:59:14.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:14 trial099 sudo[37117]: pam_unix(sudo:session): session closed for user root 2026-02-13T03:59:14.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:14 trial099 sudo[37121]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme mtfdkcc1t9tgp-1bk1jabyy smart-log-add --json /dev/nvme0n1 2026-02-13T03:59:14.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:14 trial099 sudo[37121]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2026-02-13T03:59:14.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:14 trial099 sudo[37121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2026-02-13T03:59:14.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:14 trial099 sudo[37121]: pam_unix(sudo:session): session closed for user root 2026-02-13T03:59:14.765 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:14 trial092 ceph-mon[23047]: pgmap v38: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:59:14.765 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:14 trial092 ceph-mon[23047]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:59:14.765 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:14 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-13T03:59:14.765 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:14 trial092 ceph-mon[23047]: osdmap e20: 4 total, 3 up, 4 in 2026-02-13T03:59:14.765 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:14 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:59:14.765 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:14 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:14.765 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:14 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:14.765 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:14 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:14.765 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:14 trial092 ceph-mon[23047]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T03:59:14.766 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:14 trial092 ceph-mon[23047]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T03:59:14.766 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:14 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:59:14.766 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:14 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:59:14.766 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:14 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:59:14.766 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:14 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-13T03:59:14.766 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:14 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:14.766 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:14 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:14.766 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:14 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:59:14.766 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:14 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:59:14.766 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:14 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:59:14.766 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:14 trial092 ceph-mon[23047]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T03:59:14.766 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:14 trial092 ceph-mon[23047]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T03:59:14.767 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:14 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:14.767 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:14 trial092 ceph-mon[23047]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T03:59:14.767 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:14 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:59:14.767 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:14 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:59:14.767 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:14 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:59:14.767 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:14 trial092 ceph-mon[23047]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T03:59:14.767 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:14 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:14.817 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:14.814+0000 7f8ec77fe6c0 1 -- 10.20.193.92:0/1092574395 <== mon.2 v2:10.20.193.99:3300/0 7 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f8ed40a60f0 con 0x7f8ee0118f30 2026-02-13T03:59:15.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:14 trial158 ceph-mon[27763]: pgmap v38: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:59:15.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:14 trial158 ceph-mon[27763]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:59:15.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:14 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-13T03:59:15.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:14 trial158 ceph-mon[27763]: osdmap e20: 4 total, 3 up, 4 in 2026-02-13T03:59:15.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:14 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:59:15.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:14 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:15.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:14 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:15.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:14 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:15.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:14 trial158 ceph-mon[27763]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T03:59:15.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:14 trial158 ceph-mon[27763]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T03:59:15.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:14 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:59:15.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:14 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:59:15.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:14 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:59:15.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:14 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-13T03:59:15.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:14 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:15.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:14 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:15.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:14 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:59:15.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:14 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:59:15.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:14 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:59:15.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:14 trial158 ceph-mon[27763]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T03:59:15.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:14 trial158 ceph-mon[27763]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T03:59:15.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:14 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:15.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:14 trial158 ceph-mon[27763]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T03:59:15.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:14 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:59:15.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:14 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:59:15.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:14 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:59:15.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:14 trial158 ceph-mon[27763]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T03:59:15.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:14 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:15.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:14 trial099 ceph-mon[27808]: pgmap v38: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:59:15.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:14 trial099 ceph-mon[27808]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:59:15.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:14 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2026-02-13T03:59:15.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:14 trial099 ceph-mon[27808]: osdmap e20: 4 total, 3 up, 4 in 2026-02-13T03:59:15.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:14 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:59:15.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:14 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:15.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:14 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:15.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:14 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:15.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:14 trial099 ceph-mon[27808]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T03:59:15.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:14 trial099 ceph-mon[27808]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T03:59:15.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:14 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:59:15.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:14 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:59:15.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:14 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:59:15.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:14 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2026-02-13T03:59:15.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:14 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:15.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:14 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:15.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:14 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:59:15.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:14 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:59:15.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:14 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:59:15.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:14 trial099 ceph-mon[27808]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T03:59:15.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:14 trial099 ceph-mon[27808]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T03:59:15.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:14 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:15.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:14 trial099 ceph-mon[27808]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2026-02-13T03:59:15.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:14 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2026-02-13T03:59:15.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:14 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2026-02-13T03:59:15.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:14 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2026-02-13T03:59:15.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:14 trial099 ceph-mon[27808]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2026-02-13T03:59:15.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:14 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:15.767 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:15 trial092 ceph-mon[23047]: osdmap e21: 4 total, 3 up, 4 in 2026-02-13T03:59:15.767 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:15 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:59:15.767 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:15 trial092 ceph-mon[23047]: mgrmap e15: x(active, since 40s), standbys: z, y 2026-02-13T03:59:16.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:15 trial158 ceph-mon[27763]: osdmap e21: 4 total, 3 up, 4 in 2026-02-13T03:59:16.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:15 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:59:16.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:15 trial158 ceph-mon[27763]: mgrmap e15: x(active, since 40s), standbys: z, y 2026-02-13T03:59:16.115 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:15 trial099 ceph-mon[27808]: osdmap e21: 4 total, 3 up, 4 in 2026-02-13T03:59:16.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:15 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:59:16.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:15 trial099 ceph-mon[27808]: mgrmap e15: x(active, since 40s), standbys: z, y 2026-02-13T03:59:16.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:16 trial092 ceph-mon[23047]: pgmap v41: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:59:17.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:16 trial158 ceph-mon[27763]: pgmap v41: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:59:17.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:16 trial099 ceph-mon[27808]: pgmap v41: 1 pgs: 1 creating+peering; 0 B data, 79 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:59:17.679 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:17 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:17.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:17 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:17.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:17 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:18.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:17 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:18.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:17 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:18.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:17 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:18.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:17 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:18.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:17 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:18.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:17 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:18.774 INFO:teuthology.orchestra.run.trial092.stdout:Created osd(s) 3 on host 'trial092' 2026-02-13T03:59:18.774 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:18.771+0000 7f8ec77fe6c0 1 -- 10.20.193.92:0/1092574395 <== mgr.14187 v2:10.20.193.92:6800/4191527999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f8ee0186160 con 0x7f8eb80b5640 2026-02-13T03:59:18.776 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:18.774+0000 7f8edf5776c0 1 -- 10.20.193.92:0/1092574395 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f8eb80b5640 msgr2=0x7f8eb80d5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:59:18.776 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:18.774+0000 7f8edf5776c0 1 --2- 10.20.193.92:0/1092574395 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f8eb80b5640 0x7f8eb80d5af0 secure :-1 s=READY pgs=57 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ee01043e0 tx=0x7f8ec80023a0 comp rx=0 tx=0).stop 2026-02-13T03:59:18.776 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:18.774+0000 7f8edf5776c0 1 -- 10.20.193.92:0/1092574395 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8ee0118f30 msgr2=0x7f8ee00fda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:59:18.776 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:18.774+0000 7f8edf5776c0 1 --2- 10.20.193.92:0/1092574395 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8ee0118f30 0x7f8ee00fda50 secure :-1 s=READY pgs=38 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ed4009490 tx=0x7f8ed400bc50 comp rx=0 tx=0).stop 2026-02-13T03:59:18.777 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:18.774+0000 7f8edf5776c0 1 -- 10.20.193.92:0/1092574395 shutdown_connections 2026-02-13T03:59:18.777 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:18.774+0000 7f8edf5776c0 1 --2- 10.20.193.92:0/1092574395 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8ee011b3f0 0x7f8ee0103350 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:18.778 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:18.774+0000 7f8edf5776c0 1 --2- 10.20.193.92:0/1092574395 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f8ee01199a0 0x7f8ee00fdf90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:18.778 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:18.774+0000 7f8edf5776c0 1 --2- 10.20.193.92:0/1092574395 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f8eb80b5640 0x7f8eb80d5af0 unknown :-1 s=CLOSED pgs=57 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:18.778 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:18.774+0000 7f8edf5776c0 1 --2- 10.20.193.92:0/1092574395 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8ee0118f30 0x7f8ee00fda50 unknown :-1 s=CLOSED pgs=38 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:18.778 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:18.774+0000 7f8edf5776c0 1 -- 10.20.193.92:0/1092574395 >> 10.20.193.92:0/1092574395 conn(0x7f8ee005b290 msgr2=0x7f8ee00f82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:59:18.778 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:18.774+0000 7f8edf5776c0 1 -- 10.20.193.92:0/1092574395 shutdown_connections 2026-02-13T03:59:18.778 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:18.774+0000 7f8edf5776c0 1 -- 10.20.193.92:0/1092574395 wait complete. 2026-02-13T03:59:18.875 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:18 trial092 ceph-mon[23047]: pgmap v42: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:59:18.875 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:18 trial092 ceph-mon[23047]: from='osd.3 [v2:10.20.193.92:6810/4168983230,v1:10.20.193.92:6811/4168983230]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-13T03:59:18.875 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:18 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:18.875 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:18 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:18.876 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:18 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:18.876 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:18 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:18.876 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:18 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:18.876 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:18 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:18.876 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:18 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:18.876 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:18 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:18.879 DEBUG:teuthology.orchestra.run.trial092:osd.3> sudo journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@osd.3.service 2026-02-13T03:59:18.883 INFO:tasks.cephadm:Deploying osd.4 on trial099 with /dev/vg_nvme/lv_3... 2026-02-13T03:59:18.883 DEBUG:teuthology.orchestra.run.trial099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-13T03:59:19.004 INFO:teuthology.orchestra.run.trial099.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.b/config 2026-02-13T03:59:19.027 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:18 trial099 ceph-mon[27808]: pgmap v42: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:59:19.027 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:18 trial099 ceph-mon[27808]: from='osd.3 [v2:10.20.193.92:6810/4168983230,v1:10.20.193.92:6811/4168983230]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-13T03:59:19.027 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:18 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:19.027 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:18 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:19.028 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:18 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:19.028 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:18 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:19.028 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:18 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:19.028 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:18 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:19.028 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:18 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:19.028 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:18 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:19.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:18 trial158 ceph-mon[27763]: pgmap v42: 1 pgs: 1 creating+peering; 0 B data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:59:19.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:18 trial158 ceph-mon[27763]: from='osd.3 [v2:10.20.193.92:6810/4168983230,v1:10.20.193.92:6811/4168983230]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2026-02-13T03:59:19.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:18 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:19.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:18 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:19.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:18 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:19.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:18 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:19.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:18 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:19.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:18 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:19.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:18 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:19.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:18 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:19.467 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-13T03:59:19.483 DEBUG:teuthology.orchestra.run.trial099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph orch daemon add osd trial099:vg_nvme/lv_3 --skip-validation 2026-02-13T03:59:19.601 INFO:teuthology.orchestra.run.trial099.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.b/config 2026-02-13T03:59:19.719 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:19.715+0000 7f1870a346c0 1 -- 10.20.193.99:0/111609540 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f186c115410 msgr2=0x7f186c175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:59:19.719 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:19.715+0000 7f1870a346c0 1 --2- 10.20.193.99:0/111609540 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f186c115410 0x7f186c175db0 secure :-1 s=READY pgs=40 gs=1 cs=0 l=1 c_cookie=17594058671227145289 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f185c00aa40 tx=0x7f185c02fde0 comp rx=0 tx=0).stop 2026-02-13T03:59:19.720 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:19.715+0000 7f1870a346c0 1 -- 10.20.193.99:0/111609540 shutdown_connections 2026-02-13T03:59:19.720 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:19.715+0000 7f1870a346c0 1 --2- 10.20.193.99:0/111609540 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f186c115410 0x7f186c175db0 unknown :-1 s=CLOSED pgs=40 gs=1 cs=0 l=1 c_cookie=17594058671227145289 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:19.720 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:19.715+0000 7f1870a346c0 1 --2- 10.20.193.99:0/111609540 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f186c10fbf0 0x7f186c114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:19.720 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:19.715+0000 7f1870a346c0 1 --2- 10.20.193.99:0/111609540 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f186c10f200 0x7f186c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:19.720 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:19.715+0000 7f1870a346c0 1 -- 10.20.193.99:0/111609540 >> 10.20.193.99:0/111609540 conn(0x7f186c0ecb00 msgr2=0x7f186c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:59:19.720 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:19.715+0000 7f1870a346c0 1 -- 10.20.193.99:0/111609540 shutdown_connections 2026-02-13T03:59:19.720 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:19.715+0000 7f1870a346c0 1 -- 10.20.193.99:0/111609540 wait complete. 2026-02-13T03:59:19.720 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:19.715+0000 7f1870a346c0 1 Processor -- start 2026-02-13T03:59:19.720 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:19.715+0000 7f1870a346c0 1 -- start start 2026-02-13T03:59:19.721 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:19.715+0000 7f1870a346c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f186c10f200 0x7f186c11cf50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:59:19.721 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:19.715+0000 7f1870a346c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f186c115410 0x7f186c11d490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:59:19.721 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:19.715+0000 7f1870a346c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f186c122850 0x7f186c122cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:59:19.721 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:19.715+0000 7f1870a346c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f186c123260 con 0x7f186c122850 2026-02-13T03:59:19.721 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:19.715+0000 7f1870a346c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f186c1233d0 con 0x7f186c10f200 2026-02-13T03:59:19.721 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:19.715+0000 7f1870a346c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f186c123590 con 0x7f186c115410 2026-02-13T03:59:19.721 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:19.715+0000 7f186a5756c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f186c10f200 0x7f186c11cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:59:19.721 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:19.715+0000 7f186a5756c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f186c10f200 0x7f186c11cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.99:56172/0 (socket says 10.20.193.99:56172) 2026-02-13T03:59:19.721 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:19.715+0000 7f186a5756c0 1 -- 10.20.193.99:0/4124304213 learned_addr learned my addr 10.20.193.99:0/4124304213 (peer_addr_for_me v2:10.20.193.99:0/0) 2026-02-13T03:59:19.722 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:19.716+0000 7f1869d746c0 1 --2- 10.20.193.99:0/4124304213 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f186c115410 0x7f186c11d490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:59:19.722 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:19.716+0000 7f186ad766c0 1 --2- 10.20.193.99:0/4124304213 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f186c122850 0x7f186c122cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:59:19.722 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:19.716+0000 7f186a5756c0 1 -- 10.20.193.99:0/4124304213 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f186c115410 msgr2=0x7f186c11d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:59:19.722 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:19.716+0000 7f186a5756c0 1 --2- 10.20.193.99:0/4124304213 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f186c115410 0x7f186c11d490 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:19.722 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:19.716+0000 7f186a5756c0 1 -- 10.20.193.99:0/4124304213 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f186c122850 msgr2=0x7f186c122cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:59:19.722 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:19.716+0000 7f186a5756c0 1 --2- 10.20.193.99:0/4124304213 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f186c122850 0x7f186c122cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:19.722 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:19.716+0000 7f186a5756c0 1 -- 10.20.193.99:0/4124304213 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f185c00a660 con 0x7f186c10f200 2026-02-13T03:59:19.722 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:19.716+0000 7f186a5756c0 1 --2- 10.20.193.99:0/4124304213 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f186c10f200 0x7f186c11cf50 secure :-1 s=READY pgs=41 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f185800b6c0 tx=0x7f185800bb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:59:19.722 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:19.716+0000 7f18637fe6c0 1 -- 10.20.193.99:0/4124304213 <== mon.2 v2:10.20.193.99:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f18580044a0 con 0x7f186c10f200 2026-02-13T03:59:19.723 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:19.716+0000 7f18637fe6c0 1 -- 10.20.193.99:0/4124304213 <== mon.2 v2:10.20.193.99:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f185800be50 con 0x7f186c10f200 2026-02-13T03:59:19.723 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:19.716+0000 7f18637fe6c0 1 -- 10.20.193.99:0/4124304213 <== mon.2 v2:10.20.193.99:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f185800e070 con 0x7f186c10f200 2026-02-13T03:59:19.723 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:19.716+0000 7f1870a346c0 1 -- 10.20.193.99:0/4124304213 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f186c163a40 con 0x7f186c10f200 2026-02-13T03:59:19.723 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:19.716+0000 7f1870a346c0 1 -- 10.20.193.99:0/4124304213 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f186c163ed0 con 0x7f186c10f200 2026-02-13T03:59:19.723 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:19.716+0000 7f1870a346c0 1 -- 10.20.193.99:0/4124304213 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f186c1104d0 con 0x7f186c10f200 2026-02-13T03:59:19.723 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:19.717+0000 7f18637fe6c0 1 -- 10.20.193.99:0/4124304213 <== mon.2 v2:10.20.193.99:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f185800c530 con 0x7f186c10f200 2026-02-13T03:59:19.724 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:19.718+0000 7f18637fe6c0 1 --2- 10.20.193.99:0/4124304213 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f18340b56d0 0x7f18340d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:59:19.725 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:19.718+0000 7f18637fe6c0 1 -- 10.20.193.99:0/4124304213 <== mon.2 v2:10.20.193.99:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 3381+0+0 (secure 0 0 0) 0x7f18580e27f0 con 0x7f186c10f200 2026-02-13T03:59:19.725 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:19.718+0000 7f1869d746c0 1 --2- 10.20.193.99:0/4124304213 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f18340b56d0 0x7f18340d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:59:19.725 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:19.719+0000 7f1869d746c0 1 --2- 10.20.193.99:0/4124304213 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f18340b56d0 0x7f18340d5b80 secure :-1 s=READY pgs=65 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1850005980 tx=0x7f1850005910 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:59:19.725 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:19.719+0000 7f18637fe6c0 1 -- 10.20.193.99:0/4124304213 <== mon.2 v2:10.20.193.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f18580a6490 con 0x7f186c10f200 2026-02-13T03:59:19.819 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:19.817+0000 7f1870a346c0 1 -- 10.20.193.99:0/4124304213 --> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial099:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f186c10fbf0 con 0x7f18340b56d0 2026-02-13T03:59:19.964 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:19 trial092 ceph-mon[23047]: pgmap v43: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:59:19.964 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:19 trial092 ceph-mon[23047]: from='osd.3 [v2:10.20.193.92:6810/4168983230,v1:10.20.193.92:6811/4168983230]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-13T03:59:19.964 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:19 trial092 ceph-mon[23047]: osdmap e22: 4 total, 3 up, 4 in 2026-02-13T03:59:19.965 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:19 trial092 ceph-mon[23047]: from='osd.3 [v2:10.20.193.92:6810/4168983230,v1:10.20.193.92:6811/4168983230]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial092", "root=default"]} : dispatch 2026-02-13T03:59:19.965 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:19 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:59:19.965 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:19 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:19.965 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:19 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:19.965 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:19 trial092 ceph-mon[23047]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:59:19.965 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:19 trial092 ceph-mon[23047]: Cluster is now healthy 2026-02-13T03:59:19.965 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:19 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:19.965 INFO:journalctl@ceph.osd.3.trial092.stdout:Feb 13 03:59:19 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-3[41445]: 2026-02-13T03:59:19.689+0000 7f187a7556c0 -1 osd.3 0 waiting for initial osdmap 2026-02-13T03:59:19.965 INFO:journalctl@ceph.osd.3.trial092.stdout:Feb 13 03:59:19 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-3[41445]: 2026-02-13T03:59:19.694+0000 7f18726116c0 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T03:59:20.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:19 trial158 ceph-mon[27763]: pgmap v43: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:59:20.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:19 trial158 ceph-mon[27763]: from='osd.3 [v2:10.20.193.92:6810/4168983230,v1:10.20.193.92:6811/4168983230]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-13T03:59:20.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:19 trial158 ceph-mon[27763]: osdmap e22: 4 total, 3 up, 4 in 2026-02-13T03:59:20.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:19 trial158 ceph-mon[27763]: from='osd.3 [v2:10.20.193.92:6810/4168983230,v1:10.20.193.92:6811/4168983230]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial092", "root=default"]} : dispatch 2026-02-13T03:59:20.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:19 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:59:20.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:19 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:20.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:19 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:20.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:19 trial158 ceph-mon[27763]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:59:20.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:19 trial158 ceph-mon[27763]: Cluster is now healthy 2026-02-13T03:59:20.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:19 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:20.115 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:19 trial099 ceph-mon[27808]: pgmap v43: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:59:20.115 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:19 trial099 ceph-mon[27808]: from='osd.3 [v2:10.20.193.92:6810/4168983230,v1:10.20.193.92:6811/4168983230]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2026-02-13T03:59:20.115 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:19 trial099 ceph-mon[27808]: osdmap e22: 4 total, 3 up, 4 in 2026-02-13T03:59:20.115 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:19 trial099 ceph-mon[27808]: from='osd.3 [v2:10.20.193.92:6810/4168983230,v1:10.20.193.92:6811/4168983230]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial092", "root=default"]} : dispatch 2026-02-13T03:59:20.115 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:19 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:59:20.115 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:19 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:20.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:19 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:20.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:19 trial099 ceph-mon[27808]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:59:20.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:19 trial099 ceph-mon[27808]: Cluster is now healthy 2026-02-13T03:59:20.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:19 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:21.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:20 trial158 ceph-mon[27763]: pgmap v45: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:59:21.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:20 trial158 ceph-mon[27763]: from='osd.3 [v2:10.20.193.92:6810/4168983230,v1:10.20.193.92:6811/4168983230]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial092", "root=default"]}]': finished 2026-02-13T03:59:21.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:20 trial158 ceph-mon[27763]: osdmap e23: 4 total, 3 up, 4 in 2026-02-13T03:59:21.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:20 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:59:21.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:20 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:59:21.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:20 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:21.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:20 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:21.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:20 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:21.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:20 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:21.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:20 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:21.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:20 trial158 ceph-mon[27763]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:59:21.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:20 trial158 ceph-mon[27763]: from='client.? 10.20.193.99:0/3903405610' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fec31143-d966-4f9b-8021-73e24c1b4d32"} : dispatch 2026-02-13T03:59:21.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:20 trial158 ceph-mon[27763]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fec31143-d966-4f9b-8021-73e24c1b4d32"} : dispatch 2026-02-13T03:59:21.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:20 trial158 ceph-mon[27763]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fec31143-d966-4f9b-8021-73e24c1b4d32"}]': finished 2026-02-13T03:59:21.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:20 trial158 ceph-mon[27763]: osd.3 [v2:10.20.193.92:6810/4168983230,v1:10.20.193.92:6811/4168983230] boot 2026-02-13T03:59:21.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:20 trial158 ceph-mon[27763]: osdmap e24: 5 total, 4 up, 5 in 2026-02-13T03:59:21.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:20 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:59:21.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:20 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:59:21.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:20 trial099 ceph-mon[27808]: pgmap v45: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:59:21.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:20 trial099 ceph-mon[27808]: from='osd.3 [v2:10.20.193.92:6810/4168983230,v1:10.20.193.92:6811/4168983230]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial092", "root=default"]}]': finished 2026-02-13T03:59:21.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:20 trial099 ceph-mon[27808]: osdmap e23: 4 total, 3 up, 4 in 2026-02-13T03:59:21.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:20 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:59:21.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:20 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:59:21.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:20 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:21.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:20 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:21.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:20 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:21.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:20 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:21.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:20 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:21.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:20 trial099 ceph-mon[27808]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:59:21.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:20 trial099 ceph-mon[27808]: from='client.? 10.20.193.99:0/3903405610' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fec31143-d966-4f9b-8021-73e24c1b4d32"} : dispatch 2026-02-13T03:59:21.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:20 trial099 ceph-mon[27808]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fec31143-d966-4f9b-8021-73e24c1b4d32"} : dispatch 2026-02-13T03:59:21.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:20 trial099 ceph-mon[27808]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fec31143-d966-4f9b-8021-73e24c1b4d32"}]': finished 2026-02-13T03:59:21.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:20 trial099 ceph-mon[27808]: osd.3 [v2:10.20.193.92:6810/4168983230,v1:10.20.193.92:6811/4168983230] boot 2026-02-13T03:59:21.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:20 trial099 ceph-mon[27808]: osdmap e24: 5 total, 4 up, 5 in 2026-02-13T03:59:21.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:20 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:59:21.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:20 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:59:21.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:20 trial092 ceph-mon[23047]: pgmap v45: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 2.1 TiB / 2.1 TiB avail 2026-02-13T03:59:21.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:20 trial092 ceph-mon[23047]: from='osd.3 [v2:10.20.193.92:6810/4168983230,v1:10.20.193.92:6811/4168983230]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.6836, "args": ["host=trial092", "root=default"]}]': finished 2026-02-13T03:59:21.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:20 trial092 ceph-mon[23047]: osdmap e23: 4 total, 3 up, 4 in 2026-02-13T03:59:21.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:20 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:59:21.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:20 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:59:21.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:20 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:21.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:20 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:21.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:20 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:21.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:20 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:21.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:20 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:21.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:20 trial092 ceph-mon[23047]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:59:21.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:20 trial092 ceph-mon[23047]: from='client.? 10.20.193.99:0/3903405610' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fec31143-d966-4f9b-8021-73e24c1b4d32"} : dispatch 2026-02-13T03:59:21.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:20 trial092 ceph-mon[23047]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fec31143-d966-4f9b-8021-73e24c1b4d32"} : dispatch 2026-02-13T03:59:21.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:20 trial092 ceph-mon[23047]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fec31143-d966-4f9b-8021-73e24c1b4d32"}]': finished 2026-02-13T03:59:21.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:20 trial092 ceph-mon[23047]: osd.3 [v2:10.20.193.92:6810/4168983230,v1:10.20.193.92:6811/4168983230] boot 2026-02-13T03:59:21.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:20 trial092 ceph-mon[23047]: osdmap e24: 5 total, 4 up, 5 in 2026-02-13T03:59:21.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:20 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2026-02-13T03:59:21.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:20 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:59:22.074 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:21 trial099 ceph-mon[27808]: purged_snaps scrub starts 2026-02-13T03:59:22.074 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:21 trial099 ceph-mon[27808]: purged_snaps scrub ok 2026-02-13T03:59:22.074 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:21 trial099 ceph-mon[27808]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial099:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:59:22.074 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:21 trial099 ceph-mon[27808]: from='client.? 10.20.193.99:0/2051613287' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:59:22.074 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:21 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:22.074 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:21 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:22.074 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:21 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T03:59:22.074 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:21 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T03:59:22.074 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:21 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:22.074 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:21 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:22.074 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:21 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:22.074 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:21 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:22.074 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:21 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:22.074 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:21 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:22.074 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:21 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:22.074 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:21 trial099 ceph-mon[27808]: osdmap e25: 5 total, 4 up, 5 in 2026-02-13T03:59:22.074 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:21 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:59:22.078 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:21 trial158 ceph-mon[27763]: purged_snaps scrub starts 2026-02-13T03:59:22.078 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:21 trial158 ceph-mon[27763]: purged_snaps scrub ok 2026-02-13T03:59:22.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:21 trial158 ceph-mon[27763]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial099:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:59:22.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:21 trial158 ceph-mon[27763]: from='client.? 10.20.193.99:0/2051613287' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:59:22.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:21 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:22.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:21 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:22.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:21 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T03:59:22.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:21 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T03:59:22.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:21 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:22.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:21 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:22.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:21 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:22.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:21 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:22.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:21 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:22.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:21 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:22.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:21 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:22.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:21 trial158 ceph-mon[27763]: osdmap e25: 5 total, 4 up, 5 in 2026-02-13T03:59:22.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:21 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:59:22.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:21 trial092 ceph-mon[23047]: purged_snaps scrub starts 2026-02-13T03:59:22.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:21 trial092 ceph-mon[23047]: purged_snaps scrub ok 2026-02-13T03:59:22.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:21 trial092 ceph-mon[23047]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial099:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:59:22.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:21 trial092 ceph-mon[23047]: from='client.? 10.20.193.99:0/2051613287' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:59:22.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:21 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:22.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:21 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:22.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:21 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T03:59:22.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:21 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T03:59:22.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:21 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:22.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:21 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:22.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:21 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:22.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:21 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:22.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:21 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:22.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:21 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:22.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:21 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:22.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:21 trial092 ceph-mon[23047]: osdmap e25: 5 total, 4 up, 5 in 2026-02-13T03:59:22.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:21 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:59:22.836 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:22 trial099 ceph-mon[27808]: pgmap v48: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:59:22.837 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:22 trial099 ceph-mon[27808]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:59:22.837 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:22 trial099 ceph-mon[27808]: Cluster is now healthy 2026-02-13T03:59:22.837 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:22 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:22.837 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:22 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:22.837 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:22 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:22.837 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:22 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:22.837 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:22 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:22.837 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:22 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:22.837 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:22 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:22.837 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:22 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:22.838 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:22 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:22.838 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:22 trial099 ceph-mon[27808]: osdmap e26: 5 total, 4 up, 5 in 2026-02-13T03:59:22.838 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:22 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:59:23.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:22 trial158 ceph-mon[27763]: pgmap v48: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:59:23.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:22 trial158 ceph-mon[27763]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:59:23.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:22 trial158 ceph-mon[27763]: Cluster is now healthy 2026-02-13T03:59:23.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:22 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:23.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:22 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:23.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:22 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:23.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:22 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:23.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:22 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:23.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:22 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:23.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:22 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:23.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:22 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:23.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:22 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:23.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:22 trial158 ceph-mon[27763]: osdmap e26: 5 total, 4 up, 5 in 2026-02-13T03:59:23.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:22 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:59:23.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:22 trial092 ceph-mon[23047]: pgmap v48: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:59:23.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:22 trial092 ceph-mon[23047]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:59:23.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:22 trial092 ceph-mon[23047]: Cluster is now healthy 2026-02-13T03:59:23.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:22 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:23.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:22 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:23.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:22 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:23.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:22 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:23.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:22 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:23.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:22 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:23.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:22 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:23.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:22 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:23.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:22 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:23.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:22 trial092 ceph-mon[23047]: osdmap e26: 5 total, 4 up, 5 in 2026-02-13T03:59:23.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:22 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:59:23.988 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:23 trial099 ceph-mon[27808]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:59:23.989 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:23 trial099 ceph-mon[27808]: pgmap v51: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:59:23.989 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:23 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-13T03:59:23.989 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:23 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:23.989 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:23 trial099 ceph-mon[27808]: osdmap e27: 5 total, 4 up, 5 in 2026-02-13T03:59:23.989 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:23 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:59:24.078 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:23 trial158 ceph-mon[27763]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:59:24.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:23 trial158 ceph-mon[27763]: pgmap v51: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:59:24.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:23 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-13T03:59:24.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:23 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:24.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:23 trial158 ceph-mon[27763]: osdmap e27: 5 total, 4 up, 5 in 2026-02-13T03:59:24.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:23 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:59:24.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:23 trial092 ceph-mon[23047]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:59:24.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:23 trial092 ceph-mon[23047]: pgmap v51: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:59:24.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:23 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2026-02-13T03:59:24.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:23 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:24.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:23 trial092 ceph-mon[23047]: osdmap e27: 5 total, 4 up, 5 in 2026-02-13T03:59:24.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:23 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:59:24.966 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:24 trial099 ceph-mon[27808]: pgmap v53: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:59:24.966 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:24 trial099 ceph-mon[27808]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:59:24.966 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:24 trial099 ceph-mon[27808]: osdmap e28: 5 total, 4 up, 5 in 2026-02-13T03:59:24.967 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:24 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:59:25.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:24 trial158 ceph-mon[27763]: pgmap v53: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:59:25.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:24 trial158 ceph-mon[27763]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:59:25.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:24 trial158 ceph-mon[27763]: osdmap e28: 5 total, 4 up, 5 in 2026-02-13T03:59:25.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:24 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:59:25.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:24 trial092 ceph-mon[23047]: pgmap v53: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail 2026-02-13T03:59:25.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:24 trial092 ceph-mon[23047]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:59:25.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:24 trial092 ceph-mon[23047]: osdmap e28: 5 total, 4 up, 5 in 2026-02-13T03:59:25.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:24 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:59:25.751 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:25 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:25.751 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:25 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:25.751 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:25 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:26.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:25 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:26.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:25 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:26.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:25 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:26.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:25 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:26.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:25 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:26.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:25 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:26.288 INFO:teuthology.orchestra.run.trial099.stdout:Created osd(s) 4 on host 'trial099' 2026-02-13T03:59:26.288 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:26.284+0000 7f18637fe6c0 1 -- 10.20.193.99:0/4124304213 <== mgr.14187 v2:10.20.193.92:6800/4191527999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f186c10fbf0 con 0x7f18340b56d0 2026-02-13T03:59:26.290 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:26.287+0000 7f1870a346c0 1 -- 10.20.193.99:0/4124304213 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f18340b56d0 msgr2=0x7f18340d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:59:26.290 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:26.287+0000 7f1870a346c0 1 --2- 10.20.193.99:0/4124304213 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f18340b56d0 0x7f18340d5b80 secure :-1 s=READY pgs=65 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1850005980 tx=0x7f1850005910 comp rx=0 tx=0).stop 2026-02-13T03:59:26.291 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:26.287+0000 7f1870a346c0 1 -- 10.20.193.99:0/4124304213 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f186c10f200 msgr2=0x7f186c11cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:59:26.291 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:26.287+0000 7f1870a346c0 1 --2- 10.20.193.99:0/4124304213 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f186c10f200 0x7f186c11cf50 secure :-1 s=READY pgs=41 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f185800b6c0 tx=0x7f185800bb90 comp rx=0 tx=0).stop 2026-02-13T03:59:26.291 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:26.287+0000 7f1870a346c0 1 -- 10.20.193.99:0/4124304213 shutdown_connections 2026-02-13T03:59:26.291 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:26.287+0000 7f1870a346c0 1 --2- 10.20.193.99:0/4124304213 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f186c122850 0x7f186c122cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:26.291 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:26.287+0000 7f1870a346c0 1 --2- 10.20.193.99:0/4124304213 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f186c115410 0x7f186c11d490 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:26.291 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:26.287+0000 7f1870a346c0 1 --2- 10.20.193.99:0/4124304213 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f18340b56d0 0x7f18340d5b80 unknown :-1 s=CLOSED pgs=65 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:26.291 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:26.287+0000 7f1870a346c0 1 --2- 10.20.193.99:0/4124304213 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f186c10f200 0x7f186c11cf50 unknown :-1 s=CLOSED pgs=41 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:26.291 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:26.287+0000 7f1870a346c0 1 -- 10.20.193.99:0/4124304213 >> 10.20.193.99:0/4124304213 conn(0x7f186c0ecb00 msgr2=0x7f186c10cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:59:26.291 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:26.287+0000 7f1870a346c0 1 -- 10.20.193.99:0/4124304213 shutdown_connections 2026-02-13T03:59:26.291 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:26.287+0000 7f1870a346c0 1 -- 10.20.193.99:0/4124304213 wait complete. 2026-02-13T03:59:26.333 DEBUG:teuthology.orchestra.run.trial099:osd.4> sudo journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@osd.4.service 2026-02-13T03:59:26.335 INFO:tasks.cephadm:Deploying osd.5 on trial158 with /dev/vg_nvme/lv_3... 2026-02-13T03:59:26.336 DEBUG:teuthology.orchestra.run.trial158:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_3 2026-02-13T03:59:26.457 INFO:teuthology.orchestra.run.trial158.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.c/config 2026-02-13T03:59:26.866 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:26 trial158 ceph-mon[27763]: pgmap v56: 1 pgs: 1 peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 211 KiB/s, 0 objects/s recovering 2026-02-13T03:59:26.866 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:26 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:26.866 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:26 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:26.866 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:26 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:26.867 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:26 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:26.867 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:26 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:26.867 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:26 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:26.867 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:26 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:26.867 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:26 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:26.867 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:26 trial158 ceph-mon[27763]: from='osd.4 [v2:10.20.193.99:6808/1135109881,v1:10.20.193.99:6809/1135109881]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T03:59:26.867 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:26 trial158 ceph-mon[27763]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T03:59:26.867 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:26 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:26.867 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:26 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:26.867 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:26 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:26.879 INFO:teuthology.orchestra.run.trial158.stdout: 2026-02-13T03:59:26.899 DEBUG:teuthology.orchestra.run.trial158:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph orch daemon add osd trial158:vg_nvme/lv_3 --skip-validation 2026-02-13T03:59:26.948 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:26 trial099 ceph-mon[27808]: pgmap v56: 1 pgs: 1 peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 211 KiB/s, 0 objects/s recovering 2026-02-13T03:59:26.949 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:26 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:26.949 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:26 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:26.949 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:26 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:26.949 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:26 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:26.949 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:26 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:26.949 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:26 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:26.949 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:26 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:26.949 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:26 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:26.949 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:26 trial099 ceph-mon[27808]: from='osd.4 [v2:10.20.193.99:6808/1135109881,v1:10.20.193.99:6809/1135109881]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T03:59:26.950 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:26 trial099 ceph-mon[27808]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T03:59:26.950 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:26 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:26.950 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:26 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:26.950 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:26 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:27.017 INFO:teuthology.orchestra.run.trial158.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.c/config 2026-02-13T03:59:27.133 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:27.128+0000 7fb0d49fb6c0 1 -- 10.20.193.158:0/3562180656 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fb0cc115440 msgr2=0x7fb0cc175de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:59:27.133 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:27.128+0000 7fb0d49fb6c0 1 --2- 10.20.193.158:0/3562180656 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fb0cc115440 0x7fb0cc175de0 secure :-1 s=READY pgs=38 gs=1 cs=0 l=1 c_cookie=2646310279062491295 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb0c000aa70 tx=0x7fb0c002fde0 comp rx=0 tx=0).stop 2026-02-13T03:59:27.133 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:27.128+0000 7fb0d49fb6c0 1 -- 10.20.193.158:0/3562180656 shutdown_connections 2026-02-13T03:59:27.133 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:27.128+0000 7fb0d49fb6c0 1 --2- 10.20.193.158:0/3562180656 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fb0cc10fc20 0x7fb0cc114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:27.133 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:27.128+0000 7fb0d49fb6c0 1 --2- 10.20.193.158:0/3562180656 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fb0cc115440 0x7fb0cc175de0 unknown :-1 s=CLOSED pgs=38 gs=1 cs=0 l=1 c_cookie=2646310279062491295 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:27.133 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:27.128+0000 7fb0d49fb6c0 1 --2- 10.20.193.158:0/3562180656 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb0cc10f230 0x7fb0cc10f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:27.133 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:27.128+0000 7fb0d49fb6c0 1 -- 10.20.193.158:0/3562180656 >> 10.20.193.158:0/3562180656 conn(0x7fb0cc0ecb30 msgr2=0x7fb0cc10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:59:27.133 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:27.128+0000 7fb0d49fb6c0 1 -- 10.20.193.158:0/3562180656 shutdown_connections 2026-02-13T03:59:27.133 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:27.128+0000 7fb0d49fb6c0 1 -- 10.20.193.158:0/3562180656 wait complete. 2026-02-13T03:59:27.134 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:27.128+0000 7fb0d49fb6c0 1 Processor -- start 2026-02-13T03:59:27.134 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:27.128+0000 7fb0d49fb6c0 1 -- start start 2026-02-13T03:59:27.134 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:27.129+0000 7fb0d49fb6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fb0cc10f230 0x7fb0cc11cef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:59:27.134 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:27.129+0000 7fb0d49fb6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb0cc115440 0x7fb0cc11d430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:59:27.134 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:27.129+0000 7fb0d49fb6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fb0cc1227f0 0x7fb0cc122c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:59:27.134 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:27.129+0000 7fb0d49fb6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb0cc123200 con 0x7fb0cc115440 2026-02-13T03:59:27.134 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:27.129+0000 7fb0d49fb6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb0cc123370 con 0x7fb0cc1227f0 2026-02-13T03:59:27.134 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:27.129+0000 7fb0d49fb6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fb0cc123530 con 0x7fb0cc10f230 2026-02-13T03:59:27.134 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:27.129+0000 7fb0d276c6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fb0cc10f230 0x7fb0cc11cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:59:27.134 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:27.129+0000 7fb0d276c6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fb0cc10f230 0x7fb0cc11cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.158:52330/0 (socket says 10.20.193.158:52330) 2026-02-13T03:59:27.134 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:27.129+0000 7fb0d276c6c0 1 -- 10.20.193.158:0/2682104529 learned_addr learned my addr 10.20.193.158:0/2682104529 (peer_addr_for_me v2:10.20.193.158:0/0) 2026-02-13T03:59:27.135 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:27.129+0000 7fb0d2f6d6c0 1 --2- 10.20.193.158:0/2682104529 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fb0cc1227f0 0x7fb0cc122c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:59:27.135 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:27.129+0000 7fb0d1f6b6c0 1 --2- 10.20.193.158:0/2682104529 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb0cc115440 0x7fb0cc11d430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:59:27.135 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:27.129+0000 7fb0d276c6c0 1 -- 10.20.193.158:0/2682104529 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fb0cc1227f0 msgr2=0x7fb0cc122c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:59:27.135 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:27.129+0000 7fb0d276c6c0 1 --2- 10.20.193.158:0/2682104529 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fb0cc1227f0 0x7fb0cc122c90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:27.135 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:27.129+0000 7fb0d276c6c0 1 -- 10.20.193.158:0/2682104529 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb0cc115440 msgr2=0x7fb0cc11d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:59:27.135 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:27.129+0000 7fb0d276c6c0 1 --2- 10.20.193.158:0/2682104529 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb0cc115440 0x7fb0cc11d430 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:27.135 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:27.129+0000 7fb0d276c6c0 1 -- 10.20.193.158:0/2682104529 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0c000a660 con 0x7fb0cc10f230 2026-02-13T03:59:27.135 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:27.129+0000 7fb0d1f6b6c0 1 --2- 10.20.193.158:0/2682104529 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb0cc115440 0x7fb0cc11d430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:59:27.135 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:27.129+0000 7fb0d276c6c0 1 --2- 10.20.193.158:0/2682104529 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fb0cc10f230 0x7fb0cc11cef0 secure :-1 s=READY pgs=39 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb0bc00b6c0 tx=0x7fb0bc00bb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:59:27.135 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:27.129+0000 7fb0c77fe6c0 1 -- 10.20.193.158:0/2682104529 <== mon.1 v2:10.20.193.158:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb0bc0044a0 con 0x7fb0cc10f230 2026-02-13T03:59:27.135 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:27.129+0000 7fb0c77fe6c0 1 -- 10.20.193.158:0/2682104529 <== mon.1 v2:10.20.193.158:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fb0bc00be50 con 0x7fb0cc10f230 2026-02-13T03:59:27.136 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:27.129+0000 7fb0d49fb6c0 1 -- 10.20.193.158:0/2682104529 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0cc1639e0 con 0x7fb0cc10f230 2026-02-13T03:59:27.136 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:27.129+0000 7fb0c77fe6c0 1 -- 10.20.193.158:0/2682104529 <== mon.1 v2:10.20.193.158:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb0bc00e070 con 0x7fb0cc10f230 2026-02-13T03:59:27.136 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:27.129+0000 7fb0d49fb6c0 1 -- 10.20.193.158:0/2682104529 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0cc163f40 con 0x7fb0cc10f230 2026-02-13T03:59:27.136 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:27.130+0000 7fb0d49fb6c0 1 -- 10.20.193.158:0/2682104529 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0cc110500 con 0x7fb0cc10f230 2026-02-13T03:59:27.136 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:27.131+0000 7fb0c77fe6c0 1 -- 10.20.193.158:0/2682104529 <== mon.1 v2:10.20.193.158:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7fb0bc00c530 con 0x7fb0cc10f230 2026-02-13T03:59:27.137 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:27.131+0000 7fb0c77fe6c0 1 --2- 10.20.193.158:0/2682104529 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fb0980b56d0 0x7fb0980d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:59:27.137 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:27.131+0000 7fb0c77fe6c0 1 -- 10.20.193.158:0/2682104529 <== mon.1 v2:10.20.193.158:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 3797+0+0 (secure 0 0 0) 0x7fb0bc0e28f0 con 0x7fb0cc10f230 2026-02-13T03:59:27.137 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:27.132+0000 7fb0d1f6b6c0 1 --2- 10.20.193.158:0/2682104529 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fb0980b56d0 0x7fb0980d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:59:27.137 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:27.132+0000 7fb0c77fe6c0 1 -- 10.20.193.158:0/2682104529 <== mon.1 v2:10.20.193.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb0bc0a6430 con 0x7fb0cc10f230 2026-02-13T03:59:27.137 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:27.132+0000 7fb0d1f6b6c0 1 --2- 10.20.193.158:0/2682104529 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fb0980b56d0 0x7fb0980d5b80 secure :-1 s=READY pgs=69 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb0cc123880 tx=0x7fb0b4005f10 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:59:27.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:26 trial092 ceph-mon[23047]: pgmap v56: 1 pgs: 1 peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 211 KiB/s, 0 objects/s recovering 2026-02-13T03:59:27.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:26 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:27.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:26 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:27.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:26 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:27.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:26 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:27.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:26 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:27.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:26 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:27.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:26 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:27.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:26 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:27.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:26 trial092 ceph-mon[23047]: from='osd.4 [v2:10.20.193.99:6808/1135109881,v1:10.20.193.99:6809/1135109881]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T03:59:27.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:26 trial092 ceph-mon[23047]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2026-02-13T03:59:27.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:26 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:27.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:26 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:27.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:26 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:27.230 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:27.228+0000 7fb0d49fb6c0 1 -- 10.20.193.158:0/2682104529 --> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial158:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fb0cc11e0d0 con 0x7fb0980b56d0 2026-02-13T03:59:27.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:27 trial158 ceph-mon[27763]: pgmap v57: 1 pgs: 1 peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 175 KiB/s, 0 objects/s recovering 2026-02-13T03:59:27.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:27 trial158 ceph-mon[27763]: pgmap v58: 1 pgs: 1 peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 146 KiB/s, 0 objects/s recovering 2026-02-13T03:59:27.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:27 trial158 ceph-mon[27763]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-13T03:59:27.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:27 trial158 ceph-mon[27763]: from='osd.4 [v2:10.20.193.99:6808/1135109881,v1:10.20.193.99:6809/1135109881]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial099", "root=default"]} : dispatch 2026-02-13T03:59:27.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:27 trial158 ceph-mon[27763]: osdmap e29: 5 total, 4 up, 5 in 2026-02-13T03:59:27.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:27 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:59:27.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:27 trial158 ceph-mon[27763]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial099", "root=default"]} : dispatch 2026-02-13T03:59:27.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:27 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:27.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:27 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:27.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:27 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:27.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:27 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:27.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:27 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:27.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:27 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:27.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:27 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:27.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:27 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T03:59:27.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:27 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T03:59:27.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:27 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:27.831 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:27 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:27.831 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:27 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:27.831 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:27 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:27.831 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:27 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:27.831 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:27 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:27.831 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:27 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:28.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:27 trial099 ceph-mon[27808]: pgmap v57: 1 pgs: 1 peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 175 KiB/s, 0 objects/s recovering 2026-02-13T03:59:28.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:27 trial099 ceph-mon[27808]: pgmap v58: 1 pgs: 1 peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 146 KiB/s, 0 objects/s recovering 2026-02-13T03:59:28.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:27 trial099 ceph-mon[27808]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-13T03:59:28.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:27 trial099 ceph-mon[27808]: from='osd.4 [v2:10.20.193.99:6808/1135109881,v1:10.20.193.99:6809/1135109881]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial099", "root=default"]} : dispatch 2026-02-13T03:59:28.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:27 trial099 ceph-mon[27808]: osdmap e29: 5 total, 4 up, 5 in 2026-02-13T03:59:28.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:27 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:59:28.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:27 trial099 ceph-mon[27808]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial099", "root=default"]} : dispatch 2026-02-13T03:59:28.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:27 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:28.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:27 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:28.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:27 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:28.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:27 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:28.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:27 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:28.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:27 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:28.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:27 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:28.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:27 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T03:59:28.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:27 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T03:59:28.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:27 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:28.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:27 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:28.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:27 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:28.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:27 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:28.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:27 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:28.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:27 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:28.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:27 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:28.118 INFO:journalctl@ceph.osd.4.trial099.stdout:Feb 13 03:59:27 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-4[40210]: 2026-02-13T03:59:27.867+0000 7f9e295036c0 -1 osd.4 0 waiting for initial osdmap 2026-02-13T03:59:28.119 INFO:journalctl@ceph.osd.4.trial099.stdout:Feb 13 03:59:27 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-4[40210]: 2026-02-13T03:59:27.870+0000 7f9e213bf6c0 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T03:59:28.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:27 trial092 ceph-mon[23047]: pgmap v57: 1 pgs: 1 peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 175 KiB/s, 0 objects/s recovering 2026-02-13T03:59:28.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:27 trial092 ceph-mon[23047]: pgmap v58: 1 pgs: 1 peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 146 KiB/s, 0 objects/s recovering 2026-02-13T03:59:28.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:27 trial092 ceph-mon[23047]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2026-02-13T03:59:28.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:27 trial092 ceph-mon[23047]: from='osd.4 [v2:10.20.193.99:6808/1135109881,v1:10.20.193.99:6809/1135109881]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial099", "root=default"]} : dispatch 2026-02-13T03:59:28.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:27 trial092 ceph-mon[23047]: osdmap e29: 5 total, 4 up, 5 in 2026-02-13T03:59:28.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:27 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:59:28.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:27 trial092 ceph-mon[23047]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial099", "root=default"]} : dispatch 2026-02-13T03:59:28.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:27 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:28.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:27 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:28.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:27 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:28.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:27 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:28.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:27 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:28.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:27 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:28.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:27 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:28.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:27 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T03:59:28.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:27 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T03:59:28.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:27 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:28.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:27 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:28.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:27 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:28.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:27 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:28.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:27 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:28.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:27 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:28.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:27 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:29.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:28 trial158 ceph-mon[27763]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial158:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:59:29.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:28 trial158 ceph-mon[27763]: pgmap v60: 1 pgs: 1 peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 138 KiB/s, 0 objects/s recovering 2026-02-13T03:59:29.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:28 trial158 ceph-mon[27763]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial099", "root=default"]}]': finished 2026-02-13T03:59:29.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:28 trial158 ceph-mon[27763]: osdmap e30: 5 total, 4 up, 5 in 2026-02-13T03:59:29.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:28 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:59:29.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:28 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:59:29.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:28 trial158 ceph-mon[27763]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fcb06e7c-2900-49d9-9b39-6521200cd89a"} : dispatch 2026-02-13T03:59:29.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:28 trial158 ceph-mon[27763]: from='client.? 10.20.193.158:0/481812046' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fcb06e7c-2900-49d9-9b39-6521200cd89a"} : dispatch 2026-02-13T03:59:29.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:28 trial158 ceph-mon[27763]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fcb06e7c-2900-49d9-9b39-6521200cd89a"}]': finished 2026-02-13T03:59:29.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:28 trial158 ceph-mon[27763]: osd.4 [v2:10.20.193.99:6808/1135109881,v1:10.20.193.99:6809/1135109881] boot 2026-02-13T03:59:29.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:28 trial158 ceph-mon[27763]: osdmap e31: 6 total, 5 up, 6 in 2026-02-13T03:59:29.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:28 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:59:29.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:28 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:59:29.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:28 trial158 ceph-mon[27763]: from='client.? 10.20.193.158:0/3766997229' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:59:29.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:28 trial158 ceph-mon[27763]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:59:29.081 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:28 trial158 ceph-mon[27763]: Cluster is now healthy 2026-02-13T03:59:29.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:28 trial099 ceph-mon[27808]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial158:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:59:29.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:28 trial099 ceph-mon[27808]: pgmap v60: 1 pgs: 1 peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 138 KiB/s, 0 objects/s recovering 2026-02-13T03:59:29.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:28 trial099 ceph-mon[27808]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial099", "root=default"]}]': finished 2026-02-13T03:59:29.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:28 trial099 ceph-mon[27808]: osdmap e30: 5 total, 4 up, 5 in 2026-02-13T03:59:29.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:28 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:59:29.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:28 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:59:29.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:28 trial099 ceph-mon[27808]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fcb06e7c-2900-49d9-9b39-6521200cd89a"} : dispatch 2026-02-13T03:59:29.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:28 trial099 ceph-mon[27808]: from='client.? 10.20.193.158:0/481812046' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fcb06e7c-2900-49d9-9b39-6521200cd89a"} : dispatch 2026-02-13T03:59:29.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:28 trial099 ceph-mon[27808]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fcb06e7c-2900-49d9-9b39-6521200cd89a"}]': finished 2026-02-13T03:59:29.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:28 trial099 ceph-mon[27808]: osd.4 [v2:10.20.193.99:6808/1135109881,v1:10.20.193.99:6809/1135109881] boot 2026-02-13T03:59:29.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:28 trial099 ceph-mon[27808]: osdmap e31: 6 total, 5 up, 6 in 2026-02-13T03:59:29.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:28 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:59:29.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:28 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:59:29.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:28 trial099 ceph-mon[27808]: from='client.? 10.20.193.158:0/3766997229' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:59:29.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:28 trial099 ceph-mon[27808]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:59:29.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:28 trial099 ceph-mon[27808]: Cluster is now healthy 2026-02-13T03:59:29.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:28 trial092 ceph-mon[23047]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial158:vg_nvme/lv_3", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:59:29.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:28 trial092 ceph-mon[23047]: pgmap v60: 1 pgs: 1 peering; 577 KiB data, 106 MiB used, 2.7 TiB / 2.7 TiB avail; 138 KiB/s, 0 objects/s recovering 2026-02-13T03:59:29.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:28 trial092 ceph-mon[23047]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.6836, "args": ["host=trial099", "root=default"]}]': finished 2026-02-13T03:59:29.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:28 trial092 ceph-mon[23047]: osdmap e30: 5 total, 4 up, 5 in 2026-02-13T03:59:29.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:28 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:59:29.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:28 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:59:29.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:28 trial092 ceph-mon[23047]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fcb06e7c-2900-49d9-9b39-6521200cd89a"} : dispatch 2026-02-13T03:59:29.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:28 trial092 ceph-mon[23047]: from='client.? 10.20.193.158:0/481812046' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "fcb06e7c-2900-49d9-9b39-6521200cd89a"} : dispatch 2026-02-13T03:59:29.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:28 trial092 ceph-mon[23047]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fcb06e7c-2900-49d9-9b39-6521200cd89a"}]': finished 2026-02-13T03:59:29.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:28 trial092 ceph-mon[23047]: osd.4 [v2:10.20.193.99:6808/1135109881,v1:10.20.193.99:6809/1135109881] boot 2026-02-13T03:59:29.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:28 trial092 ceph-mon[23047]: osdmap e31: 6 total, 5 up, 6 in 2026-02-13T03:59:29.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:28 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2026-02-13T03:59:29.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:28 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:59:29.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:28 trial092 ceph-mon[23047]: from='client.? 10.20.193.158:0/3766997229' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:59:29.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:28 trial092 ceph-mon[23047]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:59:29.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:28 trial092 ceph-mon[23047]: Cluster is now healthy 2026-02-13T03:59:30.306 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:30 trial158 ceph-mon[27763]: purged_snaps scrub starts 2026-02-13T03:59:30.306 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:30 trial158 ceph-mon[27763]: purged_snaps scrub ok 2026-02-13T03:59:30.306 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:30 trial158 ceph-mon[27763]: osdmap e32: 6 total, 5 up, 6 in 2026-02-13T03:59:30.307 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:30 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:59:30.307 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:30 trial158 ceph-mon[27763]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:59:30.307 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:30 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:30.307 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:30 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:30.307 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:30 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:30.307 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:30 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:30.307 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:30 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:30.307 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:30 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:30.307 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:30 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:30.307 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:30 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:30.308 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:30 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:30.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:30 trial099 ceph-mon[27808]: purged_snaps scrub starts 2026-02-13T03:59:30.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:30 trial099 ceph-mon[27808]: purged_snaps scrub ok 2026-02-13T03:59:30.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:30 trial099 ceph-mon[27808]: osdmap e32: 6 total, 5 up, 6 in 2026-02-13T03:59:30.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:30 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:59:30.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:30 trial099 ceph-mon[27808]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:59:30.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:30 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:30.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:30 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:30.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:30 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:30.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:30 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:30.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:30 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:30.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:30 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:30.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:30 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:30.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:30 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:30.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:30 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:30.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:30 trial092 ceph-mon[23047]: purged_snaps scrub starts 2026-02-13T03:59:30.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:30 trial092 ceph-mon[23047]: purged_snaps scrub ok 2026-02-13T03:59:30.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:30 trial092 ceph-mon[23047]: osdmap e32: 6 total, 5 up, 6 in 2026-02-13T03:59:30.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:30 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:59:30.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:30 trial092 ceph-mon[23047]: pgmap v64: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:59:30.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:30 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:30.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:30 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:30.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:30 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:30.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:30 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:30.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:30 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:30.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:30 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:30.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:30 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:30.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:30 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:30.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:30 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:31.158 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:31 trial158 ceph-mon[27763]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:59:31.158 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:31 trial158 ceph-mon[27763]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:59:31.158 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:31 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-13T03:59:31.158 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:31 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:31.158 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:31 trial158 ceph-mon[27763]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:59:31.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:31 trial099 ceph-mon[27808]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:59:31.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:31 trial099 ceph-mon[27808]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:59:31.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:31 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-13T03:59:31.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:31 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:31.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:31 trial099 ceph-mon[27808]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:59:31.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:31 trial092 ceph-mon[23047]: pgmap v65: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:59:31.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:31 trial092 ceph-mon[23047]: pgmap v66: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:59:31.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:31 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2026-02-13T03:59:31.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:31 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:31.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:31 trial092 ceph-mon[23047]: pgmap v67: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:59:32.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:32 trial158 ceph-mon[27763]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:59:32.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:32 trial099 ceph-mon[27808]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:59:32.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:32 trial092 ceph-mon[23047]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:59:33.305 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:33 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:33.305 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:33 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:33.305 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:33 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:33.305 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:33 trial158 ceph-mon[27763]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:59:33.305 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:33 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:33.305 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:33 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:33.306 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:33 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:33.306 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:33 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:33.306 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:33 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:33.306 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:33 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:33.306 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:33 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:33.306 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:33 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:33.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:33 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:33.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:33 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:33.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:33 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:33.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:33 trial099 ceph-mon[27808]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:59:33.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:33 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:33.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:33 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:33.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:33 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:33.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:33 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:33.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:33 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:33.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:33 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:33.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:33 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:33.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:33 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:33.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:33 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:33.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:33 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:33.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:33 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:33.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:33 trial092 ceph-mon[23047]: pgmap v68: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:59:33.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:33 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:33.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:33 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:33.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:33 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:33.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:33 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:33.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:33 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:33.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:33 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:33.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:33 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:33.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:33 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:33.444 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:33.442+0000 7fb0c77fe6c0 1 -- 10.20.193.158:0/2682104529 <== mgr.14187 v2:10.20.193.92:6800/4191527999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fb0b4004020 con 0x7fb0980b56d0 2026-02-13T03:59:33.444 INFO:teuthology.orchestra.run.trial158.stdout:Created osd(s) 5 on host 'trial158' 2026-02-13T03:59:33.447 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:33.444+0000 7fb0d49fb6c0 1 -- 10.20.193.158:0/2682104529 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fb0980b56d0 msgr2=0x7fb0980d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:59:33.447 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:33.444+0000 7fb0d49fb6c0 1 --2- 10.20.193.158:0/2682104529 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fb0980b56d0 0x7fb0980d5b80 secure :-1 s=READY pgs=69 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb0cc123880 tx=0x7fb0b4005f10 comp rx=0 tx=0).stop 2026-02-13T03:59:33.447 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:33.444+0000 7fb0d49fb6c0 1 -- 10.20.193.158:0/2682104529 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fb0cc10f230 msgr2=0x7fb0cc11cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:59:33.447 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:33.444+0000 7fb0d49fb6c0 1 --2- 10.20.193.158:0/2682104529 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fb0cc10f230 0x7fb0cc11cef0 secure :-1 s=READY pgs=39 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb0bc00b6c0 tx=0x7fb0bc00bb90 comp rx=0 tx=0).stop 2026-02-13T03:59:33.447 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:33.444+0000 7fb0d49fb6c0 1 -- 10.20.193.158:0/2682104529 shutdown_connections 2026-02-13T03:59:33.447 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:33.444+0000 7fb0d49fb6c0 1 --2- 10.20.193.158:0/2682104529 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fb0980b56d0 0x7fb0980d5b80 unknown :-1 s=CLOSED pgs=69 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:33.447 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:33.444+0000 7fb0d49fb6c0 1 --2- 10.20.193.158:0/2682104529 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fb0cc1227f0 0x7fb0cc122c90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:33.448 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:33.444+0000 7fb0d49fb6c0 1 --2- 10.20.193.158:0/2682104529 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb0cc115440 0x7fb0cc11d430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:33.448 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:33.444+0000 7fb0d49fb6c0 1 --2- 10.20.193.158:0/2682104529 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fb0cc10f230 0x7fb0cc11cef0 unknown :-1 s=CLOSED pgs=39 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:33.448 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:33.444+0000 7fb0d49fb6c0 1 -- 10.20.193.158:0/2682104529 >> 10.20.193.158:0/2682104529 conn(0x7fb0cc0ecb30 msgr2=0x7fb0cc10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:59:33.448 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:33.444+0000 7fb0d49fb6c0 1 -- 10.20.193.158:0/2682104529 shutdown_connections 2026-02-13T03:59:33.448 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:33.444+0000 7fb0d49fb6c0 1 -- 10.20.193.158:0/2682104529 wait complete. 2026-02-13T03:59:33.487 DEBUG:teuthology.orchestra.run.trial158:osd.5> sudo journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@osd.5.service 2026-02-13T03:59:33.490 INFO:tasks.cephadm:Deploying osd.6 on trial092 with /dev/vg_nvme/lv_2... 2026-02-13T03:59:33.490 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-13T03:59:33.678 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:59:34.052 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:34 trial092 ceph-mon[23047]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:59:34.052 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:34 trial092 ceph-mon[23047]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T03:59:34.053 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:34 trial092 ceph-mon[23047]: from='osd.5 [v2:10.20.193.158:6808/428074602,v1:10.20.193.158:6809/428074602]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T03:59:34.053 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:34 trial092 ceph-mon[23047]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:59:34.053 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:34 trial092 ceph-mon[23047]: Cluster is now healthy 2026-02-13T03:59:34.053 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:34 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:34.053 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:34 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:34.053 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:34 trial092 ceph-mon[23047]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:59:34.053 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:34 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:34.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:34 trial158 ceph-mon[27763]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:59:34.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:34 trial158 ceph-mon[27763]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T03:59:34.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:34 trial158 ceph-mon[27763]: from='osd.5 [v2:10.20.193.158:6808/428074602,v1:10.20.193.158:6809/428074602]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T03:59:34.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:34 trial158 ceph-mon[27763]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:59:34.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:34 trial158 ceph-mon[27763]: Cluster is now healthy 2026-02-13T03:59:34.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:34 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:34.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:34 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:34.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:34 trial158 ceph-mon[27763]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:59:34.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:34 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:34.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:34 trial099 ceph-mon[27808]: pgmap v69: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:59:34.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:34 trial099 ceph-mon[27808]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T03:59:34.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:34 trial099 ceph-mon[27808]: from='osd.5 [v2:10.20.193.158:6808/428074602,v1:10.20.193.158:6809/428074602]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2026-02-13T03:59:34.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:34 trial099 ceph-mon[27808]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:59:34.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:34 trial099 ceph-mon[27808]: Cluster is now healthy 2026-02-13T03:59:34.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:34 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:34.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:34 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:34.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:34 trial099 ceph-mon[27808]: pgmap v70: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:59:34.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:34 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:34.504 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T03:59:34.527 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph orch daemon add osd trial092:vg_nvme/lv_2 --skip-validation 2026-02-13T03:59:34.713 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T03:59:34.921 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:34.919+0000 7f03f53246c0 1 -- 10.20.193.92:0/7210830 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f03f0115270 msgr2=0x7f03f0175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:59:34.922 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:34.919+0000 7f03f53246c0 1 --2- 10.20.193.92:0/7210830 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f03f0115270 0x7f03f0175c10 secure :-1 s=READY pgs=135 gs=2 cs=0 l=1 c_cookie=8422874101601504502 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f03e400a9b0 tx=0x7f03e402fd60 comp rx=0 tx=0).stop 2026-02-13T03:59:34.922 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:34.919+0000 7f03f53246c0 1 -- 10.20.193.92:0/7210830 shutdown_connections 2026-02-13T03:59:34.922 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:34.919+0000 7f03f53246c0 1 --2- 10.20.193.92:0/7210830 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f03f0115270 0x7f03f0175c10 unknown :-1 s=CLOSED pgs=135 gs=2 cs=0 l=1 c_cookie=8422874101601504502 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:34.922 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:34.919+0000 7f03f53246c0 1 --2- 10.20.193.92:0/7210830 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f03f010fa50 0x7f03f0114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:34.922 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:34.919+0000 7f03f53246c0 1 --2- 10.20.193.92:0/7210830 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f03f010f060 0x7f03f010f430 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:34.922 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:34.919+0000 7f03f53246c0 1 -- 10.20.193.92:0/7210830 >> 10.20.193.92:0/7210830 conn(0x7f03f00ec980 msgr2=0x7f03f010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:59:34.922 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:34.919+0000 7f03f53246c0 1 -- 10.20.193.92:0/7210830 shutdown_connections 2026-02-13T03:59:34.922 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:34.919+0000 7f03f53246c0 1 -- 10.20.193.92:0/7210830 wait complete. 2026-02-13T03:59:34.925 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:34.920+0000 7f03f53246c0 1 Processor -- start 2026-02-13T03:59:34.925 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:34.920+0000 7f03f53246c0 1 -- start start 2026-02-13T03:59:34.925 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:34.920+0000 7f03f53246c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f03f010f060 0x7f03f011cdb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:59:34.925 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:34.920+0000 7f03f53246c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f03f0115270 0x7f03f011d2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:59:34.925 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:34.920+0000 7f03f53246c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f03f01226b0 0x7f03f0122b50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:59:34.925 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:34.920+0000 7f03f53246c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f03f01230c0 con 0x7f03f01226b0 2026-02-13T03:59:34.925 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:34.920+0000 7f03f53246c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f03f0123230 con 0x7f03f0115270 2026-02-13T03:59:34.925 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:34.920+0000 7f03f53246c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f03f01233f0 con 0x7f03f010f060 2026-02-13T03:59:34.925 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:34.920+0000 7f03effff6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f03f010f060 0x7f03f011cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:59:34.926 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:34.920+0000 7f03effff6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f03f010f060 0x7f03f011cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:34426/0 (socket says 10.20.193.92:34426) 2026-02-13T03:59:34.926 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:34.920+0000 7f03effff6c0 1 -- 10.20.193.92:0/2129899362 learned_addr learned my addr 10.20.193.92:0/2129899362 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T03:59:34.926 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:34.920+0000 7f03ef7fe6c0 1 --2- 10.20.193.92:0/2129899362 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f03f0115270 0x7f03f011d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:59:34.926 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:34.921+0000 7f03f4b236c0 1 --2- 10.20.193.92:0/2129899362 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f03f01226b0 0x7f03f0122b50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:59:34.926 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:34.921+0000 7f03effff6c0 1 -- 10.20.193.92:0/2129899362 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f03f0115270 msgr2=0x7f03f011d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:59:34.926 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:34.921+0000 7f03effff6c0 1 --2- 10.20.193.92:0/2129899362 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f03f0115270 0x7f03f011d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:34.926 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:34.921+0000 7f03effff6c0 1 -- 10.20.193.92:0/2129899362 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f03f01226b0 msgr2=0x7f03f0122b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:59:34.926 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:34.921+0000 7f03effff6c0 1 --2- 10.20.193.92:0/2129899362 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f03f01226b0 0x7f03f0122b50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:34.926 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:34.921+0000 7f03effff6c0 1 -- 10.20.193.92:0/2129899362 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03dc009590 con 0x7f03f010f060 2026-02-13T03:59:34.926 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:34.921+0000 7f03f4b236c0 1 --2- 10.20.193.92:0/2129899362 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f03f01226b0 0x7f03f0122b50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T03:59:34.926 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:34.921+0000 7f03effff6c0 1 --2- 10.20.193.92:0/2129899362 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f03f010f060 0x7f03f011cdb0 secure :-1 s=READY pgs=47 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f03dc004750 tx=0x7f03dc00be00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:59:34.926 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:34.921+0000 7f03ed7fa6c0 1 -- 10.20.193.92:0/2129899362 <== mon.1 v2:10.20.193.158:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f03dc0044a0 con 0x7f03f010f060 2026-02-13T03:59:34.927 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:34.921+0000 7f03f53246c0 1 -- 10.20.193.92:0/2129899362 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03e400a5b0 con 0x7f03f010f060 2026-02-13T03:59:34.927 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:34.921+0000 7f03ed7fa6c0 1 -- 10.20.193.92:0/2129899362 <== mon.1 v2:10.20.193.158:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f03dc009030 con 0x7f03f010f060 2026-02-13T03:59:34.927 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:34.921+0000 7f03ed7fa6c0 1 -- 10.20.193.92:0/2129899362 <== mon.1 v2:10.20.193.158:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f03dc007440 con 0x7f03f010f060 2026-02-13T03:59:34.927 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:34.921+0000 7f03f53246c0 1 -- 10.20.193.92:0/2129899362 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03f0163bf0 con 0x7f03f010f060 2026-02-13T03:59:34.927 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:34.922+0000 7f03f53246c0 1 -- 10.20.193.92:0/2129899362 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03f0110330 con 0x7f03f010f060 2026-02-13T03:59:34.927 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:34.924+0000 7f03ed7fa6c0 1 -- 10.20.193.92:0/2129899362 <== mon.1 v2:10.20.193.158:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f03dc00c690 con 0x7f03f010f060 2026-02-13T03:59:34.928 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:34.926+0000 7f03ed7fa6c0 1 --2- 10.20.193.92:0/2129899362 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f03c40b56d0 0x7f03c40d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:59:34.929 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:34.926+0000 7f03ed7fa6c0 1 -- 10.20.193.92:0/2129899362 <== mon.1 v2:10.20.193.158:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4229+0+0 (secure 0 0 0) 0x7f03dc0e2e40 con 0x7f03f010f060 2026-02-13T03:59:34.929 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:34.926+0000 7f03ed7fa6c0 1 -- 10.20.193.92:0/2129899362 <== mon.1 v2:10.20.193.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f03dc0e32c0 con 0x7f03f010f060 2026-02-13T03:59:34.929 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:34.926+0000 7f03ef7fe6c0 1 --2- 10.20.193.92:0/2129899362 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f03c40b56d0 0x7f03c40d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:59:34.929 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:34.927+0000 7f03ef7fe6c0 1 --2- 10.20.193.92:0/2129899362 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f03c40b56d0 0x7f03c40d5b80 secure :-1 s=READY pgs=74 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f03f0123740 tx=0x7f03e0009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:59:35.035 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:35.032+0000 7f03f53246c0 1 -- 10.20.193.92:0/2129899362 --> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial092:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f03f011df90 con 0x7f03c40b56d0 2026-02-13T03:59:35.173 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:35 trial158 ceph-mon[27763]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-13T03:59:35.173 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:35 trial158 ceph-mon[27763]: osdmap e33: 6 total, 5 up, 6 in 2026-02-13T03:59:35.173 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:35 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:59:35.173 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:35 trial158 ceph-mon[27763]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial158", "root=default"]} : dispatch 2026-02-13T03:59:35.173 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:35 trial158 ceph-mon[27763]: from='osd.5 [v2:10.20.193.158:6808/428074602,v1:10.20.193.158:6809/428074602]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial158", "root=default"]} : dispatch 2026-02-13T03:59:35.173 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:35 trial158 ceph-mon[27763]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:59:35.173 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:35 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:35.173 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:35 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:35.174 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:35 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T03:59:35.174 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:35 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T03:59:35.174 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:35 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:35.174 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:35 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:35.174 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:35 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:35.174 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:35 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:35.174 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:35 trial158 ceph-mon[27763]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:59:35.174 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:35 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:35.174 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:35 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:35.174 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:35 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:35.175 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:35 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:35.175 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:35 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:35.175 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:35 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:35.175 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:35 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:35.175 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:35 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:35.175 INFO:journalctl@ceph.osd.5.trial158.stdout:Feb 13 03:59:35 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-5[40185]: 2026-02-13T03:59:35.058+0000 7f22ab5aa6c0 -1 osd.5 0 waiting for initial osdmap 2026-02-13T03:59:35.175 INFO:journalctl@ceph.osd.5.trial158.stdout:Feb 13 03:59:35 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-5[40185]: 2026-02-13T03:59:35.062+0000 7f22a746e6c0 -1 osd.5 34 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T03:59:35.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:35 trial092 ceph-mon[23047]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-13T03:59:35.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:35 trial092 ceph-mon[23047]: osdmap e33: 6 total, 5 up, 6 in 2026-02-13T03:59:35.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:35 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:59:35.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:35 trial092 ceph-mon[23047]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial158", "root=default"]} : dispatch 2026-02-13T03:59:35.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:35 trial092 ceph-mon[23047]: from='osd.5 [v2:10.20.193.158:6808/428074602,v1:10.20.193.158:6809/428074602]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial158", "root=default"]} : dispatch 2026-02-13T03:59:35.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:35 trial092 ceph-mon[23047]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:59:35.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:35 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:35.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:35 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:35.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:35 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T03:59:35.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:35 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T03:59:35.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:35 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:35.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:35 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:35.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:35 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:35.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:35 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:35.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:35 trial092 ceph-mon[23047]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:59:35.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:35 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:35.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:35 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:35.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:35 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:35.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:35 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:35.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:35 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:35.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:35 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:35.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:35 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:35.186 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:35 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:35.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:35 trial099 ceph-mon[27808]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2026-02-13T03:59:35.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:35 trial099 ceph-mon[27808]: osdmap e33: 6 total, 5 up, 6 in 2026-02-13T03:59:35.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:35 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:59:35.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:35 trial099 ceph-mon[27808]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial158", "root=default"]} : dispatch 2026-02-13T03:59:35.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:35 trial099 ceph-mon[27808]: from='osd.5 [v2:10.20.193.158:6808/428074602,v1:10.20.193.158:6809/428074602]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial158", "root=default"]} : dispatch 2026-02-13T03:59:35.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:35 trial099 ceph-mon[27808]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:59:35.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:35 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:35.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:35 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:35.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:35 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T03:59:35.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:35 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T03:59:35.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:35 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:35.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:35 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:35.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:35 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:35.368 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:35 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:35.368 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:35 trial099 ceph-mon[27808]: pgmap v72: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:59:35.368 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:35 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:35.368 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:35 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:35.368 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:35 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:35.368 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:35 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:35.368 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:35 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:35.368 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:35 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:35.368 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:35 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:35.368 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:35 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:36.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:36 trial158 ceph-mon[27763]: from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial092:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:59:36.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:36 trial158 ceph-mon[27763]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial158", "root=default"]}]': finished 2026-02-13T03:59:36.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:36 trial158 ceph-mon[27763]: osdmap e34: 6 total, 5 up, 6 in 2026-02-13T03:59:36.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:36 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:59:36.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:36 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:59:36.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:36 trial158 ceph-mon[27763]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:59:36.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:36 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:36.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:36 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:36.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:36 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:36.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:36 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:36.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:36 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:36.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:36 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:36.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:36 trial158 ceph-mon[27763]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:59:36.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:36 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:36.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:36 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:36.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:36 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:36.331 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:36 trial158 ceph-mon[27763]: osd.5 [v2:10.20.193.158:6808/428074602,v1:10.20.193.158:6809/428074602] boot 2026-02-13T03:59:36.331 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:36 trial158 ceph-mon[27763]: osdmap e35: 6 total, 6 up, 6 in 2026-02-13T03:59:36.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:36 trial099 ceph-mon[27808]: from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial092:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:59:36.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:36 trial099 ceph-mon[27808]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial158", "root=default"]}]': finished 2026-02-13T03:59:36.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:36 trial099 ceph-mon[27808]: osdmap e34: 6 total, 5 up, 6 in 2026-02-13T03:59:36.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:36 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:59:36.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:36 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:59:36.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:36 trial099 ceph-mon[27808]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:59:36.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:36 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:36.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:36 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:36.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:36 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:36.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:36 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:36.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:36 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:36.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:36 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:36.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:36 trial099 ceph-mon[27808]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:59:36.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:36 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:36.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:36 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:36.368 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:36 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:36.368 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:36 trial099 ceph-mon[27808]: osd.5 [v2:10.20.193.158:6808/428074602,v1:10.20.193.158:6809/428074602] boot 2026-02-13T03:59:36.368 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:36 trial099 ceph-mon[27808]: osdmap e35: 6 total, 6 up, 6 in 2026-02-13T03:59:36.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:36 trial092 ceph-mon[23047]: from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial092:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:59:36.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:36 trial092 ceph-mon[23047]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.6836, "args": ["host=trial158", "root=default"]}]': finished 2026-02-13T03:59:36.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:36 trial092 ceph-mon[23047]: osdmap e34: 6 total, 5 up, 6 in 2026-02-13T03:59:36.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:36 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:59:36.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:36 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:59:36.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:36 trial092 ceph-mon[23047]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:59:36.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:36 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:36.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:36 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:36.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:36 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:36.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:36 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:36.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:36 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:36.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:36 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:36.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:36 trial092 ceph-mon[23047]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 3.4 TiB / 3.4 TiB avail 2026-02-13T03:59:36.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:36 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:36.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:36 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:36.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:36 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:36.435 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:36 trial092 ceph-mon[23047]: osd.5 [v2:10.20.193.158:6808/428074602,v1:10.20.193.158:6809/428074602] boot 2026-02-13T03:59:36.435 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:36 trial092 ceph-mon[23047]: osdmap e35: 6 total, 6 up, 6 in 2026-02-13T03:59:37.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:37 trial158 ceph-mon[27763]: purged_snaps scrub starts 2026-02-13T03:59:37.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:37 trial158 ceph-mon[27763]: purged_snaps scrub ok 2026-02-13T03:59:37.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:37 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:59:37.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:37 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/539693703' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "17251a9f-8203-4bdf-87c5-1bd31254f2e0"} : dispatch 2026-02-13T03:59:37.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:37 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/539693703' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "17251a9f-8203-4bdf-87c5-1bd31254f2e0"}]': finished 2026-02-13T03:59:37.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:37 trial158 ceph-mon[27763]: osdmap e36: 7 total, 6 up, 7 in 2026-02-13T03:59:37.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:37 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:59:37.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:37 trial158 ceph-mon[27763]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:59:37.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:37 trial158 ceph-mon[27763]: Cluster is now healthy 2026-02-13T03:59:37.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:37 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/225957360' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:59:37.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:37 trial099 ceph-mon[27808]: purged_snaps scrub starts 2026-02-13T03:59:37.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:37 trial099 ceph-mon[27808]: purged_snaps scrub ok 2026-02-13T03:59:37.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:37 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:59:37.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:37 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/539693703' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "17251a9f-8203-4bdf-87c5-1bd31254f2e0"} : dispatch 2026-02-13T03:59:37.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:37 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/539693703' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "17251a9f-8203-4bdf-87c5-1bd31254f2e0"}]': finished 2026-02-13T03:59:37.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:37 trial099 ceph-mon[27808]: osdmap e36: 7 total, 6 up, 7 in 2026-02-13T03:59:37.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:37 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:59:37.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:37 trial099 ceph-mon[27808]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:59:37.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:37 trial099 ceph-mon[27808]: Cluster is now healthy 2026-02-13T03:59:37.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:37 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/225957360' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:59:37.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:37 trial092 ceph-mon[23047]: purged_snaps scrub starts 2026-02-13T03:59:37.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:37 trial092 ceph-mon[23047]: purged_snaps scrub ok 2026-02-13T03:59:37.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:37 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2026-02-13T03:59:37.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:37 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/539693703' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "17251a9f-8203-4bdf-87c5-1bd31254f2e0"} : dispatch 2026-02-13T03:59:37.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:37 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/539693703' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "17251a9f-8203-4bdf-87c5-1bd31254f2e0"}]': finished 2026-02-13T03:59:37.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:37 trial092 ceph-mon[23047]: osdmap e36: 7 total, 6 up, 7 in 2026-02-13T03:59:37.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:37 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:59:37.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:37 trial092 ceph-mon[23047]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:59:37.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:37 trial092 ceph-mon[23047]: Cluster is now healthy 2026-02-13T03:59:37.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:37 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/225957360' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:59:38.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:38 trial099 ceph-mon[27808]: osdmap e37: 7 total, 6 up, 7 in 2026-02-13T03:59:38.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:38 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:59:38.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:38 trial099 ceph-mon[27808]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T03:59:38.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:38 trial099 ceph-mon[27808]: osdmap e38: 7 total, 6 up, 7 in 2026-02-13T03:59:38.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:38 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:59:38.620 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:38 trial092 ceph-mon[23047]: osdmap e37: 7 total, 6 up, 7 in 2026-02-13T03:59:38.620 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:38 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:59:38.621 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:38 trial092 ceph-mon[23047]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T03:59:38.621 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:38 trial092 ceph-mon[23047]: osdmap e38: 7 total, 6 up, 7 in 2026-02-13T03:59:38.621 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:38 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:59:38.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:38 trial158 ceph-mon[27763]: osdmap e37: 7 total, 6 up, 7 in 2026-02-13T03:59:38.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:38 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:59:38.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:38 trial158 ceph-mon[27763]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T03:59:38.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:38 trial158 ceph-mon[27763]: osdmap e38: 7 total, 6 up, 7 in 2026-02-13T03:59:38.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:38 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:59:40.570 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:40 trial092 ceph-mon[23047]: pgmap v81: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 164 KiB/s, 0 objects/s recovering 2026-02-13T03:59:40.570 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:40 trial092 ceph-mon[23047]: osdmap e39: 7 total, 6 up, 7 in 2026-02-13T03:59:40.571 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:40 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:59:40.571 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:40 trial092 ceph-mon[23047]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:59:40.571 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:40 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-13T03:59:40.571 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:40 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:40.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:40 trial158 ceph-mon[27763]: pgmap v81: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 164 KiB/s, 0 objects/s recovering 2026-02-13T03:59:40.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:40 trial158 ceph-mon[27763]: osdmap e39: 7 total, 6 up, 7 in 2026-02-13T03:59:40.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:40 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:59:40.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:40 trial158 ceph-mon[27763]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:59:40.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:40 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-13T03:59:40.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:40 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:40.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:40 trial099 ceph-mon[27808]: pgmap v81: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 164 KiB/s, 0 objects/s recovering 2026-02-13T03:59:40.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:40 trial099 ceph-mon[27808]: osdmap e39: 7 total, 6 up, 7 in 2026-02-13T03:59:40.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:40 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:59:40.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:40 trial099 ceph-mon[27808]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:59:40.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:40 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2026-02-13T03:59:40.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:40 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:42.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:42 trial158 ceph-mon[27763]: pgmap v83: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 119 KiB/s, 0 objects/s recovering 2026-02-13T03:59:42.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:42 trial099 ceph-mon[27808]: pgmap v83: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 119 KiB/s, 0 objects/s recovering 2026-02-13T03:59:42.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:42 trial092 ceph-mon[23047]: pgmap v83: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 119 KiB/s, 0 objects/s recovering 2026-02-13T03:59:44.261 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:44 trial092 ceph-mon[23047]: pgmap v84: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 99 KiB/s, 0 objects/s recovering 2026-02-13T03:59:44.262 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:44 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:44.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:44 trial158 ceph-mon[27763]: pgmap v84: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 99 KiB/s, 0 objects/s recovering 2026-02-13T03:59:44.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:44 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:44.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:44 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:44.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:44 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:44.599 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:44 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:44.599 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:44 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:44.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:44 trial099 ceph-mon[27808]: pgmap v84: 1 pgs: 1 peering; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 99 KiB/s, 0 objects/s recovering 2026-02-13T03:59:44.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:44 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:44.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:44 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:44.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:44 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:44.709 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:44.706+0000 7f03ed7fa6c0 1 -- 10.20.193.92:0/2129899362 <== mgr.14187 v2:10.20.193.92:6800/4191527999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f03e0009970 con 0x7f03c40b56d0 2026-02-13T03:59:44.709 INFO:teuthology.orchestra.run.trial092.stdout:Created osd(s) 6 on host 'trial092' 2026-02-13T03:59:44.711 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:44.708+0000 7f03f53246c0 1 -- 10.20.193.92:0/2129899362 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f03c40b56d0 msgr2=0x7f03c40d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:59:44.712 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:44.708+0000 7f03f53246c0 1 --2- 10.20.193.92:0/2129899362 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f03c40b56d0 0x7f03c40d5b80 secure :-1 s=READY pgs=74 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f03f0123740 tx=0x7f03e0009260 comp rx=0 tx=0).stop 2026-02-13T03:59:44.712 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:44.708+0000 7f03f53246c0 1 -- 10.20.193.92:0/2129899362 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f03f010f060 msgr2=0x7f03f011cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:59:44.712 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:44.708+0000 7f03f53246c0 1 --2- 10.20.193.92:0/2129899362 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f03f010f060 0x7f03f011cdb0 secure :-1 s=READY pgs=47 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f03dc004750 tx=0x7f03dc00be00 comp rx=0 tx=0).stop 2026-02-13T03:59:44.712 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:44.709+0000 7f03f53246c0 1 -- 10.20.193.92:0/2129899362 shutdown_connections 2026-02-13T03:59:44.712 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:44.709+0000 7f03f53246c0 1 --2- 10.20.193.92:0/2129899362 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f03c40b56d0 0x7f03c40d5b80 unknown :-1 s=CLOSED pgs=74 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:44.712 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:44.709+0000 7f03f53246c0 1 --2- 10.20.193.92:0/2129899362 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f03f0115270 0x7f03f011d2f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:44.712 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:44.709+0000 7f03f53246c0 1 --2- 10.20.193.92:0/2129899362 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f03f01226b0 0x7f03f0122b50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:44.712 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:44.709+0000 7f03f53246c0 1 --2- 10.20.193.92:0/2129899362 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f03f010f060 0x7f03f011cdb0 unknown :-1 s=CLOSED pgs=47 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:44.712 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:44.709+0000 7f03f53246c0 1 -- 10.20.193.92:0/2129899362 >> 10.20.193.92:0/2129899362 conn(0x7f03f00ec980 msgr2=0x7f03f010cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:59:44.713 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:44.709+0000 7f03f53246c0 1 -- 10.20.193.92:0/2129899362 shutdown_connections 2026-02-13T03:59:44.713 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T03:59:44.709+0000 7f03f53246c0 1 -- 10.20.193.92:0/2129899362 wait complete. 2026-02-13T03:59:44.815 DEBUG:teuthology.orchestra.run.trial092:osd.6> sudo journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@osd.6.service 2026-02-13T03:59:44.819 INFO:tasks.cephadm:Deploying osd.7 on trial099 with /dev/vg_nvme/lv_2... 2026-02-13T03:59:44.819 DEBUG:teuthology.orchestra.run.trial099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-13T03:59:44.940 INFO:teuthology.orchestra.run.trial099.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.b/config 2026-02-13T03:59:45.354 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:45 trial099 ceph-mon[27808]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-13T03:59:45.355 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:45 trial099 ceph-mon[27808]: from='osd.6 [v2:10.20.193.92:6818/1823230093,v1:10.20.193.92:6819/1823230093]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-13T03:59:45.355 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:45 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:45.355 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:45 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:45.355 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:45 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:45.355 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:45 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:45.387 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-13T03:59:45.405 DEBUG:teuthology.orchestra.run.trial099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph orch daemon add osd trial099:vg_nvme/lv_2 --skip-validation 2026-02-13T03:59:45.523 INFO:teuthology.orchestra.run.trial099.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.b/config 2026-02-13T03:59:45.553 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:45 trial092 ceph-mon[23047]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-13T03:59:45.553 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:45 trial092 ceph-mon[23047]: from='osd.6 [v2:10.20.193.92:6818/1823230093,v1:10.20.193.92:6819/1823230093]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-13T03:59:45.553 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:45 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:45.553 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:45 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:45.553 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:45 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:45.553 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:45 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:45.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:45 trial158 ceph-mon[27763]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-13T03:59:45.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:45 trial158 ceph-mon[27763]: from='osd.6 [v2:10.20.193.92:6818/1823230093,v1:10.20.193.92:6819/1823230093]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2026-02-13T03:59:45.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:45 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:45.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:45 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:45.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:45 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:45.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:45 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:45.643 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:45.637+0000 7f4eabe4c6c0 1 -- 10.20.193.99:0/1209071986 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4ea410f230 msgr2=0x7f4ea410f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:59:45.643 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:45.637+0000 7f4eabe4c6c0 1 --2- 10.20.193.99:0/1209071986 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4ea410f230 0x7f4ea410f600 secure :-1 s=READY pgs=51 gs=1 cs=0 l=1 c_cookie=10815913681265324898 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e90009970 tx=0x7f4e9002ed20 comp rx=0 tx=0).stop 2026-02-13T03:59:45.643 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:45.638+0000 7f4eabe4c6c0 1 -- 10.20.193.99:0/1209071986 shutdown_connections 2026-02-13T03:59:45.643 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:45.638+0000 7f4eabe4c6c0 1 --2- 10.20.193.99:0/1209071986 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4ea4115440 0x7f4ea4175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:45.643 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:45.638+0000 7f4eabe4c6c0 1 --2- 10.20.193.99:0/1209071986 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4ea410fc20 0x7f4ea4114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:45.643 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:45.638+0000 7f4eabe4c6c0 1 --2- 10.20.193.99:0/1209071986 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4ea410f230 0x7f4ea410f600 unknown :-1 s=CLOSED pgs=51 gs=1 cs=0 l=1 c_cookie=10815913681265324898 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:45.644 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:45.638+0000 7f4eabe4c6c0 1 -- 10.20.193.99:0/1209071986 >> 10.20.193.99:0/1209071986 conn(0x7f4ea40ecb30 msgr2=0x7f4ea410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:59:45.644 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:45.638+0000 7f4eabe4c6c0 1 -- 10.20.193.99:0/1209071986 shutdown_connections 2026-02-13T03:59:45.644 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:45.638+0000 7f4eabe4c6c0 1 -- 10.20.193.99:0/1209071986 wait complete. 2026-02-13T03:59:45.644 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:45.638+0000 7f4eabe4c6c0 1 Processor -- start 2026-02-13T03:59:45.644 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:45.638+0000 7f4eabe4c6c0 1 -- start start 2026-02-13T03:59:45.644 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:45.638+0000 7f4eabe4c6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4ea410f230 0x7f4ea411d080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:59:45.644 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:45.638+0000 7f4eabe4c6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4ea4115440 0x7f4ea411d5c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:59:45.644 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:45.638+0000 7f4eabe4c6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4ea4122980 0x7f4ea4122e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:59:45.644 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:45.638+0000 7f4eabe4c6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea4123360 con 0x7f4ea410f230 2026-02-13T03:59:45.644 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:45.638+0000 7f4eabe4c6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea41234d0 con 0x7f4ea4115440 2026-02-13T03:59:45.644 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:45.638+0000 7f4eabe4c6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea4123690 con 0x7f4ea4122980 2026-02-13T03:59:45.645 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:45.638+0000 7f4ea93c06c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4ea4115440 0x7f4ea411d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:59:45.645 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:45.638+0000 7f4ea93c06c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4ea4115440 0x7f4ea411d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.99:43776/0 (socket says 10.20.193.99:43776) 2026-02-13T03:59:45.645 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:45.638+0000 7f4ea93c06c0 1 -- 10.20.193.99:0/2909676312 learned_addr learned my addr 10.20.193.99:0/2909676312 (peer_addr_for_me v2:10.20.193.99:0/0) 2026-02-13T03:59:45.645 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:45.638+0000 7f4ea9bc16c0 1 --2- 10.20.193.99:0/2909676312 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4ea410f230 0x7f4ea411d080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:59:45.645 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:45.638+0000 7f4eaa3c26c0 1 --2- 10.20.193.99:0/2909676312 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4ea4122980 0x7f4ea4122e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:59:45.645 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:45.638+0000 7f4ea93c06c0 1 -- 10.20.193.99:0/2909676312 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4ea4122980 msgr2=0x7f4ea4122e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:59:45.645 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:45.638+0000 7f4ea93c06c0 1 --2- 10.20.193.99:0/2909676312 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4ea4122980 0x7f4ea4122e20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:45.645 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:45.638+0000 7f4ea93c06c0 1 -- 10.20.193.99:0/2909676312 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4ea410f230 msgr2=0x7f4ea411d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:59:45.645 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:45.638+0000 7f4ea93c06c0 1 --2- 10.20.193.99:0/2909676312 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4ea410f230 0x7f4ea411d080 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:45.645 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:45.638+0000 7f4ea93c06c0 1 -- 10.20.193.99:0/2909676312 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e90009590 con 0x7f4ea4115440 2026-02-13T03:59:45.645 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:45.638+0000 7f4eaa3c26c0 1 --2- 10.20.193.99:0/2909676312 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4ea4122980 0x7f4ea4122e20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T03:59:45.645 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:45.638+0000 7f4ea93c06c0 1 --2- 10.20.193.99:0/2909676312 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4ea4115440 0x7f4ea411d5c0 secure :-1 s=READY pgs=52 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e8c00b650 tx=0x7f4e8c00bb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:59:45.646 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:45.638+0000 7f4ea2ffd6c0 1 -- 10.20.193.99:0/2909676312 <== mon.2 v2:10.20.193.99:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4e8c0044a0 con 0x7f4ea4115440 2026-02-13T03:59:45.646 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:45.638+0000 7f4ea2ffd6c0 1 -- 10.20.193.99:0/2909676312 <== mon.2 v2:10.20.193.99:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f4e8c009030 con 0x7f4ea4115440 2026-02-13T03:59:45.646 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:45.639+0000 7f4ea2ffd6c0 1 -- 10.20.193.99:0/2909676312 <== mon.2 v2:10.20.193.99:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4e8c00ce60 con 0x7f4ea4115440 2026-02-13T03:59:45.646 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:45.639+0000 7f4eabe4c6c0 1 -- 10.20.193.99:0/2909676312 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ea4163b10 con 0x7f4ea4115440 2026-02-13T03:59:45.646 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:45.639+0000 7f4eabe4c6c0 1 -- 10.20.193.99:0/2909676312 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ea4163fa0 con 0x7f4ea4115440 2026-02-13T03:59:45.646 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:45.639+0000 7f4eabe4c6c0 1 -- 10.20.193.99:0/2909676312 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ea4110500 con 0x7f4ea4115440 2026-02-13T03:59:45.647 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:45.641+0000 7f4ea2ffd6c0 1 -- 10.20.193.99:0/2909676312 <== mon.2 v2:10.20.193.99:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f4e8c00c410 con 0x7f4ea4115440 2026-02-13T03:59:45.647 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:45.641+0000 7f4ea2ffd6c0 1 --2- 10.20.193.99:0/2909676312 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f4e6c0b5640 0x7f4e6c0d5af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:59:45.647 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:45.642+0000 7f4ea2ffd6c0 1 -- 10.20.193.99:0/2909676312 <== mon.2 v2:10.20.193.99:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4661+0+0 (secure 0 0 0) 0x7f4e8c0e2d50 con 0x7f4ea4115440 2026-02-13T03:59:45.647 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:45.642+0000 7f4ea2ffd6c0 1 -- 10.20.193.99:0/2909676312 <== mon.2 v2:10.20.193.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4e8c0e31d0 con 0x7f4ea4115440 2026-02-13T03:59:45.647 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:45.642+0000 7f4ea9bc16c0 1 --2- 10.20.193.99:0/2909676312 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f4e6c0b5640 0x7f4e6c0d5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:59:45.648 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:45.642+0000 7f4ea9bc16c0 1 --2- 10.20.193.99:0/2909676312 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f4e6c0b5640 0x7f4e6c0d5af0 secure :-1 s=READY pgs=79 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e900023e0 tx=0x7f4e90005c60 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:59:45.742 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:45.738+0000 7f4eabe4c6c0 1 -- 10.20.193.99:0/2909676312 --> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial099:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f4ea411e230 con 0x7f4e6c0b5640 2026-02-13T03:59:46.359 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:46 trial099 ceph-mon[27808]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 77 KiB/s, 0 objects/s recovering 2026-02-13T03:59:46.360 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:46 trial099 ceph-mon[27808]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-13T03:59:46.360 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:46 trial099 ceph-mon[27808]: osdmap e40: 7 total, 6 up, 7 in 2026-02-13T03:59:46.360 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:46 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:59:46.360 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:46 trial099 ceph-mon[27808]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial092", "root=default"]} : dispatch 2026-02-13T03:59:46.360 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:46 trial099 ceph-mon[27808]: from='osd.6 [v2:10.20.193.92:6818/1823230093,v1:10.20.193.92:6819/1823230093]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial092", "root=default"]} : dispatch 2026-02-13T03:59:46.360 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:46 trial099 ceph-mon[27808]: from='client.24428 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial099:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:59:46.360 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:46 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:46.360 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:46 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:46.360 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:46 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:46.360 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:46 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:46.361 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:46 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:46.527 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:46 trial092 ceph-mon[23047]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 77 KiB/s, 0 objects/s recovering 2026-02-13T03:59:46.528 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:46 trial092 ceph-mon[23047]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-13T03:59:46.528 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:46 trial092 ceph-mon[23047]: osdmap e40: 7 total, 6 up, 7 in 2026-02-13T03:59:46.528 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:46 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:59:46.528 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:46 trial092 ceph-mon[23047]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial092", "root=default"]} : dispatch 2026-02-13T03:59:46.528 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:46 trial092 ceph-mon[23047]: from='osd.6 [v2:10.20.193.92:6818/1823230093,v1:10.20.193.92:6819/1823230093]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial092", "root=default"]} : dispatch 2026-02-13T03:59:46.528 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:46 trial092 ceph-mon[23047]: from='client.24428 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial099:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:59:46.528 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:46 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:46.528 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:46 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:46.528 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:46 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:46.529 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:46 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:46.529 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:46 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:46.529 INFO:journalctl@ceph.osd.6.trial092.stdout:Feb 13 03:59:46 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-6[47366]: 2026-02-13T03:59:46.269+0000 7f847b64d6c0 -1 osd.6 0 waiting for initial osdmap 2026-02-13T03:59:46.529 INFO:journalctl@ceph.osd.6.trial092.stdout:Feb 13 03:59:46 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-6[47366]: 2026-02-13T03:59:46.277+0000 7f84735096c0 -1 osd.6 41 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T03:59:46.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:46 trial158 ceph-mon[27763]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail; 77 KiB/s, 0 objects/s recovering 2026-02-13T03:59:46.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:46 trial158 ceph-mon[27763]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2026-02-13T03:59:46.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:46 trial158 ceph-mon[27763]: osdmap e40: 7 total, 6 up, 7 in 2026-02-13T03:59:46.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:46 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:59:46.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:46 trial158 ceph-mon[27763]: from='osd.6 ' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial092", "root=default"]} : dispatch 2026-02-13T03:59:46.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:46 trial158 ceph-mon[27763]: from='osd.6 [v2:10.20.193.92:6818/1823230093,v1:10.20.193.92:6819/1823230093]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial092", "root=default"]} : dispatch 2026-02-13T03:59:46.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:46 trial158 ceph-mon[27763]: from='client.24428 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial099:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:59:46.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:46 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:46.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:46 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:46.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:46 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:46.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:46 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:46.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:46 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:47.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:47 trial158 ceph-mon[27763]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial092", "root=default"]}]': finished 2026-02-13T03:59:47.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:47 trial158 ceph-mon[27763]: osdmap e41: 7 total, 6 up, 7 in 2026-02-13T03:59:47.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:47 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:59:47.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:47 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:59:47.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:47 trial158 ceph-mon[27763]: from='client.? 10.20.193.99:0/280629407' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6775e50d-691e-472f-a99e-d6cd4786d4b1"} : dispatch 2026-02-13T03:59:47.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:47 trial158 ceph-mon[27763]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6775e50d-691e-472f-a99e-d6cd4786d4b1"} : dispatch 2026-02-13T03:59:47.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:47 trial158 ceph-mon[27763]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6775e50d-691e-472f-a99e-d6cd4786d4b1"}]': finished 2026-02-13T03:59:47.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:47 trial158 ceph-mon[27763]: osd.6 [v2:10.20.193.92:6818/1823230093,v1:10.20.193.92:6819/1823230093] boot 2026-02-13T03:59:47.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:47 trial158 ceph-mon[27763]: osdmap e42: 8 total, 7 up, 8 in 2026-02-13T03:59:47.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:47 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:59:47.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:47 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:59:47.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:47 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:47.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:47 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:47.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:47 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T03:59:47.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:47 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T03:59:47.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:47 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T03:59:47.581 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:47 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:47.581 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:47 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:47.581 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:47 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:47.581 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:47 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:47.581 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:47 trial158 ceph-mon[27763]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T03:59:47.581 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:47 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:47.581 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:47 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:47.581 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:47 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:47.581 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:47 trial158 ceph-mon[27763]: from='client.? 10.20.193.99:0/2407552781' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:59:47.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:47 trial099 ceph-mon[27808]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial092", "root=default"]}]': finished 2026-02-13T03:59:47.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:47 trial099 ceph-mon[27808]: osdmap e41: 7 total, 6 up, 7 in 2026-02-13T03:59:47.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:47 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:59:47.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:47 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:59:47.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:47 trial099 ceph-mon[27808]: from='client.? 10.20.193.99:0/280629407' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6775e50d-691e-472f-a99e-d6cd4786d4b1"} : dispatch 2026-02-13T03:59:47.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:47 trial099 ceph-mon[27808]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6775e50d-691e-472f-a99e-d6cd4786d4b1"} : dispatch 2026-02-13T03:59:47.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:47 trial099 ceph-mon[27808]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6775e50d-691e-472f-a99e-d6cd4786d4b1"}]': finished 2026-02-13T03:59:47.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:47 trial099 ceph-mon[27808]: osd.6 [v2:10.20.193.92:6818/1823230093,v1:10.20.193.92:6819/1823230093] boot 2026-02-13T03:59:47.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:47 trial099 ceph-mon[27808]: osdmap e42: 8 total, 7 up, 8 in 2026-02-13T03:59:47.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:47 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:59:47.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:47 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:59:47.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:47 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:47.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:47 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:47.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:47 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T03:59:47.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:47 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T03:59:47.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:47 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T03:59:47.618 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:47 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:47.618 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:47 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:47.618 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:47 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:47.618 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:47 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:47.618 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:47 trial099 ceph-mon[27808]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T03:59:47.618 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:47 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:47.618 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:47 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:47.618 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:47 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:47.618 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:47 trial099 ceph-mon[27808]: from='client.? 10.20.193.99:0/2407552781' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:59:47.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:47 trial092 ceph-mon[23047]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.6836, "args": ["host=trial092", "root=default"]}]': finished 2026-02-13T03:59:47.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:47 trial092 ceph-mon[23047]: osdmap e41: 7 total, 6 up, 7 in 2026-02-13T03:59:47.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:47 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:59:47.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:47 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:59:47.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:47 trial092 ceph-mon[23047]: from='client.? 10.20.193.99:0/280629407' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6775e50d-691e-472f-a99e-d6cd4786d4b1"} : dispatch 2026-02-13T03:59:47.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:47 trial092 ceph-mon[23047]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "6775e50d-691e-472f-a99e-d6cd4786d4b1"} : dispatch 2026-02-13T03:59:47.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:47 trial092 ceph-mon[23047]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6775e50d-691e-472f-a99e-d6cd4786d4b1"}]': finished 2026-02-13T03:59:47.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:47 trial092 ceph-mon[23047]: osd.6 [v2:10.20.193.92:6818/1823230093,v1:10.20.193.92:6819/1823230093] boot 2026-02-13T03:59:47.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:47 trial092 ceph-mon[23047]: osdmap e42: 8 total, 7 up, 8 in 2026-02-13T03:59:47.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:47 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2026-02-13T03:59:47.685 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:47 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:59:47.685 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:47 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:47.685 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:47 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:47.685 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:47 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T03:59:47.685 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:47 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T03:59:47.685 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:47 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T03:59:47.685 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:47 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:47.685 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:47 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:47.685 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:47 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:47.685 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:47 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:47.685 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:47 trial092 ceph-mon[23047]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 4.1 TiB / 4.1 TiB avail 2026-02-13T03:59:47.685 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:47 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:47.686 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:47 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:47.686 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:47 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:47.686 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:47 trial092 ceph-mon[23047]: from='client.? 10.20.193.99:0/2407552781' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:59:48.524 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:48 trial099 ceph-mon[27808]: purged_snaps scrub starts 2026-02-13T03:59:48.525 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:48 trial099 ceph-mon[27808]: purged_snaps scrub ok 2026-02-13T03:59:48.525 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:48 trial099 ceph-mon[27808]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:59:48.525 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:48 trial099 ceph-mon[27808]: Cluster is now healthy 2026-02-13T03:59:48.525 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:48 trial099 ceph-mon[27808]: osdmap e43: 8 total, 7 up, 8 in 2026-02-13T03:59:48.525 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:48 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:59:48.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:48 trial158 ceph-mon[27763]: purged_snaps scrub starts 2026-02-13T03:59:48.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:48 trial158 ceph-mon[27763]: purged_snaps scrub ok 2026-02-13T03:59:48.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:48 trial158 ceph-mon[27763]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:59:48.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:48 trial158 ceph-mon[27763]: Cluster is now healthy 2026-02-13T03:59:48.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:48 trial158 ceph-mon[27763]: osdmap e43: 8 total, 7 up, 8 in 2026-02-13T03:59:48.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:48 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:59:48.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:48 trial092 ceph-mon[23047]: purged_snaps scrub starts 2026-02-13T03:59:48.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:48 trial092 ceph-mon[23047]: purged_snaps scrub ok 2026-02-13T03:59:48.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:48 trial092 ceph-mon[23047]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:59:48.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:48 trial092 ceph-mon[23047]: Cluster is now healthy 2026-02-13T03:59:48.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:48 trial092 ceph-mon[23047]: osdmap e43: 8 total, 7 up, 8 in 2026-02-13T03:59:48.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:48 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:59:49.363 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:49 trial099 ceph-mon[27808]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:59:49.363 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:49 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:49.364 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:49 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:49.364 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:49 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:49.364 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:49 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:49.364 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:49 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:49.364 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:49 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:49.364 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:49 trial099 ceph-mon[27808]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:59:49.364 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:49 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:49.364 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:49 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:49.364 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:49 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:49.364 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:49 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-13T03:59:49.365 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:49 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:49.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:49 trial158 ceph-mon[27763]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:59:49.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:49 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:49.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:49 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:49.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:49 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:49.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:49 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:49.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:49 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:49.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:49 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:49.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:49 trial158 ceph-mon[27763]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:59:49.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:49 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:49.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:49 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:49.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:49 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:49.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:49 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-13T03:59:49.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:49 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:49.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:49 trial092 ceph-mon[23047]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:59:49.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:49 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:49.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:49 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:49.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:49 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:49.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:49 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:49.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:49 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:49.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:49 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:49.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:49 trial092 ceph-mon[23047]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:59:49.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:49 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:49.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:49 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:49.685 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:49 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:49.685 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:49 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2026-02-13T03:59:49.685 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:49 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:50.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:50 trial158 ceph-mon[27763]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:59:50.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:50 trial158 ceph-mon[27763]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:59:50.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:50 trial099 ceph-mon[27808]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:59:50.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:50 trial099 ceph-mon[27808]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:59:50.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:50 trial092 ceph-mon[23047]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:59:50.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:50 trial092 ceph-mon[23047]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:59:51.533 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:51 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:51.533 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:51 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:51.534 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:51 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:51.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:51 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:51.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:51 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:51.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:51 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:51.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:51 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:51.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:51 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:51.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:51 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:52.112 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:52.109+0000 7f4ea2ffd6c0 1 -- 10.20.193.99:0/2909676312 <== mgr.14187 v2:10.20.193.92:6800/4191527999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f4ea411e230 con 0x7f4e6c0b5640 2026-02-13T03:59:52.112 INFO:teuthology.orchestra.run.trial099.stdout:Created osd(s) 7 on host 'trial099' 2026-02-13T03:59:52.114 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:52.112+0000 7f4eabe4c6c0 1 -- 10.20.193.99:0/2909676312 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f4e6c0b5640 msgr2=0x7f4e6c0d5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:59:52.114 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:52.112+0000 7f4eabe4c6c0 1 --2- 10.20.193.99:0/2909676312 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f4e6c0b5640 0x7f4e6c0d5af0 secure :-1 s=READY pgs=79 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e900023e0 tx=0x7f4e90005c60 comp rx=0 tx=0).stop 2026-02-13T03:59:52.114 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:52.112+0000 7f4eabe4c6c0 1 -- 10.20.193.99:0/2909676312 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4ea4115440 msgr2=0x7f4ea411d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:59:52.115 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:52.112+0000 7f4eabe4c6c0 1 --2- 10.20.193.99:0/2909676312 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4ea4115440 0x7f4ea411d5c0 secure :-1 s=READY pgs=52 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e8c00b650 tx=0x7f4e8c00bb20 comp rx=0 tx=0).stop 2026-02-13T03:59:52.115 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:52.112+0000 7f4eabe4c6c0 1 -- 10.20.193.99:0/2909676312 shutdown_connections 2026-02-13T03:59:52.115 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:52.112+0000 7f4eabe4c6c0 1 --2- 10.20.193.99:0/2909676312 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f4e6c0b5640 0x7f4e6c0d5af0 unknown :-1 s=CLOSED pgs=79 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:52.115 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:52.112+0000 7f4eabe4c6c0 1 --2- 10.20.193.99:0/2909676312 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4ea4115440 0x7f4ea411d5c0 unknown :-1 s=CLOSED pgs=52 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:52.115 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:52.112+0000 7f4eabe4c6c0 1 --2- 10.20.193.99:0/2909676312 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4ea4122980 0x7f4ea4122e20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:52.115 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:52.112+0000 7f4eabe4c6c0 1 --2- 10.20.193.99:0/2909676312 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4ea410f230 0x7f4ea411d080 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:52.115 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:52.112+0000 7f4eabe4c6c0 1 -- 10.20.193.99:0/2909676312 >> 10.20.193.99:0/2909676312 conn(0x7f4ea40ecb30 msgr2=0x7f4ea410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:59:52.115 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:52.112+0000 7f4eabe4c6c0 1 -- 10.20.193.99:0/2909676312 shutdown_connections 2026-02-13T03:59:52.115 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T03:59:52.112+0000 7f4eabe4c6c0 1 -- 10.20.193.99:0/2909676312 wait complete. 2026-02-13T03:59:52.156 DEBUG:teuthology.orchestra.run.trial099:osd.7> sudo journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@osd.7.service 2026-02-13T03:59:52.159 INFO:tasks.cephadm:Deploying osd.8 on trial158 with /dev/vg_nvme/lv_2... 2026-02-13T03:59:52.159 DEBUG:teuthology.orchestra.run.trial158:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_2 2026-02-13T03:59:52.278 INFO:teuthology.orchestra.run.trial158.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.c/config 2026-02-13T03:59:52.707 INFO:teuthology.orchestra.run.trial158.stdout: 2026-02-13T03:59:52.723 DEBUG:teuthology.orchestra.run.trial158:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph orch daemon add osd trial158:vg_nvme/lv_2 --skip-validation 2026-02-13T03:59:52.842 INFO:teuthology.orchestra.run.trial158.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.c/config 2026-02-13T03:59:52.957 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:52 trial158 ceph-mon[27763]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:59:52.957 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:52 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:52.958 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:52 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:52.958 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:52 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:52.958 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:52 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:52.958 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:52 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:52.958 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:52 trial158 ceph-mon[27763]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:59:52.958 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:52 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:52.958 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:52 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:52.958 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:52 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:52.958 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:52 trial158 ceph-mon[27763]: from='osd.7 [v2:10.20.193.99:6816/3951959773,v1:10.20.193.99:6817/3951959773]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T03:59:52.958 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:52 trial158 ceph-mon[27763]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T03:59:52.958 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:52 trial158 ceph-mon[27763]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:59:52.959 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:52 trial158 ceph-mon[27763]: Cluster is now healthy 2026-02-13T03:59:52.959 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:52 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:52.959 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:52 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:52.959 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:52 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:52.961 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:52.956+0000 7ffa72feb6c0 1 -- 10.20.193.158:0/2112229756 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ffa6c10f230 msgr2=0x7ffa6c10f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:59:52.961 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:52.956+0000 7ffa72feb6c0 1 --2- 10.20.193.158:0/2112229756 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ffa6c10f230 0x7ffa6c10f600 secure :-1 s=READY pgs=49 gs=1 cs=0 l=1 c_cookie=8435561435493580740 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa580099a0 tx=0x7ffa5802ed20 comp rx=0 tx=0).stop 2026-02-13T03:59:52.961 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:52.956+0000 7ffa72feb6c0 1 -- 10.20.193.158:0/2112229756 shutdown_connections 2026-02-13T03:59:52.961 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:52.956+0000 7ffa72feb6c0 1 --2- 10.20.193.158:0/2112229756 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ffa6c115440 0x7ffa6c175de0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:52.962 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:52.956+0000 7ffa72feb6c0 1 --2- 10.20.193.158:0/2112229756 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ffa6c10fc20 0x7ffa6c114c60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:52.962 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:52.956+0000 7ffa72feb6c0 1 --2- 10.20.193.158:0/2112229756 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ffa6c10f230 0x7ffa6c10f600 unknown :-1 s=CLOSED pgs=49 gs=1 cs=0 l=1 c_cookie=8435561435493580740 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:52.962 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:52.956+0000 7ffa72feb6c0 1 -- 10.20.193.158:0/2112229756 >> 10.20.193.158:0/2112229756 conn(0x7ffa6c0ecb30 msgr2=0x7ffa6c10cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:59:52.962 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:52.956+0000 7ffa72feb6c0 1 -- 10.20.193.158:0/2112229756 shutdown_connections 2026-02-13T03:59:52.962 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:52.956+0000 7ffa72feb6c0 1 -- 10.20.193.158:0/2112229756 wait complete. 2026-02-13T03:59:52.962 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:52.956+0000 7ffa72feb6c0 1 Processor -- start 2026-02-13T03:59:52.962 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:52.956+0000 7ffa72feb6c0 1 -- start start 2026-02-13T03:59:52.962 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:52.957+0000 7ffa72feb6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ffa6c10f230 0x7ffa6c11d030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:59:52.962 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:52.957+0000 7ffa72feb6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ffa6c115440 0x7ffa6c11d570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:59:52.962 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:52.957+0000 7ffa72feb6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ffa6c122930 0x7ffa6c122dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:59:52.962 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:52.957+0000 7ffa72feb6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6c123340 con 0x7ffa6c115440 2026-02-13T03:59:52.963 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:52.957+0000 7ffa72feb6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6c1234b0 con 0x7ffa6c10f230 2026-02-13T03:59:52.963 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:52.957+0000 7ffa72feb6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7ffa6c123670 con 0x7ffa6c122930 2026-02-13T03:59:52.963 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:52.957+0000 7ffa7155d6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ffa6c122930 0x7ffa6c122dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:59:52.963 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:52.957+0000 7ffa7155d6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ffa6c122930 0x7ffa6c122dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.158:56180/0 (socket says 10.20.193.158:56180) 2026-02-13T03:59:52.963 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:52.957+0000 7ffa7155d6c0 1 -- 10.20.193.158:0/913021878 learned_addr learned my addr 10.20.193.158:0/913021878 (peer_addr_for_me v2:10.20.193.158:0/0) 2026-02-13T03:59:52.963 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:52.957+0000 7ffa70d5c6c0 1 --2- 10.20.193.158:0/913021878 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ffa6c10f230 0x7ffa6c11d030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:59:52.963 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:52.957+0000 7ffa6bfff6c0 1 --2- 10.20.193.158:0/913021878 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ffa6c115440 0x7ffa6c11d570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:59:52.963 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:52.957+0000 7ffa7155d6c0 1 -- 10.20.193.158:0/913021878 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ffa6c10f230 msgr2=0x7ffa6c11d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:59:52.963 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:52.957+0000 7ffa7155d6c0 1 --2- 10.20.193.158:0/913021878 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ffa6c10f230 0x7ffa6c11d030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:52.963 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:52.957+0000 7ffa7155d6c0 1 -- 10.20.193.158:0/913021878 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ffa6c115440 msgr2=0x7ffa6c11d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:59:52.963 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:52.957+0000 7ffa7155d6c0 1 --2- 10.20.193.158:0/913021878 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ffa6c115440 0x7ffa6c11d570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:52.963 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:52.957+0000 7ffa7155d6c0 1 -- 10.20.193.158:0/913021878 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa58009590 con 0x7ffa6c122930 2026-02-13T03:59:52.964 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:52.957+0000 7ffa7155d6c0 1 --2- 10.20.193.158:0/913021878 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ffa6c122930 0x7ffa6c122dd0 secure :-1 s=READY pgs=50 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa60006ea0 tx=0x7ffa6000cca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:59:52.964 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:52.957+0000 7ffa69ffb6c0 1 -- 10.20.193.158:0/913021878 <== mon.1 v2:10.20.193.158:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffa60003a30 con 0x7ffa6c122930 2026-02-13T03:59:52.964 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:52.957+0000 7ffa69ffb6c0 1 -- 10.20.193.158:0/913021878 <== mon.1 v2:10.20.193.158:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7ffa60005560 con 0x7ffa6c122930 2026-02-13T03:59:52.964 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:52.957+0000 7ffa72feb6c0 1 -- 10.20.193.158:0/913021878 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa6c163b20 con 0x7ffa6c122930 2026-02-13T03:59:52.964 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:52.957+0000 7ffa69ffb6c0 1 -- 10.20.193.158:0/913021878 <== mon.1 v2:10.20.193.158:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffa600082a0 con 0x7ffa6c122930 2026-02-13T03:59:52.964 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:52.957+0000 7ffa72feb6c0 1 -- 10.20.193.158:0/913021878 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa6c163fb0 con 0x7ffa6c122930 2026-02-13T03:59:52.964 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:52.957+0000 7ffa72feb6c0 1 -- 10.20.193.158:0/913021878 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa6c110500 con 0x7ffa6c122930 2026-02-13T03:59:52.964 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:52.959+0000 7ffa69ffb6c0 1 -- 10.20.193.158:0/913021878 <== mon.1 v2:10.20.193.158:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7ffa6000d4d0 con 0x7ffa6c122930 2026-02-13T03:59:52.965 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:52.960+0000 7ffa69ffb6c0 1 --2- 10.20.193.158:0/913021878 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ffa340b5650 0x7ffa340d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T03:59:52.965 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:52.960+0000 7ffa69ffb6c0 1 -- 10.20.193.158:0/913021878 <== mon.1 v2:10.20.193.158:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5093+0+0 (secure 0 0 0) 0x7ffa600e4020 con 0x7ffa6c122930 2026-02-13T03:59:52.965 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:52.960+0000 7ffa70d5c6c0 1 --2- 10.20.193.158:0/913021878 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ffa340b5650 0x7ffa340d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T03:59:52.966 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:52.960+0000 7ffa69ffb6c0 1 -- 10.20.193.158:0/913021878 <== mon.1 v2:10.20.193.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ffa600e4510 con 0x7ffa6c122930 2026-02-13T03:59:52.966 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:52.961+0000 7ffa70d5c6c0 1 --2- 10.20.193.158:0/913021878 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ffa340b5650 0x7ffa340d5b00 secure :-1 s=READY pgs=84 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa580098c0 tx=0x7ffa580023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T03:59:53.059 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:53.057+0000 7ffa72feb6c0 1 -- 10.20.193.158:0/913021878 --> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial158:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7ffa6c11e210 con 0x7ffa340b5650 2026-02-13T03:59:53.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:52 trial099 ceph-mon[27808]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:59:53.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:52 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:53.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:52 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:53.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:52 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:53.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:52 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:53.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:52 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:53.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:52 trial099 ceph-mon[27808]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:59:53.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:52 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:53.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:52 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:53.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:52 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:53.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:52 trial099 ceph-mon[27808]: from='osd.7 [v2:10.20.193.99:6816/3951959773,v1:10.20.193.99:6817/3951959773]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T03:59:53.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:52 trial099 ceph-mon[27808]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T03:59:53.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:52 trial099 ceph-mon[27808]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:59:53.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:52 trial099 ceph-mon[27808]: Cluster is now healthy 2026-02-13T03:59:53.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:52 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:53.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:52 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:53.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:52 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:53.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:52 trial092 ceph-mon[23047]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:59:53.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:52 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:53.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:52 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:53.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:52 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:53.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:52 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:53.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:52 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:53.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:52 trial092 ceph-mon[23047]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:59:53.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:52 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:53.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:52 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:53.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:52 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:53.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:52 trial092 ceph-mon[23047]: from='osd.7 [v2:10.20.193.99:6816/3951959773,v1:10.20.193.99:6817/3951959773]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T03:59:53.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:52 trial092 ceph-mon[23047]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2026-02-13T03:59:53.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:52 trial092 ceph-mon[23047]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:59:53.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:52 trial092 ceph-mon[23047]: Cluster is now healthy 2026-02-13T03:59:53.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:52 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:53.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:52 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:53.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:52 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:53.977 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:53 trial158 ceph-mon[27763]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:59:53.978 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:53 trial158 ceph-mon[27763]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-13T03:59:53.978 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:53 trial158 ceph-mon[27763]: osdmap e44: 8 total, 7 up, 8 in 2026-02-13T03:59:53.978 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:53 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:59:53.978 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:53 trial158 ceph-mon[27763]: from='osd.7 [v2:10.20.193.99:6816/3951959773,v1:10.20.193.99:6817/3951959773]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial099", "root=default"]} : dispatch 2026-02-13T03:59:53.978 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:53 trial158 ceph-mon[27763]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial099", "root=default"]} : dispatch 2026-02-13T03:59:53.978 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:53 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:53.978 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:53 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:53.978 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:53 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:53.978 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:53 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:53.979 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:53 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:53.979 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:53 trial158 ceph-mon[27763]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:59:53.979 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:53 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:53.979 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:53 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:53.979 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:53 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T03:59:53.979 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:53 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T03:59:53.979 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:53 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T03:59:53.979 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:53 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:53.979 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:53 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:53.979 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:53 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:53.979 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:53 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:53.979 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:53 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:53.980 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:53 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:53.980 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:53 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:54.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:53 trial099 ceph-mon[27808]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:59:54.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:53 trial099 ceph-mon[27808]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-13T03:59:54.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:53 trial099 ceph-mon[27808]: osdmap e44: 8 total, 7 up, 8 in 2026-02-13T03:59:54.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:53 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:59:54.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:53 trial099 ceph-mon[27808]: from='osd.7 [v2:10.20.193.99:6816/3951959773,v1:10.20.193.99:6817/3951959773]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial099", "root=default"]} : dispatch 2026-02-13T03:59:54.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:53 trial099 ceph-mon[27808]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial099", "root=default"]} : dispatch 2026-02-13T03:59:54.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:53 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:54.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:53 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:54.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:53 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:54.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:53 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:54.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:53 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:54.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:53 trial099 ceph-mon[27808]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:59:54.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:53 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:54.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:53 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:54.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:53 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T03:59:54.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:53 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T03:59:54.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:53 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T03:59:54.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:53 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:54.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:53 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:54.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:53 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:54.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:53 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:54.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:53 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:54.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:53 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:54.119 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:53 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:54.119 INFO:journalctl@ceph.osd.7.trial099.stdout:Feb 13 03:59:53 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-7[46494]: 2026-02-13T03:59:53.732+0000 7fb9146a36c0 -1 osd.7 0 waiting for initial osdmap 2026-02-13T03:59:54.119 INFO:journalctl@ceph.osd.7.trial099.stdout:Feb 13 03:59:53 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-7[46494]: 2026-02-13T03:59:53.737+0000 7fb90c55f6c0 -1 osd.7 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T03:59:54.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:53 trial092 ceph-mon[23047]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:59:54.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:53 trial092 ceph-mon[23047]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2026-02-13T03:59:54.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:53 trial092 ceph-mon[23047]: osdmap e44: 8 total, 7 up, 8 in 2026-02-13T03:59:54.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:53 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:59:54.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:53 trial092 ceph-mon[23047]: from='osd.7 [v2:10.20.193.99:6816/3951959773,v1:10.20.193.99:6817/3951959773]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial099", "root=default"]} : dispatch 2026-02-13T03:59:54.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:53 trial092 ceph-mon[23047]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial099", "root=default"]} : dispatch 2026-02-13T03:59:54.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:53 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:54.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:53 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:54.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:53 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:54.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:53 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:54.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:53 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:54.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:53 trial092 ceph-mon[23047]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:59:54.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:53 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:54.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:53 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:54.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:53 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T03:59:54.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:53 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T03:59:54.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:53 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T03:59:54.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:53 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:54.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:53 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:54.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:53 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:54.186 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:53 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:54.186 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:53 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:54.186 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:53 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:54.186 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:53 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:55.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:54 trial158 ceph-mon[27763]: from='client.24454 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial158:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:59:55.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:54 trial158 ceph-mon[27763]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:59:55.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:54 trial158 ceph-mon[27763]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial099", "root=default"]}]': finished 2026-02-13T03:59:55.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:54 trial158 ceph-mon[27763]: osdmap e45: 8 total, 7 up, 8 in 2026-02-13T03:59:55.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:54 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:59:55.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:54 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:59:55.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:54 trial158 ceph-mon[27763]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a6be4612-8a0a-4590-95a9-82b973ad4c19"} : dispatch 2026-02-13T03:59:55.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:54 trial158 ceph-mon[27763]: from='client.? 10.20.193.158:0/709776607' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a6be4612-8a0a-4590-95a9-82b973ad4c19"} : dispatch 2026-02-13T03:59:55.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:54 trial158 ceph-mon[27763]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a6be4612-8a0a-4590-95a9-82b973ad4c19"}]': finished 2026-02-13T03:59:55.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:54 trial158 ceph-mon[27763]: osd.7 [v2:10.20.193.99:6816/3951959773,v1:10.20.193.99:6817/3951959773] boot 2026-02-13T03:59:55.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:54 trial158 ceph-mon[27763]: osdmap e46: 9 total, 8 up, 9 in 2026-02-13T03:59:55.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:54 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:59:55.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:54 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:59:55.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:54 trial158 ceph-mon[27763]: from='client.? 10.20.193.158:0/2302401096' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:59:55.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:54 trial158 ceph-mon[27763]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:59:55.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:54 trial158 ceph-mon[27763]: Cluster is now healthy 2026-02-13T03:59:55.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:54 trial099 ceph-mon[27808]: from='client.24454 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial158:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:59:55.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:54 trial099 ceph-mon[27808]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:59:55.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:54 trial099 ceph-mon[27808]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial099", "root=default"]}]': finished 2026-02-13T03:59:55.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:54 trial099 ceph-mon[27808]: osdmap e45: 8 total, 7 up, 8 in 2026-02-13T03:59:55.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:54 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:59:55.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:54 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:59:55.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:54 trial099 ceph-mon[27808]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a6be4612-8a0a-4590-95a9-82b973ad4c19"} : dispatch 2026-02-13T03:59:55.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:54 trial099 ceph-mon[27808]: from='client.? 10.20.193.158:0/709776607' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a6be4612-8a0a-4590-95a9-82b973ad4c19"} : dispatch 2026-02-13T03:59:55.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:54 trial099 ceph-mon[27808]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a6be4612-8a0a-4590-95a9-82b973ad4c19"}]': finished 2026-02-13T03:59:55.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:54 trial099 ceph-mon[27808]: osd.7 [v2:10.20.193.99:6816/3951959773,v1:10.20.193.99:6817/3951959773] boot 2026-02-13T03:59:55.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:54 trial099 ceph-mon[27808]: osdmap e46: 9 total, 8 up, 9 in 2026-02-13T03:59:55.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:54 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:59:55.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:54 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:59:55.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:54 trial099 ceph-mon[27808]: from='client.? 10.20.193.158:0/2302401096' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:59:55.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:54 trial099 ceph-mon[27808]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:59:55.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:54 trial099 ceph-mon[27808]: Cluster is now healthy 2026-02-13T03:59:55.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:54 trial092 ceph-mon[23047]: from='client.24454 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial158:vg_nvme/lv_2", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T03:59:55.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:54 trial092 ceph-mon[23047]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 4.8 TiB / 4.8 TiB avail 2026-02-13T03:59:55.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:54 trial092 ceph-mon[23047]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.6836, "args": ["host=trial099", "root=default"]}]': finished 2026-02-13T03:59:55.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:54 trial092 ceph-mon[23047]: osdmap e45: 8 total, 7 up, 8 in 2026-02-13T03:59:55.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:54 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:59:55.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:54 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:59:55.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:54 trial092 ceph-mon[23047]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a6be4612-8a0a-4590-95a9-82b973ad4c19"} : dispatch 2026-02-13T03:59:55.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:54 trial092 ceph-mon[23047]: from='client.? 10.20.193.158:0/709776607' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a6be4612-8a0a-4590-95a9-82b973ad4c19"} : dispatch 2026-02-13T03:59:55.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:54 trial092 ceph-mon[23047]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a6be4612-8a0a-4590-95a9-82b973ad4c19"}]': finished 2026-02-13T03:59:55.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:54 trial092 ceph-mon[23047]: osd.7 [v2:10.20.193.99:6816/3951959773,v1:10.20.193.99:6817/3951959773] boot 2026-02-13T03:59:55.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:54 trial092 ceph-mon[23047]: osdmap e46: 9 total, 8 up, 9 in 2026-02-13T03:59:55.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:54 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2026-02-13T03:59:55.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:54 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:59:55.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:54 trial092 ceph-mon[23047]: from='client.? 10.20.193.158:0/2302401096' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T03:59:55.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:54 trial092 ceph-mon[23047]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T03:59:55.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:54 trial092 ceph-mon[23047]: Cluster is now healthy 2026-02-13T03:59:56.141 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:55 trial158 ceph-mon[27763]: purged_snaps scrub starts 2026-02-13T03:59:56.142 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:55 trial158 ceph-mon[27763]: purged_snaps scrub ok 2026-02-13T03:59:56.142 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:55 trial158 ceph-mon[27763]: osdmap e47: 9 total, 8 up, 9 in 2026-02-13T03:59:56.142 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:55 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:59:56.142 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:55 trial158 ceph-mon[27763]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:59:56.142 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:55 trial158 ceph-mon[27763]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:59:56.142 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:55 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:56.142 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:55 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:56.142 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:55 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:56.143 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:55 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:56.143 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:55 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:56.143 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:55 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:56.143 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:55 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:56.143 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:55 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:56.143 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:55 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:56.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:55 trial092 ceph-mon[23047]: purged_snaps scrub starts 2026-02-13T03:59:56.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:55 trial092 ceph-mon[23047]: purged_snaps scrub ok 2026-02-13T03:59:56.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:55 trial092 ceph-mon[23047]: osdmap e47: 9 total, 8 up, 9 in 2026-02-13T03:59:56.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:55 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:59:56.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:55 trial092 ceph-mon[23047]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:59:56.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:55 trial092 ceph-mon[23047]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:59:56.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:55 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:56.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:55 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:56.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:55 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:56.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:55 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:56.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:55 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:56.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:55 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:56.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:55 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:56.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:55 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:56.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:55 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:56.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:55 trial099 ceph-mon[27808]: purged_snaps scrub starts 2026-02-13T03:59:56.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:55 trial099 ceph-mon[27808]: purged_snaps scrub ok 2026-02-13T03:59:56.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:55 trial099 ceph-mon[27808]: osdmap e47: 9 total, 8 up, 9 in 2026-02-13T03:59:56.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:55 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:59:56.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:55 trial099 ceph-mon[27808]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:59:56.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:55 trial099 ceph-mon[27808]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:59:56.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:55 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:56.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:55 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:56.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:55 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:56.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:55 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:56.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:55 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T03:59:56.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:55 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:56.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:55 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T03:59:56.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:55 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T03:59:56.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:55 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:56.990 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:56 trial158 ceph-mon[27763]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:59:56.990 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:56 trial158 ceph-mon[27763]: osdmap e48: 9 total, 8 up, 9 in 2026-02-13T03:59:56.990 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:56 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:59:56.990 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:56 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-13T03:59:56.990 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:56 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:56.990 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:56 trial158 ceph-mon[27763]: pgmap v106: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:59:57.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:56 trial092 ceph-mon[23047]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:59:57.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:56 trial092 ceph-mon[23047]: osdmap e48: 9 total, 8 up, 9 in 2026-02-13T03:59:57.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:56 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:59:57.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:56 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-13T03:59:57.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:56 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:57.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:56 trial092 ceph-mon[23047]: pgmap v106: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:59:57.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:56 trial099 ceph-mon[27808]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:59:57.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:56 trial099 ceph-mon[27808]: osdmap e48: 9 total, 8 up, 9 in 2026-02-13T03:59:57.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:56 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:59:57.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:56 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2026-02-13T03:59:57.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:56 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T03:59:57.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:56 trial099 ceph-mon[27808]: pgmap v106: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:59:58.160 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:57 trial158 ceph-mon[27763]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:59:58.160 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:57 trial158 ceph-mon[27763]: osdmap e49: 9 total, 8 up, 9 in 2026-02-13T03:59:58.160 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:57 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:59:58.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:57 trial092 ceph-mon[23047]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:59:58.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:57 trial092 ceph-mon[23047]: osdmap e49: 9 total, 8 up, 9 in 2026-02-13T03:59:58.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:57 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:59:58.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:57 trial099 ceph-mon[27808]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T03:59:58.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:57 trial099 ceph-mon[27808]: osdmap e49: 9 total, 8 up, 9 in 2026-02-13T03:59:58.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:57 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:59:59.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:58 trial092 ceph-mon[23047]: osdmap e50: 9 total, 8 up, 9 in 2026-02-13T03:59:59.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:58 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:59:59.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:58 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:59.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:58 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:59.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:58 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:59.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:58 trial092 ceph-mon[23047]: pgmap v109: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:59:59.262 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:58 trial158 ceph-mon[27763]: osdmap e50: 9 total, 8 up, 9 in 2026-02-13T03:59:59.262 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:58 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:59:59.262 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:58 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:59.262 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:58 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:59.262 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:58 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:59.262 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:58 trial158 ceph-mon[27763]: pgmap v109: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:59:59.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:58 trial099 ceph-mon[27808]: osdmap e50: 9 total, 8 up, 9 in 2026-02-13T03:59:59.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:58 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T03:59:59.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:58 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T03:59:59.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:58 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:59.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:58 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T03:59:59.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:58 trial099 ceph-mon[27808]: pgmap v109: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T03:59:59.379 INFO:teuthology.orchestra.run.trial158.stdout:Created osd(s) 8 on host 'trial158' 2026-02-13T03:59:59.379 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:59.377+0000 7ffa69ffb6c0 1 -- 10.20.193.158:0/913021878 <== mgr.14187 v2:10.20.193.92:6800/4191527999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7ffa58031de0 con 0x7ffa340b5650 2026-02-13T03:59:59.382 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:59.379+0000 7ffa72feb6c0 1 -- 10.20.193.158:0/913021878 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ffa340b5650 msgr2=0x7ffa340d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:59:59.382 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:59.379+0000 7ffa72feb6c0 1 --2- 10.20.193.158:0/913021878 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ffa340b5650 0x7ffa340d5b00 secure :-1 s=READY pgs=84 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa580098c0 tx=0x7ffa580023a0 comp rx=0 tx=0).stop 2026-02-13T03:59:59.382 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:59.379+0000 7ffa72feb6c0 1 -- 10.20.193.158:0/913021878 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ffa6c122930 msgr2=0x7ffa6c122dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T03:59:59.382 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:59.379+0000 7ffa72feb6c0 1 --2- 10.20.193.158:0/913021878 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ffa6c122930 0x7ffa6c122dd0 secure :-1 s=READY pgs=50 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffa60006ea0 tx=0x7ffa6000cca0 comp rx=0 tx=0).stop 2026-02-13T03:59:59.382 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:59.379+0000 7ffa72feb6c0 1 -- 10.20.193.158:0/913021878 shutdown_connections 2026-02-13T03:59:59.382 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:59.379+0000 7ffa72feb6c0 1 --2- 10.20.193.158:0/913021878 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ffa6c122930 0x7ffa6c122dd0 unknown :-1 s=CLOSED pgs=50 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:59.382 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:59.379+0000 7ffa72feb6c0 1 --2- 10.20.193.158:0/913021878 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ffa6c115440 0x7ffa6c11d570 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:59.383 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:59.379+0000 7ffa72feb6c0 1 --2- 10.20.193.158:0/913021878 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ffa340b5650 0x7ffa340d5b00 unknown :-1 s=CLOSED pgs=84 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:59.383 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:59.379+0000 7ffa72feb6c0 1 --2- 10.20.193.158:0/913021878 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ffa6c10f230 0x7ffa6c11d030 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T03:59:59.383 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:59.379+0000 7ffa72feb6c0 1 -- 10.20.193.158:0/913021878 >> 10.20.193.158:0/913021878 conn(0x7ffa6c0ecb30 msgr2=0x7ffa6c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T03:59:59.383 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:59.379+0000 7ffa72feb6c0 1 -- 10.20.193.158:0/913021878 shutdown_connections 2026-02-13T03:59:59.383 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T03:59:59.379+0000 7ffa72feb6c0 1 -- 10.20.193.158:0/913021878 wait complete. 2026-02-13T03:59:59.422 DEBUG:teuthology.orchestra.run.trial158:osd.8> sudo journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@osd.8.service 2026-02-13T03:59:59.425 INFO:tasks.cephadm:Deploying osd.9 on trial092 with /dev/vg_nvme/lv_1... 2026-02-13T03:59:59.425 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-13T03:59:59.613 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:00:00.016 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:59 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:00.016 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:59 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:00.016 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:59 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:00.016 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:59 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:00:00.016 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:59 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:00.016 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:59 trial092 ceph-mon[23047]: pgmap v110: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T04:00:00.016 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:59 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:00.016 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:59 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:00.016 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:59 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:00.017 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:59 trial092 ceph-mon[23047]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T04:00:00.017 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:59 trial092 ceph-mon[23047]: from='osd.8 [v2:10.20.193.158:6816/1505536261,v1:10.20.193.158:6817/1505536261]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T04:00:00.017 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:59 trial092 ceph-mon[23047]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T04:00:00.017 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:59 trial092 ceph-mon[23047]: Cluster is now healthy 2026-02-13T04:00:00.017 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:59 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:00.017 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:59 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:00.017 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:59 trial092 ceph-mon[23047]: pgmap v111: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T04:00:00.017 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 03:59:59 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:00:00.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:59 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:00.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:59 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:00.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:59 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:00.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:59 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:00:00.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:59 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:00.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:59 trial158 ceph-mon[27763]: pgmap v110: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T04:00:00.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:59 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:00.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:59 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:00.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:59 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:00.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:59 trial158 ceph-mon[27763]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T04:00:00.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:59 trial158 ceph-mon[27763]: from='osd.8 [v2:10.20.193.158:6816/1505536261,v1:10.20.193.158:6817/1505536261]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T04:00:00.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:59 trial158 ceph-mon[27763]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T04:00:00.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:59 trial158 ceph-mon[27763]: Cluster is now healthy 2026-02-13T04:00:00.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:59 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:00.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:59 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:00.331 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:59 trial158 ceph-mon[27763]: pgmap v111: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T04:00:00.331 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 03:59:59 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:00:00.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:59 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:00.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:59 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:00.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:59 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:00.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:59 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:00:00.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:59 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:00.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:59 trial099 ceph-mon[27808]: pgmap v110: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T04:00:00.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:59 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:00.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:59 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:00.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:59 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:00.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:59 trial099 ceph-mon[27808]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T04:00:00.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:59 trial099 ceph-mon[27808]: from='osd.8 [v2:10.20.193.158:6816/1505536261,v1:10.20.193.158:6817/1505536261]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2026-02-13T04:00:00.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:59 trial099 ceph-mon[27808]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T04:00:00.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:59 trial099 ceph-mon[27808]: Cluster is now healthy 2026-02-13T04:00:00.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:59 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:00.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:59 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:00.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:59 trial099 ceph-mon[27808]: pgmap v111: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 214 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T04:00:00.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 03:59:59 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:00:00.517 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:00:00.540 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph orch daemon add osd trial092:vg_nvme/lv_1 --skip-validation 2026-02-13T04:00:00.727 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:00:00.927 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:00.923+0000 7f4e3d9636c0 1 -- 10.20.193.92:0/860769973 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4e3810f050 msgr2=0x7f4e3810f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:00.927 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:00.923+0000 7f4e3d9636c0 1 --2- 10.20.193.92:0/860769973 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4e3810f050 0x7f4e3810f420 secure :-1 s=READY pgs=140 gs=1 cs=0 l=1 c_cookie=14953811655681542998 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e280099a0 tx=0x7f4e2802ed00 comp rx=0 tx=0).stop 2026-02-13T04:00:00.927 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:00.923+0000 7f4e3d9636c0 1 -- 10.20.193.92:0/860769973 shutdown_connections 2026-02-13T04:00:00.928 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:00.923+0000 7f4e3d9636c0 1 --2- 10.20.193.92:0/860769973 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4e3810fa40 0x7f4e38114a80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:00.928 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:00.923+0000 7f4e3d9636c0 1 --2- 10.20.193.92:0/860769973 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4e38115260 0x7f4e38175c00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:00.928 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:00.923+0000 7f4e3d9636c0 1 --2- 10.20.193.92:0/860769973 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4e3810f050 0x7f4e3810f420 unknown :-1 s=CLOSED pgs=140 gs=1 cs=0 l=1 c_cookie=14953811655681542998 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:00.928 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:00.923+0000 7f4e3d9636c0 1 -- 10.20.193.92:0/860769973 >> 10.20.193.92:0/860769973 conn(0x7f4e380ec950 msgr2=0x7f4e3810cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:00.928 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:00.923+0000 7f4e3d9636c0 1 -- 10.20.193.92:0/860769973 shutdown_connections 2026-02-13T04:00:00.928 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:00.923+0000 7f4e3d9636c0 1 -- 10.20.193.92:0/860769973 wait complete. 2026-02-13T04:00:00.928 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:00.924+0000 7f4e3d9636c0 1 Processor -- start 2026-02-13T04:00:00.928 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:00.924+0000 7f4e3d9636c0 1 -- start start 2026-02-13T04:00:00.930 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:00.924+0000 7f4e3d9636c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4e3810f050 0x7f4e3811cd80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:00.930 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:00.924+0000 7f4e3d9636c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4e38115260 0x7f4e3811d2c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:00.930 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:00.924+0000 7f4e3d9636c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4e38122680 0x7f4e38122b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:00.930 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:00.924+0000 7f4e3d9636c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4e38123090 con 0x7f4e38115260 2026-02-13T04:00:00.930 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:00.924+0000 7f4e3d9636c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4e38123200 con 0x7f4e3810f050 2026-02-13T04:00:00.930 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:00.924+0000 7f4e3d9636c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f4e381233c0 con 0x7f4e38122680 2026-02-13T04:00:00.930 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:00.925+0000 7f4e3c9616c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4e3810f050 0x7f4e3811cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:00.930 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:00.925+0000 7f4e3c9616c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4e3810f050 0x7f4e3811cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:35806/0 (socket says 10.20.193.92:35806) 2026-02-13T04:00:00.931 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:00.925+0000 7f4e3c9616c0 1 -- 10.20.193.92:0/2686165153 learned_addr learned my addr 10.20.193.92:0/2686165153 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:00:00.931 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:00.925+0000 7f4e3d1626c0 1 --2- 10.20.193.92:0/2686165153 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4e38122680 0x7f4e38122b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:00.931 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:00.925+0000 7f4e2ffff6c0 1 --2- 10.20.193.92:0/2686165153 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4e38115260 0x7f4e3811d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:00.931 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:00.925+0000 7f4e3c9616c0 1 -- 10.20.193.92:0/2686165153 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4e38122680 msgr2=0x7f4e38122b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:00.931 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:00.925+0000 7f4e3c9616c0 1 --2- 10.20.193.92:0/2686165153 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4e38122680 0x7f4e38122b20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:00.931 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:00.925+0000 7f4e3c9616c0 1 -- 10.20.193.92:0/2686165153 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4e38115260 msgr2=0x7f4e3811d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:00.931 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:00.925+0000 7f4e3c9616c0 1 --2- 10.20.193.92:0/2686165153 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4e38115260 0x7f4e3811d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:00.931 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:00.925+0000 7f4e3c9616c0 1 -- 10.20.193.92:0/2686165153 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e28009590 con 0x7f4e3810f050 2026-02-13T04:00:00.931 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:00.925+0000 7f4e3c9616c0 1 --2- 10.20.193.92:0/2686165153 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4e3810f050 0x7f4e3811cd80 secure :-1 s=READY pgs=60 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e2802f210 tx=0x7f4e2802f810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:00.931 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:00.925+0000 7f4e2dffb6c0 1 -- 10.20.193.92:0/2686165153 <== mon.2 v2:10.20.193.99:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4e280046b0 con 0x7f4e3810f050 2026-02-13T04:00:00.931 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:00.925+0000 7f4e2dffb6c0 1 -- 10.20.193.92:0/2686165153 <== mon.2 v2:10.20.193.99:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f4e28002be0 con 0x7f4e3810f050 2026-02-13T04:00:00.932 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:00.925+0000 7f4e2dffb6c0 1 -- 10.20.193.92:0/2686165153 <== mon.2 v2:10.20.193.99:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4e280073f0 con 0x7f4e3810f050 2026-02-13T04:00:00.932 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:00.925+0000 7f4e3d9636c0 1 -- 10.20.193.92:0/2686165153 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e38163810 con 0x7f4e3810f050 2026-02-13T04:00:00.932 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:00.926+0000 7f4e3d9636c0 1 -- 10.20.193.92:0/2686165153 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e38163c40 con 0x7f4e3810f050 2026-02-13T04:00:00.932 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:00.926+0000 7f4e3d9636c0 1 -- 10.20.193.92:0/2686165153 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e38110320 con 0x7f4e3810f050 2026-02-13T04:00:00.932 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:00.928+0000 7f4e2dffb6c0 1 -- 10.20.193.92:0/2686165153 <== mon.2 v2:10.20.193.99:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f4e280310c0 con 0x7f4e3810f050 2026-02-13T04:00:00.933 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:00.930+0000 7f4e2dffb6c0 1 --2- 10.20.193.92:0/2686165153 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f4e140b57a0 0x7f4e140d5c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:00.933 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:00.930+0000 7f4e2dffb6c0 1 -- 10.20.193.92:0/2686165153 <== mon.2 v2:10.20.193.99:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5525+0+0 (secure 0 0 0) 0x7f4e28107180 con 0x7f4e3810f050 2026-02-13T04:00:00.934 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:00.930+0000 7f4e2ffff6c0 1 --2- 10.20.193.92:0/2686165153 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f4e140b57a0 0x7f4e140d5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:00.934 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:00.930+0000 7f4e2dffb6c0 1 -- 10.20.193.92:0/2686165153 <== mon.2 v2:10.20.193.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4e28107600 con 0x7f4e3810f050 2026-02-13T04:00:00.934 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:00.931+0000 7f4e2ffff6c0 1 --2- 10.20.193.92:0/2686165153 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f4e140b57a0 0x7f4e140d5c50 secure :-1 s=READY pgs=89 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e38123710 tx=0x7f4e20009390 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:01.038 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:01.035+0000 7f4e3d9636c0 1 -- 10.20.193.92:0/2686165153 --> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial092:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f4e3811ded0 con 0x7f4e140b57a0 2026-02-13T04:00:01.106 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:00:00 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:00:00.966+0000 7f8d409ce6c0 -1 osd.8 0 waiting for initial osdmap 2026-02-13T04:00:01.107 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:00:00 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:00:00.972+0000 7f8d3888a6c0 -1 osd.8 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T04:00:01.107 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:00 trial158 ceph-mon[27763]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2026-02-13T04:00:01.107 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:00 trial158 ceph-mon[27763]: osdmap e51: 9 total, 8 up, 9 in 2026-02-13T04:00:01.107 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:00 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T04:00:01.107 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:00 trial158 ceph-mon[27763]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial158", "root=default"]} : dispatch 2026-02-13T04:00:01.107 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:00 trial158 ceph-mon[27763]: from='osd.8 [v2:10.20.193.158:6816/1505536261,v1:10.20.193.158:6817/1505536261]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial158", "root=default"]} : dispatch 2026-02-13T04:00:01.107 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:00 trial158 ceph-mon[27763]: overall HEALTH_OK 2026-02-13T04:00:01.107 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:00 trial158 ceph-mon[27763]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T04:00:01.108 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:00 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:01.108 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:00 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:01.108 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:00 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:01.108 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:00 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:01.108 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:00 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:01.108 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:00 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:01.108 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:00 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:01.108 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:00 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:00:01.108 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:00 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:01.108 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:00 trial158 ceph-mon[27763]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T04:00:01.108 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:00 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:01.108 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:00 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:01.109 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:00 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:01.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:00 trial092 ceph-mon[23047]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2026-02-13T04:00:01.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:00 trial092 ceph-mon[23047]: osdmap e51: 9 total, 8 up, 9 in 2026-02-13T04:00:01.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:00 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T04:00:01.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:00 trial092 ceph-mon[23047]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial158", "root=default"]} : dispatch 2026-02-13T04:00:01.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:00 trial092 ceph-mon[23047]: from='osd.8 [v2:10.20.193.158:6816/1505536261,v1:10.20.193.158:6817/1505536261]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial158", "root=default"]} : dispatch 2026-02-13T04:00:01.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:00 trial092 ceph-mon[23047]: overall HEALTH_OK 2026-02-13T04:00:01.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:00 trial092 ceph-mon[23047]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T04:00:01.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:00 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:01.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:00 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:01.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:00 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:01.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:00 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:01.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:00 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:01.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:00 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:01.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:00 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:01.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:00 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:00:01.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:00 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:01.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:00 trial092 ceph-mon[23047]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T04:00:01.186 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:00 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:01.186 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:00 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:01.186 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:00 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:01.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:00 trial099 ceph-mon[27808]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2026-02-13T04:00:01.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:00 trial099 ceph-mon[27808]: osdmap e51: 9 total, 8 up, 9 in 2026-02-13T04:00:01.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:00 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T04:00:01.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:00 trial099 ceph-mon[27808]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial158", "root=default"]} : dispatch 2026-02-13T04:00:01.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:00 trial099 ceph-mon[27808]: from='osd.8 [v2:10.20.193.158:6816/1505536261,v1:10.20.193.158:6817/1505536261]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial158", "root=default"]} : dispatch 2026-02-13T04:00:01.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:00 trial099 ceph-mon[27808]: overall HEALTH_OK 2026-02-13T04:00:01.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:00 trial099 ceph-mon[27808]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T04:00:01.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:00 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:01.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:00 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:01.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:00 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:01.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:00 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:01.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:00 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:01.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:00 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:01.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:00 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:01.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:00 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:00:01.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:00 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:01.368 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:00 trial099 ceph-mon[27808]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T04:00:01.368 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:00 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:01.368 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:00 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:01.368 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:00 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:02.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:01 trial158 ceph-mon[27763]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial158", "root=default"]}]': finished 2026-02-13T04:00:02.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:01 trial158 ceph-mon[27763]: osdmap e52: 9 total, 8 up, 9 in 2026-02-13T04:00:02.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:01 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T04:00:02.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:01 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T04:00:02.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:01 trial158 ceph-mon[27763]: from='client.24476 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial092:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T04:00:02.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:01 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:02.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:01 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:02.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:01 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:02.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:01 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:02.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:01 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:02.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:01 trial158 ceph-mon[27763]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T04:00:02.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:01 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:00:02.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:01 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:02.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:01 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:02.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:01 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:02.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:01 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:00:02.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:01 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:02.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:01 trial158 ceph-mon[27763]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T04:00:02.331 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:01 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:02.331 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:01 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:02.331 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:01 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:02.331 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:01 trial158 ceph-mon[27763]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T04:00:02.331 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:01 trial158 ceph-mon[27763]: Cluster is now healthy 2026-02-13T04:00:02.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:01 trial099 ceph-mon[27808]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial158", "root=default"]}]': finished 2026-02-13T04:00:02.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:01 trial099 ceph-mon[27808]: osdmap e52: 9 total, 8 up, 9 in 2026-02-13T04:00:02.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:01 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T04:00:02.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:01 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T04:00:02.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:01 trial099 ceph-mon[27808]: from='client.24476 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial092:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T04:00:02.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:01 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:02.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:01 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:02.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:01 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:02.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:01 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:02.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:01 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:02.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:01 trial099 ceph-mon[27808]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T04:00:02.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:01 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:00:02.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:01 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:02.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:01 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:02.368 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:01 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:02.368 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:01 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:00:02.368 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:01 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:02.368 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:01 trial099 ceph-mon[27808]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T04:00:02.368 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:01 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:02.368 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:01 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:02.368 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:01 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:02.368 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:01 trial099 ceph-mon[27808]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T04:00:02.368 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:01 trial099 ceph-mon[27808]: Cluster is now healthy 2026-02-13T04:00:02.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:01 trial092 ceph-mon[23047]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.6836, "args": ["host=trial158", "root=default"]}]': finished 2026-02-13T04:00:02.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:01 trial092 ceph-mon[23047]: osdmap e52: 9 total, 8 up, 9 in 2026-02-13T04:00:02.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:01 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T04:00:02.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:01 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T04:00:02.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:01 trial092 ceph-mon[23047]: from='client.24476 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial092:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T04:00:02.435 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:01 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:02.435 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:01 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:02.435 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:01 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:02.435 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:01 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:02.435 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:01 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:02.435 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:01 trial092 ceph-mon[23047]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T04:00:02.435 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:01 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:00:02.435 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:01 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:02.435 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:01 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:02.435 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:01 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:02.435 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:01 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:00:02.435 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:01 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:02.436 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:01 trial092 ceph-mon[23047]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 5.5 TiB / 5.5 TiB avail 2026-02-13T04:00:02.436 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:01 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:02.436 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:01 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:02.436 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:01 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:02.436 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:01 trial092 ceph-mon[23047]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T04:00:02.436 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:01 trial092 ceph-mon[23047]: Cluster is now healthy 2026-02-13T04:00:03.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:02 trial092 ceph-mon[23047]: purged_snaps scrub starts 2026-02-13T04:00:03.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:02 trial092 ceph-mon[23047]: purged_snaps scrub ok 2026-02-13T04:00:03.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:02 trial092 ceph-mon[23047]: osd.8 [v2:10.20.193.158:6816/1505536261,v1:10.20.193.158:6817/1505536261] boot 2026-02-13T04:00:03.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:02 trial092 ceph-mon[23047]: osdmap e53: 9 total, 9 up, 9 in 2026-02-13T04:00:03.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:02 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T04:00:03.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:02 trial092 ceph-mon[23047]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b51a7c23-3bba-4404-8b3a-462a2870b83c"} : dispatch 2026-02-13T04:00:03.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:02 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1784787156' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b51a7c23-3bba-4404-8b3a-462a2870b83c"} : dispatch 2026-02-13T04:00:03.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:02 trial092 ceph-mon[23047]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b51a7c23-3bba-4404-8b3a-462a2870b83c"}]': finished 2026-02-13T04:00:03.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:02 trial092 ceph-mon[23047]: osdmap e54: 10 total, 9 up, 10 in 2026-02-13T04:00:03.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:02 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T04:00:03.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:02 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/2999461899' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T04:00:03.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:02 trial158 ceph-mon[27763]: purged_snaps scrub starts 2026-02-13T04:00:03.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:02 trial158 ceph-mon[27763]: purged_snaps scrub ok 2026-02-13T04:00:03.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:02 trial158 ceph-mon[27763]: osd.8 [v2:10.20.193.158:6816/1505536261,v1:10.20.193.158:6817/1505536261] boot 2026-02-13T04:00:03.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:02 trial158 ceph-mon[27763]: osdmap e53: 9 total, 9 up, 9 in 2026-02-13T04:00:03.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:02 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T04:00:03.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:02 trial158 ceph-mon[27763]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b51a7c23-3bba-4404-8b3a-462a2870b83c"} : dispatch 2026-02-13T04:00:03.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:02 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/1784787156' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b51a7c23-3bba-4404-8b3a-462a2870b83c"} : dispatch 2026-02-13T04:00:03.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:02 trial158 ceph-mon[27763]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b51a7c23-3bba-4404-8b3a-462a2870b83c"}]': finished 2026-02-13T04:00:03.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:02 trial158 ceph-mon[27763]: osdmap e54: 10 total, 9 up, 10 in 2026-02-13T04:00:03.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:02 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T04:00:03.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:02 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/2999461899' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T04:00:03.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:02 trial099 ceph-mon[27808]: purged_snaps scrub starts 2026-02-13T04:00:03.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:02 trial099 ceph-mon[27808]: purged_snaps scrub ok 2026-02-13T04:00:03.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:02 trial099 ceph-mon[27808]: osd.8 [v2:10.20.193.158:6816/1505536261,v1:10.20.193.158:6817/1505536261] boot 2026-02-13T04:00:03.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:02 trial099 ceph-mon[27808]: osdmap e53: 9 total, 9 up, 9 in 2026-02-13T04:00:03.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:02 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2026-02-13T04:00:03.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:02 trial099 ceph-mon[27808]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b51a7c23-3bba-4404-8b3a-462a2870b83c"} : dispatch 2026-02-13T04:00:03.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:02 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/1784787156' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b51a7c23-3bba-4404-8b3a-462a2870b83c"} : dispatch 2026-02-13T04:00:03.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:02 trial099 ceph-mon[27808]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b51a7c23-3bba-4404-8b3a-462a2870b83c"}]': finished 2026-02-13T04:00:03.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:02 trial099 ceph-mon[27808]: osdmap e54: 10 total, 9 up, 10 in 2026-02-13T04:00:03.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:02 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T04:00:03.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:02 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/2999461899' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T04:00:04.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:04 trial092 ceph-mon[23047]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T04:00:04.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:04 trial092 ceph-mon[23047]: osdmap e55: 10 total, 9 up, 10 in 2026-02-13T04:00:04.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:04 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T04:00:04.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:04 trial158 ceph-mon[27763]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T04:00:04.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:04 trial158 ceph-mon[27763]: osdmap e55: 10 total, 9 up, 10 in 2026-02-13T04:00:04.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:04 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T04:00:04.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:04 trial099 ceph-mon[27808]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T04:00:04.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:04 trial099 ceph-mon[27808]: osdmap e55: 10 total, 9 up, 10 in 2026-02-13T04:00:04.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:04 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T04:00:06.223 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:05 trial092 ceph-mon[23047]: osdmap e56: 10 total, 9 up, 10 in 2026-02-13T04:00:06.223 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:05 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T04:00:06.223 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:05 trial092 ceph-mon[23047]: pgmap v122: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 149 KiB/s, 0 objects/s recovering 2026-02-13T04:00:06.223 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:05 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-13T04:00:06.223 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:05 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:06.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:05 trial158 ceph-mon[27763]: osdmap e56: 10 total, 9 up, 10 in 2026-02-13T04:00:06.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:05 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T04:00:06.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:05 trial158 ceph-mon[27763]: pgmap v122: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 149 KiB/s, 0 objects/s recovering 2026-02-13T04:00:06.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:05 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-13T04:00:06.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:05 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:06.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:05 trial099 ceph-mon[27808]: osdmap e56: 10 total, 9 up, 10 in 2026-02-13T04:00:06.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:05 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T04:00:06.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:05 trial099 ceph-mon[27808]: pgmap v122: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 149 KiB/s, 0 objects/s recovering 2026-02-13T04:00:06.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:05 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2026-02-13T04:00:06.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:05 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:07.186 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:06 trial092 ceph-mon[23047]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T04:00:07.186 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:06 trial092 ceph-mon[23047]: osdmap e57: 10 total, 9 up, 10 in 2026-02-13T04:00:07.186 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:06 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T04:00:07.230 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:06 trial158 ceph-mon[27763]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T04:00:07.230 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:06 trial158 ceph-mon[27763]: osdmap e57: 10 total, 9 up, 10 in 2026-02-13T04:00:07.230 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:06 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T04:00:07.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:06 trial099 ceph-mon[27808]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T04:00:07.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:06 trial099 ceph-mon[27808]: osdmap e57: 10 total, 9 up, 10 in 2026-02-13T04:00:07.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:06 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T04:00:08.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:07 trial158 ceph-mon[27763]: pgmap v124: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 122 KiB/s, 0 objects/s recovering 2026-02-13T04:00:08.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:07 trial099 ceph-mon[27808]: pgmap v124: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 122 KiB/s, 0 objects/s recovering 2026-02-13T04:00:08.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:07 trial092 ceph-mon[23047]: pgmap v124: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 122 KiB/s, 0 objects/s recovering 2026-02-13T04:00:10.163 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:10 trial092 ceph-mon[23047]: pgmap v125: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 98 KiB/s, 0 objects/s recovering 2026-02-13T04:00:10.163 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:10 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:00:10.163 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:10 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:10.163 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:10 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:10.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:10 trial158 ceph-mon[27763]: pgmap v125: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 98 KiB/s, 0 objects/s recovering 2026-02-13T04:00:10.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:10 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:00:10.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:10 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:10.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:10 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:10.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:10 trial099 ceph-mon[27808]: pgmap v125: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 98 KiB/s, 0 objects/s recovering 2026-02-13T04:00:10.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:10 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:00:10.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:10 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:10.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:10 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:10.931 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:10.928+0000 7f4e3e3eb6c0 1 -- 10.20.193.92:0/2686165153 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({osdmap=52}) -- 0x7f4e10003570 con 0x7f4e3810f050 2026-02-13T04:00:10.931 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:10.928+0000 7f4e2dffb6c0 1 -- 10.20.193.92:0/2686165153 <== mon.2 v2:10.20.193.99:3300/0 7 ==== osd_map(52..57 src has 1..57) ==== 3239+0+0 (secure 0 0 0) 0x7f4e2802f980 con 0x7f4e3810f050 2026-02-13T04:00:10.973 INFO:teuthology.orchestra.run.trial092.stdout:Created osd(s) 9 on host 'trial092' 2026-02-13T04:00:10.973 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:10.970+0000 7f4e2dffb6c0 1 -- 10.20.193.92:0/2686165153 <== mgr.14187 v2:10.20.193.92:6800/4191527999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f4e3811ded0 con 0x7f4e140b57a0 2026-02-13T04:00:10.975 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:10.972+0000 7f4e3d9636c0 1 -- 10.20.193.92:0/2686165153 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f4e140b57a0 msgr2=0x7f4e140d5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:10.975 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:10.972+0000 7f4e3d9636c0 1 --2- 10.20.193.92:0/2686165153 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f4e140b57a0 0x7f4e140d5c50 secure :-1 s=READY pgs=89 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e38123710 tx=0x7f4e20009390 comp rx=0 tx=0).stop 2026-02-13T04:00:10.975 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:10.972+0000 7f4e3d9636c0 1 -- 10.20.193.92:0/2686165153 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4e3810f050 msgr2=0x7f4e3811cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:10.975 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:10.972+0000 7f4e3d9636c0 1 --2- 10.20.193.92:0/2686165153 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4e3810f050 0x7f4e3811cd80 secure :-1 s=READY pgs=60 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e2802f210 tx=0x7f4e2802f810 comp rx=0 tx=0).stop 2026-02-13T04:00:10.976 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:10.972+0000 7f4e3d9636c0 1 -- 10.20.193.92:0/2686165153 shutdown_connections 2026-02-13T04:00:10.976 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:10.972+0000 7f4e3d9636c0 1 --2- 10.20.193.92:0/2686165153 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4e38122680 0x7f4e38122b20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:10.976 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:10.972+0000 7f4e3d9636c0 1 --2- 10.20.193.92:0/2686165153 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4e38115260 0x7f4e3811d2c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:10.976 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:10.972+0000 7f4e3d9636c0 1 --2- 10.20.193.92:0/2686165153 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f4e140b57a0 0x7f4e140d5c50 unknown :-1 s=CLOSED pgs=89 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:10.976 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:10.972+0000 7f4e3d9636c0 1 --2- 10.20.193.92:0/2686165153 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4e3810f050 0x7f4e3811cd80 unknown :-1 s=CLOSED pgs=60 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:10.976 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:10.972+0000 7f4e3d9636c0 1 -- 10.20.193.92:0/2686165153 >> 10.20.193.92:0/2686165153 conn(0x7f4e380ec950 msgr2=0x7f4e3810cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:10.977 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:10.972+0000 7f4e3d9636c0 1 -- 10.20.193.92:0/2686165153 shutdown_connections 2026-02-13T04:00:10.977 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:10.972+0000 7f4e3d9636c0 1 -- 10.20.193.92:0/2686165153 wait complete. 2026-02-13T04:00:11.082 DEBUG:teuthology.orchestra.run.trial092:osd.9> sudo journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@osd.9.service 2026-02-13T04:00:11.115 INFO:tasks.cephadm:Deploying osd.10 on trial099 with /dev/vg_nvme/lv_1... 2026-02-13T04:00:11.116 DEBUG:teuthology.orchestra.run.trial099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-13T04:00:11.236 INFO:teuthology.orchestra.run.trial099.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.b/config 2026-02-13T04:00:11.392 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:11 trial099 ceph-mon[27808]: from='osd.9 [v2:10.20.193.92:6826/3596797929,v1:10.20.193.92:6827/3596797929]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-13T04:00:11.392 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:11 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:11.393 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:11 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:11.393 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:11 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:11.393 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:11 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:00:11.393 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:11 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:11.393 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:11 trial099 ceph-mon[27808]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 81 KiB/s, 0 objects/s recovering 2026-02-13T04:00:11.393 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:11 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:11.393 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:11 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:11.393 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:11 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:11.393 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:11 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:11.393 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:11 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:11.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:11 trial092 ceph-mon[23047]: from='osd.9 [v2:10.20.193.92:6826/3596797929,v1:10.20.193.92:6827/3596797929]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-13T04:00:11.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:11 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:11.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:11 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:11.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:11 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:11.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:11 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:00:11.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:11 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:11.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:11 trial092 ceph-mon[23047]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 81 KiB/s, 0 objects/s recovering 2026-02-13T04:00:11.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:11 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:11.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:11 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:11.435 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:11 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:11.435 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:11 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:11.435 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:11 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:11.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:11 trial158 ceph-mon[27763]: from='osd.9 [v2:10.20.193.92:6826/3596797929,v1:10.20.193.92:6827/3596797929]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2026-02-13T04:00:11.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:11 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:11.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:11 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:11.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:11 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:11.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:11 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:00:11.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:11 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:11.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:11 trial158 ceph-mon[27763]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail; 81 KiB/s, 0 objects/s recovering 2026-02-13T04:00:11.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:11 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:11.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:11 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:11.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:11 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:11.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:11 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:11.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:11 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:11.689 INFO:teuthology.orchestra.run.trial099.stdout: 2026-02-13T04:00:11.706 DEBUG:teuthology.orchestra.run.trial099:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph orch daemon add osd trial099:vg_nvme/lv_1 --skip-validation 2026-02-13T04:00:11.823 INFO:teuthology.orchestra.run.trial099.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.b/config 2026-02-13T04:00:11.946 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:11.940+0000 7f565eabf6c0 1 -- 10.20.193.99:0/910439685 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5658115410 msgr2=0x7f5658175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:11.946 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:11.940+0000 7f565eabf6c0 1 --2- 10.20.193.99:0/910439685 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5658115410 0x7f5658175db0 secure :-1 s=READY pgs=61 gs=1 cs=0 l=1 c_cookie=1824052754665226760 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f564c00aa40 tx=0x7f564c02fde0 comp rx=0 tx=0).stop 2026-02-13T04:00:11.946 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:11.940+0000 7f565eabf6c0 1 -- 10.20.193.99:0/910439685 shutdown_connections 2026-02-13T04:00:11.946 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:11.940+0000 7f565eabf6c0 1 --2- 10.20.193.99:0/910439685 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5658115410 0x7f5658175db0 unknown :-1 s=CLOSED pgs=61 gs=1 cs=0 l=1 c_cookie=1824052754665226760 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:11.946 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:11.940+0000 7f565eabf6c0 1 --2- 10.20.193.99:0/910439685 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f565810fbf0 0x7f5658114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:11.946 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:11.940+0000 7f565eabf6c0 1 --2- 10.20.193.99:0/910439685 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f565810f200 0x7f565810f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:11.946 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:11.940+0000 7f565eabf6c0 1 -- 10.20.193.99:0/910439685 >> 10.20.193.99:0/910439685 conn(0x7f56580ecb00 msgr2=0x7f565810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:11.946 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:11.940+0000 7f565eabf6c0 1 -- 10.20.193.99:0/910439685 shutdown_connections 2026-02-13T04:00:11.946 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:11.940+0000 7f565eabf6c0 1 -- 10.20.193.99:0/910439685 wait complete. 2026-02-13T04:00:11.947 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:11.941+0000 7f565eabf6c0 1 Processor -- start 2026-02-13T04:00:11.947 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:11.941+0000 7f565eabf6c0 1 -- start start 2026-02-13T04:00:11.947 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:11.941+0000 7f565eabf6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f565810f200 0x7f565811cf60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:11.947 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:11.941+0000 7f565eabf6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5658115410 0x7f565811d4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:11.947 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:11.941+0000 7f565eabf6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f5658122810 0x7f5658122cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:11.947 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:11.941+0000 7f565eabf6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5658123220 con 0x7f565810f200 2026-02-13T04:00:11.947 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:11.941+0000 7f565eabf6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f5658123390 con 0x7f5658115410 2026-02-13T04:00:11.947 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:11.941+0000 7f565eabf6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f5658123550 con 0x7f5658122810 2026-02-13T04:00:11.947 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:11.941+0000 7f5657fff6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5658115410 0x7f565811d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:11.947 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:11.941+0000 7f5657fff6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5658115410 0x7f565811d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.99:38054/0 (socket says 10.20.193.99:38054) 2026-02-13T04:00:11.947 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:11.941+0000 7f5657fff6c0 1 -- 10.20.193.99:0/2029576169 learned_addr learned my addr 10.20.193.99:0/2029576169 (peer_addr_for_me v2:10.20.193.99:0/0) 2026-02-13T04:00:11.948 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:11.941+0000 7f565c8306c0 1 --2- 10.20.193.99:0/2029576169 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f565810f200 0x7f565811cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:11.948 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:11.941+0000 7f5657fff6c0 1 -- 10.20.193.99:0/2029576169 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f5658122810 msgr2=0x7f5658122cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:11.948 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:11.941+0000 7f5657fff6c0 1 --2- 10.20.193.99:0/2029576169 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f5658122810 0x7f5658122cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:11.948 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:11.941+0000 7f5657fff6c0 1 -- 10.20.193.99:0/2029576169 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f565810f200 msgr2=0x7f565811cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:11.948 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:11.941+0000 7f5657fff6c0 1 --2- 10.20.193.99:0/2029576169 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f565810f200 0x7f565811cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:11.948 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:11.941+0000 7f5657fff6c0 1 -- 10.20.193.99:0/2029576169 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f564c00a660 con 0x7f5658115410 2026-02-13T04:00:11.948 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:11.941+0000 7f5657fff6c0 1 --2- 10.20.193.99:0/2029576169 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5658115410 0x7f565811d4a0 secure :-1 s=READY pgs=62 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f564000b6c0 tx=0x7f564000bb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:11.948 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:11.941+0000 7f5655ffb6c0 1 -- 10.20.193.99:0/2029576169 <== mon.2 v2:10.20.193.99:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5640004250 con 0x7f5658115410 2026-02-13T04:00:11.948 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:11.941+0000 7f5655ffb6c0 1 -- 10.20.193.99:0/2029576169 <== mon.2 v2:10.20.193.99:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f5640009070 con 0x7f5658115410 2026-02-13T04:00:11.948 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:11.941+0000 7f565eabf6c0 1 -- 10.20.193.99:0/2029576169 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5658163a00 con 0x7f5658115410 2026-02-13T04:00:11.948 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:11.941+0000 7f5655ffb6c0 1 -- 10.20.193.99:0/2029576169 <== mon.2 v2:10.20.193.99:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f56400071c0 con 0x7f5658115410 2026-02-13T04:00:11.948 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:11.941+0000 7f565eabf6c0 1 -- 10.20.193.99:0/2029576169 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5658163e90 con 0x7f5658115410 2026-02-13T04:00:11.948 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:11.942+0000 7f565eabf6c0 1 -- 10.20.193.99:0/2029576169 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56581104d0 con 0x7f5658115410 2026-02-13T04:00:11.949 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:11.943+0000 7f5655ffb6c0 1 -- 10.20.193.99:0/2029576169 <== mon.2 v2:10.20.193.99:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f56400043b0 con 0x7f5658115410 2026-02-13T04:00:11.950 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:11.944+0000 7f5655ffb6c0 1 --2- 10.20.193.99:0/2029576169 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f56200b56d0 0x7f56200d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:11.950 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:11.944+0000 7f5655ffb6c0 1 -- 10.20.193.99:0/2029576169 <== mon.2 v2:10.20.193.99:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5957+0+0 (secure 0 0 0) 0x7f56400e3330 con 0x7f5658115410 2026-02-13T04:00:11.950 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:11.944+0000 7f565c8306c0 1 --2- 10.20.193.99:0/2029576169 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f56200b56d0 0x7f56200d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:11.950 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:11.944+0000 7f565c8306c0 1 --2- 10.20.193.99:0/2029576169 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f56200b56d0 0x7f56200d5b80 secure :-1 s=READY pgs=94 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5644005fd0 tx=0x7f5644005910 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:11.950 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:11.944+0000 7f5655ffb6c0 1 -- 10.20.193.99:0/2029576169 <== mon.2 v2:10.20.193.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f56400a65c0 con 0x7f5658115410 2026-02-13T04:00:12.046 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:12.043+0000 7f565eabf6c0 1 -- 10.20.193.99:0/2029576169 --> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial099:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7f565811e0f0 con 0x7f56200b56d0 2026-02-13T04:00:12.345 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:12 trial099 ceph-mon[27808]: from='osd.9 [v2:10.20.193.92:6826/3596797929,v1:10.20.193.92:6827/3596797929]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-13T04:00:12.346 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:12 trial099 ceph-mon[27808]: osdmap e58: 10 total, 9 up, 10 in 2026-02-13T04:00:12.346 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:12 trial099 ceph-mon[27808]: from='osd.9 [v2:10.20.193.92:6826/3596797929,v1:10.20.193.92:6827/3596797929]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial092", "root=default"]} : dispatch 2026-02-13T04:00:12.346 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:12 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T04:00:12.346 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:12 trial099 ceph-mon[27808]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T04:00:12.346 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:12 trial099 ceph-mon[27808]: Cluster is now healthy 2026-02-13T04:00:12.346 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:12 trial099 ceph-mon[27808]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T04:00:12.346 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:12 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:00:12.346 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:12 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:12.346 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:12 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:12.346 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:12 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:12.346 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:12 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:12.347 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:12 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:12.379 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:12 trial092 ceph-mon[23047]: from='osd.9 [v2:10.20.193.92:6826/3596797929,v1:10.20.193.92:6827/3596797929]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-13T04:00:12.379 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:12 trial092 ceph-mon[23047]: osdmap e58: 10 total, 9 up, 10 in 2026-02-13T04:00:12.379 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:12 trial092 ceph-mon[23047]: from='osd.9 [v2:10.20.193.92:6826/3596797929,v1:10.20.193.92:6827/3596797929]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial092", "root=default"]} : dispatch 2026-02-13T04:00:12.380 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:12 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T04:00:12.380 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:12 trial092 ceph-mon[23047]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T04:00:12.380 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:12 trial092 ceph-mon[23047]: Cluster is now healthy 2026-02-13T04:00:12.380 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:12 trial092 ceph-mon[23047]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T04:00:12.380 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:12 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:00:12.380 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:12 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:12.380 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:12 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:12.380 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:12 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:12.380 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:12 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:12.380 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:12 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:12.381 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:00:12 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:00:12.171+0000 7f83e58fd6c0 -1 osd.9 0 waiting for initial osdmap 2026-02-13T04:00:12.381 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:00:12 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:00:12.180+0000 7f83e17c16c0 -1 osd.9 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T04:00:12.578 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:12 trial158 ceph-mon[27763]: from='osd.9 [v2:10.20.193.92:6826/3596797929,v1:10.20.193.92:6827/3596797929]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2026-02-13T04:00:12.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:12 trial158 ceph-mon[27763]: osdmap e58: 10 total, 9 up, 10 in 2026-02-13T04:00:12.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:12 trial158 ceph-mon[27763]: from='osd.9 [v2:10.20.193.92:6826/3596797929,v1:10.20.193.92:6827/3596797929]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial092", "root=default"]} : dispatch 2026-02-13T04:00:12.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:12 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T04:00:12.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:12 trial158 ceph-mon[27763]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T04:00:12.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:12 trial158 ceph-mon[27763]: Cluster is now healthy 2026-02-13T04:00:12.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:12 trial158 ceph-mon[27763]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T04:00:12.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:12 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:00:12.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:12 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:12.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:12 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:12.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:12 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:12.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:12 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:12.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:12 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:13.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:13 trial099 ceph-mon[27808]: from='client.24503 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial099:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T04:00:13.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:13 trial099 ceph-mon[27808]: from='osd.9 [v2:10.20.193.92:6826/3596797929,v1:10.20.193.92:6827/3596797929]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial092", "root=default"]}]': finished 2026-02-13T04:00:13.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:13 trial099 ceph-mon[27808]: osdmap e59: 10 total, 9 up, 10 in 2026-02-13T04:00:13.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:13 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T04:00:13.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:13 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T04:00:13.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:13 trial099 ceph-mon[27808]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T04:00:13.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:13 trial099 ceph-mon[27808]: from='client.? 10.20.193.99:0/965225970' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "dda9bd0a-0359-4889-ad2d-8da7602164cc"} : dispatch 2026-02-13T04:00:13.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:13 trial099 ceph-mon[27808]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "dda9bd0a-0359-4889-ad2d-8da7602164cc"} : dispatch 2026-02-13T04:00:13.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:13 trial099 ceph-mon[27808]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dda9bd0a-0359-4889-ad2d-8da7602164cc"}]': finished 2026-02-13T04:00:13.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:13 trial099 ceph-mon[27808]: osd.9 [v2:10.20.193.92:6826/3596797929,v1:10.20.193.92:6827/3596797929] boot 2026-02-13T04:00:13.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:13 trial099 ceph-mon[27808]: osdmap e60: 11 total, 10 up, 11 in 2026-02-13T04:00:13.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:13 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T04:00:13.368 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:13 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T04:00:13.368 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:13 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:13.368 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:13 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:13.368 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:13 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:13.368 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:13 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:13.368 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:13 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:13.368 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:13 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:13.368 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:13 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:13.368 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:13 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:13.368 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:13 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:00:13.368 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:13 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:13.368 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:13 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:13.369 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:13 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:13.369 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:13 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:13.369 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:13 trial099 ceph-mon[27808]: from='client.? 10.20.193.99:0/869226095' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T04:00:13.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:13 trial092 ceph-mon[23047]: from='client.24503 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial099:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T04:00:13.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:13 trial092 ceph-mon[23047]: from='osd.9 [v2:10.20.193.92:6826/3596797929,v1:10.20.193.92:6827/3596797929]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial092", "root=default"]}]': finished 2026-02-13T04:00:13.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:13 trial092 ceph-mon[23047]: osdmap e59: 10 total, 9 up, 10 in 2026-02-13T04:00:13.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:13 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T04:00:13.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:13 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T04:00:13.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:13 trial092 ceph-mon[23047]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T04:00:13.435 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:13 trial092 ceph-mon[23047]: from='client.? 10.20.193.99:0/965225970' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "dda9bd0a-0359-4889-ad2d-8da7602164cc"} : dispatch 2026-02-13T04:00:13.435 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:13 trial092 ceph-mon[23047]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "dda9bd0a-0359-4889-ad2d-8da7602164cc"} : dispatch 2026-02-13T04:00:13.435 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:13 trial092 ceph-mon[23047]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dda9bd0a-0359-4889-ad2d-8da7602164cc"}]': finished 2026-02-13T04:00:13.435 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:13 trial092 ceph-mon[23047]: osd.9 [v2:10.20.193.92:6826/3596797929,v1:10.20.193.92:6827/3596797929] boot 2026-02-13T04:00:13.435 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:13 trial092 ceph-mon[23047]: osdmap e60: 11 total, 10 up, 11 in 2026-02-13T04:00:13.435 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:13 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T04:00:13.435 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:13 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T04:00:13.435 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:13 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:13.435 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:13 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:13.435 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:13 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:13.435 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:13 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:13.435 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:13 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:13.436 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:13 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:13.436 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:13 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:13.436 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:13 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:13.436 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:13 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:00:13.436 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:13 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:13.436 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:13 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:13.436 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:13 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:13.436 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:13 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:13.436 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:13 trial092 ceph-mon[23047]: from='client.? 10.20.193.99:0/869226095' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T04:00:13.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:13 trial158 ceph-mon[27763]: from='client.24503 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial099:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T04:00:13.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:13 trial158 ceph-mon[27763]: from='osd.9 [v2:10.20.193.92:6826/3596797929,v1:10.20.193.92:6827/3596797929]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.6836, "args": ["host=trial092", "root=default"]}]': finished 2026-02-13T04:00:13.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:13 trial158 ceph-mon[27763]: osdmap e59: 10 total, 9 up, 10 in 2026-02-13T04:00:13.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:13 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T04:00:13.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:13 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T04:00:13.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:13 trial158 ceph-mon[27763]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T04:00:13.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:13 trial158 ceph-mon[27763]: from='client.? 10.20.193.99:0/965225970' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "dda9bd0a-0359-4889-ad2d-8da7602164cc"} : dispatch 2026-02-13T04:00:13.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:13 trial158 ceph-mon[27763]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "dda9bd0a-0359-4889-ad2d-8da7602164cc"} : dispatch 2026-02-13T04:00:13.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:13 trial158 ceph-mon[27763]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dda9bd0a-0359-4889-ad2d-8da7602164cc"}]': finished 2026-02-13T04:00:13.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:13 trial158 ceph-mon[27763]: osd.9 [v2:10.20.193.92:6826/3596797929,v1:10.20.193.92:6827/3596797929] boot 2026-02-13T04:00:13.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:13 trial158 ceph-mon[27763]: osdmap e60: 11 total, 10 up, 11 in 2026-02-13T04:00:13.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:13 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2026-02-13T04:00:13.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:13 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T04:00:13.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:13 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:13.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:13 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:13.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:13 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:13.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:13 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:13.581 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:13 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:13.581 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:13 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:13.581 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:13 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:13.581 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:13 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:13.581 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:13 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:00:13.581 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:13 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:13.581 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:13 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:13.581 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:13 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:13.581 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:13 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:13.581 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:13 trial158 ceph-mon[27763]: from='client.? 10.20.193.99:0/869226095' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T04:00:14.507 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:14 trial099 ceph-mon[27808]: purged_snaps scrub starts 2026-02-13T04:00:14.507 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:14 trial099 ceph-mon[27808]: purged_snaps scrub ok 2026-02-13T04:00:14.507 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:14 trial099 ceph-mon[27808]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T04:00:14.507 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:14 trial099 ceph-mon[27808]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T04:00:14.507 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:14 trial099 ceph-mon[27808]: Cluster is now healthy 2026-02-13T04:00:14.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:14 trial158 ceph-mon[27763]: purged_snaps scrub starts 2026-02-13T04:00:14.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:14 trial158 ceph-mon[27763]: purged_snaps scrub ok 2026-02-13T04:00:14.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:14 trial158 ceph-mon[27763]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T04:00:14.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:14 trial158 ceph-mon[27763]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T04:00:14.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:14 trial158 ceph-mon[27763]: Cluster is now healthy 2026-02-13T04:00:14.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:14 trial092 ceph-mon[23047]: purged_snaps scrub starts 2026-02-13T04:00:14.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:14 trial092 ceph-mon[23047]: purged_snaps scrub ok 2026-02-13T04:00:14.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:14 trial092 ceph-mon[23047]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 6.2 TiB / 6.2 TiB avail 2026-02-13T04:00:14.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:14 trial092 ceph-mon[23047]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T04:00:14.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:14 trial092 ceph-mon[23047]: Cluster is now healthy 2026-02-13T04:00:15.315 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:15 trial099 ceph-mon[27808]: osdmap e61: 11 total, 10 up, 11 in 2026-02-13T04:00:15.315 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:15 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T04:00:15.315 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:15 trial099 ceph-mon[27808]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T04:00:15.315 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:15 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:00:15.315 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:15 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:15.315 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:15 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:15.315 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:15 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:15.315 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:15 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:00:15.315 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:15 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:15.316 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:15 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:15.316 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:15 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:15.316 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:15 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:15.316 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:15 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2026-02-13T04:00:15.316 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:15 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:15.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:15 trial158 ceph-mon[27763]: osdmap e61: 11 total, 10 up, 11 in 2026-02-13T04:00:15.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:15 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T04:00:15.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:15 trial158 ceph-mon[27763]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T04:00:15.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:15 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:00:15.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:15 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:15.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:15 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:15.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:15 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:15.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:15 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:00:15.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:15 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:15.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:15 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:15.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:15 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:15.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:15 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:15.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:15 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2026-02-13T04:00:15.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:15 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:15.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:15 trial092 ceph-mon[23047]: osdmap e61: 11 total, 10 up, 11 in 2026-02-13T04:00:15.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:15 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T04:00:15.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:15 trial092 ceph-mon[23047]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T04:00:15.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:15 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:00:15.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:15 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:15.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:15 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:15.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:15 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:15.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:15 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:00:15.685 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:15 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:15.685 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:15 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:15.685 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:15 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:15.685 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:15 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:15.685 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:15 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2026-02-13T04:00:15.685 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:15 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:16.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:16 trial158 ceph-mon[27763]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T04:00:16.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:16 trial158 ceph-mon[27763]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T04:00:16.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:16 trial099 ceph-mon[27808]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T04:00:16.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:16 trial099 ceph-mon[27808]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T04:00:16.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:16 trial092 ceph-mon[23047]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T04:00:16.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:16 trial092 ceph-mon[23047]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T04:00:17.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:17 trial158 ceph-mon[27763]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T04:00:17.608 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:17 trial099 ceph-mon[27808]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T04:00:17.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:17 trial092 ceph-mon[23047]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T04:00:18.458 INFO:teuthology.orchestra.run.trial099.stdout:Created osd(s) 10 on host 'trial099' 2026-02-13T04:00:18.459 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:18.455+0000 7f5655ffb6c0 1 -- 10.20.193.99:0/2029576169 <== mgr.14187 v2:10.20.193.92:6800/4191527999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f5644009020 con 0x7f56200b56d0 2026-02-13T04:00:18.461 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:18.457+0000 7f565eabf6c0 1 -- 10.20.193.99:0/2029576169 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f56200b56d0 msgr2=0x7f56200d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:18.461 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:18.457+0000 7f565eabf6c0 1 --2- 10.20.193.99:0/2029576169 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f56200b56d0 0x7f56200d5b80 secure :-1 s=READY pgs=94 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5644005fd0 tx=0x7f5644005910 comp rx=0 tx=0).stop 2026-02-13T04:00:18.461 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:18.457+0000 7f565eabf6c0 1 -- 10.20.193.99:0/2029576169 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5658115410 msgr2=0x7f565811d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:18.461 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:18.457+0000 7f565eabf6c0 1 --2- 10.20.193.99:0/2029576169 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5658115410 0x7f565811d4a0 secure :-1 s=READY pgs=62 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f564000b6c0 tx=0x7f564000bb90 comp rx=0 tx=0).stop 2026-02-13T04:00:18.462 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:18.457+0000 7f565eabf6c0 1 -- 10.20.193.99:0/2029576169 shutdown_connections 2026-02-13T04:00:18.462 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:18.457+0000 7f565eabf6c0 1 --2- 10.20.193.99:0/2029576169 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f56200b56d0 0x7f56200d5b80 unknown :-1 s=CLOSED pgs=94 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:18.462 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:18.457+0000 7f565eabf6c0 1 --2- 10.20.193.99:0/2029576169 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5658115410 0x7f565811d4a0 unknown :-1 s=CLOSED pgs=62 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:18.462 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:18.457+0000 7f565eabf6c0 1 --2- 10.20.193.99:0/2029576169 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f5658122810 0x7f5658122cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:18.462 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:18.457+0000 7f565eabf6c0 1 --2- 10.20.193.99:0/2029576169 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f565810f200 0x7f565811cf60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:18.462 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:18.457+0000 7f565eabf6c0 1 -- 10.20.193.99:0/2029576169 >> 10.20.193.99:0/2029576169 conn(0x7f56580ecb00 msgr2=0x7f565810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:18.462 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:18.457+0000 7f565eabf6c0 1 -- 10.20.193.99:0/2029576169 shutdown_connections 2026-02-13T04:00:18.462 INFO:teuthology.orchestra.run.trial099.stderr:2026-02-13T04:00:18.457+0000 7f565eabf6c0 1 -- 10.20.193.99:0/2029576169 wait complete. 2026-02-13T04:00:18.505 DEBUG:teuthology.orchestra.run.trial099:osd.10> sudo journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@osd.10.service 2026-02-13T04:00:18.507 INFO:tasks.cephadm:Deploying osd.11 on trial158 with /dev/vg_nvme/lv_1... 2026-02-13T04:00:18.508 DEBUG:teuthology.orchestra.run.trial158:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- lvm zap /dev/vg_nvme/lv_1 2026-02-13T04:00:18.520 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:18 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:00:18.520 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:18 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:18.520 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:18 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:18.520 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:18 trial099 ceph-mon[27808]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T04:00:18.520 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:18 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:18.520 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:18 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:18.521 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:18 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:18.521 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:18 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:00:18.521 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:18 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:18.521 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:18 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:18.521 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:18 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:18.521 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:18 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:18.533 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:18 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:00:18.533 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:18 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:18.533 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:18 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:18.533 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:18 trial158 ceph-mon[27763]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T04:00:18.533 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:18 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:18.533 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:18 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:18.534 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:18 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:18.534 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:18 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:00:18.534 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:18 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:18.534 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:18 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:18.534 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:18 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:18.534 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:18 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:18.628 INFO:teuthology.orchestra.run.trial158.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.c/config 2026-02-13T04:00:18.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:18 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:00:18.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:18 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:18.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:18 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:18.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:18 trial092 ceph-mon[23047]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T04:00:18.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:18 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:18.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:18 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:18.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:18 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:18.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:18 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:00:18.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:18 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:18.685 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:18 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:18.685 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:18 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:18.685 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:18 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:19.076 INFO:teuthology.orchestra.run.trial158.stdout: 2026-02-13T04:00:19.094 DEBUG:teuthology.orchestra.run.trial158:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph orch daemon add osd trial158:vg_nvme/lv_1 --skip-validation 2026-02-13T04:00:19.251 INFO:teuthology.orchestra.run.trial158.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.c/config 2026-02-13T04:00:19.296 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:19 trial158 ceph-mon[27763]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T04:00:19.296 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:19 trial158 ceph-mon[27763]: from='osd.10 [v2:10.20.193.99:6824/4260536068,v1:10.20.193.99:6825/4260536068]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T04:00:19.296 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:19 trial158 ceph-mon[27763]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T04:00:19.296 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:19 trial158 ceph-mon[27763]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T04:00:19.296 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:19 trial158 ceph-mon[27763]: Cluster is now healthy 2026-02-13T04:00:19.296 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:19 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:19.296 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:19 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:19.297 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:19 trial158 ceph-mon[27763]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T04:00:19.297 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:19 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:00:19.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:19 trial099 ceph-mon[27808]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T04:00:19.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:19 trial099 ceph-mon[27808]: from='osd.10 [v2:10.20.193.99:6824/4260536068,v1:10.20.193.99:6825/4260536068]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T04:00:19.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:19 trial099 ceph-mon[27808]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T04:00:19.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:19 trial099 ceph-mon[27808]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T04:00:19.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:19 trial099 ceph-mon[27808]: Cluster is now healthy 2026-02-13T04:00:19.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:19 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:19.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:19 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:19.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:19 trial099 ceph-mon[27808]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T04:00:19.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:19 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:00:19.371 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:19.367+0000 7fb3ab93c6c0 1 -- 10.20.193.158:0/3335278180 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fb3a410fc20 msgr2=0x7fb3a4114c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:19.371 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:19.367+0000 7fb3ab93c6c0 1 --2- 10.20.193.158:0/3335278180 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fb3a410fc20 0x7fb3a4114c60 secure :-1 s=READY pgs=59 gs=1 cs=0 l=1 c_cookie=453174829264281832 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb38c0099a0 tx=0x7fb38c02ed20 comp rx=0 tx=0).stop 2026-02-13T04:00:19.371 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:19.367+0000 7fb3ab93c6c0 1 -- 10.20.193.158:0/3335278180 shutdown_connections 2026-02-13T04:00:19.371 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:19.367+0000 7fb3ab93c6c0 1 --2- 10.20.193.158:0/3335278180 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb3a4115440 0x7fb3a4175de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:19.371 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:19.367+0000 7fb3ab93c6c0 1 --2- 10.20.193.158:0/3335278180 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fb3a410fc20 0x7fb3a4114c60 unknown :-1 s=CLOSED pgs=59 gs=1 cs=0 l=1 c_cookie=453174829264281832 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:19.372 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:19.367+0000 7fb3ab93c6c0 1 --2- 10.20.193.158:0/3335278180 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fb3a410f230 0x7fb3a410f600 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:19.372 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:19.367+0000 7fb3ab93c6c0 1 -- 10.20.193.158:0/3335278180 >> 10.20.193.158:0/3335278180 conn(0x7fb3a40ecb30 msgr2=0x7fb3a410cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:19.372 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:19.367+0000 7fb3ab93c6c0 1 -- 10.20.193.158:0/3335278180 shutdown_connections 2026-02-13T04:00:19.372 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:19.367+0000 7fb3ab93c6c0 1 -- 10.20.193.158:0/3335278180 wait complete. 2026-02-13T04:00:19.372 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:19.367+0000 7fb3ab93c6c0 1 Processor -- start 2026-02-13T04:00:19.372 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:19.367+0000 7fb3ab93c6c0 1 -- start start 2026-02-13T04:00:19.372 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:19.367+0000 7fb3ab93c6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb3a410f230 0x7fb3a40f49c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:19.372 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:19.367+0000 7fb3ab93c6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fb3a4115440 0x7fb3a4175ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:19.372 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:19.368+0000 7fb3ab93c6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fb3a40f4ff0 0x7fb3a40fa270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:19.372 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:19.368+0000 7fb3ab93c6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a40f56e0 con 0x7fb3a410f230 2026-02-13T04:00:19.372 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:19.368+0000 7fb3ab93c6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a40fa7b0 con 0x7fb3a40f4ff0 2026-02-13T04:00:19.373 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:19.368+0000 7fb3ab93c6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a40fa970 con 0x7fb3a4115440 2026-02-13T04:00:19.373 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:19.368+0000 7fb3a8eb06c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fb3a4115440 0x7fb3a4175ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:19.373 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:19.368+0000 7fb3a8eb06c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fb3a4115440 0x7fb3a4175ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.158:33882/0 (socket says 10.20.193.158:33882) 2026-02-13T04:00:19.373 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:19.368+0000 7fb3a8eb06c0 1 -- 10.20.193.158:0/1689087674 learned_addr learned my addr 10.20.193.158:0/1689087674 (peer_addr_for_me v2:10.20.193.158:0/0) 2026-02-13T04:00:19.373 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:19.368+0000 7fb3a9eb26c0 1 --2- 10.20.193.158:0/1689087674 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fb3a40f4ff0 0x7fb3a40fa270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:19.373 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:19.368+0000 7fb3a8eb06c0 1 -- 10.20.193.158:0/1689087674 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fb3a40f4ff0 msgr2=0x7fb3a40fa270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:19.373 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:19.368+0000 7fb3a8eb06c0 1 --2- 10.20.193.158:0/1689087674 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fb3a40f4ff0 0x7fb3a40fa270 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:19.373 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:19.368+0000 7fb3a8eb06c0 1 -- 10.20.193.158:0/1689087674 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb3a410f230 msgr2=0x7fb3a40f49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:19.373 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:19.368+0000 7fb3a8eb06c0 1 --2- 10.20.193.158:0/1689087674 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb3a410f230 0x7fb3a40f49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:19.373 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:19.368+0000 7fb3a8eb06c0 1 -- 10.20.193.158:0/1689087674 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb38c009590 con 0x7fb3a4115440 2026-02-13T04:00:19.373 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:19.368+0000 7fb3a8eb06c0 1 --2- 10.20.193.158:0/1689087674 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fb3a4115440 0x7fb3a4175ce0 secure :-1 s=READY pgs=60 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb38c009290 tx=0x7fb38c02f830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:19.373 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:19.368+0000 7fb3a27fc6c0 1 -- 10.20.193.158:0/1689087674 <== mon.1 v2:10.20.193.158:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb38c0026b0 con 0x7fb3a4115440 2026-02-13T04:00:19.374 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:19.368+0000 7fb3ab93c6c0 1 -- 10.20.193.158:0/1689087674 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3a40fabf0 con 0x7fb3a4115440 2026-02-13T04:00:19.374 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:19.368+0000 7fb3a27fc6c0 1 -- 10.20.193.158:0/1689087674 <== mon.1 v2:10.20.193.158:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fb38c031560 con 0x7fb3a4115440 2026-02-13T04:00:19.374 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:19.368+0000 7fb3a27fc6c0 1 -- 10.20.193.158:0/1689087674 <== mon.1 v2:10.20.193.158:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb38c007da0 con 0x7fb3a4115440 2026-02-13T04:00:19.374 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:19.368+0000 7fb3ab93c6c0 1 -- 10.20.193.158:0/1689087674 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3a40fb0c0 con 0x7fb3a4115440 2026-02-13T04:00:19.374 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:19.368+0000 7fb3ab93c6c0 1 -- 10.20.193.158:0/1689087674 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3a4110500 con 0x7fb3a4115440 2026-02-13T04:00:19.375 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:19.370+0000 7fb3a27fc6c0 1 -- 10.20.193.158:0/1689087674 <== mon.1 v2:10.20.193.158:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7fb38c0316d0 con 0x7fb3a4115440 2026-02-13T04:00:19.375 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:19.370+0000 7fb3a27fc6c0 1 --2- 10.20.193.158:0/1689087674 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fb36c0b56d0 0x7fb36c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:19.375 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:19.371+0000 7fb3a27fc6c0 1 -- 10.20.193.158:0/1689087674 <== mon.1 v2:10.20.193.158:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6390+0+0 (secure 0 0 0) 0x7fb38c1076a0 con 0x7fb3a4115440 2026-02-13T04:00:19.375 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:19.371+0000 7fb3a96b16c0 1 --2- 10.20.193.158:0/1689087674 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fb36c0b56d0 0x7fb36c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:19.375 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:19.371+0000 7fb3a27fc6c0 1 -- 10.20.193.158:0/1689087674 <== mon.1 v2:10.20.193.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb38c0ca780 con 0x7fb3a4115440 2026-02-13T04:00:19.375 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:19.371+0000 7fb3a96b16c0 1 --2- 10.20.193.158:0/1689087674 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fb36c0b56d0 0x7fb36c0d5b80 secure :-1 s=READY pgs=99 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb390005980 tx=0x7fb390005910 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:19.470 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:19.468+0000 7fb3ab93c6c0 1 -- 10.20.193.158:0/1689087674 --> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "trial158:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}) -- 0x7fb3a410fc20 con 0x7fb36c0b56d0 2026-02-13T04:00:19.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:19 trial092 ceph-mon[23047]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T04:00:19.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:19 trial092 ceph-mon[23047]: from='osd.10 [v2:10.20.193.99:6824/4260536068,v1:10.20.193.99:6825/4260536068]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T04:00:19.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:19 trial092 ceph-mon[23047]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2026-02-13T04:00:19.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:19 trial092 ceph-mon[23047]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T04:00:19.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:19 trial092 ceph-mon[23047]: Cluster is now healthy 2026-02-13T04:00:19.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:19 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:19.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:19 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:19.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:19 trial092 ceph-mon[23047]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T04:00:19.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:19 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:00:20.377 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:20 trial158 ceph-mon[27763]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2026-02-13T04:00:20.377 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:20 trial158 ceph-mon[27763]: osdmap e62: 11 total, 10 up, 11 in 2026-02-13T04:00:20.377 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:20 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T04:00:20.377 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:20 trial158 ceph-mon[27763]: from='osd.10 [v2:10.20.193.99:6824/4260536068,v1:10.20.193.99:6825/4260536068]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial099", "root=default"]} : dispatch 2026-02-13T04:00:20.377 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:20 trial158 ceph-mon[27763]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial099", "root=default"]} : dispatch 2026-02-13T04:00:20.377 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:20 trial158 ceph-mon[27763]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T04:00:20.377 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:20 trial158 ceph-mon[27763]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial158:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T04:00:20.377 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:20 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:20.377 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:20 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:20.377 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:20 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:20.377 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:20 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:20.377 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:20 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:20.377 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:20 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:20.377 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:20 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:20.377 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:20 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:20.378 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:20 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:20.378 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:20 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:20.378 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:20 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:20.378 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:20 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:20.378 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:20 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:20.378 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:20 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:00:20.378 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:20 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:20.378 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:20 trial158 ceph-mon[27763]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T04:00:20.378 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:20 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:20.378 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:20 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:20.378 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:20 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:20.616 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:00:20 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:00:20.274+0000 7f9d22b116c0 -1 osd.10 0 waiting for initial osdmap 2026-02-13T04:00:20.616 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:00:20 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:00:20.281+0000 7f9d1e9d56c0 -1 osd.10 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T04:00:20.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:20 trial099 ceph-mon[27808]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2026-02-13T04:00:20.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:20 trial099 ceph-mon[27808]: osdmap e62: 11 total, 10 up, 11 in 2026-02-13T04:00:20.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:20 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T04:00:20.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:20 trial099 ceph-mon[27808]: from='osd.10 [v2:10.20.193.99:6824/4260536068,v1:10.20.193.99:6825/4260536068]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial099", "root=default"]} : dispatch 2026-02-13T04:00:20.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:20 trial099 ceph-mon[27808]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial099", "root=default"]} : dispatch 2026-02-13T04:00:20.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:20 trial099 ceph-mon[27808]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T04:00:20.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:20 trial099 ceph-mon[27808]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial158:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T04:00:20.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:20 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:20.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:20 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:20.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:20 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:20.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:20 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:20.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:20 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:20.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:20 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:20.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:20 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:20.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:20 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:20.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:20 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:20.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:20 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:20.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:20 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:20.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:20 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:20.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:20 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:20.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:20 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:00:20.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:20 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:20.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:20 trial099 ceph-mon[27808]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T04:00:20.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:20 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:20.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:20 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:20.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:20 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:20.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:20 trial092 ceph-mon[23047]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2026-02-13T04:00:20.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:20 trial092 ceph-mon[23047]: osdmap e62: 11 total, 10 up, 11 in 2026-02-13T04:00:20.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:20 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T04:00:20.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:20 trial092 ceph-mon[23047]: from='osd.10 [v2:10.20.193.99:6824/4260536068,v1:10.20.193.99:6825/4260536068]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial099", "root=default"]} : dispatch 2026-02-13T04:00:20.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:20 trial092 ceph-mon[23047]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial099", "root=default"]} : dispatch 2026-02-13T04:00:20.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:20 trial092 ceph-mon[23047]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T04:00:20.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:20 trial092 ceph-mon[23047]: from='client.24523 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "trial158:vg_nvme/lv_1", "skip_validation": true, "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T04:00:20.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:20 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:20.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:20 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:20.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:20 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:20.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:20 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:20.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:20 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:20.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:20 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:20.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:20 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:20.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:20 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:20.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:20 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:20.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:20 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:20.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:20 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:20.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:20 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:20.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:20 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:20.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:20 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:00:20.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:20 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:20.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:20 trial092 ceph-mon[23047]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 6.8 TiB / 6.8 TiB avail 2026-02-13T04:00:20.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:20 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:20.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:20 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:20.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:20 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:21.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:21 trial158 ceph-mon[27763]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial099", "root=default"]}]': finished 2026-02-13T04:00:21.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:21 trial158 ceph-mon[27763]: osdmap e63: 11 total, 10 up, 11 in 2026-02-13T04:00:21.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:21 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T04:00:21.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:21 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T04:00:21.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:21 trial158 ceph-mon[27763]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8e78b081-0fe6-49a4-879b-094cfb14783c"} : dispatch 2026-02-13T04:00:21.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:21 trial158 ceph-mon[27763]: from='client.? 10.20.193.158:0/424954901' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8e78b081-0fe6-49a4-879b-094cfb14783c"} : dispatch 2026-02-13T04:00:21.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:21 trial158 ceph-mon[27763]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8e78b081-0fe6-49a4-879b-094cfb14783c"}]': finished 2026-02-13T04:00:21.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:21 trial158 ceph-mon[27763]: osd.10 [v2:10.20.193.99:6824/4260536068,v1:10.20.193.99:6825/4260536068] boot 2026-02-13T04:00:21.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:21 trial158 ceph-mon[27763]: osdmap e64: 12 total, 11 up, 12 in 2026-02-13T04:00:21.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:21 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T04:00:21.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:21 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T04:00:21.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:21 trial158 ceph-mon[27763]: from='client.? 10.20.193.158:0/3627659553' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T04:00:21.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:21 trial158 ceph-mon[27763]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T04:00:21.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:21 trial158 ceph-mon[27763]: Cluster is now healthy 2026-02-13T04:00:21.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:21 trial099 ceph-mon[27808]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial099", "root=default"]}]': finished 2026-02-13T04:00:21.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:21 trial099 ceph-mon[27808]: osdmap e63: 11 total, 10 up, 11 in 2026-02-13T04:00:21.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:21 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T04:00:21.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:21 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T04:00:21.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:21 trial099 ceph-mon[27808]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8e78b081-0fe6-49a4-879b-094cfb14783c"} : dispatch 2026-02-13T04:00:21.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:21 trial099 ceph-mon[27808]: from='client.? 10.20.193.158:0/424954901' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8e78b081-0fe6-49a4-879b-094cfb14783c"} : dispatch 2026-02-13T04:00:21.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:21 trial099 ceph-mon[27808]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8e78b081-0fe6-49a4-879b-094cfb14783c"}]': finished 2026-02-13T04:00:21.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:21 trial099 ceph-mon[27808]: osd.10 [v2:10.20.193.99:6824/4260536068,v1:10.20.193.99:6825/4260536068] boot 2026-02-13T04:00:21.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:21 trial099 ceph-mon[27808]: osdmap e64: 12 total, 11 up, 12 in 2026-02-13T04:00:21.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:21 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T04:00:21.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:21 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T04:00:21.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:21 trial099 ceph-mon[27808]: from='client.? 10.20.193.158:0/3627659553' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T04:00:21.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:21 trial099 ceph-mon[27808]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T04:00:21.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:21 trial099 ceph-mon[27808]: Cluster is now healthy 2026-02-13T04:00:21.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:21 trial092 ceph-mon[23047]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.6836, "args": ["host=trial099", "root=default"]}]': finished 2026-02-13T04:00:21.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:21 trial092 ceph-mon[23047]: osdmap e63: 11 total, 10 up, 11 in 2026-02-13T04:00:21.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:21 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T04:00:21.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:21 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T04:00:21.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:21 trial092 ceph-mon[23047]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8e78b081-0fe6-49a4-879b-094cfb14783c"} : dispatch 2026-02-13T04:00:21.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:21 trial092 ceph-mon[23047]: from='client.? 10.20.193.158:0/424954901' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "8e78b081-0fe6-49a4-879b-094cfb14783c"} : dispatch 2026-02-13T04:00:21.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:21 trial092 ceph-mon[23047]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8e78b081-0fe6-49a4-879b-094cfb14783c"}]': finished 2026-02-13T04:00:21.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:21 trial092 ceph-mon[23047]: osd.10 [v2:10.20.193.99:6824/4260536068,v1:10.20.193.99:6825/4260536068] boot 2026-02-13T04:00:21.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:21 trial092 ceph-mon[23047]: osdmap e64: 12 total, 11 up, 12 in 2026-02-13T04:00:21.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:21 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2026-02-13T04:00:21.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:21 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T04:00:21.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:21 trial092 ceph-mon[23047]: from='client.? 10.20.193.158:0/3627659553' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2026-02-13T04:00:21.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:21 trial092 ceph-mon[23047]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T04:00:21.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:21 trial092 ceph-mon[23047]: Cluster is now healthy 2026-02-13T04:00:22.562 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:22 trial158 ceph-mon[27763]: purged_snaps scrub starts 2026-02-13T04:00:22.562 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:22 trial158 ceph-mon[27763]: purged_snaps scrub ok 2026-02-13T04:00:22.562 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:22 trial158 ceph-mon[27763]: osdmap e65: 12 total, 11 up, 12 in 2026-02-13T04:00:22.562 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:22 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T04:00:22.562 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:22 trial158 ceph-mon[27763]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T04:00:22.562 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:22 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:00:22.562 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:22 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:22.562 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:22 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:22.562 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:22 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:22.562 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:22 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:00:22.562 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:22 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:22.563 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:22 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:22.563 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:22 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:22.563 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:22 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:22.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:22 trial099 ceph-mon[27808]: purged_snaps scrub starts 2026-02-13T04:00:22.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:22 trial099 ceph-mon[27808]: purged_snaps scrub ok 2026-02-13T04:00:22.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:22 trial099 ceph-mon[27808]: osdmap e65: 12 total, 11 up, 12 in 2026-02-13T04:00:22.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:22 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T04:00:22.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:22 trial099 ceph-mon[27808]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T04:00:22.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:22 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:00:22.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:22 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:22.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:22 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:22.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:22 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:22.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:22 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:00:22.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:22 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:22.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:22 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:22.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:22 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:22.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:22 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:22.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:22 trial092 ceph-mon[23047]: purged_snaps scrub starts 2026-02-13T04:00:22.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:22 trial092 ceph-mon[23047]: purged_snaps scrub ok 2026-02-13T04:00:22.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:22 trial092 ceph-mon[23047]: osdmap e65: 12 total, 11 up, 12 in 2026-02-13T04:00:22.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:22 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T04:00:22.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:22 trial092 ceph-mon[23047]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T04:00:22.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:22 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:00:22.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:22 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:22.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:22 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:22.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:22 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:22.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:22 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:00:22.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:22 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:22.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:22 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:22.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:22 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:22.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:22 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:23.418 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:23 trial158 ceph-mon[27763]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T04:00:23.418 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:23 trial158 ceph-mon[27763]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T04:00:23.418 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:23 trial158 ceph-mon[27763]: osdmap e66: 12 total, 11 up, 12 in 2026-02-13T04:00:23.418 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:23 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T04:00:23.418 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:23 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-13T04:00:23.418 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:23 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:23.419 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:23 trial158 ceph-mon[27763]: osdmap e67: 12 total, 11 up, 12 in 2026-02-13T04:00:23.419 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:23 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T04:00:23.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:23 trial099 ceph-mon[27808]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T04:00:23.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:23 trial099 ceph-mon[27808]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T04:00:23.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:23 trial099 ceph-mon[27808]: osdmap e66: 12 total, 11 up, 12 in 2026-02-13T04:00:23.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:23 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T04:00:23.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:23 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-13T04:00:23.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:23 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:23.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:23 trial099 ceph-mon[27808]: osdmap e67: 12 total, 11 up, 12 in 2026-02-13T04:00:23.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:23 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T04:00:23.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:23 trial092 ceph-mon[23047]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T04:00:23.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:23 trial092 ceph-mon[23047]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T04:00:23.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:23 trial092 ceph-mon[23047]: osdmap e66: 12 total, 11 up, 12 in 2026-02-13T04:00:23.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:23 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T04:00:23.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:23 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2026-02-13T04:00:23.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:23 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:23.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:23 trial092 ceph-mon[23047]: osdmap e67: 12 total, 11 up, 12 in 2026-02-13T04:00:23.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:23 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T04:00:24.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:24 trial158 ceph-mon[27763]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T04:00:24.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:24 trial158 ceph-mon[27763]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T04:00:24.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:24 trial158 ceph-mon[27763]: osdmap e68: 12 total, 11 up, 12 in 2026-02-13T04:00:24.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:24 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T04:00:24.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:24 trial099 ceph-mon[27808]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T04:00:24.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:24 trial099 ceph-mon[27808]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T04:00:24.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:24 trial099 ceph-mon[27808]: osdmap e68: 12 total, 11 up, 12 in 2026-02-13T04:00:24.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:24 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T04:00:24.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:24 trial092 ceph-mon[23047]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T04:00:24.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:24 trial092 ceph-mon[23047]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T04:00:24.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:24 trial092 ceph-mon[23047]: osdmap e68: 12 total, 11 up, 12 in 2026-02-13T04:00:24.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:24 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T04:00:25.350 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:25 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:00:25.350 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:25 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:25.350 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:25 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:25.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:25 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:00:25.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:25 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:25.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:25 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:25.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:25 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:00:25.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:25 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:25.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:25 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:25.955 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:25.953+0000 7fb3a27fc6c0 1 -- 10.20.193.158:0/1689087674 <== mgr.14187 v2:10.20.193.92:6800/4191527999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb3a410fc20 con 0x7fb36c0b56d0 2026-02-13T04:00:25.956 INFO:teuthology.orchestra.run.trial158.stdout:Created osd(s) 11 on host 'trial158' 2026-02-13T04:00:25.958 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:25.955+0000 7fb3ab93c6c0 1 -- 10.20.193.158:0/1689087674 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fb36c0b56d0 msgr2=0x7fb36c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:25.958 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:25.955+0000 7fb3ab93c6c0 1 --2- 10.20.193.158:0/1689087674 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fb36c0b56d0 0x7fb36c0d5b80 secure :-1 s=READY pgs=99 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb390005980 tx=0x7fb390005910 comp rx=0 tx=0).stop 2026-02-13T04:00:25.958 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:25.955+0000 7fb3ab93c6c0 1 -- 10.20.193.158:0/1689087674 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fb3a4115440 msgr2=0x7fb3a4175ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:25.958 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:25.955+0000 7fb3ab93c6c0 1 --2- 10.20.193.158:0/1689087674 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fb3a4115440 0x7fb3a4175ce0 secure :-1 s=READY pgs=60 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb38c009290 tx=0x7fb38c02f830 comp rx=0 tx=0).stop 2026-02-13T04:00:25.958 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:25.955+0000 7fb3ab93c6c0 1 -- 10.20.193.158:0/1689087674 shutdown_connections 2026-02-13T04:00:25.959 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:25.955+0000 7fb3ab93c6c0 1 --2- 10.20.193.158:0/1689087674 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fb36c0b56d0 0x7fb36c0d5b80 unknown :-1 s=CLOSED pgs=99 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:25.959 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:25.955+0000 7fb3ab93c6c0 1 --2- 10.20.193.158:0/1689087674 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fb3a40f4ff0 0x7fb3a40fa270 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:25.959 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:25.955+0000 7fb3ab93c6c0 1 --2- 10.20.193.158:0/1689087674 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fb3a4115440 0x7fb3a4175ce0 unknown :-1 s=CLOSED pgs=60 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:25.959 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:25.955+0000 7fb3ab93c6c0 1 --2- 10.20.193.158:0/1689087674 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb3a410f230 0x7fb3a40f49c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:25.959 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:25.955+0000 7fb3ab93c6c0 1 -- 10.20.193.158:0/1689087674 >> 10.20.193.158:0/1689087674 conn(0x7fb3a40ecb30 msgr2=0x7fb3a410d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:25.959 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:25.955+0000 7fb3ab93c6c0 1 -- 10.20.193.158:0/1689087674 shutdown_connections 2026-02-13T04:00:25.959 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:25.956+0000 7fb3ab93c6c0 1 -- 10.20.193.158:0/1689087674 wait complete. 2026-02-13T04:00:26.002 DEBUG:teuthology.orchestra.run.trial158:osd.11> sudo journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@osd.11.service 2026-02-13T04:00:26.004 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2026-02-13T04:00:26.005 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph osd stat -f json 2026-02-13T04:00:26.190 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:00:26.392 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.386+0000 7f9691d836c0 1 -- 10.20.193.92:0/3962350515 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f968c115270 msgr2=0x7f968c175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:26.392 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.386+0000 7f9691d836c0 1 --2- 10.20.193.92:0/3962350515 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f968c115270 0x7f968c175c10 secure :-1 s=READY pgs=147 gs=1 cs=0 l=1 c_cookie=1962086071468330035 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f968800aa70 tx=0x7f968802fde0 comp rx=0 tx=0).stop 2026-02-13T04:00:26.392 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.387+0000 7f9691d836c0 1 -- 10.20.193.92:0/3962350515 shutdown_connections 2026-02-13T04:00:26.392 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.387+0000 7f9691d836c0 1 --2- 10.20.193.92:0/3962350515 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f968c10fa50 0x7f968c114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:26.392 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.387+0000 7f9691d836c0 1 --2- 10.20.193.92:0/3962350515 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f968c115270 0x7f968c175c10 unknown :-1 s=CLOSED pgs=147 gs=1 cs=0 l=1 c_cookie=1962086071468330035 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:26.392 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.387+0000 7f9691d836c0 1 --2- 10.20.193.92:0/3962350515 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f968c10f060 0x7f968c10f430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:26.392 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.387+0000 7f9691d836c0 1 -- 10.20.193.92:0/3962350515 >> 10.20.193.92:0/3962350515 conn(0x7f968c0ec980 msgr2=0x7f968c10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:26.392 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.387+0000 7f9691d836c0 1 -- 10.20.193.92:0/3962350515 shutdown_connections 2026-02-13T04:00:26.392 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.387+0000 7f9691d836c0 1 -- 10.20.193.92:0/3962350515 wait complete. 2026-02-13T04:00:26.393 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.387+0000 7f9691d836c0 1 Processor -- start 2026-02-13T04:00:26.393 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.387+0000 7f9691d836c0 1 -- start start 2026-02-13T04:00:26.393 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.388+0000 7f9691d836c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f968c10f060 0x7f968c11cd80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:26.393 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.388+0000 7f9691d836c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f968c115270 0x7f968c11d2c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:26.393 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.388+0000 7f9691d836c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f968c122680 0x7f968c122b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:26.393 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.388+0000 7f9691d836c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f968c123060 con 0x7f968c10f060 2026-02-13T04:00:26.393 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.388+0000 7f9691d836c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f968c1231d0 con 0x7f968c115270 2026-02-13T04:00:26.393 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.388+0000 7f9691d836c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f968c123390 con 0x7f968c122680 2026-02-13T04:00:26.393 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.388+0000 7f9690d816c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f968c10f060 0x7f968c11cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:26.393 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.388+0000 7f9690d816c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f968c10f060 0x7f968c11cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:55172/0 (socket says 10.20.193.92:55172) 2026-02-13T04:00:26.393 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.388+0000 7f9690d816c0 1 -- 10.20.193.92:0/2581599629 learned_addr learned my addr 10.20.193.92:0/2581599629 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:00:26.394 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.388+0000 7f9683fff6c0 1 --2- 10.20.193.92:0/2581599629 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f968c115270 0x7f968c11d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:26.394 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.388+0000 7f96915826c0 1 --2- 10.20.193.92:0/2581599629 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f968c122680 0x7f968c122b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:26.394 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.388+0000 7f9690d816c0 1 -- 10.20.193.92:0/2581599629 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f968c122680 msgr2=0x7f968c122b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:26.394 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.388+0000 7f9690d816c0 1 --2- 10.20.193.92:0/2581599629 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f968c122680 0x7f968c122b20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:26.394 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.388+0000 7f9690d816c0 1 -- 10.20.193.92:0/2581599629 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f968c115270 msgr2=0x7f968c11d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:26.394 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.388+0000 7f9690d816c0 1 --2- 10.20.193.92:0/2581599629 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f968c115270 0x7f968c11d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:26.394 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.388+0000 7f9690d816c0 1 -- 10.20.193.92:0/2581599629 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f968800a660 con 0x7f968c10f060 2026-02-13T04:00:26.394 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.388+0000 7f9690d816c0 1 --2- 10.20.193.92:0/2581599629 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f968c10f060 0x7f968c11cd80 secure :-1 s=READY pgs=148 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f967c00b6c0 tx=0x7f967c00bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:26.394 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.388+0000 7f9681ffb6c0 1 -- 10.20.193.92:0/2581599629 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f967c0044a0 con 0x7f968c10f060 2026-02-13T04:00:26.394 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.389+0000 7f9681ffb6c0 1 -- 10.20.193.92:0/2581599629 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f967c009030 con 0x7f968c10f060 2026-02-13T04:00:26.394 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.389+0000 7f9681ffb6c0 1 -- 10.20.193.92:0/2581599629 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f967c0071c0 con 0x7f968c10f060 2026-02-13T04:00:26.394 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.389+0000 7f9691d836c0 1 -- 10.20.193.92:0/2581599629 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f968c163810 con 0x7f968c10f060 2026-02-13T04:00:26.395 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.389+0000 7f9691d836c0 1 -- 10.20.193.92:0/2581599629 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f968c163ca0 con 0x7f968c10f060 2026-02-13T04:00:26.395 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.389+0000 7f9691d836c0 1 -- 10.20.193.92:0/2581599629 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f968c110330 con 0x7f968c10f060 2026-02-13T04:00:26.395 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.392+0000 7f9681ffb6c0 1 -- 10.20.193.92:0/2581599629 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f967c00c410 con 0x7f968c10f060 2026-02-13T04:00:26.396 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.393+0000 7f9681ffb6c0 1 --2- 10.20.193.92:0/2581599629 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f96680b56d0 0x7f96680d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:26.396 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.393+0000 7f9681ffb6c0 1 -- 10.20.193.92:0/2581599629 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6801+0+0 (secure 0 0 0) 0x7f967c0e3490 con 0x7f968c10f060 2026-02-13T04:00:26.396 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.393+0000 7f9681ffb6c0 1 -- 10.20.193.92:0/2581599629 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f967c0e3910 con 0x7f968c10f060 2026-02-13T04:00:26.396 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.393+0000 7f9683fff6c0 1 --2- 10.20.193.92:0/2581599629 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f96680b56d0 0x7f96680d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:26.397 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.393+0000 7f9683fff6c0 1 --2- 10.20.193.92:0/2581599629 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f96680b56d0 0x7f96680d5b80 secure :-1 s=READY pgs=104 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9674005980 tx=0x7f9674005910 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:26.497 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.494+0000 7f9691d836c0 1 -- 10.20.193.92:0/2581599629 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f968c10fa50 con 0x7f968c10f060 2026-02-13T04:00:26.497 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.494+0000 7f9681ffb6c0 1 -- 10.20.193.92:0/2581599629 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v68) ==== 74+0+133 (secure 0 0 0) 0x7f967c0a63d0 con 0x7f968c10f060 2026-02-13T04:00:26.497 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:00:26.498 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.495+0000 7f9691d836c0 1 -- 10.20.193.92:0/2581599629 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f96680b56d0 msgr2=0x7f96680d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:26.498 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.495+0000 7f9691d836c0 1 --2- 10.20.193.92:0/2581599629 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f96680b56d0 0x7f96680d5b80 secure :-1 s=READY pgs=104 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9674005980 tx=0x7f9674005910 comp rx=0 tx=0).stop 2026-02-13T04:00:26.499 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.495+0000 7f9691d836c0 1 -- 10.20.193.92:0/2581599629 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f968c10f060 msgr2=0x7f968c11cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:26.499 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.495+0000 7f9691d836c0 1 --2- 10.20.193.92:0/2581599629 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f968c10f060 0x7f968c11cd80 secure :-1 s=READY pgs=148 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f967c00b6c0 tx=0x7f967c00bb90 comp rx=0 tx=0).stop 2026-02-13T04:00:26.499 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.495+0000 7f9691d836c0 1 -- 10.20.193.92:0/2581599629 shutdown_connections 2026-02-13T04:00:26.499 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.495+0000 7f9691d836c0 1 --2- 10.20.193.92:0/2581599629 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f96680b56d0 0x7f96680d5b80 unknown :-1 s=CLOSED pgs=104 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:26.499 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.495+0000 7f9691d836c0 1 --2- 10.20.193.92:0/2581599629 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f968c115270 0x7f968c11d2c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:26.499 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.495+0000 7f9691d836c0 1 --2- 10.20.193.92:0/2581599629 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f968c122680 0x7f968c122b20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:26.499 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.495+0000 7f9691d836c0 1 --2- 10.20.193.92:0/2581599629 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f968c10f060 0x7f968c11cd80 unknown :-1 s=CLOSED pgs=148 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:26.499 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.495+0000 7f9691d836c0 1 -- 10.20.193.92:0/2581599629 >> 10.20.193.92:0/2581599629 conn(0x7f968c0ec980 msgr2=0x7f968c10cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:26.499 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.495+0000 7f9691d836c0 1 -- 10.20.193.92:0/2581599629 shutdown_connections 2026-02-13T04:00:26.499 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:26.495+0000 7f9691d836c0 1 -- 10.20.193.92:0/2581599629 wait complete. 2026-02-13T04:00:26.579 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:26 trial092 ceph-mon[23047]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 213 KiB/s, 0 objects/s recovering 2026-02-13T04:00:26.579 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:26 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:26.579 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:26 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:26.579 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:26 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:26.579 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:26 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:00:26.579 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:26 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:26.579 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:26 trial092 ceph-mon[23047]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 175 KiB/s, 0 objects/s recovering 2026-02-13T04:00:26.579 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:26 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:26.579 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:26 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:26.580 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:26 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:26.580 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:26 trial092 ceph-mon[23047]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T04:00:26.580 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:26 trial092 ceph-mon[23047]: from='osd.11 [v2:10.20.193.158:6824/2019612524,v1:10.20.193.158:6825/2019612524]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T04:00:26.580 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:26 trial092 ceph-mon[23047]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T04:00:26.580 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:26 trial092 ceph-mon[23047]: Cluster is now healthy 2026-02-13T04:00:26.580 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:26 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:26.580 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:26 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:26.580 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:26 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:00:26.580 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:26 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/2581599629' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T04:00:26.636 INFO:teuthology.orchestra.run.trial092.stdout:{"epoch":68,"num_osds":12,"num_up_osds":11,"osd_up_since":1770955220,"num_in_osds":12,"osd_in_since":1770955220,"num_remapped_pgs":0} 2026-02-13T04:00:26.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:26 trial158 ceph-mon[27763]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 213 KiB/s, 0 objects/s recovering 2026-02-13T04:00:26.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:26 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:26.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:26 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:26.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:26 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:26.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:26 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:00:26.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:26 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:26.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:26 trial158 ceph-mon[27763]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 175 KiB/s, 0 objects/s recovering 2026-02-13T04:00:26.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:26 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:26.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:26 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:26.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:26 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:26.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:26 trial158 ceph-mon[27763]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T04:00:26.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:26 trial158 ceph-mon[27763]: from='osd.11 [v2:10.20.193.158:6824/2019612524,v1:10.20.193.158:6825/2019612524]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T04:00:26.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:26 trial158 ceph-mon[27763]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T04:00:26.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:26 trial158 ceph-mon[27763]: Cluster is now healthy 2026-02-13T04:00:26.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:26 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:26.831 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:26 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:26.831 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:26 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:00:26.831 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:26 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/2581599629' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T04:00:26.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:26 trial099 ceph-mon[27808]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 213 KiB/s, 0 objects/s recovering 2026-02-13T04:00:26.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:26 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:26.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:26 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:26.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:26 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:26.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:26 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:00:26.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:26 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:26.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:26 trial099 ceph-mon[27808]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 175 KiB/s, 0 objects/s recovering 2026-02-13T04:00:26.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:26 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:26.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:26 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:26.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:26 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:26.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:26 trial099 ceph-mon[27808]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T04:00:26.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:26 trial099 ceph-mon[27808]: from='osd.11 [v2:10.20.193.158:6824/2019612524,v1:10.20.193.158:6825/2019612524]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2026-02-13T04:00:26.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:26 trial099 ceph-mon[27808]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T04:00:26.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:26 trial099 ceph-mon[27808]: Cluster is now healthy 2026-02-13T04:00:26.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:26 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:26.868 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:26 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:26.868 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:26 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:00:26.868 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:26 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/2581599629' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T04:00:27.637 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph osd stat -f json 2026-02-13T04:00:27.656 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:27 trial158 ceph-mon[27763]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 148 KiB/s, 0 objects/s recovering 2026-02-13T04:00:27.656 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:27 trial158 ceph-mon[27763]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2026-02-13T04:00:27.656 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:27 trial158 ceph-mon[27763]: osdmap e69: 12 total, 11 up, 12 in 2026-02-13T04:00:27.656 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:27 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T04:00:27.656 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:27 trial158 ceph-mon[27763]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial158", "root=default"]} : dispatch 2026-02-13T04:00:27.656 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:27 trial158 ceph-mon[27763]: from='osd.11 [v2:10.20.193.158:6824/2019612524,v1:10.20.193.158:6825/2019612524]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial158", "root=default"]} : dispatch 2026-02-13T04:00:27.656 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:27 trial158 ceph-mon[27763]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T04:00:27.656 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:27 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:27.657 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:27 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:27.657 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:27 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:27.657 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:27 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:27.657 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:27 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:27.657 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:27 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:27.657 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:27 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:27.657 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:27 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:27.657 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:27 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:00:27.657 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:27 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:27.657 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:27 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:27.657 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:27 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:27.657 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:27 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:27.658 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:00:27 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:00:27.572+0000 7f70ec7f06c0 -1 osd.11 0 waiting for initial osdmap 2026-02-13T04:00:27.658 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:00:27 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:00:27.580+0000 7f70e86b46c0 -1 osd.11 70 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-13T04:00:27.821 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:00:27.865 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:27 trial092 ceph-mon[23047]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 148 KiB/s, 0 objects/s recovering 2026-02-13T04:00:27.865 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:27 trial092 ceph-mon[23047]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2026-02-13T04:00:27.865 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:27 trial092 ceph-mon[23047]: osdmap e69: 12 total, 11 up, 12 in 2026-02-13T04:00:27.865 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:27 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T04:00:27.865 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:27 trial092 ceph-mon[23047]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial158", "root=default"]} : dispatch 2026-02-13T04:00:27.865 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:27 trial092 ceph-mon[23047]: from='osd.11 [v2:10.20.193.158:6824/2019612524,v1:10.20.193.158:6825/2019612524]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial158", "root=default"]} : dispatch 2026-02-13T04:00:27.865 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:27 trial092 ceph-mon[23047]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T04:00:27.865 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:27 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:27.866 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:27 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:27.866 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:27 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:27.866 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:27 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:27.866 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:27 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:27.866 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:27 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:27.866 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:27 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:27.866 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:27 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:27.866 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:27 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:00:27.866 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:27 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:27.866 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:27 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:27.866 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:27 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:27.867 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:27 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:27.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:27 trial099 ceph-mon[27808]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 148 KiB/s, 0 objects/s recovering 2026-02-13T04:00:27.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:27 trial099 ceph-mon[27808]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2026-02-13T04:00:27.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:27 trial099 ceph-mon[27808]: osdmap e69: 12 total, 11 up, 12 in 2026-02-13T04:00:27.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:27 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T04:00:27.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:27 trial099 ceph-mon[27808]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial158", "root=default"]} : dispatch 2026-02-13T04:00:27.868 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:27 trial099 ceph-mon[27808]: from='osd.11 [v2:10.20.193.158:6824/2019612524,v1:10.20.193.158:6825/2019612524]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial158", "root=default"]} : dispatch 2026-02-13T04:00:27.868 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:27 trial099 ceph-mon[27808]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T04:00:27.868 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:27 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:27.868 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:27 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:27.868 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:27 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:27.868 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:27 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:27.868 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:27 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:27.868 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:27 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2026-02-13T04:00:27.868 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:27 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:27.868 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:27 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:27.868 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:27 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:00:27.868 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:27 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:27.869 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:27 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:27.869 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:27 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:27.869 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:27 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:28.010 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.006+0000 7fbf6e6a76c0 1 -- 10.20.193.92:0/2113615399 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbf6810f060 msgr2=0x7fbf6810f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:28.010 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.006+0000 7fbf6e6a76c0 1 --2- 10.20.193.92:0/2113615399 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbf6810f060 0x7fbf6810f430 secure :-1 s=READY pgs=149 gs=1 cs=0 l=1 c_cookie=11771390326817386555 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf580099a0 tx=0x7fbf5802ed50 comp rx=0 tx=0).stop 2026-02-13T04:00:28.010 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.007+0000 7fbf6e6a76c0 1 -- 10.20.193.92:0/2113615399 shutdown_connections 2026-02-13T04:00:28.011 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.007+0000 7fbf6e6a76c0 1 --2- 10.20.193.92:0/2113615399 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fbf68115270 0x7fbf68175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:28.011 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.007+0000 7fbf6e6a76c0 1 --2- 10.20.193.92:0/2113615399 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fbf6810fa50 0x7fbf68114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:28.011 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.007+0000 7fbf6e6a76c0 1 --2- 10.20.193.92:0/2113615399 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbf6810f060 0x7fbf6810f430 unknown :-1 s=CLOSED pgs=149 gs=1 cs=0 l=1 c_cookie=11771390326817386555 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:28.011 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.007+0000 7fbf6e6a76c0 1 -- 10.20.193.92:0/2113615399 >> 10.20.193.92:0/2113615399 conn(0x7fbf680ec980 msgr2=0x7fbf6810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:28.011 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.007+0000 7fbf6e6a76c0 1 -- 10.20.193.92:0/2113615399 shutdown_connections 2026-02-13T04:00:28.011 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.007+0000 7fbf6e6a76c0 1 -- 10.20.193.92:0/2113615399 wait complete. 2026-02-13T04:00:28.011 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.007+0000 7fbf6e6a76c0 1 Processor -- start 2026-02-13T04:00:28.011 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.007+0000 7fbf6e6a76c0 1 -- start start 2026-02-13T04:00:28.013 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.008+0000 7fbf6e6a76c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fbf6810f060 0x7fbf6811ce00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:28.013 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.008+0000 7fbf6e6a76c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fbf68115270 0x7fbf6811d340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:28.013 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.008+0000 7fbf6e6a76c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbf68122700 0x7fbf68122ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:28.013 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.008+0000 7fbf6e6a76c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbf68123110 con 0x7fbf68122700 2026-02-13T04:00:28.013 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.008+0000 7fbf6e6a76c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fbf68123280 con 0x7fbf68115270 2026-02-13T04:00:28.013 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.008+0000 7fbf6e6a76c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fbf68123440 con 0x7fbf6810f060 2026-02-13T04:00:28.013 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.008+0000 7fbf6dea66c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbf68122700 0x7fbf68122ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:28.014 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.008+0000 7fbf6cea46c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fbf68115270 0x7fbf6811d340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:28.014 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.008+0000 7fbf6dea66c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbf68122700 0x7fbf68122ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:55198/0 (socket says 10.20.193.92:55198) 2026-02-13T04:00:28.014 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.008+0000 7fbf6dea66c0 1 -- 10.20.193.92:0/465166785 learned_addr learned my addr 10.20.193.92:0/465166785 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:00:28.014 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.008+0000 7fbf6d6a56c0 1 --2- 10.20.193.92:0/465166785 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fbf6810f060 0x7fbf6811ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:28.014 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.008+0000 7fbf6dea66c0 1 -- 10.20.193.92:0/465166785 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fbf6810f060 msgr2=0x7fbf6811ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:28.014 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.008+0000 7fbf6dea66c0 1 --2- 10.20.193.92:0/465166785 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fbf6810f060 0x7fbf6811ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:28.014 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.008+0000 7fbf6dea66c0 1 -- 10.20.193.92:0/465166785 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fbf68115270 msgr2=0x7fbf6811d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:28.014 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.008+0000 7fbf6dea66c0 1 --2- 10.20.193.92:0/465166785 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fbf68115270 0x7fbf6811d340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:28.014 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.008+0000 7fbf6dea66c0 1 -- 10.20.193.92:0/465166785 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf58009590 con 0x7fbf68122700 2026-02-13T04:00:28.014 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.008+0000 7fbf6dea66c0 1 --2- 10.20.193.92:0/465166785 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbf68122700 0x7fbf68122ba0 secure :-1 s=READY pgs=150 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf64006ea0 tx=0x7fbf6400ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:28.014 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.008+0000 7fbf567fc6c0 1 -- 10.20.193.92:0/465166785 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf64003c40 con 0x7fbf68122700 2026-02-13T04:00:28.015 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.008+0000 7fbf567fc6c0 1 -- 10.20.193.92:0/465166785 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fbf64003da0 con 0x7fbf68122700 2026-02-13T04:00:28.015 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.008+0000 7fbf567fc6c0 1 -- 10.20.193.92:0/465166785 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf64008440 con 0x7fbf68122700 2026-02-13T04:00:28.015 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.008+0000 7fbf6e6a76c0 1 -- 10.20.193.92:0/465166785 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf681638f0 con 0x7fbf68122700 2026-02-13T04:00:28.015 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.008+0000 7fbf6e6a76c0 1 -- 10.20.193.92:0/465166785 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf68163dd0 con 0x7fbf68122700 2026-02-13T04:00:28.015 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.009+0000 7fbf6e6a76c0 1 -- 10.20.193.92:0/465166785 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf68110330 con 0x7fbf68122700 2026-02-13T04:00:28.015 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.011+0000 7fbf567fc6c0 1 -- 10.20.193.92:0/465166785 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7fbf6400d690 con 0x7fbf68122700 2026-02-13T04:00:28.016 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.013+0000 7fbf567fc6c0 1 --2- 10.20.193.92:0/465166785 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fbf440b56d0 0x7fbf440d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:28.016 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.013+0000 7fbf567fc6c0 1 -- 10.20.193.92:0/465166785 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 6839+0+0 (secure 0 0 0) 0x7fbf640e47b0 con 0x7fbf68122700 2026-02-13T04:00:28.016 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.013+0000 7fbf567fc6c0 1 -- 10.20.193.92:0/465166785 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fbf640e4c30 con 0x7fbf68122700 2026-02-13T04:00:28.016 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.013+0000 7fbf6d6a56c0 1 --2- 10.20.193.92:0/465166785 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fbf440b56d0 0x7fbf440d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:28.017 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.014+0000 7fbf6d6a56c0 1 --2- 10.20.193.92:0/465166785 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fbf440b56d0 0x7fbf440d5b80 secure :-1 s=READY pgs=106 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf580023e0 tx=0x7fbf580071c0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:28.117 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.114+0000 7fbf6e6a76c0 1 -- 10.20.193.92:0/465166785 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fbf6811df80 con 0x7fbf68122700 2026-02-13T04:00:28.117 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.114+0000 7fbf567fc6c0 1 -- 10.20.193.92:0/465166785 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v70) ==== 74+0+133 (secure 0 0 0) 0x7fbf640a76d0 con 0x7fbf68122700 2026-02-13T04:00:28.118 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:00:28.119 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.115+0000 7fbf6e6a76c0 1 -- 10.20.193.92:0/465166785 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fbf440b56d0 msgr2=0x7fbf440d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:28.119 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.115+0000 7fbf6e6a76c0 1 --2- 10.20.193.92:0/465166785 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fbf440b56d0 0x7fbf440d5b80 secure :-1 s=READY pgs=106 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf580023e0 tx=0x7fbf580071c0 comp rx=0 tx=0).stop 2026-02-13T04:00:28.119 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.115+0000 7fbf6e6a76c0 1 -- 10.20.193.92:0/465166785 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbf68122700 msgr2=0x7fbf68122ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:28.119 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.115+0000 7fbf6e6a76c0 1 --2- 10.20.193.92:0/465166785 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbf68122700 0x7fbf68122ba0 secure :-1 s=READY pgs=150 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf64006ea0 tx=0x7fbf6400ce50 comp rx=0 tx=0).stop 2026-02-13T04:00:28.119 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.116+0000 7fbf6e6a76c0 1 -- 10.20.193.92:0/465166785 shutdown_connections 2026-02-13T04:00:28.119 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.116+0000 7fbf6e6a76c0 1 --2- 10.20.193.92:0/465166785 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fbf440b56d0 0x7fbf440d5b80 unknown :-1 s=CLOSED pgs=106 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:28.119 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.116+0000 7fbf6e6a76c0 1 --2- 10.20.193.92:0/465166785 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fbf68115270 0x7fbf6811d340 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:28.119 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.116+0000 7fbf6e6a76c0 1 --2- 10.20.193.92:0/465166785 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbf68122700 0x7fbf68122ba0 unknown :-1 s=CLOSED pgs=150 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:28.120 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.116+0000 7fbf6e6a76c0 1 --2- 10.20.193.92:0/465166785 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fbf6810f060 0x7fbf6811ce00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:28.120 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.116+0000 7fbf6e6a76c0 1 -- 10.20.193.92:0/465166785 >> 10.20.193.92:0/465166785 conn(0x7fbf680ec980 msgr2=0x7fbf6810cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:28.120 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.116+0000 7fbf6e6a76c0 1 -- 10.20.193.92:0/465166785 shutdown_connections 2026-02-13T04:00:28.120 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:28.116+0000 7fbf6e6a76c0 1 -- 10.20.193.92:0/465166785 wait complete. 2026-02-13T04:00:28.258 INFO:teuthology.orchestra.run.trial092.stdout:{"epoch":70,"num_osds":12,"num_up_osds":11,"osd_up_since":1770955220,"num_in_osds":12,"osd_in_since":1770955220,"num_remapped_pgs":0} 2026-02-13T04:00:28.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:28 trial158 ceph-mon[27763]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 150 KiB/s, 0 objects/s recovering 2026-02-13T04:00:28.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:28 trial158 ceph-mon[27763]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial158", "root=default"]}]': finished 2026-02-13T04:00:28.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:28 trial158 ceph-mon[27763]: osdmap e70: 12 total, 11 up, 12 in 2026-02-13T04:00:28.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:28 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T04:00:28.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:28 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T04:00:28.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:28 trial158 ceph-mon[27763]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T04:00:28.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:28 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/465166785' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T04:00:28.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:28 trial099 ceph-mon[27808]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 150 KiB/s, 0 objects/s recovering 2026-02-13T04:00:28.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:28 trial099 ceph-mon[27808]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial158", "root=default"]}]': finished 2026-02-13T04:00:28.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:28 trial099 ceph-mon[27808]: osdmap e70: 12 total, 11 up, 12 in 2026-02-13T04:00:28.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:28 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T04:00:28.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:28 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T04:00:28.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:28 trial099 ceph-mon[27808]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T04:00:28.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:28 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/465166785' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T04:00:28.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:28 trial092 ceph-mon[23047]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail; 150 KiB/s, 0 objects/s recovering 2026-02-13T04:00:28.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:28 trial092 ceph-mon[23047]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.6836, "args": ["host=trial158", "root=default"]}]': finished 2026-02-13T04:00:28.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:28 trial092 ceph-mon[23047]: osdmap e70: 12 total, 11 up, 12 in 2026-02-13T04:00:28.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:28 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T04:00:28.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:28 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T04:00:28.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:28 trial092 ceph-mon[23047]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 7.5 TiB / 7.5 TiB avail 2026-02-13T04:00:28.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:28 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/465166785' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T04:00:29.260 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph osd stat -f json 2026-02-13T04:00:29.445 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:00:29.631 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.628+0000 7fb1d05a16c0 1 -- 10.20.193.92:0/1301640622 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb1c810f200 msgr2=0x7fb1c810f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:29.631 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.628+0000 7fb1d05a16c0 1 --2- 10.20.193.92:0/1301640622 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb1c810f200 0x7fb1c810f5d0 secure :-1 s=READY pgs=151 gs=1 cs=0 l=1 c_cookie=2655826880075522233 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1b80099a0 tx=0x7fb1b802ed00 comp rx=0 tx=0).stop 2026-02-13T04:00:29.632 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.628+0000 7fb1d05a16c0 1 -- 10.20.193.92:0/1301640622 shutdown_connections 2026-02-13T04:00:29.632 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.628+0000 7fb1d05a16c0 1 --2- 10.20.193.92:0/1301640622 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fb1c8115410 0x7fb1c8175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:29.632 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.628+0000 7fb1d05a16c0 1 --2- 10.20.193.92:0/1301640622 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fb1c810fbf0 0x7fb1c8114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:29.632 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.628+0000 7fb1d05a16c0 1 --2- 10.20.193.92:0/1301640622 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb1c810f200 0x7fb1c810f5d0 unknown :-1 s=CLOSED pgs=151 gs=1 cs=0 l=1 c_cookie=2655826880075522233 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:29.632 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.628+0000 7fb1d05a16c0 1 -- 10.20.193.92:0/1301640622 >> 10.20.193.92:0/1301640622 conn(0x7fb1c80ecb00 msgr2=0x7fb1c810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:29.632 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.628+0000 7fb1d05a16c0 1 -- 10.20.193.92:0/1301640622 shutdown_connections 2026-02-13T04:00:29.632 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.628+0000 7fb1d05a16c0 1 -- 10.20.193.92:0/1301640622 wait complete. 2026-02-13T04:00:29.634 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.629+0000 7fb1d05a16c0 1 Processor -- start 2026-02-13T04:00:29.634 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.629+0000 7fb1d05a16c0 1 -- start start 2026-02-13T04:00:29.634 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.629+0000 7fb1d05a16c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb1c810f200 0x7fb1c811d010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:29.634 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.629+0000 7fb1d05a16c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fb1c8115410 0x7fb1c811d550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:29.635 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.629+0000 7fb1d05a16c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fb1c8122910 0x7fb1c8122db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:29.635 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.629+0000 7fb1d05a16c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c8123320 con 0x7fb1c810f200 2026-02-13T04:00:29.635 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.629+0000 7fb1d05a16c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c8123490 con 0x7fb1c8115410 2026-02-13T04:00:29.635 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.629+0000 7fb1d05a16c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c8123650 con 0x7fb1c8122910 2026-02-13T04:00:29.635 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.629+0000 7fb1ce3126c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb1c810f200 0x7fb1c811d010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:29.635 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.629+0000 7fb1ce3126c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb1c810f200 0x7fb1c811d010 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:55214/0 (socket says 10.20.193.92:55214) 2026-02-13T04:00:29.635 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.629+0000 7fb1ce3126c0 1 -- 10.20.193.92:0/3748613679 learned_addr learned my addr 10.20.193.92:0/3748613679 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:00:29.635 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.629+0000 7fb1cdb116c0 1 --2- 10.20.193.92:0/3748613679 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fb1c8115410 0x7fb1c811d550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:29.635 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.629+0000 7fb1ceb136c0 1 --2- 10.20.193.92:0/3748613679 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fb1c8122910 0x7fb1c8122db0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:29.635 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.629+0000 7fb1ce3126c0 1 -- 10.20.193.92:0/3748613679 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fb1c8122910 msgr2=0x7fb1c8122db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:29.635 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.629+0000 7fb1ce3126c0 1 --2- 10.20.193.92:0/3748613679 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fb1c8122910 0x7fb1c8122db0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:29.636 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.629+0000 7fb1ce3126c0 1 -- 10.20.193.92:0/3748613679 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fb1c8115410 msgr2=0x7fb1c811d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:29.636 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.629+0000 7fb1ce3126c0 1 --2- 10.20.193.92:0/3748613679 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fb1c8115410 0x7fb1c811d550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:29.636 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.629+0000 7fb1ce3126c0 1 -- 10.20.193.92:0/3748613679 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1b8009590 con 0x7fb1c810f200 2026-02-13T04:00:29.636 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.630+0000 7fb1ce3126c0 1 --2- 10.20.193.92:0/3748613679 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb1c810f200 0x7fb1c811d010 secure :-1 s=READY pgs=152 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1b802f210 tx=0x7fb1b802f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:29.636 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.630+0000 7fb1af7fe6c0 1 -- 10.20.193.92:0/3748613679 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb1b8005e90 con 0x7fb1c810f200 2026-02-13T04:00:29.636 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.630+0000 7fb1af7fe6c0 1 -- 10.20.193.92:0/3748613679 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fb1b80046b0 con 0x7fb1c810f200 2026-02-13T04:00:29.636 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.630+0000 7fb1af7fe6c0 1 -- 10.20.193.92:0/3748613679 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb1b80073f0 con 0x7fb1c810f200 2026-02-13T04:00:29.636 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.630+0000 7fb1d05a16c0 1 -- 10.20.193.92:0/3748613679 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1c8163aa0 con 0x7fb1c810f200 2026-02-13T04:00:29.636 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.630+0000 7fb1d05a16c0 1 -- 10.20.193.92:0/3748613679 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1c8163f20 con 0x7fb1c810f200 2026-02-13T04:00:29.636 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.630+0000 7fb1ad7fa6c0 1 -- 10.20.193.92:0/3748613679 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1c81104d0 con 0x7fb1c810f200 2026-02-13T04:00:29.637 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.632+0000 7fb1af7fe6c0 1 -- 10.20.193.92:0/3748613679 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7fb1b80026b0 con 0x7fb1c810f200 2026-02-13T04:00:29.637 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.634+0000 7fb1af7fe6c0 1 --2- 10.20.193.92:0/3748613679 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fb1a40b56d0 0x7fb1a40d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:29.638 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.634+0000 7fb1af7fe6c0 1 -- 10.20.193.92:0/3748613679 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7119+0+0 (secure 0 0 0) 0x7fb1b8107870 con 0x7fb1c810f200 2026-02-13T04:00:29.638 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.634+0000 7fb1af7fe6c0 1 -- 10.20.193.92:0/3748613679 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb1b8107d60 con 0x7fb1c810f200 2026-02-13T04:00:29.638 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.634+0000 7fb1cdb116c0 1 --2- 10.20.193.92:0/3748613679 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fb1a40b56d0 0x7fb1a40d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:29.638 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.635+0000 7fb1cdb116c0 1 --2- 10.20.193.92:0/3748613679 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fb1a40b56d0 0x7fb1a40d5b80 secure :-1 s=READY pgs=109 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1c81239a0 tx=0x7fb1bc009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:29.740 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.737+0000 7fb1ad7fa6c0 1 -- 10.20.193.92:0/3748613679 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fb1c810f5d0 con 0x7fb1c810f200 2026-02-13T04:00:29.740 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.737+0000 7fb1af7fe6c0 1 -- 10.20.193.92:0/3748613679 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v72) ==== 74+0+133 (secure 0 0 0) 0x7fb1b80ca6c0 con 0x7fb1c810f200 2026-02-13T04:00:29.740 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:00:29.742 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.738+0000 7fb1ad7fa6c0 1 -- 10.20.193.92:0/3748613679 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fb1a40b56d0 msgr2=0x7fb1a40d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:29.742 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.738+0000 7fb1ad7fa6c0 1 --2- 10.20.193.92:0/3748613679 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fb1a40b56d0 0x7fb1a40d5b80 secure :-1 s=READY pgs=109 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1c81239a0 tx=0x7fb1bc009260 comp rx=0 tx=0).stop 2026-02-13T04:00:29.742 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.738+0000 7fb1ad7fa6c0 1 -- 10.20.193.92:0/3748613679 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb1c810f200 msgr2=0x7fb1c811d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:29.742 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.738+0000 7fb1ad7fa6c0 1 --2- 10.20.193.92:0/3748613679 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb1c810f200 0x7fb1c811d010 secure :-1 s=READY pgs=152 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1b802f210 tx=0x7fb1b802f810 comp rx=0 tx=0).stop 2026-02-13T04:00:29.742 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.738+0000 7fb1ad7fa6c0 1 -- 10.20.193.92:0/3748613679 shutdown_connections 2026-02-13T04:00:29.742 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.738+0000 7fb1ad7fa6c0 1 --2- 10.20.193.92:0/3748613679 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fb1a40b56d0 0x7fb1a40d5b80 unknown :-1 s=CLOSED pgs=109 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:29.742 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.738+0000 7fb1ad7fa6c0 1 --2- 10.20.193.92:0/3748613679 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fb1c8115410 0x7fb1c811d550 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:29.742 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.738+0000 7fb1ad7fa6c0 1 --2- 10.20.193.92:0/3748613679 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fb1c8122910 0x7fb1c8122db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:29.742 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.738+0000 7fb1ad7fa6c0 1 --2- 10.20.193.92:0/3748613679 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb1c810f200 0x7fb1c811d010 unknown :-1 s=CLOSED pgs=152 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:29.743 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.738+0000 7fb1ad7fa6c0 1 -- 10.20.193.92:0/3748613679 >> 10.20.193.92:0/3748613679 conn(0x7fb1c80ecb00 msgr2=0x7fb1c810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:29.743 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.739+0000 7fb1ad7fa6c0 1 -- 10.20.193.92:0/3748613679 shutdown_connections 2026-02-13T04:00:29.743 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:29.739+0000 7fb1ad7fa6c0 1 -- 10.20.193.92:0/3748613679 wait complete. 2026-02-13T04:00:29.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:29 trial158 ceph-mon[27763]: purged_snaps scrub starts 2026-02-13T04:00:29.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:29 trial158 ceph-mon[27763]: purged_snaps scrub ok 2026-02-13T04:00:29.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:29 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T04:00:29.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:29 trial158 ceph-mon[27763]: osd.11 [v2:10.20.193.158:6824/2019612524,v1:10.20.193.158:6825/2019612524] boot 2026-02-13T04:00:29.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:29 trial158 ceph-mon[27763]: osdmap e71: 12 total, 12 up, 12 in 2026-02-13T04:00:29.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:29 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T04:00:29.843 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:29 trial092 ceph-mon[23047]: purged_snaps scrub starts 2026-02-13T04:00:29.843 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:29 trial092 ceph-mon[23047]: purged_snaps scrub ok 2026-02-13T04:00:29.843 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:29 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T04:00:29.843 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:29 trial092 ceph-mon[23047]: osd.11 [v2:10.20.193.158:6824/2019612524,v1:10.20.193.158:6825/2019612524] boot 2026-02-13T04:00:29.843 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:29 trial092 ceph-mon[23047]: osdmap e71: 12 total, 12 up, 12 in 2026-02-13T04:00:29.843 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:29 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T04:00:29.845 INFO:teuthology.orchestra.run.trial092.stdout:{"epoch":72,"num_osds":12,"num_up_osds":12,"osd_up_since":1770955228,"num_in_osds":12,"osd_in_since":1770955220,"num_remapped_pgs":0} 2026-02-13T04:00:29.846 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T04:00:29.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:29 trial099 ceph-mon[27808]: purged_snaps scrub starts 2026-02-13T04:00:29.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:29 trial099 ceph-mon[27808]: purged_snaps scrub ok 2026-02-13T04:00:29.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:29 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T04:00:29.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:29 trial099 ceph-mon[27808]: osd.11 [v2:10.20.193.158:6824/2019612524,v1:10.20.193.158:6825/2019612524] boot 2026-02-13T04:00:29.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:29 trial099 ceph-mon[27808]: osdmap e71: 12 total, 12 up, 12 in 2026-02-13T04:00:29.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:29 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2026-02-13T04:00:30.029 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:00:30.231 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.226+0000 7f630dce76c0 1 -- 10.20.193.92:0/2216724068 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f63081149c0 msgr2=0x7f6308114ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:30.231 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.226+0000 7f630dce76c0 1 --2- 10.20.193.92:0/2216724068 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f63081149c0 0x7f6308114ee0 secure :-1 s=READY pgs=70 gs=2 cs=0 l=1 c_cookie=3091755212658219047 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f62fc00aa40 tx=0x7f62fc02fdf0 comp rx=0 tx=0).stop 2026-02-13T04:00:30.231 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.226+0000 7f630dce76c0 1 -- 10.20.193.92:0/2216724068 shutdown_connections 2026-02-13T04:00:30.231 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.226+0000 7f630dce76c0 1 --2- 10.20.193.92:0/2216724068 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f63081149c0 0x7f6308114ee0 unknown :-1 s=CLOSED pgs=70 gs=2 cs=0 l=1 c_cookie=3091755212658219047 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:30.232 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.226+0000 7f630dce76c0 1 --2- 10.20.193.92:0/2216724068 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f6308113dc0 0x7f6308114210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:30.232 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.226+0000 7f630dce76c0 1 --2- 10.20.193.92:0/2216724068 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f630811b510 0x7f630811b8e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:30.232 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.226+0000 7f630dce76c0 1 -- 10.20.193.92:0/2216724068 >> 10.20.193.92:0/2216724068 conn(0x7f6308058a50 msgr2=0x7f6308058e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:30.232 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.226+0000 7f630dce76c0 1 -- 10.20.193.92:0/2216724068 shutdown_connections 2026-02-13T04:00:30.232 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.226+0000 7f630dce76c0 1 -- 10.20.193.92:0/2216724068 wait complete. 2026-02-13T04:00:30.232 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.227+0000 7f630dce76c0 1 Processor -- start 2026-02-13T04:00:30.232 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.227+0000 7f630dce76c0 1 -- start start 2026-02-13T04:00:30.232 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.227+0000 7f630dce76c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6308113dc0 0x7f630812b6e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:30.232 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.227+0000 7f630dce76c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f63081149c0 0x7f630812bc20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:30.232 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.227+0000 7f630dce76c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f630811b510 0x7f6308130fe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:30.232 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.227+0000 7f630dce76c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6308131630 con 0x7f6308113dc0 2026-02-13T04:00:30.233 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.227+0000 7f630dce76c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f63081317a0 con 0x7f630811b510 2026-02-13T04:00:30.233 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.227+0000 7f630dce76c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f6308131960 con 0x7f63081149c0 2026-02-13T04:00:30.233 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.228+0000 7f63077fe6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6308113dc0 0x7f630812b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:30.233 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.228+0000 7f63077fe6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6308113dc0 0x7f630812b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:55230/0 (socket says 10.20.193.92:55230) 2026-02-13T04:00:30.233 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.228+0000 7f63077fe6c0 1 -- 10.20.193.92:0/2902987248 learned_addr learned my addr 10.20.193.92:0/2902987248 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:00:30.233 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.228+0000 7f6306ffd6c0 1 --2- 10.20.193.92:0/2902987248 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f63081149c0 0x7f630812bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:30.233 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.228+0000 7f6307fff6c0 1 --2- 10.20.193.92:0/2902987248 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f630811b510 0x7f6308130fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:30.233 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.228+0000 7f63077fe6c0 1 -- 10.20.193.92:0/2902987248 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f63081149c0 msgr2=0x7f630812bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:30.233 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.228+0000 7f63077fe6c0 1 --2- 10.20.193.92:0/2902987248 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f63081149c0 0x7f630812bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:30.233 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.228+0000 7f63077fe6c0 1 -- 10.20.193.92:0/2902987248 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f630811b510 msgr2=0x7f6308130fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:30.233 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.228+0000 7f63077fe6c0 1 --2- 10.20.193.92:0/2902987248 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f630811b510 0x7f6308130fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:30.233 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.228+0000 7f63077fe6c0 1 -- 10.20.193.92:0/2902987248 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62fc00a660 con 0x7f6308113dc0 2026-02-13T04:00:30.234 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.228+0000 7f63077fe6c0 1 --2- 10.20.193.92:0/2902987248 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6308113dc0 0x7f630812b6e0 secure :-1 s=READY pgs=153 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f62f4009490 tx=0x7f62f400bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:30.234 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.228+0000 7f6304ff96c0 1 -- 10.20.193.92:0/2902987248 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f62f4004a80 con 0x7f6308113dc0 2026-02-13T04:00:30.235 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.228+0000 7f6304ff96c0 1 -- 10.20.193.92:0/2902987248 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f62f4009030 con 0x7f6308113dc0 2026-02-13T04:00:30.235 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.228+0000 7f6304ff96c0 1 -- 10.20.193.92:0/2902987248 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f62f4007440 con 0x7f6308113dc0 2026-02-13T04:00:30.235 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.228+0000 7f630dce76c0 1 -- 10.20.193.92:0/2902987248 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6308131c40 con 0x7f6308113dc0 2026-02-13T04:00:30.235 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.228+0000 7f630dce76c0 1 -- 10.20.193.92:0/2902987248 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6308172320 con 0x7f6308113dc0 2026-02-13T04:00:30.235 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.229+0000 7f62e27fc6c0 1 -- 10.20.193.92:0/2902987248 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6308131e60 con 0x7f6308113dc0 2026-02-13T04:00:30.235 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.231+0000 7f6304ff96c0 1 -- 10.20.193.92:0/2902987248 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f62f40075d0 con 0x7f6308113dc0 2026-02-13T04:00:30.236 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.233+0000 7f6304ff96c0 1 --2- 10.20.193.92:0/2902987248 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f62dc0b5650 0x7f62dc0d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:30.237 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.233+0000 7f6304ff96c0 1 -- 10.20.193.92:0/2902987248 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7119+0+0 (secure 0 0 0) 0x7f62f40e36e0 con 0x7f6308113dc0 2026-02-13T04:00:30.237 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.233+0000 7f6304ff96c0 1 -- 10.20.193.92:0/2902987248 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f62f40e3b60 con 0x7f6308113dc0 2026-02-13T04:00:30.237 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.233+0000 7f6306ffd6c0 1 --2- 10.20.193.92:0/2902987248 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f62dc0b5650 0x7f62dc0d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:30.237 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.234+0000 7f6306ffd6c0 1 --2- 10.20.193.92:0/2902987248 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f62dc0b5650 0x7f62dc0d5b00 secure :-1 s=READY pgs=110 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6308132070 tx=0x7f62f8009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:30.339 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.336+0000 7f62e27fc6c0 1 -- 10.20.193.92:0/2902987248 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6308114ee0 con 0x7f6308113dc0 2026-02-13T04:00:30.340 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.337+0000 7f6304ff96c0 1 -- 10.20.193.92:0/2902987248 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+18469 (secure 0 0 0) 0x7f62f40a64f0 con 0x7f6308113dc0 2026-02-13T04:00:30.340 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:00:30.341 INFO:teuthology.orchestra.run.trial092.stdout:{"epoch":72,"fsid":"1fefccae-0890-11f1-bcc5-d404e6e7d460","created":"2026-02-13T03:57:51.342799+0000","modified":"2026-02-13T04:00:29.576266+0000","last_up_change":"2026-02-13T04:00:28.570362+0000","last_in_change":"2026-02-13T04:00:20.284718+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T03:59:12.044389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8527c214-a46e-4505-b9a0-dc55e7cf6b55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6802","nonce":2375200644},{"type":"v1","addr":"10.20.193.92:6803","nonce":2375200644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6804","nonce":2375200644},{"type":"v1","addr":"10.20.193.92:6805","nonce":2375200644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6808","nonce":2375200644},{"type":"v1","addr":"10.20.193.92:6809","nonce":2375200644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6806","nonce":2375200644},{"type":"v1","addr":"10.20.193.92:6807","nonce":2375200644}]},"public_addr":"10.20.193.92:6803/2375200644","cluster_addr":"10.20.193.92:6805/2375200644","heartbeat_back_addr":"10.20.193.92:6809/2375200644","heartbeat_front_addr":"10.20.193.92:6807/2375200644","state":["exists","up"]},{"osd":1,"uuid":"253e5e0e-8571-4add-81e5-ca92934b8171","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6800","nonce":3943455734},{"type":"v1","addr":"10.20.193.99:6801","nonce":3943455734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6802","nonce":3943455734},{"type":"v1","addr":"10.20.193.99:6803","nonce":3943455734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6806","nonce":3943455734},{"type":"v1","addr":"10.20.193.99:6807","nonce":3943455734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6804","nonce":3943455734},{"type":"v1","addr":"10.20.193.99:6805","nonce":3943455734}]},"public_addr":"10.20.193.99:6801/3943455734","cluster_addr":"10.20.193.99:6803/3943455734","heartbeat_back_addr":"10.20.193.99:6807/3943455734","heartbeat_front_addr":"10.20.193.99:6805/3943455734","state":["exists","up"]},{"osd":2,"uuid":"e94c2f5c-ce8a-484e-9cf3-e436edc16bdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6800","nonce":676925869},{"type":"v1","addr":"10.20.193.158:6801","nonce":676925869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6802","nonce":676925869},{"type":"v1","addr":"10.20.193.158:6803","nonce":676925869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6806","nonce":676925869},{"type":"v1","addr":"10.20.193.158:6807","nonce":676925869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6804","nonce":676925869},{"type":"v1","addr":"10.20.193.158:6805","nonce":676925869}]},"public_addr":"10.20.193.158:6801/676925869","cluster_addr":"10.20.193.158:6803/676925869","heartbeat_back_addr":"10.20.193.158:6807/676925869","heartbeat_front_addr":"10.20.193.158:6805/676925869","state":["exists","up"]},{"osd":3,"uuid":"91080154-0bd8-4e06-832e-1590d7784229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6810","nonce":4168983230},{"type":"v1","addr":"10.20.193.92:6811","nonce":4168983230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6812","nonce":4168983230},{"type":"v1","addr":"10.20.193.92:6813","nonce":4168983230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6816","nonce":4168983230},{"type":"v1","addr":"10.20.193.92:6817","nonce":4168983230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6814","nonce":4168983230},{"type":"v1","addr":"10.20.193.92:6815","nonce":4168983230}]},"public_addr":"10.20.193.92:6811/4168983230","cluster_addr":"10.20.193.92:6813/4168983230","heartbeat_back_addr":"10.20.193.92:6817/4168983230","heartbeat_front_addr":"10.20.193.92:6815/4168983230","state":["exists","up"]},{"osd":4,"uuid":"fec31143-d966-4f9b-8021-73e24c1b4d32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6808","nonce":1135109881},{"type":"v1","addr":"10.20.193.99:6809","nonce":1135109881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6810","nonce":1135109881},{"type":"v1","addr":"10.20.193.99:6811","nonce":1135109881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6814","nonce":1135109881},{"type":"v1","addr":"10.20.193.99:6815","nonce":1135109881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6812","nonce":1135109881},{"type":"v1","addr":"10.20.193.99:6813","nonce":1135109881}]},"public_addr":"10.20.193.99:6809/1135109881","cluster_addr":"10.20.193.99:6811/1135109881","heartbeat_back_addr":"10.20.193.99:6815/1135109881","heartbeat_front_addr":"10.20.193.99:6813/1135109881","state":["exists","up"]},{"osd":5,"uuid":"fcb06e7c-2900-49d9-9b39-6521200cd89a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6808","nonce":428074602},{"type":"v1","addr":"10.20.193.158:6809","nonce":428074602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6810","nonce":428074602},{"type":"v1","addr":"10.20.193.158:6811","nonce":428074602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6814","nonce":428074602},{"type":"v1","addr":"10.20.193.158:6815","nonce":428074602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6812","nonce":428074602},{"type":"v1","addr":"10.20.193.158:6813","nonce":428074602}]},"public_addr":"10.20.193.158:6809/428074602","cluster_addr":"10.20.193.158:6811/428074602","heartbeat_back_addr":"10.20.193.158:6815/428074602","heartbeat_front_addr":"10.20.193.158:6813/428074602","state":["exists","up"]},{"osd":6,"uuid":"17251a9f-8203-4bdf-87c5-1bd31254f2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6818","nonce":1823230093},{"type":"v1","addr":"10.20.193.92:6819","nonce":1823230093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6820","nonce":1823230093},{"type":"v1","addr":"10.20.193.92:6821","nonce":1823230093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6824","nonce":1823230093},{"type":"v1","addr":"10.20.193.92:6825","nonce":1823230093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6822","nonce":1823230093},{"type":"v1","addr":"10.20.193.92:6823","nonce":1823230093}]},"public_addr":"10.20.193.92:6819/1823230093","cluster_addr":"10.20.193.92:6821/1823230093","heartbeat_back_addr":"10.20.193.92:6825/1823230093","heartbeat_front_addr":"10.20.193.92:6823/1823230093","state":["exists","up"]},{"osd":7,"uuid":"6775e50d-691e-472f-a99e-d6cd4786d4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6816","nonce":3951959773},{"type":"v1","addr":"10.20.193.99:6817","nonce":3951959773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6818","nonce":3951959773},{"type":"v1","addr":"10.20.193.99:6819","nonce":3951959773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6822","nonce":3951959773},{"type":"v1","addr":"10.20.193.99:6823","nonce":3951959773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6820","nonce":3951959773},{"type":"v1","addr":"10.20.193.99:6821","nonce":3951959773}]},"public_addr":"10.20.193.99:6817/3951959773","cluster_addr":"10.20.193.99:6819/3951959773","heartbeat_back_addr":"10.20.193.99:6823/3951959773","heartbeat_front_addr":"10.20.193.99:6821/3951959773","state":["exists","up"]},{"osd":8,"uuid":"a6be4612-8a0a-4590-95a9-82b973ad4c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6816","nonce":1505536261},{"type":"v1","addr":"10.20.193.158:6817","nonce":1505536261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6818","nonce":1505536261},{"type":"v1","addr":"10.20.193.158:6819","nonce":1505536261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6822","nonce":1505536261},{"type":"v1","addr":"10.20.193.158:6823","nonce":1505536261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6820","nonce":1505536261},{"type":"v1","addr":"10.20.193.158:6821","nonce":1505536261}]},"public_addr":"10.20.193.158:6817/1505536261","cluster_addr":"10.20.193.158:6819/1505536261","heartbeat_back_addr":"10.20.193.158:6823/1505536261","heartbeat_front_addr":"10.20.193.158:6821/1505536261","state":["exists","up"]},{"osd":9,"uuid":"b51a7c23-3bba-4404-8b3a-462a2870b83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6826","nonce":3596797929},{"type":"v1","addr":"10.20.193.92:6827","nonce":3596797929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6828","nonce":3596797929},{"type":"v1","addr":"10.20.193.92:6829","nonce":3596797929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6832","nonce":3596797929},{"type":"v1","addr":"10.20.193.92:6833","nonce":3596797929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6830","nonce":3596797929},{"type":"v1","addr":"10.20.193.92:6831","nonce":3596797929}]},"public_addr":"10.20.193.92:6827/3596797929","cluster_addr":"10.20.193.92:6829/3596797929","heartbeat_back_addr":"10.20.193.92:6833/3596797929","heartbeat_front_addr":"10.20.193.92:6831/3596797929","state":["exists","up"]},{"osd":10,"uuid":"dda9bd0a-0359-4889-ad2d-8da7602164cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6824","nonce":4260536068},{"type":"v1","addr":"10.20.193.99:6825","nonce":4260536068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6826","nonce":4260536068},{"type":"v1","addr":"10.20.193.99:6827","nonce":4260536068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6830","nonce":4260536068},{"type":"v1","addr":"10.20.193.99:6831","nonce":4260536068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6828","nonce":4260536068},{"type":"v1","addr":"10.20.193.99:6829","nonce":4260536068}]},"public_addr":"10.20.193.99:6825/4260536068","cluster_addr":"10.20.193.99:6827/4260536068","heartbeat_back_addr":"10.20.193.99:6831/4260536068","heartbeat_front_addr":"10.20.193.99:6829/4260536068","state":["exists","up"]},{"osd":11,"uuid":"8e78b081-0fe6-49a4-879b-094cfb14783c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6824","nonce":2019612524},{"type":"v1","addr":"10.20.193.158:6825","nonce":2019612524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6826","nonce":2019612524},{"type":"v1","addr":"10.20.193.158:6827","nonce":2019612524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6830","nonce":2019612524},{"type":"v1","addr":"10.20.193.158:6831","nonce":2019612524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6828","nonce":2019612524},{"type":"v1","addr":"10.20.193.158:6829","nonce":2019612524}]},"public_addr":"10.20.193.158:6825/2019612524","cluster_addr":"10.20.193.158:6827/2019612524","heartbeat_back_addr":"10.20.193.158:6831/2019612524","heartbeat_front_addr":"10.20.193.158:6829/2019612524","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:58:53.806082+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:59:01.539380+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:59:08.639667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:59:19.253252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:59:27.067122+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:59:34.359212+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:59:45.274527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:59:52.962680+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T04:00:00.299816+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T04:00:11.400008+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T04:00:19.328513+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T04:00:26.837283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.92:0/1237375916":"2026-02-14T03:58:33.822496+0000","10.20.193.92:6800/1986528669":"2026-02-14T03:58:33.822496+0000","10.20.193.92:0/1967601204":"2026-02-14T03:58:33.822496+0000","10.20.193.92:0/2687491302":"2026-02-14T03:57:59.617461+0000","10.20.193.92:6801/1986528669":"2026-02-14T03:58:33.822496+0000","10.20.193.92:0/3477507155":"2026-02-14T03:58:33.822496+0000","10.20.193.92:0/3506092440":"2026-02-14T03:57:59.617461+0000","10.20.193.92:6801/3709134212":"2026-02-14T03:57:59.617461+0000","10.20.193.92:6800/3709134212":"2026-02-14T03:57:59.617461+0000","10.20.193.92:0/1198638193":"2026-02-14T03:57:59.617461+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T04:00:30.342 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.338+0000 7f62e27fc6c0 1 -- 10.20.193.92:0/2902987248 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f62dc0b5650 msgr2=0x7f62dc0d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:30.342 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.338+0000 7f62e27fc6c0 1 --2- 10.20.193.92:0/2902987248 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f62dc0b5650 0x7f62dc0d5b00 secure :-1 s=READY pgs=110 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6308132070 tx=0x7f62f8009260 comp rx=0 tx=0).stop 2026-02-13T04:00:30.342 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.338+0000 7f62e27fc6c0 1 -- 10.20.193.92:0/2902987248 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6308113dc0 msgr2=0x7f630812b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:30.342 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.338+0000 7f62e27fc6c0 1 --2- 10.20.193.92:0/2902987248 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6308113dc0 0x7f630812b6e0 secure :-1 s=READY pgs=153 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f62f4009490 tx=0x7f62f400bca0 comp rx=0 tx=0).stop 2026-02-13T04:00:30.342 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.338+0000 7f62e27fc6c0 1 -- 10.20.193.92:0/2902987248 shutdown_connections 2026-02-13T04:00:30.342 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.338+0000 7f62e27fc6c0 1 --2- 10.20.193.92:0/2902987248 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f62dc0b5650 0x7f62dc0d5b00 unknown :-1 s=CLOSED pgs=110 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:30.342 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.338+0000 7f62e27fc6c0 1 --2- 10.20.193.92:0/2902987248 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f630811b510 0x7f6308130fe0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:30.342 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.338+0000 7f62e27fc6c0 1 --2- 10.20.193.92:0/2902987248 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f63081149c0 0x7f630812bc20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:30.342 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.338+0000 7f62e27fc6c0 1 --2- 10.20.193.92:0/2902987248 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6308113dc0 0x7f630812b6e0 unknown :-1 s=CLOSED pgs=153 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:30.343 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.338+0000 7f62e27fc6c0 1 -- 10.20.193.92:0/2902987248 >> 10.20.193.92:0/2902987248 conn(0x7f6308058a50 msgr2=0x7f630811a460 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:30.343 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.338+0000 7f62e27fc6c0 1 -- 10.20.193.92:0/2902987248 shutdown_connections 2026-02-13T04:00:30.343 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.338+0000 7f62e27fc6c0 1 -- 10.20.193.92:0/2902987248 wait complete. 2026-02-13T04:00:30.443 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-13T03:59:12.044389+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-13T04:00:30.444 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph osd pool get .mgr pg_num 2026-02-13T04:00:30.626 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:00:30.668 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:30 trial092 ceph-mon[23047]: osdmap e72: 12 total, 12 up, 12 in 2026-02-13T04:00:30.668 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:30 trial092 ceph-mon[23047]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T04:00:30.668 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:30 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/3748613679' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T04:00:30.668 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:30 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/2902987248' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T04:00:30.815 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.812+0000 7f6cbcd466c0 1 -- 10.20.193.92:0/4001229577 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6cb8115270 msgr2=0x7f6cb8175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:30.816 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.812+0000 7f6cbcd466c0 1 --2- 10.20.193.92:0/4001229577 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6cb8115270 0x7f6cb8175c10 secure :-1 s=READY pgs=154 gs=2 cs=0 l=1 c_cookie=12955380951534335097 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6cac00aa70 tx=0x7f6cac02fde0 comp rx=0 tx=0).stop 2026-02-13T04:00:30.816 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.812+0000 7f6cbcd466c0 1 -- 10.20.193.92:0/4001229577 shutdown_connections 2026-02-13T04:00:30.816 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.812+0000 7f6cbcd466c0 1 --2- 10.20.193.92:0/4001229577 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6cb8115270 0x7f6cb8175c10 unknown :-1 s=CLOSED pgs=154 gs=2 cs=0 l=1 c_cookie=12955380951534335097 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:30.816 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.812+0000 7f6cbcd466c0 1 --2- 10.20.193.92:0/4001229577 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f6cb810fa50 0x7f6cb8114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:30.816 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.812+0000 7f6cbcd466c0 1 --2- 10.20.193.92:0/4001229577 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f6cb810f060 0x7f6cb810f430 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:30.816 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.812+0000 7f6cbcd466c0 1 -- 10.20.193.92:0/4001229577 >> 10.20.193.92:0/4001229577 conn(0x7f6cb80ec980 msgr2=0x7f6cb810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:30.816 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.812+0000 7f6cbcd466c0 1 -- 10.20.193.92:0/4001229577 shutdown_connections 2026-02-13T04:00:30.816 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.812+0000 7f6cbcd466c0 1 -- 10.20.193.92:0/4001229577 wait complete. 2026-02-13T04:00:30.816 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.812+0000 7f6cbcd466c0 1 Processor -- start 2026-02-13T04:00:30.816 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.812+0000 7f6cbcd466c0 1 -- start start 2026-02-13T04:00:30.818 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.813+0000 7f6cbcd466c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f6cb810f060 0x7f6cb811cd90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:30.818 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.813+0000 7f6cbcd466c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6cb8115270 0x7f6cb811d2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:30.818 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.813+0000 7f6cbcd466c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f6cb8122690 0x7f6cb8122b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:30.818 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.813+0000 7f6cbcd466c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb81230a0 con 0x7f6cb8115270 2026-02-13T04:00:30.818 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.813+0000 7f6cbcd466c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb8123210 con 0x7f6cb8122690 2026-02-13T04:00:30.818 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.813+0000 7f6cbcd466c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb81233d0 con 0x7f6cb810f060 2026-02-13T04:00:30.818 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.813+0000 7f6cb6ffd6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6cb8115270 0x7f6cb811d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:30.819 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.813+0000 7f6cb7fff6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f6cb8122690 0x7f6cb8122b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:30.819 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.813+0000 7f6cb6ffd6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6cb8115270 0x7f6cb811d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:55252/0 (socket says 10.20.193.92:55252) 2026-02-13T04:00:30.819 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.813+0000 7f6cb6ffd6c0 1 -- 10.20.193.92:0/2468163708 learned_addr learned my addr 10.20.193.92:0/2468163708 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:00:30.819 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.813+0000 7f6cb77fe6c0 1 --2- 10.20.193.92:0/2468163708 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f6cb810f060 0x7f6cb811cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:30.819 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.813+0000 7f6cb6ffd6c0 1 -- 10.20.193.92:0/2468163708 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f6cb810f060 msgr2=0x7f6cb811cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:30.819 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.813+0000 7f6cb6ffd6c0 1 --2- 10.20.193.92:0/2468163708 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f6cb810f060 0x7f6cb811cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:30.819 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.813+0000 7f6cb6ffd6c0 1 -- 10.20.193.92:0/2468163708 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f6cb8122690 msgr2=0x7f6cb8122b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:30.819 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.813+0000 7f6cb6ffd6c0 1 --2- 10.20.193.92:0/2468163708 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f6cb8122690 0x7f6cb8122b30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:30.819 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.813+0000 7f6cb6ffd6c0 1 -- 10.20.193.92:0/2468163708 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cac00a660 con 0x7f6cb8115270 2026-02-13T04:00:30.819 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.813+0000 7f6cb6ffd6c0 1 --2- 10.20.193.92:0/2468163708 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6cb8115270 0x7f6cb811d2d0 secure :-1 s=READY pgs=155 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ca800b6c0 tx=0x7f6ca800bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:30.819 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.813+0000 7f6cb4ff96c0 1 -- 10.20.193.92:0/2468163708 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6ca8004250 con 0x7f6cb8115270 2026-02-13T04:00:30.819 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.813+0000 7f6cbcd466c0 1 -- 10.20.193.92:0/2468163708 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cb8163880 con 0x7f6cb8115270 2026-02-13T04:00:30.820 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.814+0000 7f6cbcd466c0 1 -- 10.20.193.92:0/2468163708 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cb8163d10 con 0x7f6cb8115270 2026-02-13T04:00:30.820 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.814+0000 7f6cb4ff96c0 1 -- 10.20.193.92:0/2468163708 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f6ca8009070 con 0x7f6cb8115270 2026-02-13T04:00:30.820 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.814+0000 7f6cb4ff96c0 1 -- 10.20.193.92:0/2468163708 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6ca800ce80 con 0x7f6cb8115270 2026-02-13T04:00:30.820 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.814+0000 7f6cbcd466c0 1 -- 10.20.193.92:0/2468163708 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cb8110330 con 0x7f6cb8115270 2026-02-13T04:00:30.820 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.816+0000 7f6cb4ff96c0 1 -- 10.20.193.92:0/2468163708 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f6ca80043b0 con 0x7f6cb8115270 2026-02-13T04:00:30.821 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.818+0000 7f6cb4ff96c0 1 --2- 10.20.193.92:0/2468163708 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f6c8c0b5710 0x7f6c8c0d5bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:30.821 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.818+0000 7f6cb4ff96c0 1 -- 10.20.193.92:0/2468163708 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7119+0+0 (secure 0 0 0) 0x7f6ca80e3550 con 0x7f6cb8115270 2026-02-13T04:00:30.821 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.818+0000 7f6cb4ff96c0 1 -- 10.20.193.92:0/2468163708 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6ca80e39d0 con 0x7f6cb8115270 2026-02-13T04:00:30.821 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.818+0000 7f6cb77fe6c0 1 --2- 10.20.193.92:0/2468163708 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f6c8c0b5710 0x7f6c8c0d5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:30.822 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.819+0000 7f6cb77fe6c0 1 --2- 10.20.193.92:0/2468163708 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f6c8c0b5710 0x7f6c8c0d5bc0 secure :-1 s=READY pgs=111 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ca4005fd0 tx=0x7f6ca40093f0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:30.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:30 trial099 ceph-mon[27808]: osdmap e72: 12 total, 12 up, 12 in 2026-02-13T04:00:30.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:30 trial099 ceph-mon[27808]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T04:00:30.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:30 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/3748613679' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T04:00:30.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:30 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/2902987248' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T04:00:30.923 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.920+0000 7f6cbcd466c0 1 -- 10.20.193.92:0/2468163708 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6cb811dee0 con 0x7f6cb8115270 2026-02-13T04:00:30.923 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.920+0000 7f6cb4ff96c0 1 -- 10.20.193.92:0/2468163708 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) ==== 93+0+10 (secure 0 0 0) 0x7f6ca80a6360 con 0x7f6cb8115270 2026-02-13T04:00:30.923 INFO:teuthology.orchestra.run.trial092.stdout:pg_num: 1 2026-02-13T04:00:30.924 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.921+0000 7f6cbcd466c0 1 -- 10.20.193.92:0/2468163708 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f6c8c0b5710 msgr2=0x7f6c8c0d5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:30.924 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.921+0000 7f6cbcd466c0 1 --2- 10.20.193.92:0/2468163708 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f6c8c0b5710 0x7f6c8c0d5bc0 secure :-1 s=READY pgs=111 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ca4005fd0 tx=0x7f6ca40093f0 comp rx=0 tx=0).stop 2026-02-13T04:00:30.924 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.921+0000 7f6cbcd466c0 1 -- 10.20.193.92:0/2468163708 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6cb8115270 msgr2=0x7f6cb811d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:30.924 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.921+0000 7f6cbcd466c0 1 --2- 10.20.193.92:0/2468163708 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6cb8115270 0x7f6cb811d2d0 secure :-1 s=READY pgs=155 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ca800b6c0 tx=0x7f6ca800bb90 comp rx=0 tx=0).stop 2026-02-13T04:00:30.925 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.921+0000 7f6cbcd466c0 1 -- 10.20.193.92:0/2468163708 shutdown_connections 2026-02-13T04:00:30.925 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.921+0000 7f6cbcd466c0 1 --2- 10.20.193.92:0/2468163708 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f6c8c0b5710 0x7f6c8c0d5bc0 unknown :-1 s=CLOSED pgs=111 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:30.925 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.921+0000 7f6cbcd466c0 1 --2- 10.20.193.92:0/2468163708 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f6cb8122690 0x7f6cb8122b30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:30.925 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.921+0000 7f6cbcd466c0 1 --2- 10.20.193.92:0/2468163708 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6cb8115270 0x7f6cb811d2d0 unknown :-1 s=CLOSED pgs=155 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:30.925 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.921+0000 7f6cbcd466c0 1 --2- 10.20.193.92:0/2468163708 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f6cb810f060 0x7f6cb811cd90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:30.925 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.921+0000 7f6cbcd466c0 1 -- 10.20.193.92:0/2468163708 >> 10.20.193.92:0/2468163708 conn(0x7f6cb80ec980 msgr2=0x7f6cb810cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:30.926 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.921+0000 7f6cbcd466c0 1 -- 10.20.193.92:0/2468163708 shutdown_connections 2026-02-13T04:00:30.926 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:30.922+0000 7f6cbcd466c0 1 -- 10.20.193.92:0/2468163708 wait complete. 2026-02-13T04:00:31.030 INFO:tasks.cephadm:Adding mds.a on trial092 2026-02-13T04:00:31.031 INFO:tasks.cephadm:Adding mds.d on trial092 2026-02-13T04:00:31.031 INFO:tasks.cephadm:Adding mds.g on trial092 2026-02-13T04:00:31.031 INFO:tasks.cephadm:Adding mds.j on trial092 2026-02-13T04:00:31.031 INFO:tasks.cephadm:Adding mds.b on trial099 2026-02-13T04:00:31.031 INFO:tasks.cephadm:Adding mds.e on trial099 2026-02-13T04:00:31.031 INFO:tasks.cephadm:Adding mds.h on trial099 2026-02-13T04:00:31.031 INFO:tasks.cephadm:Adding mds.k on trial099 2026-02-13T04:00:31.031 INFO:tasks.cephadm:Adding mds.c on trial158 2026-02-13T04:00:31.031 INFO:tasks.cephadm:Adding mds.f on trial158 2026-02-13T04:00:31.031 INFO:tasks.cephadm:Adding mds.i on trial158 2026-02-13T04:00:31.031 INFO:tasks.cephadm:Adding mds.l on trial158 2026-02-13T04:00:31.032 DEBUG:teuthology.orchestra.run.trial158:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph orch apply mds all '12;trial092=a;trial092=d;trial092=g;trial092=j;trial099=b;trial099=e;trial099=h;trial099=k;trial158=c;trial158=f;trial158=i;trial158=l' 2026-02-13T04:00:31.057 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:30 trial158 ceph-mon[27763]: osdmap e72: 12 total, 12 up, 12 in 2026-02-13T04:00:31.057 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:30 trial158 ceph-mon[27763]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T04:00:31.057 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:30 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/3748613679' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2026-02-13T04:00:31.058 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:30 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/2902987248' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T04:00:31.153 INFO:teuthology.orchestra.run.trial158.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.c/config 2026-02-13T04:00:31.271 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.266+0000 7f7b4848c6c0 1 -- 10.20.193.158:0/2175010993 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7b4010f200 msgr2=0x7f7b4010f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:31.272 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.266+0000 7f7b4848c6c0 1 --2- 10.20.193.158:0/2175010993 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7b4010f200 0x7f7b4010f5d0 secure :-1 s=READY pgs=68 gs=1 cs=0 l=1 c_cookie=7342808190020607095 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b2c0099a0 tx=0x7f7b2c02ed20 comp rx=0 tx=0).stop 2026-02-13T04:00:31.272 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.266+0000 7f7b4848c6c0 1 -- 10.20.193.158:0/2175010993 shutdown_connections 2026-02-13T04:00:31.272 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.266+0000 7f7b4848c6c0 1 --2- 10.20.193.158:0/2175010993 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7b4010fbf0 0x7f7b40114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:31.272 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.266+0000 7f7b4848c6c0 1 --2- 10.20.193.158:0/2175010993 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7b40115410 0x7f7b40175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:31.272 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.266+0000 7f7b4848c6c0 1 --2- 10.20.193.158:0/2175010993 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7b4010f200 0x7f7b4010f5d0 unknown :-1 s=CLOSED pgs=68 gs=1 cs=0 l=1 c_cookie=7342808190020607095 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:31.272 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.266+0000 7f7b4848c6c0 1 -- 10.20.193.158:0/2175010993 >> 10.20.193.158:0/2175010993 conn(0x7f7b400ecb00 msgr2=0x7f7b4010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:31.272 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.266+0000 7f7b4848c6c0 1 -- 10.20.193.158:0/2175010993 shutdown_connections 2026-02-13T04:00:31.272 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.266+0000 7f7b4848c6c0 1 -- 10.20.193.158:0/2175010993 wait complete. 2026-02-13T04:00:31.272 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.267+0000 7f7b4848c6c0 1 Processor -- start 2026-02-13T04:00:31.273 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.267+0000 7f7b4848c6c0 1 -- start start 2026-02-13T04:00:31.273 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.267+0000 7f7b4848c6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7b4010f200 0x7f7b4011d0a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:31.273 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.267+0000 7f7b4848c6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7b40115410 0x7f7b4011d5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:31.273 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.267+0000 7f7b4848c6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7b401229a0 0x7f7b40122e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:31.273 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.267+0000 7f7b4848c6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7b401233b0 con 0x7f7b40115410 2026-02-13T04:00:31.273 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.267+0000 7f7b4848c6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7b40123520 con 0x7f7b401229a0 2026-02-13T04:00:31.273 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.267+0000 7f7b4848c6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f7b401236e0 con 0x7f7b4010f200 2026-02-13T04:00:31.273 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.267+0000 7f7b461fd6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7b4010f200 0x7f7b4011d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:31.273 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.267+0000 7f7b461fd6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7b4010f200 0x7f7b4011d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.158:41624/0 (socket says 10.20.193.158:41624) 2026-02-13T04:00:31.273 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.267+0000 7f7b461fd6c0 1 -- 10.20.193.158:0/3933858504 learned_addr learned my addr 10.20.193.158:0/3933858504 (peer_addr_for_me v2:10.20.193.158:0/0) 2026-02-13T04:00:31.273 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.267+0000 7f7b459fc6c0 1 --2- 10.20.193.158:0/3933858504 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7b40115410 0x7f7b4011d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:31.274 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.267+0000 7f7b469fe6c0 1 --2- 10.20.193.158:0/3933858504 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7b401229a0 0x7f7b40122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:31.274 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.267+0000 7f7b461fd6c0 1 -- 10.20.193.158:0/3933858504 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7b401229a0 msgr2=0x7f7b40122e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:31.274 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.267+0000 7f7b461fd6c0 1 --2- 10.20.193.158:0/3933858504 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7b401229a0 0x7f7b40122e40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:31.274 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.267+0000 7f7b461fd6c0 1 -- 10.20.193.158:0/3933858504 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7b40115410 msgr2=0x7f7b4011d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:31.274 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.267+0000 7f7b461fd6c0 1 --2- 10.20.193.158:0/3933858504 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7b40115410 0x7f7b4011d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:31.274 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.267+0000 7f7b461fd6c0 1 -- 10.20.193.158:0/3933858504 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b2c009590 con 0x7f7b4010f200 2026-02-13T04:00:31.274 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.267+0000 7f7b469fe6c0 1 --2- 10.20.193.158:0/3933858504 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7b401229a0 0x7f7b40122e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T04:00:31.274 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.267+0000 7f7b461fd6c0 1 --2- 10.20.193.158:0/3933858504 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7b4010f200 0x7f7b4011d0a0 secure :-1 s=READY pgs=69 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b2c0098c0 tx=0x7f7b2c02f830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:31.274 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.267+0000 7f7b3f7fe6c0 1 -- 10.20.193.158:0/3933858504 <== mon.1 v2:10.20.193.158:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7b2c0026b0 con 0x7f7b4010f200 2026-02-13T04:00:31.274 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.267+0000 7f7b4848c6c0 1 -- 10.20.193.158:0/3933858504 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b40163b30 con 0x7f7b4010f200 2026-02-13T04:00:31.274 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.267+0000 7f7b3f7fe6c0 1 -- 10.20.193.158:0/3933858504 <== mon.1 v2:10.20.193.158:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f7b2c031560 con 0x7f7b4010f200 2026-02-13T04:00:31.274 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.268+0000 7f7b3f7fe6c0 1 -- 10.20.193.158:0/3933858504 <== mon.1 v2:10.20.193.158:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7b2c007d70 con 0x7f7b4010f200 2026-02-13T04:00:31.275 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.268+0000 7f7b4848c6c0 1 -- 10.20.193.158:0/3933858504 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b40163fb0 con 0x7f7b4010f200 2026-02-13T04:00:31.275 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.268+0000 7f7b4848c6c0 1 -- 10.20.193.158:0/3933858504 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b401104d0 con 0x7f7b4010f200 2026-02-13T04:00:31.275 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.269+0000 7f7b3f7fe6c0 1 -- 10.20.193.158:0/3933858504 <== mon.1 v2:10.20.193.158:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f7b2c0316d0 con 0x7f7b4010f200 2026-02-13T04:00:31.276 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.270+0000 7f7b3f7fe6c0 1 --2- 10.20.193.158:0/3933858504 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f7b080b5650 0x7f7b080d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:31.276 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.270+0000 7f7b459fc6c0 1 --2- 10.20.193.158:0/3933858504 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f7b080b5650 0x7f7b080d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:31.276 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.270+0000 7f7b3f7fe6c0 1 -- 10.20.193.158:0/3933858504 <== mon.1 v2:10.20.193.158:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7119+0+0 (secure 0 0 0) 0x7f7b2c107aa0 con 0x7f7b4010f200 2026-02-13T04:00:31.276 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.270+0000 7f7b3f7fe6c0 1 -- 10.20.193.158:0/3933858504 <== mon.1 v2:10.20.193.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7b2c0ce350 con 0x7f7b4010f200 2026-02-13T04:00:31.276 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.271+0000 7f7b459fc6c0 1 --2- 10.20.193.158:0/3933858504 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f7b080b5650 0x7f7b080d5b00 secure :-1 s=READY pgs=112 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b28005980 tx=0x7f7b28005910 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:31.371 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.369+0000 7f7b4848c6c0 1 -- 10.20.193.158:0/3933858504 --> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial092=a;trial092=d;trial092=g;trial092=j;trial099=b;trial099=e;trial099=h;trial099=k;trial158=c;trial158=f;trial158=i;trial158=l", "target": ["mon-mgr", ""]}) -- 0x7f7b4011e1f0 con 0x7f7b080b5650 2026-02-13T04:00:31.378 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.376+0000 7f7b3f7fe6c0 1 -- 10.20.193.158:0/3933858504 <== mgr.14187 v2:10.20.193.92:6800/4191527999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f7b4011e1f0 con 0x7f7b080b5650 2026-02-13T04:00:31.378 INFO:teuthology.orchestra.run.trial158.stdout:Scheduled mds.all update... 2026-02-13T04:00:31.379 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.377+0000 7f7b4848c6c0 1 -- 10.20.193.158:0/3933858504 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f7b080b5650 msgr2=0x7f7b080d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:31.380 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.377+0000 7f7b4848c6c0 1 --2- 10.20.193.158:0/3933858504 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f7b080b5650 0x7f7b080d5b00 secure :-1 s=READY pgs=112 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b28005980 tx=0x7f7b28005910 comp rx=0 tx=0).stop 2026-02-13T04:00:31.380 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.377+0000 7f7b4848c6c0 1 -- 10.20.193.158:0/3933858504 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7b4010f200 msgr2=0x7f7b4011d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:31.380 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.377+0000 7f7b4848c6c0 1 --2- 10.20.193.158:0/3933858504 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7b4010f200 0x7f7b4011d0a0 secure :-1 s=READY pgs=69 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7b2c0098c0 tx=0x7f7b2c02f830 comp rx=0 tx=0).stop 2026-02-13T04:00:31.380 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.377+0000 7f7b4848c6c0 1 -- 10.20.193.158:0/3933858504 shutdown_connections 2026-02-13T04:00:31.380 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.377+0000 7f7b4848c6c0 1 --2- 10.20.193.158:0/3933858504 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f7b080b5650 0x7f7b080d5b00 unknown :-1 s=CLOSED pgs=112 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:31.380 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.377+0000 7f7b4848c6c0 1 --2- 10.20.193.158:0/3933858504 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7b401229a0 0x7f7b40122e40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:31.380 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.377+0000 7f7b4848c6c0 1 --2- 10.20.193.158:0/3933858504 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7b40115410 0x7f7b4011d5e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:31.380 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.377+0000 7f7b4848c6c0 1 --2- 10.20.193.158:0/3933858504 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7b4010f200 0x7f7b4011d0a0 unknown :-1 s=CLOSED pgs=69 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:31.380 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.377+0000 7f7b4848c6c0 1 -- 10.20.193.158:0/3933858504 >> 10.20.193.158:0/3933858504 conn(0x7f7b400ecb00 msgr2=0x7f7b4010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:31.380 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.377+0000 7f7b4848c6c0 1 -- 10.20.193.158:0/3933858504 shutdown_connections 2026-02-13T04:00:31.381 INFO:teuthology.orchestra.run.trial158.stderr:2026-02-13T04:00:31.377+0000 7f7b4848c6c0 1 -- 10.20.193.158:0/3933858504 wait complete. 2026-02-13T04:00:31.438 DEBUG:teuthology.orchestra.run.trial092:mds.a> sudo journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mds.a.service 2026-02-13T04:00:31.442 DEBUG:teuthology.orchestra.run.trial092:mds.d> sudo journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mds.d.service 2026-02-13T04:00:31.487 DEBUG:teuthology.orchestra.run.trial092:mds.g> sudo journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mds.g.service 2026-02-13T04:00:31.531 DEBUG:teuthology.orchestra.run.trial092:mds.j> sudo journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mds.j.service 2026-02-13T04:00:31.576 DEBUG:teuthology.orchestra.run.trial099:mds.b> sudo journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mds.b.service 2026-02-13T04:00:31.579 DEBUG:teuthology.orchestra.run.trial099:mds.e> sudo journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mds.e.service 2026-02-13T04:00:31.622 DEBUG:teuthology.orchestra.run.trial099:mds.h> sudo journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mds.h.service 2026-02-13T04:00:31.665 DEBUG:teuthology.orchestra.run.trial099:mds.k> sudo journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mds.k.service 2026-02-13T04:00:31.674 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:31 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/2468163708' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-13T04:00:31.675 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:31 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:31.675 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:31 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:00:31.675 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:31 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:31.675 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:31 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:00:31.675 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:31 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:31.675 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:31 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:31.675 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:31 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:31.675 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:31 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:31.708 DEBUG:teuthology.orchestra.run.trial158:mds.c> sudo journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mds.c.service 2026-02-13T04:00:31.711 DEBUG:teuthology.orchestra.run.trial158:mds.f> sudo journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mds.f.service 2026-02-13T04:00:31.755 DEBUG:teuthology.orchestra.run.trial158:mds.i> sudo journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mds.i.service 2026-02-13T04:00:31.799 DEBUG:teuthology.orchestra.run.trial158:mds.l> sudo journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mds.l.service 2026-02-13T04:00:31.843 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2026-02-13T04:00:31.843 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T04:00:31.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:31 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/2468163708' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-13T04:00:31.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:31 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:31.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:31 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:00:31.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:31 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:31.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:31 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:00:31.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:31 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:31.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:31 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:31.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:31 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:31.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:31 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:31.893 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:31 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/2468163708' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2026-02-13T04:00:31.893 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:31 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:31.893 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:31 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:00:31.893 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:31 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:31.893 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:31 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:00:31.893 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:31 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:31.893 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:31 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:31.893 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:31 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:31.893 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:31 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:32.026 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:00:32.218 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.215+0000 7fc12f5776c0 1 -- 10.20.193.92:0/3368093270 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc130159910 msgr2=0x7fc130179cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:32.219 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.215+0000 7fc12f5776c0 1 --2- 10.20.193.92:0/3368093270 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc130159910 0x7fc130179cf0 secure :-1 s=READY pgs=156 gs=1 cs=0 l=1 c_cookie=1183615183655235106 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc12000aa40 tx=0x7fc12002fdf0 comp rx=0 tx=0).stop 2026-02-13T04:00:32.219 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.215+0000 7fc12f5776c0 1 -- 10.20.193.92:0/3368093270 shutdown_connections 2026-02-13T04:00:32.219 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.215+0000 7fc12f5776c0 1 --2- 10.20.193.92:0/3368093270 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fc130060ce0 0x7fc130061110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:32.219 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.215+0000 7fc12f5776c0 1 --2- 10.20.193.92:0/3368093270 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc130159910 0x7fc130179cf0 unknown :-1 s=CLOSED pgs=156 gs=1 cs=0 l=1 c_cookie=1183615183655235106 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:32.219 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.215+0000 7fc12f5776c0 1 --2- 10.20.193.92:0/3368093270 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fc1300622d0 0x7fc1300607a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:32.219 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.215+0000 7fc12f5776c0 1 -- 10.20.193.92:0/3368093270 >> 10.20.193.92:0/3368093270 conn(0x7fc1300ea6d0 msgr2=0x7fc13010aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:32.219 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.215+0000 7fc12f5776c0 1 -- 10.20.193.92:0/3368093270 shutdown_connections 2026-02-13T04:00:32.221 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.215+0000 7fc12f5776c0 1 -- 10.20.193.92:0/3368093270 wait complete. 2026-02-13T04:00:32.221 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.216+0000 7fc12f5776c0 1 Processor -- start 2026-02-13T04:00:32.221 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.216+0000 7fc12f5776c0 1 -- start start 2026-02-13T04:00:32.221 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.216+0000 7fc12f5776c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fc130060ce0 0x7fc130160e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:32.221 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.216+0000 7fc12f5776c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fc1300622d0 0x7fc130161390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:32.221 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.216+0000 7fc12f5776c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc130159910 0x7fc130166750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:32.222 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.216+0000 7fc12f5776c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc130166da0 con 0x7fc130159910 2026-02-13T04:00:32.222 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.216+0000 7fc12f5776c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc130166f10 con 0x7fc1300622d0 2026-02-13T04:00:32.222 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.216+0000 7fc12f5776c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fc1301670d0 con 0x7fc130060ce0 2026-02-13T04:00:32.222 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.216+0000 7fc12e5756c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fc130060ce0 0x7fc130160e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:32.222 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.216+0000 7fc12ed766c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc130159910 0x7fc130166750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:32.222 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.217+0000 7fc12ed766c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc130159910 0x7fc130166750 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:55260/0 (socket says 10.20.193.92:55260) 2026-02-13T04:00:32.222 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.217+0000 7fc12ed766c0 1 -- 10.20.193.92:0/417593398 learned_addr learned my addr 10.20.193.92:0/417593398 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:00:32.222 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.217+0000 7fc12dd746c0 1 --2- 10.20.193.92:0/417593398 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fc1300622d0 0x7fc130161390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:32.222 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.217+0000 7fc12ed766c0 1 -- 10.20.193.92:0/417593398 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fc130060ce0 msgr2=0x7fc130160e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:32.222 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.217+0000 7fc12ed766c0 1 --2- 10.20.193.92:0/417593398 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fc130060ce0 0x7fc130160e50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:32.222 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.217+0000 7fc12ed766c0 1 -- 10.20.193.92:0/417593398 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fc1300622d0 msgr2=0x7fc130161390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:32.223 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.217+0000 7fc12ed766c0 1 --2- 10.20.193.92:0/417593398 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fc1300622d0 0x7fc130161390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:32.223 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.217+0000 7fc12ed766c0 1 -- 10.20.193.92:0/417593398 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc12000a660 con 0x7fc130159910 2026-02-13T04:00:32.223 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.217+0000 7fc12dd746c0 1 --2- 10.20.193.92:0/417593398 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fc1300622d0 0x7fc130161390 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T04:00:32.223 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.217+0000 7fc12ed766c0 1 --2- 10.20.193.92:0/417593398 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc130159910 0x7fc130166750 secure :-1 s=READY pgs=157 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc120008570 tx=0x7fc120030bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:32.223 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.217+0000 7fc1177fe6c0 1 -- 10.20.193.92:0/417593398 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc120005520 con 0x7fc130159910 2026-02-13T04:00:32.223 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.217+0000 7fc1177fe6c0 1 -- 10.20.193.92:0/417593398 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fc120005680 con 0x7fc130159910 2026-02-13T04:00:32.223 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.217+0000 7fc1177fe6c0 1 -- 10.20.193.92:0/417593398 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc1200322b0 con 0x7fc130159910 2026-02-13T04:00:32.223 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.217+0000 7fc12f5776c0 1 -- 10.20.193.92:0/417593398 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc130167350 con 0x7fc130159910 2026-02-13T04:00:32.223 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.217+0000 7fc12f5776c0 1 -- 10.20.193.92:0/417593398 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1301675d0 con 0x7fc130159910 2026-02-13T04:00:32.223 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.218+0000 7fc12f5776c0 1 -- 10.20.193.92:0/417593398 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc130061cb0 con 0x7fc130159910 2026-02-13T04:00:32.224 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.220+0000 7fc1177fe6c0 1 -- 10.20.193.92:0/417593398 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7fc120003a20 con 0x7fc130159910 2026-02-13T04:00:32.225 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.222+0000 7fc1177fe6c0 1 --2- 10.20.193.92:0/417593398 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fc1080b56d0 0x7fc1080d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:32.225 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.222+0000 7fc1177fe6c0 1 -- 10.20.193.92:0/417593398 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7119+0+0 (secure 0 0 0) 0x7fc120108c40 con 0x7fc130159910 2026-02-13T04:00:32.225 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.222+0000 7fc12e5756c0 1 --2- 10.20.193.92:0/417593398 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fc1080b56d0 0x7fc1080d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:32.226 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.222+0000 7fc1177fe6c0 1 -- 10.20.193.92:0/417593398 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc1201090c0 con 0x7fc130159910 2026-02-13T04:00:32.226 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.223+0000 7fc12e5756c0 1 --2- 10.20.193.92:0/417593398 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fc1080b56d0 0x7fc1080d5b80 secure :-1 s=READY pgs=113 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc124004750 tx=0x7fc124009390 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:32.349 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.346+0000 7fc12f5776c0 1 -- 10.20.193.92:0/417593398 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc130061110 con 0x7fc130159910 2026-02-13T04:00:32.350 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.347+0000 7fc1177fe6c0 1 -- 10.20.193.92:0/417593398 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7fc1200cba50 con 0x7fc130159910 2026-02-13T04:00:32.350 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:00:32.351 INFO:teuthology.orchestra.run.trial092.stdout:{"epoch":1,"btime":"2026-02-13T03:57:51:342626+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2026-02-13T04:00:32.352 INFO:teuthology.orchestra.run.trial092.stderr:dumped fsmap epoch 1 2026-02-13T04:00:32.352 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.348+0000 7fc12f5776c0 1 -- 10.20.193.92:0/417593398 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fc1080b56d0 msgr2=0x7fc1080d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:32.352 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.348+0000 7fc12f5776c0 1 --2- 10.20.193.92:0/417593398 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fc1080b56d0 0x7fc1080d5b80 secure :-1 s=READY pgs=113 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc124004750 tx=0x7fc124009390 comp rx=0 tx=0).stop 2026-02-13T04:00:32.352 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.348+0000 7fc12f5776c0 1 -- 10.20.193.92:0/417593398 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc130159910 msgr2=0x7fc130166750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:32.352 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.348+0000 7fc12f5776c0 1 --2- 10.20.193.92:0/417593398 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc130159910 0x7fc130166750 secure :-1 s=READY pgs=157 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc120008570 tx=0x7fc120030bf0 comp rx=0 tx=0).stop 2026-02-13T04:00:32.352 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.348+0000 7fc12f5776c0 1 -- 10.20.193.92:0/417593398 shutdown_connections 2026-02-13T04:00:32.352 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.348+0000 7fc12f5776c0 1 --2- 10.20.193.92:0/417593398 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fc1080b56d0 0x7fc1080d5b80 unknown :-1 s=CLOSED pgs=113 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:32.352 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.348+0000 7fc12f5776c0 1 --2- 10.20.193.92:0/417593398 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fc1300622d0 0x7fc130161390 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:32.352 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.348+0000 7fc12f5776c0 1 --2- 10.20.193.92:0/417593398 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc130159910 0x7fc130166750 unknown :-1 s=CLOSED pgs=157 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:32.352 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.348+0000 7fc12f5776c0 1 --2- 10.20.193.92:0/417593398 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fc130060ce0 0x7fc130160e50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:32.353 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.348+0000 7fc12f5776c0 1 -- 10.20.193.92:0/417593398 >> 10.20.193.92:0/417593398 conn(0x7fc1300ea6d0 msgr2=0x7fc13010aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:32.353 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.348+0000 7fc12f5776c0 1 -- 10.20.193.92:0/417593398 shutdown_connections 2026-02-13T04:00:32.353 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:32.348+0000 7fc12f5776c0 1 -- 10.20.193.92:0/417593398 wait complete. 2026-02-13T04:00:32.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:32 trial092 ceph-mon[23047]: from='client.24574 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial092=a;trial092=d;trial092=g;trial092=j;trial099=b;trial099=e;trial099=h;trial099=k;trial158=c;trial158=f;trial158=i;trial158=l", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T04:00:32.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:32 trial092 ceph-mon[23047]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T04:00:32.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:32 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T04:00:32.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:32 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T04:00:32.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:32 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:32.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:32 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/417593398' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T04:00:32.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:32 trial099 ceph-mon[27808]: from='client.24574 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial092=a;trial092=d;trial092=g;trial092=j;trial099=b;trial099=e;trial099=h;trial099=k;trial158=c;trial158=f;trial158=i;trial158=l", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T04:00:32.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:32 trial099 ceph-mon[27808]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T04:00:32.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:32 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T04:00:32.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:32 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T04:00:32.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:32 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:32.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:32 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/417593398' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T04:00:33.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:32 trial158 ceph-mon[27763]: from='client.24574 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;trial092=a;trial092=d;trial092=g;trial092=j;trial099=b;trial099=e;trial099=h;trial099=k;trial158=c;trial158=f;trial158=i;trial158=l", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T04:00:33.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:32 trial158 ceph-mon[27763]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T04:00:33.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:32 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T04:00:33.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:32 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T04:00:33.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:32 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:33.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:32 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/417593398' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T04:00:33.080 INFO:journalctl@ceph.mds.l.trial158.stdout:Feb 13 04:00:32 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-l[57259]: starting mds.l at 2026-02-13T04:00:33.791 INFO:journalctl@ceph.mds.k.trial099.stdout:Feb 13 04:00:33 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-k[56288]: starting mds.k at 2026-02-13T04:00:34.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:33 trial158 ceph-mon[27763]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T04:00:34.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:33 trial158 ceph-mon[27763]: mds.? [v2:10.20.193.158:6832/2722781962,v1:10.20.193.158:6833/2722781962] up:boot 2026-02-13T04:00:34.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:33 trial158 ceph-mon[27763]: fsmap 1 up:standby 2026-02-13T04:00:34.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:33 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2026-02-13T04:00:34.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:33 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:34.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:33 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:34.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:33 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:34.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:33 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T04:00:34.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:33 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T04:00:34.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:33 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:34.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:33 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:34.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:33 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:34.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:33 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:34.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:33 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T04:00:34.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:33 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T04:00:34.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:33 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:34.112 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:33 trial092 ceph-mon[23047]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T04:00:34.112 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:33 trial092 ceph-mon[23047]: mds.? [v2:10.20.193.158:6832/2722781962,v1:10.20.193.158:6833/2722781962] up:boot 2026-02-13T04:00:34.112 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:33 trial092 ceph-mon[23047]: fsmap 1 up:standby 2026-02-13T04:00:34.112 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:33 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2026-02-13T04:00:34.112 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:33 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:34.112 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:33 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:34.112 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:33 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:34.112 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:33 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T04:00:34.112 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:33 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T04:00:34.112 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:33 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:34.112 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:33 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:34.112 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:33 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:34.112 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:33 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:34.112 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:33 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T04:00:34.112 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:33 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T04:00:34.112 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:33 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:34.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:33 trial099 ceph-mon[27808]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T04:00:34.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:33 trial099 ceph-mon[27808]: mds.? [v2:10.20.193.158:6832/2722781962,v1:10.20.193.158:6833/2722781962] up:boot 2026-02-13T04:00:34.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:33 trial099 ceph-mon[27808]: fsmap 1 up:standby 2026-02-13T04:00:34.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:33 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2026-02-13T04:00:34.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:33 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:34.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:33 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:34.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:33 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:34.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:33 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T04:00:34.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:33 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T04:00:34.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:33 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:34.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:33 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:34.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:33 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:34.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:33 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:34.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:33 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T04:00:34.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:33 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T04:00:34.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:33 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:34.453 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T04:00:34.640 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:00:34.754 INFO:journalctl@ceph.mds.j.trial092.stdout:Feb 13 04:00:34 trial092 systemd[1]: Starting Ceph mds.j for 1fefccae-0890-11f1-bcc5-d404e6e7d460... 2026-02-13T04:00:34.873 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:34.869+0000 7f7747fff6c0 1 -- 10.20.193.92:0/1122108138 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f774810f060 msgr2=0x7f774810f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:34.873 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:34.869+0000 7f7747fff6c0 1 --2- 10.20.193.92:0/1122108138 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f774810f060 0x7f774810f430 secure :-1 s=READY pgs=73 gs=1 cs=0 l=1 c_cookie=9153188653268420583 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f773c009970 tx=0x7f773c02ed50 comp rx=0 tx=0).stop 2026-02-13T04:00:34.873 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:34.869+0000 7f7747fff6c0 1 -- 10.20.193.92:0/1122108138 shutdown_connections 2026-02-13T04:00:34.873 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:34.869+0000 7f7747fff6c0 1 --2- 10.20.193.92:0/1122108138 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7748115270 0x7f7748175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:34.873 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:34.869+0000 7f7747fff6c0 1 --2- 10.20.193.92:0/1122108138 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f774810fa50 0x7f7748114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:34.874 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:34.869+0000 7f7747fff6c0 1 --2- 10.20.193.92:0/1122108138 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f774810f060 0x7f774810f430 unknown :-1 s=CLOSED pgs=73 gs=1 cs=0 l=1 c_cookie=9153188653268420583 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:34.874 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:34.869+0000 7f7747fff6c0 1 -- 10.20.193.92:0/1122108138 >> 10.20.193.92:0/1122108138 conn(0x7f77480ec980 msgr2=0x7f774810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:34.874 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:34.869+0000 7f7747fff6c0 1 -- 10.20.193.92:0/1122108138 shutdown_connections 2026-02-13T04:00:34.874 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:34.869+0000 7f7747fff6c0 1 -- 10.20.193.92:0/1122108138 wait complete. 2026-02-13T04:00:34.874 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:34.870+0000 7f7747fff6c0 1 Processor -- start 2026-02-13T04:00:34.874 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:34.870+0000 7f7747fff6c0 1 -- start start 2026-02-13T04:00:34.876 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:34.870+0000 7f7747fff6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f774810f060 0x7f774805dbd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:34.876 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:34.870+0000 7f7747fff6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7748115270 0x7f7748175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:34.876 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:34.870+0000 7f7747fff6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f774805e200 0x7f77480ff810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:34.876 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:34.870+0000 7f7747fff6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f774805e8f0 con 0x7f774810f060 2026-02-13T04:00:34.876 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:34.870+0000 7f7747fff6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f77480ffd50 con 0x7f7748115270 2026-02-13T04:00:34.876 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:34.870+0000 7f7747fff6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f77480fff10 con 0x7f774805e200 2026-02-13T04:00:34.876 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:34.870+0000 7f7746ffd6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f774810f060 0x7f774805dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:34.877 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:34.870+0000 7f77477fe6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f774805e200 0x7f77480ff810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:34.877 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:34.870+0000 7f77477fe6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f774805e200 0x7f77480ff810 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:38594/0 (socket says 10.20.193.92:38594) 2026-02-13T04:00:34.877 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:34.870+0000 7f77477fe6c0 1 -- 10.20.193.92:0/1754663739 learned_addr learned my addr 10.20.193.92:0/1754663739 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:00:34.877 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:34.870+0000 7f77467fc6c0 1 --2- 10.20.193.92:0/1754663739 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7748115270 0x7f7748175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:34.877 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:34.871+0000 7f77477fe6c0 1 -- 10.20.193.92:0/1754663739 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7748115270 msgr2=0x7f7748175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:34.877 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:34.871+0000 7f77477fe6c0 1 --2- 10.20.193.92:0/1754663739 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7748115270 0x7f7748175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:34.877 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:34.871+0000 7f77477fe6c0 1 -- 10.20.193.92:0/1754663739 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f774810f060 msgr2=0x7f774805dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:34.877 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:34.871+0000 7f77477fe6c0 1 --2- 10.20.193.92:0/1754663739 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f774810f060 0x7f774805dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:34.877 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:34.871+0000 7f77477fe6c0 1 -- 10.20.193.92:0/1754663739 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f773c009590 con 0x7f774805e200 2026-02-13T04:00:34.877 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:34.871+0000 7f77467fc6c0 1 --2- 10.20.193.92:0/1754663739 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7748115270 0x7f7748175b10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T04:00:34.877 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:34.871+0000 7f77477fe6c0 1 --2- 10.20.193.92:0/1754663739 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f774805e200 0x7f77480ff810 secure :-1 s=READY pgs=72 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f773800c9b0 tx=0x7f773800ce80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:34.878 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:34.871+0000 7f7727fff6c0 1 -- 10.20.193.92:0/1754663739 <== mon.1 v2:10.20.193.158:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7738003c40 con 0x7f774805e200 2026-02-13T04:00:34.878 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:34.871+0000 7f7727fff6c0 1 -- 10.20.193.92:0/1754663739 <== mon.1 v2:10.20.193.158:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f7738003da0 con 0x7f774805e200 2026-02-13T04:00:34.878 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:34.871+0000 7f7727fff6c0 1 -- 10.20.193.92:0/1754663739 <== mon.1 v2:10.20.193.158:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7738008440 con 0x7f774805e200 2026-02-13T04:00:34.878 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:34.871+0000 7f7747fff6c0 1 -- 10.20.193.92:0/1754663739 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77481001f0 con 0x7f774805e200 2026-02-13T04:00:34.878 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:34.871+0000 7f7747fff6c0 1 -- 10.20.193.92:0/1754663739 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7748100680 con 0x7f774805e200 2026-02-13T04:00:34.878 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:34.872+0000 7f7747fff6c0 1 -- 10.20.193.92:0/1754663739 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7748110330 con 0x7f774805e200 2026-02-13T04:00:34.879 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:34.874+0000 7f7727fff6c0 1 -- 10.20.193.92:0/1754663739 <== mon.1 v2:10.20.193.158:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f773800d6c0 con 0x7f774805e200 2026-02-13T04:00:34.879 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:34.875+0000 7f7727fff6c0 1 --2- 10.20.193.92:0/1754663739 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f77180b56d0 0x7f77180d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:34.879 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:34.875+0000 7f7727fff6c0 1 -- 10.20.193.92:0/1754663739 <== mon.1 v2:10.20.193.158:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7119+0+0 (secure 0 0 0) 0x7f77380e45b0 con 0x7f774805e200 2026-02-13T04:00:34.879 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:34.875+0000 7f7727fff6c0 1 -- 10.20.193.92:0/1754663739 <== mon.1 v2:10.20.193.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f77380e4a30 con 0x7f774805e200 2026-02-13T04:00:34.879 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:34.876+0000 7f7746ffd6c0 1 --2- 10.20.193.92:0/1754663739 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f77180b56d0 0x7f77180d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:34.879 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:34.876+0000 7f7746ffd6c0 1 --2- 10.20.193.92:0/1754663739 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f77180b56d0 0x7f77180d5b80 secure :-1 s=READY pgs=116 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f773c005b40 tx=0x7f773c0023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:35.004 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:35.001+0000 7f7747fff6c0 1 -- 10.20.193.92:0/1754663739 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f774810f430 con 0x7f774805e200 2026-02-13T04:00:35.004 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:35.001+0000 7f7727fff6c0 1 -- 10.20.193.92:0/1754663739 <== mon.1 v2:10.20.193.158:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2263 (secure 0 0 0) 0x7f77380a73c0 con 0x7f774805e200 2026-02-13T04:00:35.005 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:00:35.005 INFO:teuthology.orchestra.run.trial092.stdout:{"epoch":3,"btime":"2026-02-13T04:00:33:813377+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24586,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.158:6833/2722781962","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6832","nonce":2722781962},{"type":"v1","addr":"10.20.193.158:6833","nonce":2722781962}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.99:6833/2198675163","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6832","nonce":2198675163},{"type":"v1","addr":"10.20.193.99:6833","nonce":2198675163}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2026-02-13T04:00:35.005 INFO:teuthology.orchestra.run.trial092.stderr:dumped fsmap epoch 3 2026-02-13T04:00:35.006 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:35.003+0000 7f7747fff6c0 1 -- 10.20.193.92:0/1754663739 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f77180b56d0 msgr2=0x7f77180d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:35.007 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:35.003+0000 7f7747fff6c0 1 --2- 10.20.193.92:0/1754663739 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f77180b56d0 0x7f77180d5b80 secure :-1 s=READY pgs=116 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f773c005b40 tx=0x7f773c0023a0 comp rx=0 tx=0).stop 2026-02-13T04:00:35.007 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:35.003+0000 7f7747fff6c0 1 -- 10.20.193.92:0/1754663739 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f774805e200 msgr2=0x7f77480ff810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:35.007 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:35.003+0000 7f7747fff6c0 1 --2- 10.20.193.92:0/1754663739 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f774805e200 0x7f77480ff810 secure :-1 s=READY pgs=72 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f773800c9b0 tx=0x7f773800ce80 comp rx=0 tx=0).stop 2026-02-13T04:00:35.007 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:35.003+0000 7f7747fff6c0 1 -- 10.20.193.92:0/1754663739 shutdown_connections 2026-02-13T04:00:35.007 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:35.003+0000 7f7747fff6c0 1 --2- 10.20.193.92:0/1754663739 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f77180b56d0 0x7f77180d5b80 unknown :-1 s=CLOSED pgs=116 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:35.007 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:35.003+0000 7f7747fff6c0 1 --2- 10.20.193.92:0/1754663739 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7748115270 0x7f7748175b10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:35.007 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:35.003+0000 7f7747fff6c0 1 --2- 10.20.193.92:0/1754663739 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f774805e200 0x7f77480ff810 unknown :-1 s=CLOSED pgs=72 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:35.007 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:35.003+0000 7f7747fff6c0 1 --2- 10.20.193.92:0/1754663739 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f774810f060 0x7f774805dbd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:35.007 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:35.003+0000 7f7747fff6c0 1 -- 10.20.193.92:0/1754663739 >> 10.20.193.92:0/1754663739 conn(0x7f77480ec980 msgr2=0x7f7748110ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:35.007 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:35.003+0000 7f7747fff6c0 1 -- 10.20.193.92:0/1754663739 shutdown_connections 2026-02-13T04:00:35.007 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:35.003+0000 7f7747fff6c0 1 -- 10.20.193.92:0/1754663739 wait complete. 2026-02-13T04:00:35.023 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:34 trial092 ceph-mon[23047]: mds.? [v2:10.20.193.99:6832/2198675163,v1:10.20.193.99:6833/2198675163] up:boot 2026-02-13T04:00:35.023 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:34 trial092 ceph-mon[23047]: fsmap 2 up:standby 2026-02-13T04:00:35.024 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:34 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2026-02-13T04:00:35.024 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:34 trial092 ceph-mon[23047]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T04:00:35.024 INFO:journalctl@ceph.mds.j.trial092.stdout:Feb 13 04:00:34 trial092 podman[57518]: 2026-02-13 04:00:34.933377188 +0000 UTC m=+0.030312147 container create a4d6b3d22ab2057b4c3e7378c8703251eb452b21e9b346cbcdb3178bd101ddf6 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-j, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, summary=Rocky Linux Base image, io.buildah.version=1.33.7, org.opencontainers.image.licenses=BSD-3-Clause, name=rockylinux, version=10, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T04:00:35.024 INFO:journalctl@ceph.mds.j.trial092.stdout:Feb 13 04:00:34 trial092 podman[57518]: 2026-02-13 04:00:34.972068822 +0000 UTC m=+0.069003711 container init a4d6b3d22ab2057b4c3e7378c8703251eb452b21e9b346cbcdb3178bd101ddf6 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-j, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, version=10, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, ceph=True, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, OSD_FLAVOR=default, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-13T04:00:35.024 INFO:journalctl@ceph.mds.j.trial092.stdout:Feb 13 04:00:34 trial092 podman[57518]: 2026-02-13 04:00:34.97813393 +0000 UTC m=+0.075068819 container start a4d6b3d22ab2057b4c3e7378c8703251eb452b21e9b346cbcdb3178bd101ddf6 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-j, version=10, org.opencontainers.image.version=10, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, ceph=True, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , summary=Rocky Linux Base image, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-13T04:00:35.024 INFO:journalctl@ceph.mds.j.trial092.stdout:Feb 13 04:00:34 trial092 bash[57518]: a4d6b3d22ab2057b4c3e7378c8703251eb452b21e9b346cbcdb3178bd101ddf6 2026-02-13T04:00:35.024 INFO:journalctl@ceph.mds.j.trial092.stdout:Feb 13 04:00:34 trial092 podman[57518]: 2026-02-13 04:00:34.921760706 +0000 UTC m=+0.018695605 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T04:00:35.024 INFO:journalctl@ceph.mds.j.trial092.stdout:Feb 13 04:00:34 trial092 systemd[1]: Started Ceph mds.j for 1fefccae-0890-11f1-bcc5-d404e6e7d460. 2026-02-13T04:00:35.024 INFO:journalctl@ceph.mds.j.trial092.stdout:Feb 13 04:00:35 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-j[57533]: starting mds.j at 2026-02-13T04:00:35.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:34 trial158 ceph-mon[27763]: mds.? [v2:10.20.193.99:6832/2198675163,v1:10.20.193.99:6833/2198675163] up:boot 2026-02-13T04:00:35.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:34 trial158 ceph-mon[27763]: fsmap 2 up:standby 2026-02-13T04:00:35.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:34 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2026-02-13T04:00:35.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:34 trial158 ceph-mon[27763]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T04:00:35.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:34 trial099 ceph-mon[27808]: mds.? [v2:10.20.193.99:6832/2198675163,v1:10.20.193.99:6833/2198675163] up:boot 2026-02-13T04:00:35.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:34 trial099 ceph-mon[27808]: fsmap 2 up:standby 2026-02-13T04:00:35.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:34 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2026-02-13T04:00:35.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:34 trial099 ceph-mon[27808]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T04:00:36.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:35 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/1754663739' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T04:00:36.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:35 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:36.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:35 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:36.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:35 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:36.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:35 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T04:00:36.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:35 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T04:00:36.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:35 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:36.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:35 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/1754663739' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T04:00:36.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:35 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:36.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:35 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:36.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:35 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:36.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:35 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T04:00:36.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:35 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T04:00:36.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:35 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:36.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:35 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1754663739' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T04:00:36.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:35 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:36.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:35 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:36.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:35 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:36.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:35 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T04:00:36.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:35 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T04:00:36.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:35 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:36.684 INFO:journalctl@ceph.mds.d.trial092.stdout:Feb 13 04:00:36 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-d[57831]: starting mds.d at 2026-02-13T04:00:37.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:36 trial158 ceph-mon[27763]: mds.? [v2:10.20.193.92:6834/3399599706,v1:10.20.193.92:6835/3399599706] up:boot 2026-02-13T04:00:37.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:36 trial158 ceph-mon[27763]: fsmap 3 up:standby 2026-02-13T04:00:37.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:36 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2026-02-13T04:00:37.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:36 trial158 ceph-mon[27763]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T04:00:37.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:36 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:37.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:36 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:37.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:36 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:37.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:36 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T04:00:37.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:36 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T04:00:37.080 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:36 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:37.113 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T04:00:37.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:36 trial099 ceph-mon[27808]: mds.? [v2:10.20.193.92:6834/3399599706,v1:10.20.193.92:6835/3399599706] up:boot 2026-02-13T04:00:37.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:36 trial099 ceph-mon[27808]: fsmap 3 up:standby 2026-02-13T04:00:37.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:36 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2026-02-13T04:00:37.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:36 trial099 ceph-mon[27808]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T04:00:37.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:36 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:37.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:36 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:37.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:36 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:37.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:36 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T04:00:37.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:36 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T04:00:37.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:36 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:37.166 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:36 trial092 ceph-mon[23047]: mds.? [v2:10.20.193.92:6834/3399599706,v1:10.20.193.92:6835/3399599706] up:boot 2026-02-13T04:00:37.166 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:36 trial092 ceph-mon[23047]: fsmap 3 up:standby 2026-02-13T04:00:37.166 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:36 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2026-02-13T04:00:37.167 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:36 trial092 ceph-mon[23047]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T04:00:37.167 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:36 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:37.167 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:36 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:37.167 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:36 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:37.167 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:36 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T04:00:37.167 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:36 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T04:00:37.167 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:36 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:37.305 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:00:37.497 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.493+0000 7f41696e46c0 1 -- 10.20.193.92:0/3040793792 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4164115270 msgr2=0x7f4164175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:37.497 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.493+0000 7f41696e46c0 1 --2- 10.20.193.92:0/3040793792 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4164115270 0x7f4164175c10 secure :-1 s=READY pgs=161 gs=1 cs=0 l=1 c_cookie=16609997755253703362 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f415800aa70 tx=0x7f415802fde0 comp rx=0 tx=0).stop 2026-02-13T04:00:37.497 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.493+0000 7f41696e46c0 1 -- 10.20.193.92:0/3040793792 shutdown_connections 2026-02-13T04:00:37.497 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.493+0000 7f41696e46c0 1 --2- 10.20.193.92:0/3040793792 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4164115270 0x7f4164175c10 unknown :-1 s=CLOSED pgs=161 gs=1 cs=0 l=1 c_cookie=16609997755253703362 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:37.498 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.493+0000 7f41696e46c0 1 --2- 10.20.193.92:0/3040793792 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f416410fa50 0x7f4164114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:37.498 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.493+0000 7f41696e46c0 1 --2- 10.20.193.92:0/3040793792 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f416410f060 0x7f416410f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:37.498 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.493+0000 7f41696e46c0 1 -- 10.20.193.92:0/3040793792 >> 10.20.193.92:0/3040793792 conn(0x7f41640ec980 msgr2=0x7f416410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:37.498 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.493+0000 7f41696e46c0 1 -- 10.20.193.92:0/3040793792 shutdown_connections 2026-02-13T04:00:37.498 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.493+0000 7f41696e46c0 1 -- 10.20.193.92:0/3040793792 wait complete. 2026-02-13T04:00:37.498 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.494+0000 7f41696e46c0 1 Processor -- start 2026-02-13T04:00:37.498 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.494+0000 7f41696e46c0 1 -- start start 2026-02-13T04:00:37.500 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.494+0000 7f41696e46c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f416410f060 0x7f416411cea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:37.500 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.494+0000 7f41696e46c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4164115270 0x7f416411d3e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:37.500 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.494+0000 7f41696e46c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f41641227a0 0x7f4164122c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:37.500 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.494+0000 7f41696e46c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f41641231b0 con 0x7f41641227a0 2026-02-13T04:00:37.500 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.494+0000 7f41696e46c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4164123320 con 0x7f416410f060 2026-02-13T04:00:37.500 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.494+0000 7f41696e46c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f41641234e0 con 0x7f4164115270 2026-02-13T04:00:37.500 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.494+0000 7f4163fff6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f416410f060 0x7f416411cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:37.501 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.494+0000 7f4163fff6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f416410f060 0x7f416411cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:57754/0 (socket says 10.20.193.92:57754) 2026-02-13T04:00:37.501 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.494+0000 7f4163fff6c0 1 -- 10.20.193.92:0/1955059595 learned_addr learned my addr 10.20.193.92:0/1955059595 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:00:37.501 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.495+0000 7f4168ee36c0 1 --2- 10.20.193.92:0/1955059595 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f41641227a0 0x7f4164122c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:37.501 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.495+0000 7f41637fe6c0 1 --2- 10.20.193.92:0/1955059595 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4164115270 0x7f416411d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:37.501 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.495+0000 7f4163fff6c0 1 -- 10.20.193.92:0/1955059595 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4164115270 msgr2=0x7f416411d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:37.501 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.495+0000 7f4163fff6c0 1 --2- 10.20.193.92:0/1955059595 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4164115270 0x7f416411d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:37.501 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.495+0000 7f4163fff6c0 1 -- 10.20.193.92:0/1955059595 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f41641227a0 msgr2=0x7f4164122c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:37.501 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.495+0000 7f4163fff6c0 1 --2- 10.20.193.92:0/1955059595 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f41641227a0 0x7f4164122c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:37.501 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.495+0000 7f4163fff6c0 1 -- 10.20.193.92:0/1955059595 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f415800a660 con 0x7f416410f060 2026-02-13T04:00:37.501 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.495+0000 7f4168ee36c0 1 --2- 10.20.193.92:0/1955059595 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f41641227a0 0x7f4164122c40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T04:00:37.501 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.495+0000 7f41637fe6c0 1 --2- 10.20.193.92:0/1955059595 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4164115270 0x7f416411d3e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T04:00:37.501 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.495+0000 7f4163fff6c0 1 --2- 10.20.193.92:0/1955059595 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f416410f060 0x7f416411cea0 secure :-1 s=READY pgs=76 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4150009490 tx=0x7f415000bca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:37.502 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.495+0000 7f41617fa6c0 1 -- 10.20.193.92:0/1955059595 <== mon.2 v2:10.20.193.99:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4150004a80 con 0x7f416410f060 2026-02-13T04:00:37.502 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.495+0000 7f41617fa6c0 1 -- 10.20.193.92:0/1955059595 <== mon.2 v2:10.20.193.99:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f4150009030 con 0x7f416410f060 2026-02-13T04:00:37.502 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.495+0000 7f41696e46c0 1 -- 10.20.193.92:0/1955059595 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4164163990 con 0x7f416410f060 2026-02-13T04:00:37.502 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.495+0000 7f41617fa6c0 1 -- 10.20.193.92:0/1955059595 <== mon.2 v2:10.20.193.99:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4150007440 con 0x7f416410f060 2026-02-13T04:00:37.502 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.495+0000 7f41696e46c0 1 -- 10.20.193.92:0/1955059595 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4164163e70 con 0x7f416410f060 2026-02-13T04:00:37.502 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.496+0000 7f41696e46c0 1 -- 10.20.193.92:0/1955059595 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4164110330 con 0x7f416410f060 2026-02-13T04:00:37.502 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.498+0000 7f41617fa6c0 1 -- 10.20.193.92:0/1955059595 <== mon.2 v2:10.20.193.99:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f4150004060 con 0x7f416410f060 2026-02-13T04:00:37.503 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.500+0000 7f41617fa6c0 1 --2- 10.20.193.92:0/1955059595 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f41380b56d0 0x7f41380d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:37.503 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.500+0000 7f41617fa6c0 1 -- 10.20.193.92:0/1955059595 <== mon.2 v2:10.20.193.99:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7119+0+0 (secure 0 0 0) 0x7f41500e3720 con 0x7f416410f060 2026-02-13T04:00:37.503 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.500+0000 7f41637fe6c0 1 --2- 10.20.193.92:0/1955059595 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f41380b56d0 0x7f41380d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:37.503 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.500+0000 7f41617fa6c0 1 -- 10.20.193.92:0/1955059595 <== mon.2 v2:10.20.193.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f41500e3ba0 con 0x7f416410f060 2026-02-13T04:00:37.504 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.501+0000 7f41637fe6c0 1 --2- 10.20.193.92:0/1955059595 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f41380b56d0 0x7f41380d5b80 secure :-1 s=READY pgs=119 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4164123830 tx=0x7f4154009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:37.616 INFO:journalctl@ceph.mds.e.trial099.stdout:Feb 13 04:00:37 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-e[56614]: starting mds.e at 2026-02-13T04:00:37.627 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.624+0000 7f41696e46c0 1 -- 10.20.193.92:0/1955059595 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f416411dff0 con 0x7f416410f060 2026-02-13T04:00:37.628 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.625+0000 7f41617fa6c0 1 -- 10.20.193.92:0/1955059595 <== mon.2 v2:10.20.193.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3913 (secure 0 0 0) 0x7f41500a6530 con 0x7f416410f060 2026-02-13T04:00:37.628 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:00:37.629 INFO:teuthology.orchestra.run.trial092.stdout:{"epoch":5,"btime":"2026-02-13T04:00:36:822725+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14637,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.92:6835/3399599706","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6834","nonce":3399599706},{"type":"v1","addr":"10.20.193.92:6835","nonce":3399599706}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24586,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.158:6833/2722781962","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6832","nonce":2722781962},{"type":"v1","addr":"10.20.193.158:6833","nonce":2722781962}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.99:6833/2198675163","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6832","nonce":2198675163},{"type":"v1","addr":"10.20.193.99:6833","nonce":2198675163}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.92:6837/2861428966","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6836","nonce":2861428966},{"type":"v1","addr":"10.20.193.92:6837","nonce":2861428966}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[]} 2026-02-13T04:00:37.629 INFO:teuthology.orchestra.run.trial092.stderr:dumped fsmap epoch 5 2026-02-13T04:00:37.630 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.626+0000 7f41696e46c0 1 -- 10.20.193.92:0/1955059595 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f41380b56d0 msgr2=0x7f41380d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:37.630 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.626+0000 7f41696e46c0 1 --2- 10.20.193.92:0/1955059595 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f41380b56d0 0x7f41380d5b80 secure :-1 s=READY pgs=119 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4164123830 tx=0x7f4154009260 comp rx=0 tx=0).stop 2026-02-13T04:00:37.630 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.626+0000 7f41696e46c0 1 -- 10.20.193.92:0/1955059595 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f416410f060 msgr2=0x7f416411cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:37.630 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.626+0000 7f41696e46c0 1 --2- 10.20.193.92:0/1955059595 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f416410f060 0x7f416411cea0 secure :-1 s=READY pgs=76 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4150009490 tx=0x7f415000bca0 comp rx=0 tx=0).stop 2026-02-13T04:00:37.630 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.626+0000 7f41696e46c0 1 -- 10.20.193.92:0/1955059595 shutdown_connections 2026-02-13T04:00:37.630 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.626+0000 7f41696e46c0 1 --2- 10.20.193.92:0/1955059595 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f41641227a0 0x7f4164122c40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:37.630 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.626+0000 7f41696e46c0 1 --2- 10.20.193.92:0/1955059595 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4164115270 0x7f416411d3e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:37.630 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.626+0000 7f41696e46c0 1 --2- 10.20.193.92:0/1955059595 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f41380b56d0 0x7f41380d5b80 unknown :-1 s=CLOSED pgs=119 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:37.630 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.626+0000 7f41696e46c0 1 --2- 10.20.193.92:0/1955059595 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f416410f060 0x7f416411cea0 unknown :-1 s=CLOSED pgs=76 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:37.630 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.626+0000 7f41696e46c0 1 -- 10.20.193.92:0/1955059595 >> 10.20.193.92:0/1955059595 conn(0x7f41640ec980 msgr2=0x7f416410cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:37.630 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.626+0000 7f41696e46c0 1 -- 10.20.193.92:0/1955059595 shutdown_connections 2026-02-13T04:00:37.631 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:37.626+0000 7f41696e46c0 1 -- 10.20.193.92:0/1955059595 wait complete. 2026-02-13T04:00:37.964 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:37 trial158 ceph-mon[27763]: mds.? [v2:10.20.193.92:6836/2861428966,v1:10.20.193.92:6837/2861428966] up:boot 2026-02-13T04:00:37.964 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:37 trial158 ceph-mon[27763]: fsmap 4 up:standby 2026-02-13T04:00:37.965 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:37 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2026-02-13T04:00:37.965 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:37 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:37.965 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:37 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:37.965 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:37 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:37.965 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:37 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T04:00:37.965 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:37 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T04:00:37.965 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:37 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:37.965 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:37 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/1955059595' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T04:00:38.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:37 trial099 ceph-mon[27808]: mds.? [v2:10.20.193.92:6836/2861428966,v1:10.20.193.92:6837/2861428966] up:boot 2026-02-13T04:00:38.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:37 trial099 ceph-mon[27808]: fsmap 4 up:standby 2026-02-13T04:00:38.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:37 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2026-02-13T04:00:38.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:37 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:38.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:37 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:38.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:37 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:38.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:37 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T04:00:38.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:37 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T04:00:38.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:37 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:38.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:37 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/1955059595' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T04:00:38.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:37 trial092 ceph-mon[23047]: mds.? [v2:10.20.193.92:6836/2861428966,v1:10.20.193.92:6837/2861428966] up:boot 2026-02-13T04:00:38.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:37 trial092 ceph-mon[23047]: fsmap 4 up:standby 2026-02-13T04:00:38.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:37 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2026-02-13T04:00:38.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:37 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:38.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:37 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:38.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:37 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:38.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:37 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T04:00:38.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:37 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T04:00:38.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:37 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:38.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:37 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1955059595' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T04:00:38.329 INFO:journalctl@ceph.mds.f.trial158.stdout:Feb 13 04:00:38 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-f[57577]: starting mds.f at 2026-02-13T04:00:39.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:38 trial158 ceph-mon[27763]: mds.? [v2:10.20.193.99:6834/1712552217,v1:10.20.193.99:6835/1712552217] up:boot 2026-02-13T04:00:39.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:38 trial158 ceph-mon[27763]: fsmap 5 up:standby 2026-02-13T04:00:39.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:38 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2026-02-13T04:00:39.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:38 trial158 ceph-mon[27763]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T04:00:39.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:38 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:39.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:38 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:39.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:38 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:39.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:38 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T04:00:39.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:38 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T04:00:39.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:38 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:39.079 INFO:journalctl@ceph.mds.c.trial158.stdout:Feb 13 04:00:38 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-c[57910]: starting mds.c at 2026-02-13T04:00:39.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:38 trial099 ceph-mon[27808]: mds.? [v2:10.20.193.99:6834/1712552217,v1:10.20.193.99:6835/1712552217] up:boot 2026-02-13T04:00:39.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:38 trial099 ceph-mon[27808]: fsmap 5 up:standby 2026-02-13T04:00:39.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:38 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2026-02-13T04:00:39.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:38 trial099 ceph-mon[27808]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T04:00:39.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:38 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:39.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:38 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:39.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:38 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:39.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:38 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T04:00:39.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:38 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T04:00:39.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:38 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:39.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:38 trial092 ceph-mon[23047]: mds.? [v2:10.20.193.99:6834/1712552217,v1:10.20.193.99:6835/1712552217] up:boot 2026-02-13T04:00:39.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:38 trial092 ceph-mon[23047]: fsmap 5 up:standby 2026-02-13T04:00:39.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:38 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2026-02-13T04:00:39.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:38 trial092 ceph-mon[23047]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T04:00:39.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:38 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:39.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:38 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:39.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:38 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:39.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:38 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T04:00:39.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:38 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T04:00:39.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:38 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:39.732 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T04:00:39.921 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:00:40.036 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:39 trial092 ceph-mon[23047]: mds.? [v2:10.20.193.158:6834/3920757139,v1:10.20.193.158:6835/3920757139] up:boot 2026-02-13T04:00:40.036 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:39 trial092 ceph-mon[23047]: fsmap 6 up:standby 2026-02-13T04:00:40.036 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:39 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2026-02-13T04:00:40.036 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:39 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:40.036 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:39 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:40.036 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:39 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:40.037 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:39 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T04:00:40.037 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:39 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T04:00:40.037 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:39 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:40.037 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:39 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:40.037 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:39 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:40.037 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:39 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:40.037 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:39 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T04:00:40.037 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:39 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T04:00:40.037 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:39 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:40.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:39 trial099 ceph-mon[27808]: mds.? [v2:10.20.193.158:6834/3920757139,v1:10.20.193.158:6835/3920757139] up:boot 2026-02-13T04:00:40.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:39 trial099 ceph-mon[27808]: fsmap 6 up:standby 2026-02-13T04:00:40.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:39 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2026-02-13T04:00:40.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:39 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:40.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:39 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:40.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:39 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:40.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:39 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T04:00:40.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:39 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T04:00:40.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:39 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:40.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:39 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:40.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:39 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:40.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:39 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:40.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:39 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T04:00:40.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:39 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T04:00:40.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:39 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:40.122 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.119+0000 7f1f8e24c6c0 1 -- 10.20.193.92:0/1315399576 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1f88115270 msgr2=0x7f1f88175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:40.122 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.119+0000 7f1f8e24c6c0 1 --2- 10.20.193.92:0/1315399576 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1f88115270 0x7f1f88175c10 secure :-1 s=READY pgs=162 gs=2 cs=0 l=1 c_cookie=3757659740284347658 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f8400aa70 tx=0x7f1f8402fdd0 comp rx=0 tx=0).stop 2026-02-13T04:00:40.123 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.119+0000 7f1f8e24c6c0 1 -- 10.20.193.92:0/1315399576 shutdown_connections 2026-02-13T04:00:40.123 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.119+0000 7f1f8e24c6c0 1 --2- 10.20.193.92:0/1315399576 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1f88115270 0x7f1f88175c10 unknown :-1 s=CLOSED pgs=162 gs=2 cs=0 l=1 c_cookie=3757659740284347658 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:40.123 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.119+0000 7f1f8e24c6c0 1 --2- 10.20.193.92:0/1315399576 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1f8810fa50 0x7f1f88114a90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:40.123 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.119+0000 7f1f8e24c6c0 1 --2- 10.20.193.92:0/1315399576 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1f8810f060 0x7f1f8810f430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:40.123 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.119+0000 7f1f8e24c6c0 1 -- 10.20.193.92:0/1315399576 >> 10.20.193.92:0/1315399576 conn(0x7f1f880ec980 msgr2=0x7f1f8810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:40.123 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.119+0000 7f1f8e24c6c0 1 -- 10.20.193.92:0/1315399576 shutdown_connections 2026-02-13T04:00:40.123 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.119+0000 7f1f8e24c6c0 1 -- 10.20.193.92:0/1315399576 wait complete. 2026-02-13T04:00:40.123 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.119+0000 7f1f8e24c6c0 1 Processor -- start 2026-02-13T04:00:40.123 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.120+0000 7f1f8e24c6c0 1 -- start start 2026-02-13T04:00:40.125 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.120+0000 7f1f8e24c6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1f8810f060 0x7f1f8811cd90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:40.125 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.120+0000 7f1f8e24c6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1f88115270 0x7f1f8811d2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:40.125 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.120+0000 7f1f8e24c6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1f88122690 0x7f1f88122b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:40.125 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.120+0000 7f1f8e24c6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1f881230a0 con 0x7f1f88115270 2026-02-13T04:00:40.125 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.120+0000 7f1f8e24c6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1f88123210 con 0x7f1f8810f060 2026-02-13T04:00:40.125 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.120+0000 7f1f8e24c6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f1f881233d0 con 0x7f1f88122690 2026-02-13T04:00:40.125 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.120+0000 7f1f8ca496c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1f88115270 0x7f1f8811d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:40.125 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.120+0000 7f1f8ca496c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1f88115270 0x7f1f8811d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:59068/0 (socket says 10.20.193.92:59068) 2026-02-13T04:00:40.125 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.120+0000 7f1f8ca496c0 1 -- 10.20.193.92:0/1847298910 learned_addr learned my addr 10.20.193.92:0/1847298910 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:00:40.125 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.120+0000 7f1f8d24a6c0 1 --2- 10.20.193.92:0/1847298910 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1f8810f060 0x7f1f8811cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:40.126 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.120+0000 7f1f8ca496c0 1 -- 10.20.193.92:0/1847298910 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1f88122690 msgr2=0x7f1f88122b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:40.126 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.120+0000 7f1f8ca496c0 1 --2- 10.20.193.92:0/1847298910 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1f88122690 0x7f1f88122b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:40.126 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.120+0000 7f1f8ca496c0 1 -- 10.20.193.92:0/1847298910 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1f8810f060 msgr2=0x7f1f8811cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:40.126 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.120+0000 7f1f8ca496c0 1 --2- 10.20.193.92:0/1847298910 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1f8810f060 0x7f1f8811cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:40.126 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.120+0000 7f1f8ca496c0 1 -- 10.20.193.92:0/1847298910 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f8400a660 con 0x7f1f88115270 2026-02-13T04:00:40.126 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.121+0000 7f1f8ca496c0 1 --2- 10.20.193.92:0/1847298910 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1f88115270 0x7f1f8811d2d0 secure :-1 s=READY pgs=163 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f7c00b6c0 tx=0x7f1f7c00bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:40.126 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.121+0000 7f1f767fc6c0 1 -- 10.20.193.92:0/1847298910 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1f7c004250 con 0x7f1f88115270 2026-02-13T04:00:40.126 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.121+0000 7f1f767fc6c0 1 -- 10.20.193.92:0/1847298910 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f1f7c009070 con 0x7f1f88115270 2026-02-13T04:00:40.126 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.121+0000 7f1f767fc6c0 1 -- 10.20.193.92:0/1847298910 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1f7c0071c0 con 0x7f1f88115270 2026-02-13T04:00:40.126 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.121+0000 7f1f8e24c6c0 1 -- 10.20.193.92:0/1847298910 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f88163880 con 0x7f1f88115270 2026-02-13T04:00:40.126 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.121+0000 7f1f8e24c6c0 1 -- 10.20.193.92:0/1847298910 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f88163d10 con 0x7f1f88115270 2026-02-13T04:00:40.127 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.121+0000 7f1f57fff6c0 1 -- 10.20.193.92:0/1847298910 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f88110330 con 0x7f1f88115270 2026-02-13T04:00:40.127 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.124+0000 7f1f767fc6c0 1 -- 10.20.193.92:0/1847298910 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f1f7c0043b0 con 0x7f1f88115270 2026-02-13T04:00:40.128 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.125+0000 7f1f767fc6c0 1 --2- 10.20.193.92:0/1847298910 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f1f640b5650 0x7f1f640d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:40.129 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.125+0000 7f1f767fc6c0 1 -- 10.20.193.92:0/1847298910 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7119+0+0 (secure 0 0 0) 0x7f1f7c0e37f0 con 0x7f1f88115270 2026-02-13T04:00:40.129 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.125+0000 7f1f767fc6c0 1 -- 10.20.193.92:0/1847298910 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1f7c0e3c70 con 0x7f1f88115270 2026-02-13T04:00:40.129 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.126+0000 7f1f8d24a6c0 1 --2- 10.20.193.92:0/1847298910 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f1f640b5650 0x7f1f640d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:40.129 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.126+0000 7f1f8d24a6c0 1 --2- 10.20.193.92:0/1847298910 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f1f640b5650 0x7f1f640d5b00 secure :-1 s=READY pgs=124 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f78005980 tx=0x7f1f78005910 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:40.132 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:39 trial158 ceph-mon[27763]: mds.? [v2:10.20.193.158:6834/3920757139,v1:10.20.193.158:6835/3920757139] up:boot 2026-02-13T04:00:40.132 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:39 trial158 ceph-mon[27763]: fsmap 6 up:standby 2026-02-13T04:00:40.132 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:39 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2026-02-13T04:00:40.132 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:39 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:40.132 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:39 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:40.132 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:39 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:40.132 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:39 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T04:00:40.132 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:39 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T04:00:40.133 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:39 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:40.133 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:39 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:40.133 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:39 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:40.133 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:39 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:40.133 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:39 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T04:00:40.133 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:39 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T04:00:40.133 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:39 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:40.252 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.249+0000 7f1f57fff6c0 1 -- 10.20.193.92:0/1847298910 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1f8811dee0 con 0x7f1f88115270 2026-02-13T04:00:40.252 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.249+0000 7f1f767fc6c0 1 -- 10.20.193.92:0/1847298910 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+7219 (secure 0 0 0) 0x7f1f7c0a6600 con 0x7f1f88115270 2026-02-13T04:00:40.252 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:00:40.253 INFO:teuthology.orchestra.run.trial092.stdout:{"epoch":8,"btime":"2026-02-13T04:00:39:833950+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14637,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.92:6835/3399599706","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6834","nonce":3399599706},{"type":"v1","addr":"10.20.193.92:6835","nonce":3399599706}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24586,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.158:6833/2722781962","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6832","nonce":2722781962},{"type":"v1","addr":"10.20.193.158:6833","nonce":2722781962}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.99:6833/2198675163","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6832","nonce":2198675163},{"type":"v1","addr":"10.20.193.99:6833","nonce":2198675163}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.92:6837/2861428966","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6836","nonce":2861428966},{"type":"v1","addr":"10.20.193.92:6837","nonce":2861428966}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24608,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.99:6835/1712552217","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6834","nonce":1712552217},{"type":"v1","addr":"10.20.193.99:6835","nonce":1712552217}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24619,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.158:6835/3920757139","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6834","nonce":3920757139},{"type":"v1","addr":"10.20.193.158:6835","nonce":3920757139}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24625,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.158:6837/3994694149","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6836","nonce":3994694149},{"type":"v1","addr":"10.20.193.158:6837","nonce":3994694149}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24629,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.99:6837/1572110945","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6836","nonce":1572110945},{"type":"v1","addr":"10.20.193.99:6837","nonce":1572110945}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2026-02-13T04:00:40.254 INFO:teuthology.orchestra.run.trial092.stderr:dumped fsmap epoch 8 2026-02-13T04:00:40.254 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.250+0000 7f1f57fff6c0 1 -- 10.20.193.92:0/1847298910 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f1f640b5650 msgr2=0x7f1f640d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:40.254 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.250+0000 7f1f57fff6c0 1 --2- 10.20.193.92:0/1847298910 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f1f640b5650 0x7f1f640d5b00 secure :-1 s=READY pgs=124 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f78005980 tx=0x7f1f78005910 comp rx=0 tx=0).stop 2026-02-13T04:00:40.254 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.250+0000 7f1f57fff6c0 1 -- 10.20.193.92:0/1847298910 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1f88115270 msgr2=0x7f1f8811d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:40.254 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.250+0000 7f1f57fff6c0 1 --2- 10.20.193.92:0/1847298910 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1f88115270 0x7f1f8811d2d0 secure :-1 s=READY pgs=163 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f7c00b6c0 tx=0x7f1f7c00bb90 comp rx=0 tx=0).stop 2026-02-13T04:00:40.254 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.250+0000 7f1f57fff6c0 1 -- 10.20.193.92:0/1847298910 shutdown_connections 2026-02-13T04:00:40.254 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.250+0000 7f1f57fff6c0 1 --2- 10.20.193.92:0/1847298910 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1f88122690 0x7f1f88122b30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:40.254 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.250+0000 7f1f57fff6c0 1 --2- 10.20.193.92:0/1847298910 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1f88115270 0x7f1f8811d2d0 unknown :-1 s=CLOSED pgs=163 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:40.255 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.250+0000 7f1f57fff6c0 1 --2- 10.20.193.92:0/1847298910 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f1f640b5650 0x7f1f640d5b00 unknown :-1 s=CLOSED pgs=124 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:40.255 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.250+0000 7f1f57fff6c0 1 --2- 10.20.193.92:0/1847298910 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1f8810f060 0x7f1f8811cd90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:40.255 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.250+0000 7f1f57fff6c0 1 -- 10.20.193.92:0/1847298910 >> 10.20.193.92:0/1847298910 conn(0x7f1f880ec980 msgr2=0x7f1f8810cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:40.255 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.251+0000 7f1f57fff6c0 1 -- 10.20.193.92:0/1847298910 shutdown_connections 2026-02-13T04:00:40.255 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:40.251+0000 7f1f57fff6c0 1 -- 10.20.193.92:0/1847298910 wait complete. 2026-02-13T04:00:40.829 INFO:journalctl@ceph.mds.i.trial158.stdout:Feb 13 04:00:40 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-i[58234]: starting mds.i at 2026-02-13T04:00:41.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:40 trial099 ceph-mon[27808]: mds.? [v2:10.20.193.158:6836/3994694149,v1:10.20.193.158:6837/3994694149] up:boot 2026-02-13T04:00:41.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:40 trial099 ceph-mon[27808]: mds.? [v2:10.20.193.99:6836/1572110945,v1:10.20.193.99:6837/1572110945] up:boot 2026-02-13T04:00:41.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:40 trial099 ceph-mon[27808]: fsmap 8 up:standby 2026-02-13T04:00:41.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:40 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-13T04:00:41.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:40 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-13T04:00:41.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:40 trial099 ceph-mon[27808]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T04:00:41.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:40 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/1847298910' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T04:00:41.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:40 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:41.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:40 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:41.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:40 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:41.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:40 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T04:00:41.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:40 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T04:00:41.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:40 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:41.137 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:40 trial092 ceph-mon[23047]: mds.? [v2:10.20.193.158:6836/3994694149,v1:10.20.193.158:6837/3994694149] up:boot 2026-02-13T04:00:41.137 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:40 trial092 ceph-mon[23047]: mds.? [v2:10.20.193.99:6836/1572110945,v1:10.20.193.99:6837/1572110945] up:boot 2026-02-13T04:00:41.137 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:40 trial092 ceph-mon[23047]: fsmap 8 up:standby 2026-02-13T04:00:41.137 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:40 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-13T04:00:41.137 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:40 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-13T04:00:41.137 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:40 trial092 ceph-mon[23047]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T04:00:41.137 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:40 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1847298910' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T04:00:41.138 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:40 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:41.138 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:40 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:41.138 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:40 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:41.138 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:40 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T04:00:41.138 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:40 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T04:00:41.138 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:40 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:41.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:40 trial158 ceph-mon[27763]: mds.? [v2:10.20.193.158:6836/3994694149,v1:10.20.193.158:6837/3994694149] up:boot 2026-02-13T04:00:41.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:40 trial158 ceph-mon[27763]: mds.? [v2:10.20.193.99:6836/1572110945,v1:10.20.193.99:6837/1572110945] up:boot 2026-02-13T04:00:41.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:40 trial158 ceph-mon[27763]: fsmap 8 up:standby 2026-02-13T04:00:41.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:40 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2026-02-13T04:00:41.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:40 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2026-02-13T04:00:41.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:40 trial158 ceph-mon[27763]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T04:00:41.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:40 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/1847298910' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T04:00:41.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:40 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:41.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:40 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:41.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:40 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:41.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:40 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T04:00:41.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:40 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T04:00:41.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:40 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:41.845 INFO:journalctl@ceph.mds.g.trial092.stdout:Feb 13 04:00:41 trial092 systemd[1]: Starting Ceph mds.g for 1fefccae-0890-11f1-bcc5-d404e6e7d460... 2026-02-13T04:00:42.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:41 trial099 ceph-mon[27808]: mds.? [v2:10.20.193.158:6838/2250447124,v1:10.20.193.158:6839/2250447124] up:boot 2026-02-13T04:00:42.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:41 trial099 ceph-mon[27808]: fsmap 9 up:standby 2026-02-13T04:00:42.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:41 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-13T04:00:42.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:41 trial092 ceph-mon[23047]: mds.? [v2:10.20.193.158:6838/2250447124,v1:10.20.193.158:6839/2250447124] up:boot 2026-02-13T04:00:42.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:41 trial092 ceph-mon[23047]: fsmap 9 up:standby 2026-02-13T04:00:42.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:41 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-13T04:00:42.185 INFO:journalctl@ceph.mds.g.trial092.stdout:Feb 13 04:00:41 trial092 podman[58272]: 2026-02-13 04:00:41.90422153 +0000 UTC m=+0.028408347 container create 41ad110dc2f49d094944b8627f1dd18d4391ed9f50145cceb8d95d4d49a8c2f0 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-g, summary=Rocky Linux Base image, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.authors=Ceph Release Team , vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, name=rockylinux, version=10, OSD_FLAVOR=default, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-13T04:00:42.185 INFO:journalctl@ceph.mds.g.trial092.stdout:Feb 13 04:00:41 trial092 podman[58272]: 2026-02-13 04:00:41.939396429 +0000 UTC m=+0.063583246 container init 41ad110dc2f49d094944b8627f1dd18d4391ed9f50145cceb8d95d4d49a8c2f0 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-g, org.opencontainers.image.title=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, summary=Rocky Linux Base image, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7, license=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux, version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-pdonnell-testing-20260210.171210, vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, ceph=True, org.opencontainers.image.version=10, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-13T04:00:42.185 INFO:journalctl@ceph.mds.g.trial092.stdout:Feb 13 04:00:41 trial092 podman[58272]: 2026-02-13 04:00:41.944663549 +0000 UTC m=+0.068850356 container start 41ad110dc2f49d094944b8627f1dd18d4391ed9f50145cceb8d95d4d49a8c2f0 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-g, summary=Rocky Linux Base image, OSD_FLAVOR=default, io.buildah.version=1.33.7, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.authors=Ceph Release Team , vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, ceph=True, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, license=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, name=rockylinux) 2026-02-13T04:00:42.185 INFO:journalctl@ceph.mds.g.trial092.stdout:Feb 13 04:00:41 trial092 bash[58272]: 41ad110dc2f49d094944b8627f1dd18d4391ed9f50145cceb8d95d4d49a8c2f0 2026-02-13T04:00:42.185 INFO:journalctl@ceph.mds.g.trial092.stdout:Feb 13 04:00:41 trial092 podman[58272]: 2026-02-13 04:00:41.893661202 +0000 UTC m=+0.017848019 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T04:00:42.185 INFO:journalctl@ceph.mds.g.trial092.stdout:Feb 13 04:00:41 trial092 systemd[1]: Started Ceph mds.g for 1fefccae-0890-11f1-bcc5-d404e6e7d460. 2026-02-13T04:00:42.185 INFO:journalctl@ceph.mds.g.trial092.stdout:Feb 13 04:00:41 trial092 ceph-mds[58291]: -- 10.20.193.92:0/1311632803 <== mon.0 v2:10.20.193.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5648fa87b860 con 0x5648fb62a000 2026-02-13T04:00:42.185 INFO:journalctl@ceph.mds.g.trial092.stdout:Feb 13 04:00:41 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-g[58287]: starting mds.g at 2026-02-13T04:00:42.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:41 trial158 ceph-mon[27763]: mds.? [v2:10.20.193.158:6838/2250447124,v1:10.20.193.158:6839/2250447124] up:boot 2026-02-13T04:00:42.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:41 trial158 ceph-mon[27763]: fsmap 9 up:standby 2026-02-13T04:00:42.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:41 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2026-02-13T04:00:42.357 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T04:00:42.543 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:00:42.775 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.770+0000 7f551a1956c0 1 -- 10.20.193.92:0/3346530550 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5514115410 msgr2=0x7f5514175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:42.775 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.770+0000 7f551a1956c0 1 --2- 10.20.193.92:0/3346530550 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5514115410 0x7f5514175db0 secure :-1 s=READY pgs=79 gs=2 cs=0 l=1 c_cookie=7158503179173977702 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f550800aa40 tx=0x7f550802fde0 comp rx=0 tx=0).stop 2026-02-13T04:00:42.776 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.771+0000 7f551a1956c0 1 -- 10.20.193.92:0/3346530550 shutdown_connections 2026-02-13T04:00:42.776 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.771+0000 7f551a1956c0 1 --2- 10.20.193.92:0/3346530550 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5514115410 0x7f5514175db0 unknown :-1 s=CLOSED pgs=79 gs=2 cs=0 l=1 c_cookie=7158503179173977702 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:42.776 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.771+0000 7f551a1956c0 1 --2- 10.20.193.92:0/3346530550 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f551410fbf0 0x7f5514114c30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:42.776 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.771+0000 7f551a1956c0 1 --2- 10.20.193.92:0/3346530550 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f551410f200 0x7f551410f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:42.776 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.771+0000 7f551a1956c0 1 -- 10.20.193.92:0/3346530550 >> 10.20.193.92:0/3346530550 conn(0x7f55140ecb00 msgr2=0x7f551410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:42.776 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.771+0000 7f551a1956c0 1 -- 10.20.193.92:0/3346530550 shutdown_connections 2026-02-13T04:00:42.776 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.771+0000 7f551a1956c0 1 -- 10.20.193.92:0/3346530550 wait complete. 2026-02-13T04:00:42.776 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.771+0000 7f551a1956c0 1 Processor -- start 2026-02-13T04:00:42.776 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.772+0000 7f551a1956c0 1 -- start start 2026-02-13T04:00:42.776 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.772+0000 7f551a1956c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f551410f200 0x7f551411cee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:42.777 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.772+0000 7f551a1956c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5514115410 0x7f551411d420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:42.777 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.772+0000 7f551a1956c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f55141227e0 0x7f5514122c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:42.777 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.772+0000 7f551a1956c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f55141231f0 con 0x7f55141227e0 2026-02-13T04:00:42.777 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.772+0000 7f551a1956c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f5514123360 con 0x7f5514115410 2026-02-13T04:00:42.777 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.772+0000 7f551a1956c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f5514123520 con 0x7f551410f200 2026-02-13T04:00:42.777 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.772+0000 7f5513fff6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f55141227e0 0x7f5514122c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:42.777 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.772+0000 7f55137fe6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f551410f200 0x7f551411cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:42.777 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.772+0000 7f5512ffd6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5514115410 0x7f551411d420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:42.777 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.772+0000 7f5513fff6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f55141227e0 0x7f5514122c80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:59114/0 (socket says 10.20.193.92:59114) 2026-02-13T04:00:42.777 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.772+0000 7f5513fff6c0 1 -- 10.20.193.92:0/336324314 learned_addr learned my addr 10.20.193.92:0/336324314 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:00:42.777 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.772+0000 7f5513fff6c0 1 -- 10.20.193.92:0/336324314 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f551410f200 msgr2=0x7f551411cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:42.777 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.772+0000 7f5513fff6c0 1 --2- 10.20.193.92:0/336324314 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f551410f200 0x7f551411cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:42.778 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.772+0000 7f5513fff6c0 1 -- 10.20.193.92:0/336324314 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5514115410 msgr2=0x7f551411d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:42.778 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.772+0000 7f5513fff6c0 1 --2- 10.20.193.92:0/336324314 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5514115410 0x7f551411d420 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:42.778 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.772+0000 7f5513fff6c0 1 -- 10.20.193.92:0/336324314 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f550800a660 con 0x7f55141227e0 2026-02-13T04:00:42.778 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.772+0000 7f5513fff6c0 1 --2- 10.20.193.92:0/336324314 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f55141227e0 0x7f5514122c80 secure :-1 s=READY pgs=166 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f550800a3e0 tx=0x7f55080055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:42.779 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.773+0000 7f5510ff96c0 1 -- 10.20.193.92:0/336324314 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5508030860 con 0x7f55141227e0 2026-02-13T04:00:42.779 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.773+0000 7f5510ff96c0 1 -- 10.20.193.92:0/336324314 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f5508003d40 con 0x7f55141227e0 2026-02-13T04:00:42.779 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.773+0000 7f551a1956c0 1 -- 10.20.193.92:0/336324314 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5514163970 con 0x7f55141227e0 2026-02-13T04:00:42.779 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.773+0000 7f5510ff96c0 1 -- 10.20.193.92:0/336324314 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5508032030 con 0x7f55141227e0 2026-02-13T04:00:42.779 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.773+0000 7f551a1956c0 1 -- 10.20.193.92:0/336324314 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5514163df0 con 0x7f55141227e0 2026-02-13T04:00:42.779 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.773+0000 7f551a1956c0 1 -- 10.20.193.92:0/336324314 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54d8005310 con 0x7f55141227e0 2026-02-13T04:00:42.780 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.777+0000 7f5510ff96c0 1 -- 10.20.193.92:0/336324314 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f55080309c0 con 0x7f55141227e0 2026-02-13T04:00:42.782 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.779+0000 7f5510ff96c0 1 --2- 10.20.193.92:0/336324314 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f54e80b56d0 0x7f54e80d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:42.782 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.779+0000 7f5510ff96c0 1 -- 10.20.193.92:0/336324314 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7119+0+0 (secure 0 0 0) 0x7f5508108880 con 0x7f55141227e0 2026-02-13T04:00:42.783 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.779+0000 7f55137fe6c0 1 --2- 10.20.193.92:0/336324314 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f54e80b56d0 0x7f54e80d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:42.783 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.779+0000 7f5510ff96c0 1 -- 10.20.193.92:0/336324314 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f5508108d00 con 0x7f55141227e0 2026-02-13T04:00:42.783 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.780+0000 7f55137fe6c0 1 --2- 10.20.193.92:0/336324314 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f54e80b56d0 0x7f54e80d5b80 secure :-1 s=READY pgs=126 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5500004750 tx=0x7f5500009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:42.907 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.903+0000 7f551a1956c0 1 -- 10.20.193.92:0/336324314 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f54d8005960 con 0x7f55141227e0 2026-02-13T04:00:42.907 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.903+0000 7f5510ff96c0 1 -- 10.20.193.92:0/336324314 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8874 (secure 0 0 0) 0x7f55080cb690 con 0x7f55141227e0 2026-02-13T04:00:42.907 INFO:teuthology.orchestra.run.trial092.stderr:dumped fsmap epoch 10 2026-02-13T04:00:42.907 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:00:42.908 INFO:teuthology.orchestra.run.trial092.stdout:{"epoch":10,"btime":"2026-02-13T04:00:42:843031+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14637,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.92:6835/3399599706","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6834","nonce":3399599706},{"type":"v1","addr":"10.20.193.92:6835","nonce":3399599706}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14667,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.92:6839/2488042022","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6838","nonce":2488042022},{"type":"v1","addr":"10.20.193.92:6839","nonce":2488042022}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24586,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.158:6833/2722781962","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6832","nonce":2722781962},{"type":"v1","addr":"10.20.193.158:6833","nonce":2722781962}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.99:6833/2198675163","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6832","nonce":2198675163},{"type":"v1","addr":"10.20.193.99:6833","nonce":2198675163}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.92:6837/2861428966","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6836","nonce":2861428966},{"type":"v1","addr":"10.20.193.92:6837","nonce":2861428966}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24608,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.99:6835/1712552217","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6834","nonce":1712552217},{"type":"v1","addr":"10.20.193.99:6835","nonce":1712552217}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24619,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.158:6835/3920757139","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6834","nonce":3920757139},{"type":"v1","addr":"10.20.193.158:6835","nonce":3920757139}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24625,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.158:6837/3994694149","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6836","nonce":3994694149},{"type":"v1","addr":"10.20.193.158:6837","nonce":3994694149}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24629,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.99:6837/1572110945","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6836","nonce":1572110945},{"type":"v1","addr":"10.20.193.99:6837","nonce":1572110945}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24637,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.158:6839/2250447124","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6838","nonce":2250447124},{"type":"v1","addr":"10.20.193.158:6839","nonce":2250447124}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2026-02-13T04:00:42.908 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.905+0000 7f551a1956c0 1 -- 10.20.193.92:0/336324314 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f54e80b56d0 msgr2=0x7f54e80d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:42.909 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.905+0000 7f551a1956c0 1 --2- 10.20.193.92:0/336324314 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f54e80b56d0 0x7f54e80d5b80 secure :-1 s=READY pgs=126 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5500004750 tx=0x7f5500009260 comp rx=0 tx=0).stop 2026-02-13T04:00:42.909 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.905+0000 7f551a1956c0 1 -- 10.20.193.92:0/336324314 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f55141227e0 msgr2=0x7f5514122c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:42.909 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.905+0000 7f551a1956c0 1 --2- 10.20.193.92:0/336324314 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f55141227e0 0x7f5514122c80 secure :-1 s=READY pgs=166 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f550800a3e0 tx=0x7f55080055f0 comp rx=0 tx=0).stop 2026-02-13T04:00:42.909 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.905+0000 7f551a1956c0 1 -- 10.20.193.92:0/336324314 shutdown_connections 2026-02-13T04:00:42.909 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.905+0000 7f551a1956c0 1 --2- 10.20.193.92:0/336324314 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f54e80b56d0 0x7f54e80d5b80 unknown :-1 s=CLOSED pgs=126 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:42.909 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.905+0000 7f551a1956c0 1 --2- 10.20.193.92:0/336324314 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5514115410 0x7f551411d420 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:42.909 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.905+0000 7f551a1956c0 1 --2- 10.20.193.92:0/336324314 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f55141227e0 0x7f5514122c80 unknown :-1 s=CLOSED pgs=166 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:42.909 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.905+0000 7f551a1956c0 1 --2- 10.20.193.92:0/336324314 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f551410f200 0x7f551411cee0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:42.909 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.905+0000 7f551a1956c0 1 -- 10.20.193.92:0/336324314 >> 10.20.193.92:0/336324314 conn(0x7f55140ecb00 msgr2=0x7f551410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:42.910 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.905+0000 7f551a1956c0 1 -- 10.20.193.92:0/336324314 shutdown_connections 2026-02-13T04:00:42.910 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:42.905+0000 7f551a1956c0 1 -- 10.20.193.92:0/336324314 wait complete. 2026-02-13T04:00:43.173 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:43 trial092 ceph-mon[23047]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T04:00:43.173 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:43 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:43.173 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:43 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:43.173 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:43 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:43.173 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:43 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T04:00:43.173 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:43 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T04:00:43.173 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:43 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:43.174 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:43 trial092 ceph-mon[23047]: mds.? [v2:10.20.193.92:6838/2488042022,v1:10.20.193.92:6839/2488042022] up:boot 2026-02-13T04:00:43.174 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:43 trial092 ceph-mon[23047]: fsmap 10 up:standby 2026-02-13T04:00:43.174 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:43 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2026-02-13T04:00:43.174 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:43 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/336324314' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T04:00:43.174 INFO:journalctl@ceph.mds.a.trial092.stdout:Feb 13 04:00:43 trial092 systemd[1]: Starting Ceph mds.a for 1fefccae-0890-11f1-bcc5-d404e6e7d460... 2026-02-13T04:00:43.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:43 trial158 ceph-mon[27763]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T04:00:43.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:43 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:43.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:43 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:43.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:43 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:43.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:43 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T04:00:43.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:43 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T04:00:43.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:43 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:43.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:43 trial158 ceph-mon[27763]: mds.? [v2:10.20.193.92:6838/2488042022,v1:10.20.193.92:6839/2488042022] up:boot 2026-02-13T04:00:43.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:43 trial158 ceph-mon[27763]: fsmap 10 up:standby 2026-02-13T04:00:43.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:43 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2026-02-13T04:00:43.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:43 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/336324314' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T04:00:43.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:43 trial099 ceph-mon[27808]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T04:00:43.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:43 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:43.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:43 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:43.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:43 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:43.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:43 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T04:00:43.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:43 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T04:00:43.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:43 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:43.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:43 trial099 ceph-mon[27808]: mds.? [v2:10.20.193.92:6838/2488042022,v1:10.20.193.92:6839/2488042022] up:boot 2026-02-13T04:00:43.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:43 trial099 ceph-mon[27808]: fsmap 10 up:standby 2026-02-13T04:00:43.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:43 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2026-02-13T04:00:43.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:43 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/336324314' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T04:00:43.434 INFO:journalctl@ceph.mds.a.trial092.stdout:Feb 13 04:00:43 trial092 podman[58635]: 2026-02-13 04:00:43.346880878 +0000 UTC m=+0.028104072 container create f8232bc11f0518d450a1466d9df1f9e0c117e8e5ffaf88a0e9ed0bbb87da7996 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-a, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.title=rockylinux, license=BSD-3-Clause, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, summary=Rocky Linux Base image, io.buildah.version=1.33.7, version=10, org.opencontainers.image.authors=Ceph Release Team , vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-13T04:00:43.434 INFO:journalctl@ceph.mds.a.trial092.stdout:Feb 13 04:00:43 trial092 podman[58635]: 2026-02-13 04:00:43.382225733 +0000 UTC m=+0.063448887 container init f8232bc11f0518d450a1466d9df1f9e0c117e8e5ffaf88a0e9ed0bbb87da7996 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-a, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, io.buildah.version=1.33.7, license=BSD-3-Clause, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, version=10, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-13T04:00:43.435 INFO:journalctl@ceph.mds.a.trial092.stdout:Feb 13 04:00:43 trial092 podman[58635]: 2026-02-13 04:00:43.386984388 +0000 UTC m=+0.068207542 container start f8232bc11f0518d450a1466d9df1f9e0c117e8e5ffaf88a0e9ed0bbb87da7996 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-a, name=rockylinux, io.buildah.version=1.33.7, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.licenses=BSD-3-Clause, OSD_FLAVOR=default, org.opencontainers.image.version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation) 2026-02-13T04:00:43.435 INFO:journalctl@ceph.mds.a.trial092.stdout:Feb 13 04:00:43 trial092 bash[58635]: f8232bc11f0518d450a1466d9df1f9e0c117e8e5ffaf88a0e9ed0bbb87da7996 2026-02-13T04:00:43.435 INFO:journalctl@ceph.mds.a.trial092.stdout:Feb 13 04:00:43 trial092 podman[58635]: 2026-02-13 04:00:43.336658859 +0000 UTC m=+0.017882013 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T04:00:43.435 INFO:journalctl@ceph.mds.a.trial092.stdout:Feb 13 04:00:43 trial092 systemd[1]: Started Ceph mds.a for 1fefccae-0890-11f1-bcc5-d404e6e7d460. 2026-02-13T04:00:43.435 INFO:journalctl@ceph.mds.a.trial092.stdout:Feb 13 04:00:43 trial092 ceph-mds[58654]: -- 10.20.193.92:0/244609252 <== mon.1 v2:10.20.193.158:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5586fabf5860 con 0x5586fad32000 2026-02-13T04:00:43.435 INFO:journalctl@ceph.mds.a.trial092.stdout:Feb 13 04:00:43 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-a[58650]: starting mds.a at 2026-02-13T04:00:44.450 INFO:journalctl@ceph.mds.b.trial099.stdout:Feb 13 04:00:44 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-b[57261]: starting mds.b at 2026-02-13T04:00:44.724 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:44 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:44.724 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:44 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:44.724 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:44 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:44.724 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:44 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T04:00:44.724 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:44 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T04:00:44.724 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:44 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:44.724 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:44 trial158 ceph-mon[27763]: mds.? [v2:10.20.193.92:6840/1865944627,v1:10.20.193.92:6841/1865944627] up:boot 2026-02-13T04:00:44.724 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:44 trial158 ceph-mon[27763]: fsmap 11 up:standby 2026-02-13T04:00:44.724 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:44 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2026-02-13T04:00:44.724 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:44 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:44.724 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:44 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:44.724 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:44 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:44.724 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:44 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:44.724 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:44 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:44.724 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:44 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:00:44.729 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:44 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:44.729 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:44 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:44.729 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:44 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:44.729 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:44 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T04:00:44.729 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:44 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T04:00:44.729 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:44 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:44.729 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:44 trial099 ceph-mon[27808]: mds.? [v2:10.20.193.92:6840/1865944627,v1:10.20.193.92:6841/1865944627] up:boot 2026-02-13T04:00:44.729 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:44 trial099 ceph-mon[27808]: fsmap 11 up:standby 2026-02-13T04:00:44.729 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:44 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2026-02-13T04:00:44.729 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:44 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:44.729 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:44 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:44.729 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:44 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:44.729 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:44 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:44.729 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:44 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:44.729 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:44 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:00:44.892 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:44 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:44.892 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:44 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:44.892 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:44 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:44.893 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:44 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2026-02-13T04:00:44.893 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:44 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2026-02-13T04:00:44.893 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:44 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:44.893 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:44 trial092 ceph-mon[23047]: mds.? [v2:10.20.193.92:6840/1865944627,v1:10.20.193.92:6841/1865944627] up:boot 2026-02-13T04:00:44.893 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:44 trial092 ceph-mon[23047]: fsmap 11 up:standby 2026-02-13T04:00:44.893 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:44 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2026-02-13T04:00:44.893 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:44 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:44.893 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:44 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:44.893 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:44 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:44.893 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:44 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:44.893 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:44 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:44.893 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:44 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:00:45.207 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T04:00:45.395 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:00:45.511 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:45 trial092 ceph-mon[23047]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T04:00:45.511 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:45 trial092 ceph-mon[23047]: mds.? [v2:10.20.193.99:6838/147734840,v1:10.20.193.99:6839/147734840] up:boot 2026-02-13T04:00:45.511 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:45 trial092 ceph-mon[23047]: fsmap 12 up:standby 2026-02-13T04:00:45.511 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:45 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-13T04:00:45.511 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:45 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:45.511 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:45 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:45.511 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:45 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:45.511 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:45 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:45.600 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.597+0000 7f3d8332b6c0 1 -- 10.20.193.92:0/2603836583 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3d7c10f060 msgr2=0x7f3d7c10f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:45.600 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.597+0000 7f3d8332b6c0 1 --2- 10.20.193.92:0/2603836583 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3d7c10f060 0x7f3d7c10f430 secure :-1 s=READY pgs=168 gs=3 cs=0 l=1 c_cookie=9751157070632257156 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3d6c0098d0 tx=0x7f3d6c02ec40 comp rx=0 tx=0).stop 2026-02-13T04:00:45.600 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.597+0000 7f3d8332b6c0 1 -- 10.20.193.92:0/2603836583 shutdown_connections 2026-02-13T04:00:45.600 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.597+0000 7f3d8332b6c0 1 --2- 10.20.193.92:0/2603836583 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f3d7c115270 0x7f3d7c175c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:45.600 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.597+0000 7f3d8332b6c0 1 --2- 10.20.193.92:0/2603836583 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f3d7c10fa50 0x7f3d7c114a90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:45.600 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.597+0000 7f3d8332b6c0 1 --2- 10.20.193.92:0/2603836583 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3d7c10f060 0x7f3d7c10f430 unknown :-1 s=CLOSED pgs=168 gs=3 cs=0 l=1 c_cookie=9751157070632257156 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:45.600 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.597+0000 7f3d8332b6c0 1 -- 10.20.193.92:0/2603836583 >> 10.20.193.92:0/2603836583 conn(0x7f3d7c0ec980 msgr2=0x7f3d7c10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:45.600 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.597+0000 7f3d8332b6c0 1 -- 10.20.193.92:0/2603836583 shutdown_connections 2026-02-13T04:00:45.600 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.597+0000 7f3d8332b6c0 1 -- 10.20.193.92:0/2603836583 wait complete. 2026-02-13T04:00:45.600 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.597+0000 7f3d8332b6c0 1 Processor -- start 2026-02-13T04:00:45.601 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.598+0000 7f3d8332b6c0 1 -- start start 2026-02-13T04:00:45.601 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.598+0000 7f3d8332b6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3d7c10f060 0x7f3d7c0f0240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:45.601 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.598+0000 7f3d8332b6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f3d7c115270 0x7f3d7c175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:45.601 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.598+0000 7f3d8332b6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f3d7c0f0870 0x7f3d7c0ef040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:45.601 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.598+0000 7f3d8332b6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7c0f0f60 con 0x7f3d7c10f060 2026-02-13T04:00:45.601 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.598+0000 7f3d8332b6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7c0ef580 con 0x7f3d7c0f0870 2026-02-13T04:00:45.601 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.598+0000 7f3d8332b6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7c0ef740 con 0x7f3d7c115270 2026-02-13T04:00:45.601 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.599+0000 7f3d82b2a6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f3d7c0f0870 0x7f3d7c0ef040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:45.601 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.599+0000 7f3d823296c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3d7c10f060 0x7f3d7c0f0240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:45.601 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.599+0000 7f3d82b2a6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f3d7c0f0870 0x7f3d7c0ef040 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:60210/0 (socket says 10.20.193.92:60210) 2026-02-13T04:00:45.601 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.599+0000 7f3d82b2a6c0 1 -- 10.20.193.92:0/4143077582 learned_addr learned my addr 10.20.193.92:0/4143077582 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:00:45.602 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.599+0000 7f3d81b286c0 1 --2- 10.20.193.92:0/4143077582 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f3d7c115270 0x7f3d7c175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:45.602 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.599+0000 7f3d823296c0 1 -- 10.20.193.92:0/4143077582 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f3d7c115270 msgr2=0x7f3d7c175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:45.602 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.599+0000 7f3d823296c0 1 --2- 10.20.193.92:0/4143077582 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f3d7c115270 0x7f3d7c175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:45.602 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.599+0000 7f3d823296c0 1 -- 10.20.193.92:0/4143077582 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f3d7c0f0870 msgr2=0x7f3d7c0ef040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:45.602 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.599+0000 7f3d823296c0 1 --2- 10.20.193.92:0/4143077582 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f3d7c0f0870 0x7f3d7c0ef040 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:45.602 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.599+0000 7f3d823296c0 1 -- 10.20.193.92:0/4143077582 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d6c0094c0 con 0x7f3d7c10f060 2026-02-13T04:00:45.602 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.599+0000 7f3d823296c0 1 --2- 10.20.193.92:0/4143077582 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3d7c10f060 0x7f3d7c0f0240 secure :-1 s=READY pgs=169 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3d6c0098d0 tx=0x7f3d6c02f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:45.602 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.599+0000 7f3d637fe6c0 1 -- 10.20.193.92:0/4143077582 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3d6c02fcd0 con 0x7f3d7c10f060 2026-02-13T04:00:45.602 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.599+0000 7f3d637fe6c0 1 -- 10.20.193.92:0/4143077582 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f3d6c005d50 con 0x7f3d7c10f060 2026-02-13T04:00:45.602 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.599+0000 7f3d8332b6c0 1 -- 10.20.193.92:0/4143077582 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d7c0ef9c0 con 0x7f3d7c10f060 2026-02-13T04:00:45.603 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.599+0000 7f3d637fe6c0 1 -- 10.20.193.92:0/4143077582 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3d6c0318c0 con 0x7f3d7c10f060 2026-02-13T04:00:45.603 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.599+0000 7f3d8332b6c0 1 -- 10.20.193.92:0/4143077582 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d7c0efe90 con 0x7f3d7c10f060 2026-02-13T04:00:45.603 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.600+0000 7f3d8332b6c0 1 -- 10.20.193.92:0/4143077582 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d7c110330 con 0x7f3d7c10f060 2026-02-13T04:00:45.604 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.602+0000 7f3d637fe6c0 1 -- 10.20.193.92:0/4143077582 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f3d6c031030 con 0x7f3d7c10f060 2026-02-13T04:00:45.606 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.603+0000 7f3d637fe6c0 1 --2- 10.20.193.92:0/4143077582 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f3d580b56d0 0x7f3d580d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:45.606 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.604+0000 7f3d637fe6c0 1 -- 10.20.193.92:0/4143077582 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7119+0+0 (secure 0 0 0) 0x7f3d6c107580 con 0x7f3d7c10f060 2026-02-13T04:00:45.606 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.604+0000 7f3d81b286c0 1 --2- 10.20.193.92:0/4143077582 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f3d580b56d0 0x7f3d580d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:45.606 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.604+0000 7f3d637fe6c0 1 -- 10.20.193.92:0/4143077582 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3d6c107a00 con 0x7f3d7c10f060 2026-02-13T04:00:45.607 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.604+0000 7f3d81b286c0 1 --2- 10.20.193.92:0/4143077582 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f3d580b56d0 0x7f3d580d5b80 secure :-1 s=READY pgs=130 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3d7c0f3310 tx=0x7f3d70009310 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:45.731 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.728+0000 7f3d8332b6c0 1 -- 10.20.193.92:0/4143077582 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3d7c10f430 con 0x7f3d7c10f060 2026-02-13T04:00:45.731 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.728+0000 7f3d637fe6c0 1 -- 10.20.193.92:0/4143077582 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+10523 (secure 0 0 0) 0x7f3d6c0ca390 con 0x7f3d7c10f060 2026-02-13T04:00:45.731 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:00:45.731 INFO:teuthology.orchestra.run.trial092.stdout:{"epoch":12,"btime":"2026-02-13T04:00:45:006826+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14637,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.92:6835/3399599706","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6834","nonce":3399599706},{"type":"v1","addr":"10.20.193.92:6835","nonce":3399599706}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14667,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.92:6839/2488042022","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6838","nonce":2488042022},{"type":"v1","addr":"10.20.193.92:6839","nonce":2488042022}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":14679,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.92:6841/1865944627","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6840","nonce":1865944627},{"type":"v1","addr":"10.20.193.92:6841","nonce":1865944627}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24586,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.158:6833/2722781962","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6832","nonce":2722781962},{"type":"v1","addr":"10.20.193.158:6833","nonce":2722781962}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24590,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.99:6833/2198675163","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6832","nonce":2198675163},{"type":"v1","addr":"10.20.193.99:6833","nonce":2198675163}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24604,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.92:6837/2861428966","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6836","nonce":2861428966},{"type":"v1","addr":"10.20.193.92:6837","nonce":2861428966}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24608,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.99:6835/1712552217","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6834","nonce":1712552217},{"type":"v1","addr":"10.20.193.99:6835","nonce":1712552217}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24619,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.158:6835/3920757139","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6834","nonce":3920757139},{"type":"v1","addr":"10.20.193.158:6835","nonce":3920757139}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24625,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.158:6837/3994694149","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6836","nonce":3994694149},{"type":"v1","addr":"10.20.193.158:6837","nonce":3994694149}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24629,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.99:6837/1572110945","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6836","nonce":1572110945},{"type":"v1","addr":"10.20.193.99:6837","nonce":1572110945}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24637,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.158:6839/2250447124","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6838","nonce":2250447124},{"type":"v1","addr":"10.20.193.158:6839","nonce":2250447124}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24659,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.99:6839/147734840","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6838","nonce":147734840},{"type":"v1","addr":"10.20.193.99:6839","nonce":147734840}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[]} 2026-02-13T04:00:45.731 INFO:teuthology.orchestra.run.trial092.stderr:dumped fsmap epoch 12 2026-02-13T04:00:45.733 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.730+0000 7f3d8332b6c0 1 -- 10.20.193.92:0/4143077582 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f3d580b56d0 msgr2=0x7f3d580d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:45.733 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.730+0000 7f3d8332b6c0 1 --2- 10.20.193.92:0/4143077582 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f3d580b56d0 0x7f3d580d5b80 secure :-1 s=READY pgs=130 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3d7c0f3310 tx=0x7f3d70009310 comp rx=0 tx=0).stop 2026-02-13T04:00:45.733 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.730+0000 7f3d8332b6c0 1 -- 10.20.193.92:0/4143077582 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3d7c10f060 msgr2=0x7f3d7c0f0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:45.733 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.730+0000 7f3d8332b6c0 1 --2- 10.20.193.92:0/4143077582 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3d7c10f060 0x7f3d7c0f0240 secure :-1 s=READY pgs=169 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3d6c0098d0 tx=0x7f3d6c02f730 comp rx=0 tx=0).stop 2026-02-13T04:00:45.733 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.730+0000 7f3d8332b6c0 1 -- 10.20.193.92:0/4143077582 shutdown_connections 2026-02-13T04:00:45.733 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.730+0000 7f3d8332b6c0 1 --2- 10.20.193.92:0/4143077582 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f3d580b56d0 0x7f3d580d5b80 unknown :-1 s=CLOSED pgs=130 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:45.733 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.730+0000 7f3d8332b6c0 1 --2- 10.20.193.92:0/4143077582 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f3d7c0f0870 0x7f3d7c0ef040 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:45.733 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.730+0000 7f3d8332b6c0 1 --2- 10.20.193.92:0/4143077582 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f3d7c115270 0x7f3d7c175b10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:45.733 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.730+0000 7f3d8332b6c0 1 --2- 10.20.193.92:0/4143077582 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3d7c10f060 0x7f3d7c0f0240 unknown :-1 s=CLOSED pgs=169 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:45.733 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.730+0000 7f3d8332b6c0 1 -- 10.20.193.92:0/4143077582 >> 10.20.193.92:0/4143077582 conn(0x7f3d7c0ec980 msgr2=0x7f3d7c10d680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:45.733 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.730+0000 7f3d8332b6c0 1 -- 10.20.193.92:0/4143077582 shutdown_connections 2026-02-13T04:00:45.733 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:45.730+0000 7f3d8332b6c0 1 -- 10.20.193.92:0/4143077582 wait complete. 2026-02-13T04:00:45.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:45 trial158 ceph-mon[27763]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T04:00:45.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:45 trial158 ceph-mon[27763]: mds.? [v2:10.20.193.99:6838/147734840,v1:10.20.193.99:6839/147734840] up:boot 2026-02-13T04:00:45.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:45 trial158 ceph-mon[27763]: fsmap 12 up:standby 2026-02-13T04:00:45.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:45 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-13T04:00:45.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:45 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:45.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:45 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:45.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:45 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:45.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:45 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:45.838 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph --format=json-pretty osd lspools 2026-02-13T04:00:45.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:45 trial099 ceph-mon[27808]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T04:00:45.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:45 trial099 ceph-mon[27808]: mds.? [v2:10.20.193.99:6838/147734840,v1:10.20.193.99:6839/147734840] up:boot 2026-02-13T04:00:45.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:45 trial099 ceph-mon[27808]: fsmap 12 up:standby 2026-02-13T04:00:45.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:45 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2026-02-13T04:00:45.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:45 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:45.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:45 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:45.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:45 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:45.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:45 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:46.027 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:00:46.221 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.218+0000 7fa1ea2066c0 1 -- 10.20.193.92:0/693367212 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa1e41137a0 msgr2=0x7fa1e4113b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:46.221 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.218+0000 7fa1ea2066c0 1 --2- 10.20.193.92:0/693367212 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa1e41137a0 0x7fa1e4113b70 secure :-1 s=READY pgs=170 gs=3 cs=0 l=1 c_cookie=972247384983255443 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1d40098d0 tx=0x7fa1d402ec40 comp rx=0 tx=0).stop 2026-02-13T04:00:46.221 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.219+0000 7fa1ea2066c0 1 -- 10.20.193.92:0/693367212 shutdown_connections 2026-02-13T04:00:46.221 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.219+0000 7fa1ea2066c0 1 --2- 10.20.193.92:0/693367212 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa1e4114190 0x7fa1e4115d40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:46.222 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.219+0000 7fa1ea2066c0 1 --2- 10.20.193.92:0/693367212 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa1e4116520 0x7fa1e417a100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:46.222 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.219+0000 7fa1ea2066c0 1 --2- 10.20.193.92:0/693367212 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa1e41137a0 0x7fa1e4113b70 unknown :-1 s=CLOSED pgs=170 gs=3 cs=0 l=1 c_cookie=972247384983255443 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:46.222 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.219+0000 7fa1ea2066c0 1 -- 10.20.193.92:0/693367212 >> 10.20.193.92:0/693367212 conn(0x7fa1e4061510 msgr2=0x7fa1e4061910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:46.222 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.219+0000 7fa1ea2066c0 1 -- 10.20.193.92:0/693367212 shutdown_connections 2026-02-13T04:00:46.222 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.219+0000 7fa1ea2066c0 1 -- 10.20.193.92:0/693367212 wait complete. 2026-02-13T04:00:46.222 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.220+0000 7fa1ea2066c0 1 Processor -- start 2026-02-13T04:00:46.223 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.220+0000 7fa1ea2066c0 1 -- start start 2026-02-13T04:00:46.223 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.220+0000 7fa1ea2066c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa1e41137a0 0x7fa1e4121340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:46.223 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.220+0000 7fa1ea2066c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa1e4116520 0x7fa1e4121880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:46.223 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.220+0000 7fa1ea2066c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa1e4126c40 0x7fa1e41270e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:46.223 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.220+0000 7fa1ea2066c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e4127650 con 0x7fa1e4126c40 2026-02-13T04:00:46.223 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.220+0000 7fa1ea2066c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e41277c0 con 0x7fa1e4116520 2026-02-13T04:00:46.223 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.220+0000 7fa1ea2066c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fa1e4127980 con 0x7fa1e41137a0 2026-02-13T04:00:46.223 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.220+0000 7fa1e9a056c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa1e4126c40 0x7fa1e41270e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:46.223 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.221+0000 7fa1e92046c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa1e41137a0 0x7fa1e4121340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:46.223 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.221+0000 7fa1e92046c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa1e41137a0 0x7fa1e4121340 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:40308/0 (socket says 10.20.193.92:40308) 2026-02-13T04:00:46.223 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.221+0000 7fa1e92046c0 1 -- 10.20.193.92:0/191340746 learned_addr learned my addr 10.20.193.92:0/191340746 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:00:46.223 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.221+0000 7fa1e9a056c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa1e4126c40 0x7fa1e41270e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:57040/0 (socket says 10.20.193.92:57040) 2026-02-13T04:00:46.223 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.221+0000 7fa1e8a036c0 1 --2- 10.20.193.92:0/191340746 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa1e4116520 0x7fa1e4121880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:46.224 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.221+0000 7fa1e9a056c0 1 -- 10.20.193.92:0/191340746 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa1e41137a0 msgr2=0x7fa1e4121340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:46.224 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.221+0000 7fa1e9a056c0 1 --2- 10.20.193.92:0/191340746 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa1e41137a0 0x7fa1e4121340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:46.224 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.221+0000 7fa1e9a056c0 1 -- 10.20.193.92:0/191340746 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa1e4116520 msgr2=0x7fa1e4121880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:46.224 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.221+0000 7fa1e9a056c0 1 --2- 10.20.193.92:0/191340746 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa1e4116520 0x7fa1e4121880 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:46.224 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.221+0000 7fa1e9a056c0 1 -- 10.20.193.92:0/191340746 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d40094c0 con 0x7fa1e4126c40 2026-02-13T04:00:46.224 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.221+0000 7fa1e8a036c0 1 --2- 10.20.193.92:0/191340746 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa1e4116520 0x7fa1e4121880 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T04:00:46.224 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.221+0000 7fa1e92046c0 1 --2- 10.20.193.92:0/191340746 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa1e41137a0 0x7fa1e4121340 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T04:00:46.224 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.221+0000 7fa1e9a056c0 1 --2- 10.20.193.92:0/191340746 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa1e4126c40 0x7fa1e41270e0 secure :-1 s=READY pgs=171 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1e0006f60 tx=0x7fa1e000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:46.224 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.221+0000 7fa1d27fc6c0 1 -- 10.20.193.92:0/191340746 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa1e0003c40 con 0x7fa1e4126c40 2026-02-13T04:00:46.224 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.222+0000 7fa1d27fc6c0 1 -- 10.20.193.92:0/191340746 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fa1e0003da0 con 0x7fa1e4126c40 2026-02-13T04:00:46.224 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.222+0000 7fa1ea2066c0 1 -- 10.20.193.92:0/191340746 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1e4167e30 con 0x7fa1e4126c40 2026-02-13T04:00:46.224 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.222+0000 7fa1d27fc6c0 1 -- 10.20.193.92:0/191340746 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa1e0003c40 con 0x7fa1e4126c40 2026-02-13T04:00:46.225 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.222+0000 7fa1ea2066c0 1 -- 10.20.193.92:0/191340746 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1e41682c0 con 0x7fa1e4126c40 2026-02-13T04:00:46.225 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.223+0000 7fa1ea2066c0 1 -- 10.20.193.92:0/191340746 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1e4114840 con 0x7fa1e4126c40 2026-02-13T04:00:46.227 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.225+0000 7fa1d27fc6c0 1 -- 10.20.193.92:0/191340746 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7fa1e000d560 con 0x7fa1e4126c40 2026-02-13T04:00:46.229 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.226+0000 7fa1d27fc6c0 1 --2- 10.20.193.92:0/191340746 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa1c00b5730 0x7fa1c00d5be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:46.229 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.227+0000 7fa1d27fc6c0 1 -- 10.20.193.92:0/191340746 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7119+0+0 (secure 0 0 0) 0x7fa1e00e43f0 con 0x7fa1e4126c40 2026-02-13T04:00:46.229 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.227+0000 7fa1e92046c0 1 --2- 10.20.193.92:0/191340746 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa1c00b5730 0x7fa1c00d5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:46.230 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.227+0000 7fa1d27fc6c0 1 -- 10.20.193.92:0/191340746 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa1e00a7210 con 0x7fa1e4126c40 2026-02-13T04:00:46.230 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.227+0000 7fa1e92046c0 1 --2- 10.20.193.92:0/191340746 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa1c00b5730 0x7fa1c00d5be0 secure :-1 s=READY pgs=131 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1d40097f0 tx=0x7fa1d40091a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:46.333 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.330+0000 7fa1ea2066c0 1 -- 10.20.193.92:0/191340746 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fa1e4114190 con 0x7fa1e4126c40 2026-02-13T04:00:46.333 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.331+0000 7fa1d27fc6c0 1 -- 10.20.193.92:0/191340746 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v72) ==== 84+0+65 (secure 0 0 0) 0x7fa1e00aa3c0 con 0x7fa1e4126c40 2026-02-13T04:00:46.333 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:00:46.333 INFO:teuthology.orchestra.run.trial092.stdout:[ 2026-02-13T04:00:46.333 INFO:teuthology.orchestra.run.trial092.stdout: { 2026-02-13T04:00:46.333 INFO:teuthology.orchestra.run.trial092.stdout: "poolnum": 1, 2026-02-13T04:00:46.334 INFO:teuthology.orchestra.run.trial092.stdout: "poolname": ".mgr" 2026-02-13T04:00:46.334 INFO:teuthology.orchestra.run.trial092.stdout: } 2026-02-13T04:00:46.334 INFO:teuthology.orchestra.run.trial092.stdout:] 2026-02-13T04:00:46.335 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.332+0000 7fa1ea2066c0 1 -- 10.20.193.92:0/191340746 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa1c00b5730 msgr2=0x7fa1c00d5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:46.335 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.332+0000 7fa1ea2066c0 1 --2- 10.20.193.92:0/191340746 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa1c00b5730 0x7fa1c00d5be0 secure :-1 s=READY pgs=131 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1d40097f0 tx=0x7fa1d40091a0 comp rx=0 tx=0).stop 2026-02-13T04:00:46.335 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.332+0000 7fa1ea2066c0 1 -- 10.20.193.92:0/191340746 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa1e4126c40 msgr2=0x7fa1e41270e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:46.335 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.332+0000 7fa1ea2066c0 1 --2- 10.20.193.92:0/191340746 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa1e4126c40 0x7fa1e41270e0 secure :-1 s=READY pgs=171 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1e0006f60 tx=0x7fa1e000cc00 comp rx=0 tx=0).stop 2026-02-13T04:00:46.335 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.332+0000 7fa1ea2066c0 1 -- 10.20.193.92:0/191340746 shutdown_connections 2026-02-13T04:00:46.335 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.332+0000 7fa1ea2066c0 1 --2- 10.20.193.92:0/191340746 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa1c00b5730 0x7fa1c00d5be0 unknown :-1 s=CLOSED pgs=131 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:46.335 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.332+0000 7fa1ea2066c0 1 --2- 10.20.193.92:0/191340746 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa1e4116520 0x7fa1e4121880 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:46.335 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.332+0000 7fa1ea2066c0 1 --2- 10.20.193.92:0/191340746 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa1e4126c40 0x7fa1e41270e0 unknown :-1 s=CLOSED pgs=171 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:46.335 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.332+0000 7fa1ea2066c0 1 --2- 10.20.193.92:0/191340746 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa1e41137a0 0x7fa1e4121340 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:46.335 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.332+0000 7fa1ea2066c0 1 -- 10.20.193.92:0/191340746 >> 10.20.193.92:0/191340746 conn(0x7fa1e4061510 msgr2=0x7fa1e4115580 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:46.335 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.332+0000 7fa1ea2066c0 1 -- 10.20.193.92:0/191340746 shutdown_connections 2026-02-13T04:00:46.335 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.333+0000 7fa1ea2066c0 1 -- 10.20.193.92:0/191340746 wait complete. 2026-02-13T04:00:46.479 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2026-02-13T04:00:46.479 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2026-02-13T04:00:46.661 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:00:46.865 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.862+0000 7ff351b096c0 1 -- 10.20.193.92:0/588644563 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff34c10c850 msgr2=0x7ff34c111890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:46.866 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.862+0000 7ff351b096c0 1 --2- 10.20.193.92:0/588644563 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff34c10c850 0x7ff34c111890 secure :-1 s=READY pgs=172 gs=1 cs=0 l=1 c_cookie=18181803944896343528 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff33c0099a0 tx=0x7ff33c02ed00 comp rx=0 tx=0).stop 2026-02-13T04:00:46.866 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.863+0000 7ff351b096c0 1 -- 10.20.193.92:0/588644563 shutdown_connections 2026-02-13T04:00:46.866 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.863+0000 7ff351b096c0 1 --2- 10.20.193.92:0/588644563 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff34c112070 0x7ff34c172a10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:46.866 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.863+0000 7ff351b096c0 1 --2- 10.20.193.92:0/588644563 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff34c10c850 0x7ff34c111890 unknown :-1 s=CLOSED pgs=172 gs=1 cs=0 l=1 c_cookie=18181803944896343528 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:46.866 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.863+0000 7ff351b096c0 1 --2- 10.20.193.92:0/588644563 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff34c10be60 0x7ff34c10c230 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:46.866 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.863+0000 7ff351b096c0 1 -- 10.20.193.92:0/588644563 >> 10.20.193.92:0/588644563 conn(0x7ff34c0e9740 msgr2=0x7ff34c109b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:46.866 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.863+0000 7ff351b096c0 1 -- 10.20.193.92:0/588644563 shutdown_connections 2026-02-13T04:00:46.866 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.863+0000 7ff351b096c0 1 -- 10.20.193.92:0/588644563 wait complete. 2026-02-13T04:00:46.866 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.863+0000 7ff351b096c0 1 Processor -- start 2026-02-13T04:00:46.866 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.863+0000 7ff351b096c0 1 -- start start 2026-02-13T04:00:46.866 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.864+0000 7ff351b096c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff34c10be60 0x7ff34c0f4930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:46.866 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.864+0000 7ff351b096c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff34c112070 0x7ff34c172910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:46.866 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.864+0000 7ff351b096c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff34c0f4f60 0x7ff34c0fa230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:46.866 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.864+0000 7ff351b096c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff34c0f5650 con 0x7ff34c10be60 2026-02-13T04:00:46.866 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.864+0000 7ff351b096c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff34c0fa770 con 0x7ff34c112070 2026-02-13T04:00:46.867 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.864+0000 7ff351b096c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7ff34c0fa930 con 0x7ff34c0f4f60 2026-02-13T04:00:46.867 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.864+0000 7ff34affd6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff34c112070 0x7ff34c172910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:46.867 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.864+0000 7ff34affd6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff34c112070 0x7ff34c172910 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:60242/0 (socket says 10.20.193.92:60242) 2026-02-13T04:00:46.867 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.864+0000 7ff34affd6c0 1 -- 10.20.193.92:0/4092981264 learned_addr learned my addr 10.20.193.92:0/4092981264 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:00:46.867 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.864+0000 7ff34bfff6c0 1 --2- 10.20.193.92:0/4092981264 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff34c0f4f60 0x7ff34c0fa230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:46.867 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.864+0000 7ff34b7fe6c0 1 --2- 10.20.193.92:0/4092981264 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff34c10be60 0x7ff34c0f4930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:46.867 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.864+0000 7ff34affd6c0 1 -- 10.20.193.92:0/4092981264 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff34c0f4f60 msgr2=0x7ff34c0fa230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:46.867 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.864+0000 7ff34affd6c0 1 --2- 10.20.193.92:0/4092981264 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff34c0f4f60 0x7ff34c0fa230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:46.867 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.864+0000 7ff34affd6c0 1 -- 10.20.193.92:0/4092981264 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff34c10be60 msgr2=0x7ff34c0f4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:46.867 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.864+0000 7ff34affd6c0 1 --2- 10.20.193.92:0/4092981264 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff34c10be60 0x7ff34c0f4930 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:46.867 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.864+0000 7ff34affd6c0 1 -- 10.20.193.92:0/4092981264 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff33c009590 con 0x7ff34c112070 2026-02-13T04:00:46.867 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.864+0000 7ff34bfff6c0 1 --2- 10.20.193.92:0/4092981264 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff34c0f4f60 0x7ff34c0fa230 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T04:00:46.867 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.864+0000 7ff34b7fe6c0 1 --2- 10.20.193.92:0/4092981264 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff34c10be60 0x7ff34c0f4930 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T04:00:46.867 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.865+0000 7ff34affd6c0 1 --2- 10.20.193.92:0/4092981264 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff34c112070 0x7ff34c172910 secure :-1 s=READY pgs=82 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff33c02f210 tx=0x7ff33c02f810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:46.868 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.865+0000 7ff348ff96c0 1 -- 10.20.193.92:0/4092981264 <== mon.2 v2:10.20.193.99:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff33c0046b0 con 0x7ff34c112070 2026-02-13T04:00:46.868 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.865+0000 7ff348ff96c0 1 -- 10.20.193.92:0/4092981264 <== mon.2 v2:10.20.193.99:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7ff33c002be0 con 0x7ff34c112070 2026-02-13T04:00:46.868 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.865+0000 7ff348ff96c0 1 -- 10.20.193.92:0/4092981264 <== mon.2 v2:10.20.193.99:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff33c0073f0 con 0x7ff34c112070 2026-02-13T04:00:46.868 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.865+0000 7ff351b096c0 1 -- 10.20.193.92:0/4092981264 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff34c0fabb0 con 0x7ff34c112070 2026-02-13T04:00:46.868 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.865+0000 7ff351b096c0 1 -- 10.20.193.92:0/4092981264 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff34c0fafe0 con 0x7ff34c112070 2026-02-13T04:00:46.868 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.866+0000 7ff3267fc6c0 1 -- 10.20.193.92:0/4092981264 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff34c10d130 con 0x7ff34c112070 2026-02-13T04:00:46.871 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.868+0000 7ff348ff96c0 1 -- 10.20.193.92:0/4092981264 <== mon.2 v2:10.20.193.99:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7ff33c0026b0 con 0x7ff34c112070 2026-02-13T04:00:46.873 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.870+0000 7ff348ff96c0 1 --2- 10.20.193.92:0/4092981264 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff3200b56d0 0x7ff3200d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:46.873 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.870+0000 7ff348ff96c0 1 -- 10.20.193.92:0/4092981264 <== mon.2 v2:10.20.193.99:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7119+0+0 (secure 0 0 0) 0x7ff33c107750 con 0x7ff34c112070 2026-02-13T04:00:46.873 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.870+0000 7ff34b7fe6c0 1 --2- 10.20.193.92:0/4092981264 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff3200b56d0 0x7ff3200d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:46.873 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.870+0000 7ff348ff96c0 1 -- 10.20.193.92:0/4092981264 <== mon.2 v2:10.20.193.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff33c107bd0 con 0x7ff34c112070 2026-02-13T04:00:46.874 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.871+0000 7ff34b7fe6c0 1 --2- 10.20.193.92:0/4092981264 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff3200b56d0 0x7ff3200d5b80 secure :-1 s=READY pgs=132 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff338004750 tx=0x7ff338009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:46.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:46 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:46.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:46 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:46.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:46 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/4143077582' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T04:00:46.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:46 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/191340746' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2026-02-13T04:00:46.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:46 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:46.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:46 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:00:46.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:46 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:46.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:46 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:46.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:46 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:46.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:46 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:46.950 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:46 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:46.950 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:46 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:46.950 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:46 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/4143077582' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T04:00:46.950 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:46 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/191340746' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2026-02-13T04:00:46.950 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:46 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:46.950 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:46 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:00:46.950 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:46 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:46.950 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:46 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:46.950 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:46 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:46.950 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:46 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:46.973 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:46.970+0000 7ff3267fc6c0 1 -- 10.20.193.92:0/4092981264 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ff34c10c230 con 0x7ff34c112070 2026-02-13T04:00:47.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:46 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:47.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:46 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:47.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:46 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/4143077582' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T04:00:47.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:46 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/191340746' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2026-02-13T04:00:47.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:46 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:47.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:46 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:00:47.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:46 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:47.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:46 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:47.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:46 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:47.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:46 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:47.688 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:47.685+0000 7ff348ff96c0 1 -- 10.20.193.92:0/4092981264 <== mon.2 v2:10.20.193.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v73) ==== 138+0+0 (secure 0 0 0) 0x7ff33c0ca560 con 0x7ff34c112070 2026-02-13T04:00:47.689 INFO:teuthology.orchestra.run.trial092.stderr:pool 'cephfs_metadata' created 2026-02-13T04:00:47.692 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:47.688+0000 7ff3267fc6c0 1 -- 10.20.193.92:0/4092981264 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff3200b56d0 msgr2=0x7ff3200d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:47.692 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:47.688+0000 7ff3267fc6c0 1 --2- 10.20.193.92:0/4092981264 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff3200b56d0 0x7ff3200d5b80 secure :-1 s=READY pgs=132 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff338004750 tx=0x7ff338009260 comp rx=0 tx=0).stop 2026-02-13T04:00:47.692 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:47.688+0000 7ff3267fc6c0 1 -- 10.20.193.92:0/4092981264 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff34c112070 msgr2=0x7ff34c172910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:47.692 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:47.688+0000 7ff3267fc6c0 1 --2- 10.20.193.92:0/4092981264 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff34c112070 0x7ff34c172910 secure :-1 s=READY pgs=82 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff33c02f210 tx=0x7ff33c02f810 comp rx=0 tx=0).stop 2026-02-13T04:00:47.693 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:47.689+0000 7ff3267fc6c0 1 -- 10.20.193.92:0/4092981264 shutdown_connections 2026-02-13T04:00:47.693 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:47.689+0000 7ff3267fc6c0 1 --2- 10.20.193.92:0/4092981264 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff3200b56d0 0x7ff3200d5b80 unknown :-1 s=CLOSED pgs=132 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:47.693 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:47.689+0000 7ff3267fc6c0 1 --2- 10.20.193.92:0/4092981264 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff34c112070 0x7ff34c172910 unknown :-1 s=CLOSED pgs=82 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:47.693 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:47.689+0000 7ff3267fc6c0 1 --2- 10.20.193.92:0/4092981264 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff34c0f4f60 0x7ff34c0fa230 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:47.693 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:47.689+0000 7ff3267fc6c0 1 --2- 10.20.193.92:0/4092981264 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff34c10be60 0x7ff34c0f4930 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:47.693 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:47.689+0000 7ff3267fc6c0 1 -- 10.20.193.92:0/4092981264 >> 10.20.193.92:0/4092981264 conn(0x7ff34c0e9740 msgr2=0x7ff34c10a300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:47.693 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:47.689+0000 7ff3267fc6c0 1 -- 10.20.193.92:0/4092981264 shutdown_connections 2026-02-13T04:00:47.693 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:47.689+0000 7ff3267fc6c0 1 -- 10.20.193.92:0/4092981264 wait complete. 2026-02-13T04:00:47.804 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2026-02-13T04:00:47.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:47 trial158 ceph-mon[27763]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T04:00:47.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:47 trial158 ceph-mon[27763]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T04:00:47.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:47 trial158 ceph-mon[27763]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T04:00:47.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:47 trial158 ceph-mon[27763]: Cluster is now healthy 2026-02-13T04:00:47.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:47 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/4092981264' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-13T04:00:47.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:47 trial158 ceph-mon[27763]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-13T04:00:47.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:47 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:00:47.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:47 trial099 ceph-mon[27808]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T04:00:47.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:47 trial099 ceph-mon[27808]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T04:00:47.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:47 trial099 ceph-mon[27808]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T04:00:47.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:47 trial099 ceph-mon[27808]: Cluster is now healthy 2026-02-13T04:00:47.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:47 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/4092981264' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-13T04:00:47.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:47 trial099 ceph-mon[27808]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-13T04:00:47.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:47 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:00:47.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:47 trial092 ceph-mon[23047]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T04:00:47.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:47 trial092 ceph-mon[23047]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T04:00:47.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:47 trial092 ceph-mon[23047]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T04:00:47.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:47 trial092 ceph-mon[23047]: Cluster is now healthy 2026-02-13T04:00:47.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:47 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/4092981264' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-13T04:00:47.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:47 trial092 ceph-mon[23047]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2026-02-13T04:00:47.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:47 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:00:47.992 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:00:48.203 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.200+0000 7efd940b86c0 1 -- 10.20.193.92:0/707627813 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efd8c10fbf0 msgr2=0x7efd8c114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:48.203 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.200+0000 7efd940b86c0 1 --2- 10.20.193.92:0/707627813 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efd8c10fbf0 0x7efd8c114c30 secure :-1 s=READY pgs=173 gs=2 cs=0 l=1 c_cookie=776954211323078744 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd800099a0 tx=0x7efd8002ed50 comp rx=0 tx=0).stop 2026-02-13T04:00:48.203 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.200+0000 7efd940b86c0 1 -- 10.20.193.92:0/707627813 shutdown_connections 2026-02-13T04:00:48.204 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.200+0000 7efd940b86c0 1 --2- 10.20.193.92:0/707627813 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7efd8c115410 0x7efd8c175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:48.204 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.200+0000 7efd940b86c0 1 --2- 10.20.193.92:0/707627813 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efd8c10fbf0 0x7efd8c114c30 unknown :-1 s=CLOSED pgs=173 gs=2 cs=0 l=1 c_cookie=776954211323078744 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:48.204 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.200+0000 7efd940b86c0 1 --2- 10.20.193.92:0/707627813 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7efd8c10f200 0x7efd8c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:48.204 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.200+0000 7efd940b86c0 1 -- 10.20.193.92:0/707627813 >> 10.20.193.92:0/707627813 conn(0x7efd8c0ecb00 msgr2=0x7efd8c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:48.204 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.200+0000 7efd940b86c0 1 -- 10.20.193.92:0/707627813 shutdown_connections 2026-02-13T04:00:48.204 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.200+0000 7efd940b86c0 1 -- 10.20.193.92:0/707627813 wait complete. 2026-02-13T04:00:48.206 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.201+0000 7efd940b86c0 1 Processor -- start 2026-02-13T04:00:48.206 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.201+0000 7efd940b86c0 1 -- start start 2026-02-13T04:00:48.206 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.201+0000 7efd940b86c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7efd8c10f200 0x7efd8c0666e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:48.206 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.201+0000 7efd940b86c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7efd8c115410 0x7efd8c175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:48.206 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.201+0000 7efd940b86c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efd8c062940 0x7efd8c062de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:48.207 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.201+0000 7efd940b86c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7efd8c063570 con 0x7efd8c062940 2026-02-13T04:00:48.207 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.201+0000 7efd940b86c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7efd8c0636e0 con 0x7efd8c10f200 2026-02-13T04:00:48.207 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.201+0000 7efd940b86c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7efd8c0ff0f0 con 0x7efd8c115410 2026-02-13T04:00:48.207 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.201+0000 7efd9162c6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7efd8c115410 0x7efd8c175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:48.207 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.201+0000 7efd91e2d6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7efd8c10f200 0x7efd8c0666e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:48.207 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.201+0000 7efd9162c6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7efd8c115410 0x7efd8c175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:40332/0 (socket says 10.20.193.92:40332) 2026-02-13T04:00:48.207 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.201+0000 7efd9162c6c0 1 -- 10.20.193.92:0/792884811 learned_addr learned my addr 10.20.193.92:0/792884811 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:00:48.207 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.201+0000 7efd9262e6c0 1 --2- 10.20.193.92:0/792884811 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efd8c062940 0x7efd8c062de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:48.207 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.202+0000 7efd9162c6c0 1 -- 10.20.193.92:0/792884811 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7efd8c10f200 msgr2=0x7efd8c0666e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:48.207 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.202+0000 7efd9162c6c0 1 --2- 10.20.193.92:0/792884811 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7efd8c10f200 0x7efd8c0666e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:48.207 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.202+0000 7efd9162c6c0 1 -- 10.20.193.92:0/792884811 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efd8c062940 msgr2=0x7efd8c062de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:48.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.202+0000 7efd9162c6c0 1 --2- 10.20.193.92:0/792884811 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efd8c062940 0x7efd8c062de0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:48.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.202+0000 7efd9162c6c0 1 -- 10.20.193.92:0/792884811 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd80009590 con 0x7efd8c115410 2026-02-13T04:00:48.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.202+0000 7efd9262e6c0 1 --2- 10.20.193.92:0/792884811 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efd8c062940 0x7efd8c062de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T04:00:48.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.202+0000 7efd9162c6c0 1 --2- 10.20.193.92:0/792884811 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7efd8c115410 0x7efd8c175cb0 secure :-1 s=READY pgs=81 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd8002f260 tx=0x7efd8002f820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:48.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.202+0000 7efd7affd6c0 1 -- 10.20.193.92:0/792884811 <== mon.1 v2:10.20.193.158:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efd800046b0 con 0x7efd8c115410 2026-02-13T04:00:48.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.202+0000 7efd940b86c0 1 -- 10.20.193.92:0/792884811 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd8c0ff370 con 0x7efd8c115410 2026-02-13T04:00:48.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.202+0000 7efd7affd6c0 1 -- 10.20.193.92:0/792884811 <== mon.1 v2:10.20.193.158:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7efd80031560 con 0x7efd8c115410 2026-02-13T04:00:48.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.202+0000 7efd940b86c0 1 -- 10.20.193.92:0/792884811 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd8c0ff840 con 0x7efd8c115410 2026-02-13T04:00:48.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.203+0000 7efd7affd6c0 1 -- 10.20.193.92:0/792884811 <== mon.1 v2:10.20.193.158:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efd80007d80 con 0x7efd8c115410 2026-02-13T04:00:48.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.203+0000 7efd940b86c0 1 -- 10.20.193.92:0/792884811 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd8c1104d0 con 0x7efd8c115410 2026-02-13T04:00:48.209 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.205+0000 7efd7affd6c0 1 -- 10.20.193.92:0/792884811 <== mon.1 v2:10.20.193.158:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7efd800316d0 con 0x7efd8c115410 2026-02-13T04:00:48.210 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.207+0000 7efd7affd6c0 1 --2- 10.20.193.92:0/792884811 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7efd680b5650 0x7efd680d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:48.210 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.207+0000 7efd7affd6c0 1 -- 10.20.193.92:0/792884811 <== mon.1 v2:10.20.193.158:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7492+0+0 (secure 0 0 0) 0x7efd801078f0 con 0x7efd8c115410 2026-02-13T04:00:48.210 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.207+0000 7efd7affd6c0 1 -- 10.20.193.92:0/792884811 <== mon.1 v2:10.20.193.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7efd80107d70 con 0x7efd8c115410 2026-02-13T04:00:48.210 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.207+0000 7efd91e2d6c0 1 --2- 10.20.193.92:0/792884811 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7efd680b5650 0x7efd680d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:48.211 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.208+0000 7efd91e2d6c0 1 --2- 10.20.193.92:0/792884811 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7efd680b5650 0x7efd680d5b00 secure :-1 s=READY pgs=133 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd7c004750 tx=0x7efd7c009390 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:48.314 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.309+0000 7efd940b86c0 1 -- 10.20.193.92:0/792884811 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7efd8c10f5d0 con 0x7efd8c115410 2026-02-13T04:00:48.690 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.686+0000 7efd7affd6c0 1 -- 10.20.193.92:0/792884811 <== mon.1 v2:10.20.193.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v74) ==== 170+0+0 (secure 0 0 0) 0x7efd800ca580 con 0x7efd8c115410 2026-02-13T04:00:48.690 INFO:teuthology.orchestra.run.trial092.stderr:pool 'cephfs_data' created 2026-02-13T04:00:48.695 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.691+0000 7efd940b86c0 1 -- 10.20.193.92:0/792884811 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7efd680b5650 msgr2=0x7efd680d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:48.695 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.691+0000 7efd940b86c0 1 --2- 10.20.193.92:0/792884811 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7efd680b5650 0x7efd680d5b00 secure :-1 s=READY pgs=133 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd7c004750 tx=0x7efd7c009390 comp rx=0 tx=0).stop 2026-02-13T04:00:48.695 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.691+0000 7efd940b86c0 1 -- 10.20.193.92:0/792884811 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7efd8c115410 msgr2=0x7efd8c175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:48.695 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.691+0000 7efd940b86c0 1 --2- 10.20.193.92:0/792884811 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7efd8c115410 0x7efd8c175cb0 secure :-1 s=READY pgs=81 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd8002f260 tx=0x7efd8002f820 comp rx=0 tx=0).stop 2026-02-13T04:00:48.699 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.695+0000 7efd940b86c0 1 -- 10.20.193.92:0/792884811 shutdown_connections 2026-02-13T04:00:48.700 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.695+0000 7efd940b86c0 1 --2- 10.20.193.92:0/792884811 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efd8c062940 0x7efd8c062de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:48.700 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.695+0000 7efd940b86c0 1 --2- 10.20.193.92:0/792884811 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7efd8c115410 0x7efd8c175cb0 unknown :-1 s=CLOSED pgs=81 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:48.700 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.695+0000 7efd940b86c0 1 --2- 10.20.193.92:0/792884811 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7efd680b5650 0x7efd680d5b00 unknown :-1 s=CLOSED pgs=133 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:48.700 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.695+0000 7efd940b86c0 1 --2- 10.20.193.92:0/792884811 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7efd8c10f200 0x7efd8c0666e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:48.700 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.695+0000 7efd940b86c0 1 -- 10.20.193.92:0/792884811 >> 10.20.193.92:0/792884811 conn(0x7efd8c0ecb00 msgr2=0x7efd8c10d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:48.700 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.695+0000 7efd940b86c0 1 -- 10.20.193.92:0/792884811 shutdown_connections 2026-02-13T04:00:48.700 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:48.695+0000 7efd940b86c0 1 -- 10.20.193.92:0/792884811 wait complete. 2026-02-13T04:00:48.806 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph fs new cephfs cephfs_metadata cephfs_data 2026-02-13T04:00:48.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:48 trial092 ceph-mon[23047]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T04:00:48.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:48 trial092 ceph-mon[23047]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T04:00:48.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:48 trial092 ceph-mon[23047]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2026-02-13T04:00:48.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:48 trial092 ceph-mon[23047]: osdmap e73: 12 total, 12 up, 12 in 2026-02-13T04:00:48.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:48 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:48.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:48 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:48.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:48 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:48.935 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:48 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:48.935 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:48 trial092 ceph-mon[23047]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-13T04:00:48.935 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:48 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/792884811' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-13T04:00:48.935 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:48 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:48.935 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:48 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:48.935 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:48 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:48.935 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:48 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:00:48.935 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:48 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:48.935 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:48 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:48.935 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:48 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:48.935 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:48 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:48.965 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:48 trial158 ceph-mon[27763]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T04:00:48.965 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:48 trial158 ceph-mon[27763]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T04:00:48.966 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:48 trial158 ceph-mon[27763]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2026-02-13T04:00:48.966 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:48 trial158 ceph-mon[27763]: osdmap e73: 12 total, 12 up, 12 in 2026-02-13T04:00:48.966 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:48 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:48.966 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:48 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:48.966 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:48 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:48.966 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:48 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:48.966 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:48 trial158 ceph-mon[27763]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-13T04:00:48.966 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:48 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/792884811' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-13T04:00:48.966 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:48 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:48.966 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:48 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:48.966 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:48 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:48.966 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:48 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:00:48.967 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:48 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:48.967 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:48 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:48.967 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:48 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:48.967 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:48 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:48.990 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:00:49.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:48 trial099 ceph-mon[27808]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T04:00:49.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:48 trial099 ceph-mon[27808]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T04:00:49.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:48 trial099 ceph-mon[27808]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2026-02-13T04:00:49.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:48 trial099 ceph-mon[27808]: osdmap e73: 12 total, 12 up, 12 in 2026-02-13T04:00:49.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:48 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:49.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:48 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:49.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:48 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:49.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:48 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:49.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:48 trial099 ceph-mon[27808]: from='client.? ' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-13T04:00:49.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:48 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/792884811' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2026-02-13T04:00:49.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:48 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:49.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:48 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:49.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:48 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:49.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:48 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:00:49.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:48 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:49.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:48 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:00:49.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:48 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:00:49.118 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:48 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:00:49.181 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:49.177+0000 7f3a6b6676c0 1 -- 10.20.193.92:0/1146759983 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3a64114190 msgr2=0x7f3a64119140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:49.181 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:49.177+0000 7f3a6b6676c0 1 --2- 10.20.193.92:0/1146759983 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3a64114190 0x7f3a64119140 secure :-1 s=READY pgs=174 gs=3 cs=0 l=1 c_cookie=9705888624375426272 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a580098a0 tx=0x7f3a5802ec50 comp rx=0 tx=0).stop 2026-02-13T04:00:49.181 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:49.177+0000 7f3a6b6676c0 1 -- 10.20.193.92:0/1146759983 shutdown_connections 2026-02-13T04:00:49.181 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:49.177+0000 7f3a6b6676c0 1 --2- 10.20.193.92:0/1146759983 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f3a641198f0 0x7f3a6417a2c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:49.181 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:49.177+0000 7f3a6b6676c0 1 --2- 10.20.193.92:0/1146759983 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3a64114190 0x7f3a64119140 unknown :-1 s=CLOSED pgs=174 gs=3 cs=0 l=1 c_cookie=9705888624375426272 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:49.181 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:49.177+0000 7f3a6b6676c0 1 --2- 10.20.193.92:0/1146759983 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f3a641137a0 0x7f3a64113b70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:49.181 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:49.177+0000 7f3a6b6676c0 1 -- 10.20.193.92:0/1146759983 >> 10.20.193.92:0/1146759983 conn(0x7f3a64060760 msgr2=0x7f3a64060d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:49.181 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:49.177+0000 7f3a6b6676c0 1 -- 10.20.193.92:0/1146759983 shutdown_connections 2026-02-13T04:00:49.181 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:49.178+0000 7f3a6b6676c0 1 -- 10.20.193.92:0/1146759983 wait complete. 2026-02-13T04:00:49.181 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:49.178+0000 7f3a6b6676c0 1 Processor -- start 2026-02-13T04:00:49.181 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:49.178+0000 7f3a6b6676c0 1 -- start start 2026-02-13T04:00:49.181 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:49.179+0000 7f3a6b6676c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3a641137a0 0x7f3a641214a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:49.182 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:49.179+0000 7f3a6b6676c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f3a641198f0 0x7f3a641219e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:49.182 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:49.179+0000 7f3a6b6676c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f3a64126d50 0x7f3a641271f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:49.182 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:49.179+0000 7f3a6b6676c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3a64127760 con 0x7f3a641137a0 2026-02-13T04:00:49.182 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:49.179+0000 7f3a6b6676c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f3a641278d0 con 0x7f3a64126d50 2026-02-13T04:00:49.182 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:49.179+0000 7f3a6b6676c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f3a64127a90 con 0x7f3a641198f0 2026-02-13T04:00:49.182 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:49.179+0000 7f3a69bd96c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f3a64126d50 0x7f3a641271f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:49.182 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:49.179+0000 7f3a693d86c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3a641137a0 0x7f3a641214a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:49.182 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:49.179+0000 7f3a69bd96c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f3a64126d50 0x7f3a641271f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:60288/0 (socket says 10.20.193.92:60288) 2026-02-13T04:00:49.182 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:49.179+0000 7f3a69bd96c0 1 -- 10.20.193.92:0/1459173284 learned_addr learned my addr 10.20.193.92:0/1459173284 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:00:49.182 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:49.179+0000 7f3a69bd96c0 1 -- 10.20.193.92:0/1459173284 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f3a641198f0 msgr2=0x7f3a641219e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T04:00:49.182 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:49.179+0000 7f3a69bd96c0 1 --2- 10.20.193.92:0/1459173284 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f3a641198f0 0x7f3a641219e0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:49.182 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:49.179+0000 7f3a69bd96c0 1 -- 10.20.193.92:0/1459173284 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3a641137a0 msgr2=0x7f3a641214a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:49.182 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:49.179+0000 7f3a69bd96c0 1 --2- 10.20.193.92:0/1459173284 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3a641137a0 0x7f3a641214a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:49.182 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:49.179+0000 7f3a69bd96c0 1 -- 10.20.193.92:0/1459173284 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a6000a5b0 con 0x7f3a64126d50 2026-02-13T04:00:49.182 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:49.179+0000 7f3a69bd96c0 1 --2- 10.20.193.92:0/1459173284 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f3a64126d50 0x7f3a641271f0 secure :-1 s=READY pgs=83 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a6000a820 tx=0x7f3a6000ce50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:49.183 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:49.180+0000 7f3a527fc6c0 1 -- 10.20.193.92:0/1459173284 <== mon.2 v2:10.20.193.99:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a60003c40 con 0x7f3a64126d50 2026-02-13T04:00:49.183 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:49.180+0000 7f3a527fc6c0 1 -- 10.20.193.92:0/1459173284 <== mon.2 v2:10.20.193.99:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f3a6000a070 con 0x7f3a64126d50 2026-02-13T04:00:49.183 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:49.180+0000 7f3a527fc6c0 1 -- 10.20.193.92:0/1459173284 <== mon.2 v2:10.20.193.99:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3a60008440 con 0x7f3a64126d50 2026-02-13T04:00:49.183 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:49.180+0000 7f3a6b6676c0 1 -- 10.20.193.92:0/1459173284 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a580094c0 con 0x7f3a64126d50 2026-02-13T04:00:49.183 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:49.180+0000 7f3a6b6676c0 1 -- 10.20.193.92:0/1459173284 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a64168240 con 0x7f3a64126d50 2026-02-13T04:00:49.183 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:49.180+0000 7f3a6b6676c0 1 -- 10.20.193.92:0/1459173284 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a641149e0 con 0x7f3a64126d50 2026-02-13T04:00:49.185 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:49.182+0000 7f3a527fc6c0 1 -- 10.20.193.92:0/1459173284 <== mon.2 v2:10.20.193.99:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f3a6000d7a0 con 0x7f3a64126d50 2026-02-13T04:00:49.187 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:49.184+0000 7f3a527fc6c0 1 --2- 10.20.193.92:0/1459173284 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f3a400b5650 0x7f3a400d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:49.187 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:49.184+0000 7f3a527fc6c0 1 -- 10.20.193.92:0/1459173284 <== mon.2 v2:10.20.193.99:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7877+0+0 (secure 0 0 0) 0x7f3a600e4cb0 con 0x7f3a64126d50 2026-02-13T04:00:49.187 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:49.184+0000 7f3a693d86c0 1 --2- 10.20.193.92:0/1459173284 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f3a400b5650 0x7f3a400d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:49.187 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:49.184+0000 7f3a527fc6c0 1 -- 10.20.193.92:0/1459173284 <== mon.2 v2:10.20.193.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f3a600e5130 con 0x7f3a64126d50 2026-02-13T04:00:49.188 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:49.185+0000 7f3a693d86c0 1 --2- 10.20.193.92:0/1459173284 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f3a400b5650 0x7f3a400d5b00 secure :-1 s=READY pgs=134 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a54005b40 tx=0x7f3a54009310 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:49.314 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:49.311+0000 7f3a6b6676c0 1 -- 10.20.193.92:0/1459173284 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f3a64122600 con 0x7f3a64126d50 2026-02-13T04:00:50.038 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.034+0000 7f3a527fc6c0 1 -- 10.20.193.92:0/1459173284 <== mon.2 v2:10.20.193.99:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v13) ==== 172+0+0 (secure 0 0 0) 0x7f3a600a77c0 con 0x7f3a64126d50 2026-02-13T04:00:50.038 INFO:teuthology.orchestra.run.trial092.stderr:new fs with metadata pool 2 and data pool 3 2026-02-13T04:00:50.039 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:49 trial092 ceph-mon[23047]: pgmap v173: 33 pgs: 4 creating+peering, 28 unknown, 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T04:00:50.039 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:49 trial092 ceph-mon[23047]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2026-02-13T04:00:50.039 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:49 trial092 ceph-mon[23047]: osdmap e74: 12 total, 12 up, 12 in 2026-02-13T04:00:50.039 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:49 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:50.039 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:49 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1459173284' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2026-02-13T04:00:50.039 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:49 trial092 ceph-mon[23047]: from='client.? ' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2026-02-13T04:00:50.040 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:49 trial092 ceph-mon[23047]: daemon mds.b assigned to filesystem cephfs as rank 0 2026-02-13T04:00:50.040 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:49 trial092 ceph-mon[23047]: osdmap e75: 12 total, 12 up, 12 in 2026-02-13T04:00:50.043 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.039+0000 7f3a6b6676c0 1 -- 10.20.193.92:0/1459173284 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f3a400b5650 msgr2=0x7f3a400d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:50.043 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.039+0000 7f3a6b6676c0 1 --2- 10.20.193.92:0/1459173284 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f3a400b5650 0x7f3a400d5b00 secure :-1 s=READY pgs=134 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a54005b40 tx=0x7f3a54009310 comp rx=0 tx=0).stop 2026-02-13T04:00:50.043 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.039+0000 7f3a6b6676c0 1 -- 10.20.193.92:0/1459173284 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f3a64126d50 msgr2=0x7f3a641271f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:50.043 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.039+0000 7f3a6b6676c0 1 --2- 10.20.193.92:0/1459173284 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f3a64126d50 0x7f3a641271f0 secure :-1 s=READY pgs=83 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3a6000a820 tx=0x7f3a6000ce50 comp rx=0 tx=0).stop 2026-02-13T04:00:50.043 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.039+0000 7f3a6b6676c0 1 -- 10.20.193.92:0/1459173284 shutdown_connections 2026-02-13T04:00:50.043 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.039+0000 7f3a6b6676c0 1 --2- 10.20.193.92:0/1459173284 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f3a400b5650 0x7f3a400d5b00 unknown :-1 s=CLOSED pgs=134 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:50.043 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.039+0000 7f3a6b6676c0 1 --2- 10.20.193.92:0/1459173284 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f3a64126d50 0x7f3a641271f0 unknown :-1 s=CLOSED pgs=83 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:50.043 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.039+0000 7f3a6b6676c0 1 --2- 10.20.193.92:0/1459173284 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f3a641198f0 0x7f3a641219e0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:50.043 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.039+0000 7f3a6b6676c0 1 --2- 10.20.193.92:0/1459173284 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3a641137a0 0x7f3a641214a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:50.043 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.039+0000 7f3a6b6676c0 1 -- 10.20.193.92:0/1459173284 >> 10.20.193.92:0/1459173284 conn(0x7f3a64060760 msgr2=0x7f3a64117740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:50.044 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.040+0000 7f3a6b6676c0 1 -- 10.20.193.92:0/1459173284 shutdown_connections 2026-02-13T04:00:50.044 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.040+0000 7f3a6b6676c0 1 -- 10.20.193.92:0/1459173284 wait complete. 2026-02-13T04:00:50.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:49 trial158 ceph-mon[27763]: pgmap v173: 33 pgs: 4 creating+peering, 28 unknown, 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T04:00:50.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:49 trial158 ceph-mon[27763]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2026-02-13T04:00:50.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:49 trial158 ceph-mon[27763]: osdmap e74: 12 total, 12 up, 12 in 2026-02-13T04:00:50.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:49 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:50.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:49 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/1459173284' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2026-02-13T04:00:50.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:49 trial158 ceph-mon[27763]: from='client.? ' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2026-02-13T04:00:50.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:49 trial158 ceph-mon[27763]: daemon mds.b assigned to filesystem cephfs as rank 0 2026-02-13T04:00:50.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:49 trial158 ceph-mon[27763]: osdmap e75: 12 total, 12 up, 12 in 2026-02-13T04:00:50.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:49 trial099 ceph-mon[27808]: pgmap v173: 33 pgs: 4 creating+peering, 28 unknown, 1 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T04:00:50.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:49 trial099 ceph-mon[27808]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2026-02-13T04:00:50.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:49 trial099 ceph-mon[27808]: osdmap e74: 12 total, 12 up, 12 in 2026-02-13T04:00:50.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:49 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:00:50.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:49 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/1459173284' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2026-02-13T04:00:50.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:49 trial099 ceph-mon[27808]: from='client.? ' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2026-02-13T04:00:50.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:49 trial099 ceph-mon[27808]: daemon mds.b assigned to filesystem cephfs as rank 0 2026-02-13T04:00:50.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:49 trial099 ceph-mon[27808]: osdmap e75: 12 total, 12 up, 12 in 2026-02-13T04:00:50.148 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T04:00:50.331 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:00:50.542 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.538+0000 7f32070776c0 1 -- 10.20.193.92:0/3770919856 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f320010f060 msgr2=0x7f320010f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:50.542 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.538+0000 7f32070776c0 1 --2- 10.20.193.92:0/3770919856 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f320010f060 0x7f320010f430 secure :-1 s=READY pgs=175 gs=1 cs=0 l=1 c_cookie=3478386175531460040 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f31f00098d0 tx=0x7f31f002ec40 comp rx=0 tx=0).stop 2026-02-13T04:00:50.542 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.538+0000 7f32070776c0 1 -- 10.20.193.92:0/3770919856 shutdown_connections 2026-02-13T04:00:50.542 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.538+0000 7f32070776c0 1 --2- 10.20.193.92:0/3770919856 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f320010fa50 0x7f3200114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:50.542 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.538+0000 7f32070776c0 1 --2- 10.20.193.92:0/3770919856 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f3200115270 0x7f3200175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:50.542 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.538+0000 7f32070776c0 1 --2- 10.20.193.92:0/3770919856 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f320010f060 0x7f320010f430 unknown :-1 s=CLOSED pgs=175 gs=1 cs=0 l=1 c_cookie=3478386175531460040 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:50.542 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.538+0000 7f32070776c0 1 -- 10.20.193.92:0/3770919856 >> 10.20.193.92:0/3770919856 conn(0x7f32000ec980 msgr2=0x7f320010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:50.543 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.538+0000 7f32070776c0 1 -- 10.20.193.92:0/3770919856 shutdown_connections 2026-02-13T04:00:50.543 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.538+0000 7f32070776c0 1 -- 10.20.193.92:0/3770919856 wait complete. 2026-02-13T04:00:50.544 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.539+0000 7f32070776c0 1 Processor -- start 2026-02-13T04:00:50.545 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.539+0000 7f32070776c0 1 -- start start 2026-02-13T04:00:50.545 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.539+0000 7f32070776c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f320010f060 0x7f320011ce30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:50.545 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.539+0000 7f32070776c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f3200115270 0x7f320011d370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:50.545 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.539+0000 7f32070776c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f3200122730 0x7f3200122bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:50.545 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.539+0000 7f32070776c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3200123140 con 0x7f320010f060 2026-02-13T04:00:50.545 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.539+0000 7f32070776c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f32001232b0 con 0x7f3200115270 2026-02-13T04:00:50.545 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.539+0000 7f32070776c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f3200123470 con 0x7f3200122730 2026-02-13T04:00:50.545 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.540+0000 7f32060756c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f320010f060 0x7f320011ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:50.545 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.540+0000 7f32060756c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f320010f060 0x7f320011ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:57094/0 (socket says 10.20.193.92:57094) 2026-02-13T04:00:50.545 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.540+0000 7f32060756c0 1 -- 10.20.193.92:0/694443299 learned_addr learned my addr 10.20.193.92:0/694443299 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:00:50.546 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.540+0000 7f32058746c0 1 --2- 10.20.193.92:0/694443299 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f3200115270 0x7f320011d370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:50.546 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.540+0000 7f32068766c0 1 --2- 10.20.193.92:0/694443299 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f3200122730 0x7f3200122bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:50.546 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.540+0000 7f32060756c0 1 -- 10.20.193.92:0/694443299 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f3200122730 msgr2=0x7f3200122bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:50.546 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.540+0000 7f32060756c0 1 --2- 10.20.193.92:0/694443299 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f3200122730 0x7f3200122bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:50.546 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.540+0000 7f32060756c0 1 -- 10.20.193.92:0/694443299 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f3200115270 msgr2=0x7f320011d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:50.546 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.540+0000 7f32060756c0 1 --2- 10.20.193.92:0/694443299 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f3200115270 0x7f320011d370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:50.546 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.540+0000 7f32060756c0 1 -- 10.20.193.92:0/694443299 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31f00094c0 con 0x7f320010f060 2026-02-13T04:00:50.546 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.540+0000 7f32060756c0 1 --2- 10.20.193.92:0/694443299 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f320010f060 0x7f320011ce30 secure :-1 s=READY pgs=176 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f31f0005980 tx=0x7f31f002f750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:50.546 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.540+0000 7f31e77fe6c0 1 -- 10.20.193.92:0/694443299 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f31f0005d50 con 0x7f320010f060 2026-02-13T04:00:50.546 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.540+0000 7f31e77fe6c0 1 -- 10.20.193.92:0/694443299 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f31f0031e40 con 0x7f320010f060 2026-02-13T04:00:50.546 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.540+0000 7f31e77fe6c0 1 -- 10.20.193.92:0/694443299 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f31f00073f0 con 0x7f320010f060 2026-02-13T04:00:50.546 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.540+0000 7f32070776c0 1 -- 10.20.193.92:0/694443299 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32001638c0 con 0x7f320010f060 2026-02-13T04:00:50.547 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.540+0000 7f32070776c0 1 -- 10.20.193.92:0/694443299 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3200062a80 con 0x7f320010f060 2026-02-13T04:00:50.547 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.541+0000 7f32070776c0 1 -- 10.20.193.92:0/694443299 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3200110330 con 0x7f320010f060 2026-02-13T04:00:50.547 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.543+0000 7f31e77fe6c0 1 -- 10.20.193.92:0/694443299 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f31f00026b0 con 0x7f320010f060 2026-02-13T04:00:50.548 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.545+0000 7f31e77fe6c0 1 --2- 10.20.193.92:0/694443299 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f31dc0b56d0 0x7f31dc0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:50.548 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.545+0000 7f31e77fe6c0 1 -- 10.20.193.92:0/694443299 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7f31f0107b50 con 0x7f320010f060 2026-02-13T04:00:50.548 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.545+0000 7f31e77fe6c0 1 -- 10.20.193.92:0/694443299 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f31f01405e0 con 0x7f320010f060 2026-02-13T04:00:50.548 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.545+0000 7f32058746c0 1 --2- 10.20.193.92:0/694443299 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f31dc0b56d0 0x7f31dc0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:50.549 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.546+0000 7f32058746c0 1 --2- 10.20.193.92:0/694443299 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f31dc0b56d0 0x7f31dc0d5b80 secure :-1 s=READY pgs=135 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32001237c0 tx=0x7f31f4009310 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:50.648 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.645+0000 7f32070776c0 1 -- 10.20.193.92:0/694443299 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f320010fa50 con 0x7f320010f060 2026-02-13T04:00:50.649 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.646+0000 7f31e77fe6c0 1 -- 10.20.193.92:0/694443299 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22330 (secure 0 0 0) 0x7f31f00ca600 con 0x7f320010f060 2026-02-13T04:00:50.650 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:00:50.650 INFO:teuthology.orchestra.run.trial092.stdout:{"epoch":76,"fsid":"1fefccae-0890-11f1-bcc5-d404e6e7d460","created":"2026-02-13T03:57:51.342799+0000","modified":"2026-02-13T04:00:50.465887+0000","last_up_change":"2026-02-13T04:00:28.570362+0000","last_in_change":"2026-02-13T04:00:20.284718+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T03:59:12.044389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-13T04:00:46.979064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-13T04:00:48.319223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8527c214-a46e-4505-b9a0-dc55e7cf6b55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6802","nonce":2375200644},{"type":"v1","addr":"10.20.193.92:6803","nonce":2375200644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6804","nonce":2375200644},{"type":"v1","addr":"10.20.193.92:6805","nonce":2375200644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6808","nonce":2375200644},{"type":"v1","addr":"10.20.193.92:6809","nonce":2375200644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6806","nonce":2375200644},{"type":"v1","addr":"10.20.193.92:6807","nonce":2375200644}]},"public_addr":"10.20.193.92:6803/2375200644","cluster_addr":"10.20.193.92:6805/2375200644","heartbeat_back_addr":"10.20.193.92:6809/2375200644","heartbeat_front_addr":"10.20.193.92:6807/2375200644","state":["exists","up"]},{"osd":1,"uuid":"253e5e0e-8571-4add-81e5-ca92934b8171","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6800","nonce":3943455734},{"type":"v1","addr":"10.20.193.99:6801","nonce":3943455734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6802","nonce":3943455734},{"type":"v1","addr":"10.20.193.99:6803","nonce":3943455734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6806","nonce":3943455734},{"type":"v1","addr":"10.20.193.99:6807","nonce":3943455734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6804","nonce":3943455734},{"type":"v1","addr":"10.20.193.99:6805","nonce":3943455734}]},"public_addr":"10.20.193.99:6801/3943455734","cluster_addr":"10.20.193.99:6803/3943455734","heartbeat_back_addr":"10.20.193.99:6807/3943455734","heartbeat_front_addr":"10.20.193.99:6805/3943455734","state":["exists","up"]},{"osd":2,"uuid":"e94c2f5c-ce8a-484e-9cf3-e436edc16bdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6800","nonce":676925869},{"type":"v1","addr":"10.20.193.158:6801","nonce":676925869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6802","nonce":676925869},{"type":"v1","addr":"10.20.193.158:6803","nonce":676925869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6806","nonce":676925869},{"type":"v1","addr":"10.20.193.158:6807","nonce":676925869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6804","nonce":676925869},{"type":"v1","addr":"10.20.193.158:6805","nonce":676925869}]},"public_addr":"10.20.193.158:6801/676925869","cluster_addr":"10.20.193.158:6803/676925869","heartbeat_back_addr":"10.20.193.158:6807/676925869","heartbeat_front_addr":"10.20.193.158:6805/676925869","state":["exists","up"]},{"osd":3,"uuid":"91080154-0bd8-4e06-832e-1590d7784229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6810","nonce":4168983230},{"type":"v1","addr":"10.20.193.92:6811","nonce":4168983230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6812","nonce":4168983230},{"type":"v1","addr":"10.20.193.92:6813","nonce":4168983230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6816","nonce":4168983230},{"type":"v1","addr":"10.20.193.92:6817","nonce":4168983230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6814","nonce":4168983230},{"type":"v1","addr":"10.20.193.92:6815","nonce":4168983230}]},"public_addr":"10.20.193.92:6811/4168983230","cluster_addr":"10.20.193.92:6813/4168983230","heartbeat_back_addr":"10.20.193.92:6817/4168983230","heartbeat_front_addr":"10.20.193.92:6815/4168983230","state":["exists","up"]},{"osd":4,"uuid":"fec31143-d966-4f9b-8021-73e24c1b4d32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6808","nonce":1135109881},{"type":"v1","addr":"10.20.193.99:6809","nonce":1135109881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6810","nonce":1135109881},{"type":"v1","addr":"10.20.193.99:6811","nonce":1135109881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6814","nonce":1135109881},{"type":"v1","addr":"10.20.193.99:6815","nonce":1135109881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6812","nonce":1135109881},{"type":"v1","addr":"10.20.193.99:6813","nonce":1135109881}]},"public_addr":"10.20.193.99:6809/1135109881","cluster_addr":"10.20.193.99:6811/1135109881","heartbeat_back_addr":"10.20.193.99:6815/1135109881","heartbeat_front_addr":"10.20.193.99:6813/1135109881","state":["exists","up"]},{"osd":5,"uuid":"fcb06e7c-2900-49d9-9b39-6521200cd89a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6808","nonce":428074602},{"type":"v1","addr":"10.20.193.158:6809","nonce":428074602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6810","nonce":428074602},{"type":"v1","addr":"10.20.193.158:6811","nonce":428074602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6814","nonce":428074602},{"type":"v1","addr":"10.20.193.158:6815","nonce":428074602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6812","nonce":428074602},{"type":"v1","addr":"10.20.193.158:6813","nonce":428074602}]},"public_addr":"10.20.193.158:6809/428074602","cluster_addr":"10.20.193.158:6811/428074602","heartbeat_back_addr":"10.20.193.158:6815/428074602","heartbeat_front_addr":"10.20.193.158:6813/428074602","state":["exists","up"]},{"osd":6,"uuid":"17251a9f-8203-4bdf-87c5-1bd31254f2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6818","nonce":1823230093},{"type":"v1","addr":"10.20.193.92:6819","nonce":1823230093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6820","nonce":1823230093},{"type":"v1","addr":"10.20.193.92:6821","nonce":1823230093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6824","nonce":1823230093},{"type":"v1","addr":"10.20.193.92:6825","nonce":1823230093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6822","nonce":1823230093},{"type":"v1","addr":"10.20.193.92:6823","nonce":1823230093}]},"public_addr":"10.20.193.92:6819/1823230093","cluster_addr":"10.20.193.92:6821/1823230093","heartbeat_back_addr":"10.20.193.92:6825/1823230093","heartbeat_front_addr":"10.20.193.92:6823/1823230093","state":["exists","up"]},{"osd":7,"uuid":"6775e50d-691e-472f-a99e-d6cd4786d4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6816","nonce":3951959773},{"type":"v1","addr":"10.20.193.99:6817","nonce":3951959773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6818","nonce":3951959773},{"type":"v1","addr":"10.20.193.99:6819","nonce":3951959773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6822","nonce":3951959773},{"type":"v1","addr":"10.20.193.99:6823","nonce":3951959773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6820","nonce":3951959773},{"type":"v1","addr":"10.20.193.99:6821","nonce":3951959773}]},"public_addr":"10.20.193.99:6817/3951959773","cluster_addr":"10.20.193.99:6819/3951959773","heartbeat_back_addr":"10.20.193.99:6823/3951959773","heartbeat_front_addr":"10.20.193.99:6821/3951959773","state":["exists","up"]},{"osd":8,"uuid":"a6be4612-8a0a-4590-95a9-82b973ad4c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6816","nonce":1505536261},{"type":"v1","addr":"10.20.193.158:6817","nonce":1505536261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6818","nonce":1505536261},{"type":"v1","addr":"10.20.193.158:6819","nonce":1505536261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6822","nonce":1505536261},{"type":"v1","addr":"10.20.193.158:6823","nonce":1505536261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6820","nonce":1505536261},{"type":"v1","addr":"10.20.193.158:6821","nonce":1505536261}]},"public_addr":"10.20.193.158:6817/1505536261","cluster_addr":"10.20.193.158:6819/1505536261","heartbeat_back_addr":"10.20.193.158:6823/1505536261","heartbeat_front_addr":"10.20.193.158:6821/1505536261","state":["exists","up"]},{"osd":9,"uuid":"b51a7c23-3bba-4404-8b3a-462a2870b83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6826","nonce":3596797929},{"type":"v1","addr":"10.20.193.92:6827","nonce":3596797929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6828","nonce":3596797929},{"type":"v1","addr":"10.20.193.92:6829","nonce":3596797929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6832","nonce":3596797929},{"type":"v1","addr":"10.20.193.92:6833","nonce":3596797929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6830","nonce":3596797929},{"type":"v1","addr":"10.20.193.92:6831","nonce":3596797929}]},"public_addr":"10.20.193.92:6827/3596797929","cluster_addr":"10.20.193.92:6829/3596797929","heartbeat_back_addr":"10.20.193.92:6833/3596797929","heartbeat_front_addr":"10.20.193.92:6831/3596797929","state":["exists","up"]},{"osd":10,"uuid":"dda9bd0a-0359-4889-ad2d-8da7602164cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6824","nonce":4260536068},{"type":"v1","addr":"10.20.193.99:6825","nonce":4260536068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6826","nonce":4260536068},{"type":"v1","addr":"10.20.193.99:6827","nonce":4260536068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6830","nonce":4260536068},{"type":"v1","addr":"10.20.193.99:6831","nonce":4260536068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6828","nonce":4260536068},{"type":"v1","addr":"10.20.193.99:6829","nonce":4260536068}]},"public_addr":"10.20.193.99:6825/4260536068","cluster_addr":"10.20.193.99:6827/4260536068","heartbeat_back_addr":"10.20.193.99:6831/4260536068","heartbeat_front_addr":"10.20.193.99:6829/4260536068","state":["exists","up"]},{"osd":11,"uuid":"8e78b081-0fe6-49a4-879b-094cfb14783c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6824","nonce":2019612524},{"type":"v1","addr":"10.20.193.158:6825","nonce":2019612524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6826","nonce":2019612524},{"type":"v1","addr":"10.20.193.158:6827","nonce":2019612524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6830","nonce":2019612524},{"type":"v1","addr":"10.20.193.158:6831","nonce":2019612524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6828","nonce":2019612524},{"type":"v1","addr":"10.20.193.158:6829","nonce":2019612524}]},"public_addr":"10.20.193.158:6825/2019612524","cluster_addr":"10.20.193.158:6827/2019612524","heartbeat_back_addr":"10.20.193.158:6831/2019612524","heartbeat_front_addr":"10.20.193.158:6829/2019612524","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:58:53.806082+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:59:01.539380+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:59:08.639667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:59:19.253252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:59:27.067122+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:59:34.359212+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:59:45.274527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:59:52.962680+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T04:00:00.299816+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T04:00:11.400008+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T04:00:19.328513+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T04:00:26.837283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.92:0/1237375916":"2026-02-14T03:58:33.822496+0000","10.20.193.92:6800/1986528669":"2026-02-14T03:58:33.822496+0000","10.20.193.92:0/1967601204":"2026-02-14T03:58:33.822496+0000","10.20.193.92:0/2687491302":"2026-02-14T03:57:59.617461+0000","10.20.193.92:6801/1986528669":"2026-02-14T03:58:33.822496+0000","10.20.193.92:0/3477507155":"2026-02-14T03:58:33.822496+0000","10.20.193.92:0/3506092440":"2026-02-14T03:57:59.617461+0000","10.20.193.92:6801/3709134212":"2026-02-14T03:57:59.617461+0000","10.20.193.92:6800/3709134212":"2026-02-14T03:57:59.617461+0000","10.20.193.92:0/1198638193":"2026-02-14T03:57:59.617461+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T04:00:50.651 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.647+0000 7f32070776c0 1 -- 10.20.193.92:0/694443299 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f31dc0b56d0 msgr2=0x7f31dc0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:50.651 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.647+0000 7f32070776c0 1 --2- 10.20.193.92:0/694443299 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f31dc0b56d0 0x7f31dc0d5b80 secure :-1 s=READY pgs=135 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32001237c0 tx=0x7f31f4009310 comp rx=0 tx=0).stop 2026-02-13T04:00:50.651 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.647+0000 7f32070776c0 1 -- 10.20.193.92:0/694443299 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f320010f060 msgr2=0x7f320011ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:50.651 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.647+0000 7f32070776c0 1 --2- 10.20.193.92:0/694443299 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f320010f060 0x7f320011ce30 secure :-1 s=READY pgs=176 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f31f0005980 tx=0x7f31f002f750 comp rx=0 tx=0).stop 2026-02-13T04:00:50.652 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.647+0000 7f32070776c0 1 -- 10.20.193.92:0/694443299 shutdown_connections 2026-02-13T04:00:50.652 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.647+0000 7f32070776c0 1 --2- 10.20.193.92:0/694443299 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f31dc0b56d0 0x7f31dc0d5b80 unknown :-1 s=CLOSED pgs=135 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:50.652 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.647+0000 7f32070776c0 1 --2- 10.20.193.92:0/694443299 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f3200115270 0x7f320011d370 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:50.652 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.647+0000 7f32070776c0 1 --2- 10.20.193.92:0/694443299 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f3200122730 0x7f3200122bd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:50.652 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.647+0000 7f32070776c0 1 --2- 10.20.193.92:0/694443299 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f320010f060 0x7f320011ce30 unknown :-1 s=CLOSED pgs=176 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:50.652 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.647+0000 7f32070776c0 1 -- 10.20.193.92:0/694443299 >> 10.20.193.92:0/694443299 conn(0x7f32000ec980 msgr2=0x7f320010cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:50.652 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.648+0000 7f32070776c0 1 -- 10.20.193.92:0/694443299 shutdown_connections 2026-02-13T04:00:50.652 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:50.648+0000 7f32070776c0 1 -- 10.20.193.92:0/694443299 wait complete. 2026-02-13T04:00:50.753 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T04:00:50.935 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:50 trial092 ceph-mon[23047]: pgmap v175: 97 pgs: 6 creating+peering, 87 unknown, 4 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T04:00:50.935 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:50 trial092 ceph-mon[23047]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2026-02-13T04:00:50.935 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:50 trial092 ceph-mon[23047]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2026-02-13T04:00:50.935 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:50 trial092 ceph-mon[23047]: daemon mds.b is now active in filesystem cephfs as rank 0 2026-02-13T04:00:50.935 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:50 trial092 ceph-mon[23047]: osdmap e76: 12 total, 12 up, 12 in 2026-02-13T04:00:50.935 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:50 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/694443299' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T04:00:50.937 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:00:51.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:50 trial158 ceph-mon[27763]: pgmap v175: 97 pgs: 6 creating+peering, 87 unknown, 4 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T04:00:51.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:50 trial158 ceph-mon[27763]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2026-02-13T04:00:51.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:50 trial158 ceph-mon[27763]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2026-02-13T04:00:51.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:50 trial158 ceph-mon[27763]: daemon mds.b is now active in filesystem cephfs as rank 0 2026-02-13T04:00:51.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:50 trial158 ceph-mon[27763]: osdmap e76: 12 total, 12 up, 12 in 2026-02-13T04:00:51.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:50 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/694443299' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T04:00:51.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:50 trial099 ceph-mon[27808]: pgmap v175: 97 pgs: 6 creating+peering, 87 unknown, 4 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail 2026-02-13T04:00:51.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:50 trial099 ceph-mon[27808]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2026-02-13T04:00:51.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:50 trial099 ceph-mon[27808]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2026-02-13T04:00:51.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:50 trial099 ceph-mon[27808]: daemon mds.b is now active in filesystem cephfs as rank 0 2026-02-13T04:00:51.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:50 trial099 ceph-mon[27808]: osdmap e76: 12 total, 12 up, 12 in 2026-02-13T04:00:51.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:50 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/694443299' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T04:00:51.139 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.136+0000 7f8c2a6966c0 1 -- 10.20.193.92:0/1993358993 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8c241199a0 msgr2=0x7f8c24116df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:51.139 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.136+0000 7f8c2a6966c0 1 --2- 10.20.193.92:0/1993358993 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8c241199a0 0x7f8c24116df0 secure :-1 s=READY pgs=84 gs=2 cs=0 l=1 c_cookie=16670206703615534797 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c20006fd0 tx=0x7f8c2002fd20 comp rx=0 tx=0).stop 2026-02-13T04:00:51.139 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.136+0000 7f8c2a6966c0 1 -- 10.20.193.92:0/1993358993 shutdown_connections 2026-02-13T04:00:51.139 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.136+0000 7f8c2a6966c0 1 --2- 10.20.193.92:0/1993358993 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8c241199a0 0x7f8c24116df0 unknown :-1 s=CLOSED pgs=84 gs=2 cs=0 l=1 c_cookie=16670206703615534797 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:51.140 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.136+0000 7f8c2a6966c0 1 --2- 10.20.193.92:0/1993358993 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8c24118f30 0x7f8c24119380 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:51.140 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.136+0000 7f8c2a6966c0 1 --2- 10.20.193.92:0/1993358993 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f8c2411b3f0 0x7f8c2411b7c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:51.140 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.136+0000 7f8c2a6966c0 1 -- 10.20.193.92:0/1993358993 >> 10.20.193.92:0/1993358993 conn(0x7f8c2405b290 msgr2=0x7f8c2405b690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:51.140 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.136+0000 7f8c2a6966c0 1 -- 10.20.193.92:0/1993358993 shutdown_connections 2026-02-13T04:00:51.140 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.136+0000 7f8c2a6966c0 1 -- 10.20.193.92:0/1993358993 wait complete. 2026-02-13T04:00:51.142 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.137+0000 7f8c2a6966c0 1 Processor -- start 2026-02-13T04:00:51.142 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.137+0000 7f8c2a6966c0 1 -- start start 2026-02-13T04:00:51.142 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.137+0000 7f8c2a6966c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f8c24118f30 0x7f8c240fda40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:51.142 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.137+0000 7f8c2a6966c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8c241199a0 0x7f8c240fdf80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:51.142 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.137+0000 7f8c2a6966c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8c2411b3f0 0x7f8c24103340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:51.142 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.137+0000 7f8c2a6966c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8c24103990 con 0x7f8c241199a0 2026-02-13T04:00:51.142 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.137+0000 7f8c2a6966c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8c24103b00 con 0x7f8c2411b3f0 2026-02-13T04:00:51.142 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.137+0000 7f8c2a6966c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f8c24103cc0 con 0x7f8c24118f30 2026-02-13T04:00:51.142 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.137+0000 7f8c28e936c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8c241199a0 0x7f8c240fdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:51.143 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.137+0000 7f8c29e956c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8c2411b3f0 0x7f8c24103340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:51.143 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.137+0000 7f8c28e936c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8c241199a0 0x7f8c240fdf80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:57114/0 (socket says 10.20.193.92:57114) 2026-02-13T04:00:51.143 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.137+0000 7f8c28e936c0 1 -- 10.20.193.92:0/4009125901 learned_addr learned my addr 10.20.193.92:0/4009125901 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:00:51.143 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.137+0000 7f8c296946c0 1 --2- 10.20.193.92:0/4009125901 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f8c24118f30 0x7f8c240fda40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:51.143 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.137+0000 7f8c28e936c0 1 -- 10.20.193.92:0/4009125901 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f8c24118f30 msgr2=0x7f8c240fda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:51.143 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.137+0000 7f8c28e936c0 1 --2- 10.20.193.92:0/4009125901 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f8c24118f30 0x7f8c240fda40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:51.143 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.137+0000 7f8c28e936c0 1 -- 10.20.193.92:0/4009125901 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8c2411b3f0 msgr2=0x7f8c24103340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:51.143 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.137+0000 7f8c28e936c0 1 --2- 10.20.193.92:0/4009125901 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8c2411b3f0 0x7f8c24103340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:51.143 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.137+0000 7f8c28e936c0 1 -- 10.20.193.92:0/4009125901 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c18009590 con 0x7f8c241199a0 2026-02-13T04:00:51.143 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.137+0000 7f8c28e936c0 1 --2- 10.20.193.92:0/4009125901 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8c241199a0 0x7f8c240fdf80 secure :-1 s=READY pgs=177 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c18004750 tx=0x7f8c1800be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:51.143 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.138+0000 7f8c127fc6c0 1 -- 10.20.193.92:0/4009125901 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8c180044a0 con 0x7f8c241199a0 2026-02-13T04:00:51.143 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.138+0000 7f8c127fc6c0 1 -- 10.20.193.92:0/4009125901 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f8c18009030 con 0x7f8c241199a0 2026-02-13T04:00:51.144 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.138+0000 7f8c127fc6c0 1 -- 10.20.193.92:0/4009125901 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8c18007440 con 0x7f8c241199a0 2026-02-13T04:00:51.144 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.138+0000 7f8c2a6966c0 1 -- 10.20.193.92:0/4009125901 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c2000a5b0 con 0x7f8c241199a0 2026-02-13T04:00:51.144 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.138+0000 7f8c2a6966c0 1 -- 10.20.193.92:0/4009125901 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c241044b0 con 0x7f8c241199a0 2026-02-13T04:00:51.144 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.139+0000 7f8c2a6966c0 1 -- 10.20.193.92:0/4009125901 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c2405e670 con 0x7f8c241199a0 2026-02-13T04:00:51.144 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.141+0000 7f8c127fc6c0 1 -- 10.20.193.92:0/4009125901 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f8c1800c690 con 0x7f8c241199a0 2026-02-13T04:00:51.145 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.142+0000 7f8c127fc6c0 1 --2- 10.20.193.92:0/4009125901 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f8c000b5650 0x7f8c000d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:51.146 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.142+0000 7f8c127fc6c0 1 -- 10.20.193.92:0/4009125901 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7f8c180e3cf0 con 0x7f8c241199a0 2026-02-13T04:00:51.146 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.142+0000 7f8c296946c0 1 --2- 10.20.193.92:0/4009125901 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f8c000b5650 0x7f8c000d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:51.146 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.143+0000 7f8c296946c0 1 --2- 10.20.193.92:0/4009125901 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f8c000b5650 0x7f8c000d5b00 secure :-1 s=READY pgs=136 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c14004750 tx=0x7f8c14009390 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:51.146 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.143+0000 7f8c127fc6c0 1 -- 10.20.193.92:0/4009125901 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f8c180a6830 con 0x7f8c241199a0 2026-02-13T04:00:51.246 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.243+0000 7f8c2a6966c0 1 -- 10.20.193.92:0/4009125901 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8c24103e80 con 0x7f8c241199a0 2026-02-13T04:00:51.247 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.244+0000 7f8c127fc6c0 1 -- 10.20.193.92:0/4009125901 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22330 (secure 0 0 0) 0x7f8c1800ce60 con 0x7f8c241199a0 2026-02-13T04:00:51.248 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:00:51.248 INFO:teuthology.orchestra.run.trial092.stdout:{"epoch":76,"fsid":"1fefccae-0890-11f1-bcc5-d404e6e7d460","created":"2026-02-13T03:57:51.342799+0000","modified":"2026-02-13T04:00:50.465887+0000","last_up_change":"2026-02-13T04:00:28.570362+0000","last_in_change":"2026-02-13T04:00:20.284718+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T03:59:12.044389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-13T04:00:46.979064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-13T04:00:48.319223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8527c214-a46e-4505-b9a0-dc55e7cf6b55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6802","nonce":2375200644},{"type":"v1","addr":"10.20.193.92:6803","nonce":2375200644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6804","nonce":2375200644},{"type":"v1","addr":"10.20.193.92:6805","nonce":2375200644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6808","nonce":2375200644},{"type":"v1","addr":"10.20.193.92:6809","nonce":2375200644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6806","nonce":2375200644},{"type":"v1","addr":"10.20.193.92:6807","nonce":2375200644}]},"public_addr":"10.20.193.92:6803/2375200644","cluster_addr":"10.20.193.92:6805/2375200644","heartbeat_back_addr":"10.20.193.92:6809/2375200644","heartbeat_front_addr":"10.20.193.92:6807/2375200644","state":["exists","up"]},{"osd":1,"uuid":"253e5e0e-8571-4add-81e5-ca92934b8171","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6800","nonce":3943455734},{"type":"v1","addr":"10.20.193.99:6801","nonce":3943455734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6802","nonce":3943455734},{"type":"v1","addr":"10.20.193.99:6803","nonce":3943455734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6806","nonce":3943455734},{"type":"v1","addr":"10.20.193.99:6807","nonce":3943455734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6804","nonce":3943455734},{"type":"v1","addr":"10.20.193.99:6805","nonce":3943455734}]},"public_addr":"10.20.193.99:6801/3943455734","cluster_addr":"10.20.193.99:6803/3943455734","heartbeat_back_addr":"10.20.193.99:6807/3943455734","heartbeat_front_addr":"10.20.193.99:6805/3943455734","state":["exists","up"]},{"osd":2,"uuid":"e94c2f5c-ce8a-484e-9cf3-e436edc16bdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6800","nonce":676925869},{"type":"v1","addr":"10.20.193.158:6801","nonce":676925869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6802","nonce":676925869},{"type":"v1","addr":"10.20.193.158:6803","nonce":676925869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6806","nonce":676925869},{"type":"v1","addr":"10.20.193.158:6807","nonce":676925869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6804","nonce":676925869},{"type":"v1","addr":"10.20.193.158:6805","nonce":676925869}]},"public_addr":"10.20.193.158:6801/676925869","cluster_addr":"10.20.193.158:6803/676925869","heartbeat_back_addr":"10.20.193.158:6807/676925869","heartbeat_front_addr":"10.20.193.158:6805/676925869","state":["exists","up"]},{"osd":3,"uuid":"91080154-0bd8-4e06-832e-1590d7784229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6810","nonce":4168983230},{"type":"v1","addr":"10.20.193.92:6811","nonce":4168983230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6812","nonce":4168983230},{"type":"v1","addr":"10.20.193.92:6813","nonce":4168983230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6816","nonce":4168983230},{"type":"v1","addr":"10.20.193.92:6817","nonce":4168983230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6814","nonce":4168983230},{"type":"v1","addr":"10.20.193.92:6815","nonce":4168983230}]},"public_addr":"10.20.193.92:6811/4168983230","cluster_addr":"10.20.193.92:6813/4168983230","heartbeat_back_addr":"10.20.193.92:6817/4168983230","heartbeat_front_addr":"10.20.193.92:6815/4168983230","state":["exists","up"]},{"osd":4,"uuid":"fec31143-d966-4f9b-8021-73e24c1b4d32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6808","nonce":1135109881},{"type":"v1","addr":"10.20.193.99:6809","nonce":1135109881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6810","nonce":1135109881},{"type":"v1","addr":"10.20.193.99:6811","nonce":1135109881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6814","nonce":1135109881},{"type":"v1","addr":"10.20.193.99:6815","nonce":1135109881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6812","nonce":1135109881},{"type":"v1","addr":"10.20.193.99:6813","nonce":1135109881}]},"public_addr":"10.20.193.99:6809/1135109881","cluster_addr":"10.20.193.99:6811/1135109881","heartbeat_back_addr":"10.20.193.99:6815/1135109881","heartbeat_front_addr":"10.20.193.99:6813/1135109881","state":["exists","up"]},{"osd":5,"uuid":"fcb06e7c-2900-49d9-9b39-6521200cd89a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6808","nonce":428074602},{"type":"v1","addr":"10.20.193.158:6809","nonce":428074602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6810","nonce":428074602},{"type":"v1","addr":"10.20.193.158:6811","nonce":428074602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6814","nonce":428074602},{"type":"v1","addr":"10.20.193.158:6815","nonce":428074602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6812","nonce":428074602},{"type":"v1","addr":"10.20.193.158:6813","nonce":428074602}]},"public_addr":"10.20.193.158:6809/428074602","cluster_addr":"10.20.193.158:6811/428074602","heartbeat_back_addr":"10.20.193.158:6815/428074602","heartbeat_front_addr":"10.20.193.158:6813/428074602","state":["exists","up"]},{"osd":6,"uuid":"17251a9f-8203-4bdf-87c5-1bd31254f2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6818","nonce":1823230093},{"type":"v1","addr":"10.20.193.92:6819","nonce":1823230093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6820","nonce":1823230093},{"type":"v1","addr":"10.20.193.92:6821","nonce":1823230093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6824","nonce":1823230093},{"type":"v1","addr":"10.20.193.92:6825","nonce":1823230093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6822","nonce":1823230093},{"type":"v1","addr":"10.20.193.92:6823","nonce":1823230093}]},"public_addr":"10.20.193.92:6819/1823230093","cluster_addr":"10.20.193.92:6821/1823230093","heartbeat_back_addr":"10.20.193.92:6825/1823230093","heartbeat_front_addr":"10.20.193.92:6823/1823230093","state":["exists","up"]},{"osd":7,"uuid":"6775e50d-691e-472f-a99e-d6cd4786d4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6816","nonce":3951959773},{"type":"v1","addr":"10.20.193.99:6817","nonce":3951959773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6818","nonce":3951959773},{"type":"v1","addr":"10.20.193.99:6819","nonce":3951959773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6822","nonce":3951959773},{"type":"v1","addr":"10.20.193.99:6823","nonce":3951959773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6820","nonce":3951959773},{"type":"v1","addr":"10.20.193.99:6821","nonce":3951959773}]},"public_addr":"10.20.193.99:6817/3951959773","cluster_addr":"10.20.193.99:6819/3951959773","heartbeat_back_addr":"10.20.193.99:6823/3951959773","heartbeat_front_addr":"10.20.193.99:6821/3951959773","state":["exists","up"]},{"osd":8,"uuid":"a6be4612-8a0a-4590-95a9-82b973ad4c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6816","nonce":1505536261},{"type":"v1","addr":"10.20.193.158:6817","nonce":1505536261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6818","nonce":1505536261},{"type":"v1","addr":"10.20.193.158:6819","nonce":1505536261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6822","nonce":1505536261},{"type":"v1","addr":"10.20.193.158:6823","nonce":1505536261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6820","nonce":1505536261},{"type":"v1","addr":"10.20.193.158:6821","nonce":1505536261}]},"public_addr":"10.20.193.158:6817/1505536261","cluster_addr":"10.20.193.158:6819/1505536261","heartbeat_back_addr":"10.20.193.158:6823/1505536261","heartbeat_front_addr":"10.20.193.158:6821/1505536261","state":["exists","up"]},{"osd":9,"uuid":"b51a7c23-3bba-4404-8b3a-462a2870b83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6826","nonce":3596797929},{"type":"v1","addr":"10.20.193.92:6827","nonce":3596797929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6828","nonce":3596797929},{"type":"v1","addr":"10.20.193.92:6829","nonce":3596797929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6832","nonce":3596797929},{"type":"v1","addr":"10.20.193.92:6833","nonce":3596797929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6830","nonce":3596797929},{"type":"v1","addr":"10.20.193.92:6831","nonce":3596797929}]},"public_addr":"10.20.193.92:6827/3596797929","cluster_addr":"10.20.193.92:6829/3596797929","heartbeat_back_addr":"10.20.193.92:6833/3596797929","heartbeat_front_addr":"10.20.193.92:6831/3596797929","state":["exists","up"]},{"osd":10,"uuid":"dda9bd0a-0359-4889-ad2d-8da7602164cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6824","nonce":4260536068},{"type":"v1","addr":"10.20.193.99:6825","nonce":4260536068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6826","nonce":4260536068},{"type":"v1","addr":"10.20.193.99:6827","nonce":4260536068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6830","nonce":4260536068},{"type":"v1","addr":"10.20.193.99:6831","nonce":4260536068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6828","nonce":4260536068},{"type":"v1","addr":"10.20.193.99:6829","nonce":4260536068}]},"public_addr":"10.20.193.99:6825/4260536068","cluster_addr":"10.20.193.99:6827/4260536068","heartbeat_back_addr":"10.20.193.99:6831/4260536068","heartbeat_front_addr":"10.20.193.99:6829/4260536068","state":["exists","up"]},{"osd":11,"uuid":"8e78b081-0fe6-49a4-879b-094cfb14783c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6824","nonce":2019612524},{"type":"v1","addr":"10.20.193.158:6825","nonce":2019612524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6826","nonce":2019612524},{"type":"v1","addr":"10.20.193.158:6827","nonce":2019612524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6830","nonce":2019612524},{"type":"v1","addr":"10.20.193.158:6831","nonce":2019612524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6828","nonce":2019612524},{"type":"v1","addr":"10.20.193.158:6829","nonce":2019612524}]},"public_addr":"10.20.193.158:6825/2019612524","cluster_addr":"10.20.193.158:6827/2019612524","heartbeat_back_addr":"10.20.193.158:6831/2019612524","heartbeat_front_addr":"10.20.193.158:6829/2019612524","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:58:53.806082+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:59:01.539380+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:59:08.639667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:59:19.253252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:59:27.067122+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:59:34.359212+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:59:45.274527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:59:52.962680+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T04:00:00.299816+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T04:00:11.400008+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T04:00:19.328513+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T04:00:26.837283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.92:0/1237375916":"2026-02-14T03:58:33.822496+0000","10.20.193.92:6800/1986528669":"2026-02-14T03:58:33.822496+0000","10.20.193.92:0/1967601204":"2026-02-14T03:58:33.822496+0000","10.20.193.92:0/2687491302":"2026-02-14T03:57:59.617461+0000","10.20.193.92:6801/1986528669":"2026-02-14T03:58:33.822496+0000","10.20.193.92:0/3477507155":"2026-02-14T03:58:33.822496+0000","10.20.193.92:0/3506092440":"2026-02-14T03:57:59.617461+0000","10.20.193.92:6801/3709134212":"2026-02-14T03:57:59.617461+0000","10.20.193.92:6800/3709134212":"2026-02-14T03:57:59.617461+0000","10.20.193.92:0/1198638193":"2026-02-14T03:57:59.617461+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T04:00:51.249 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.245+0000 7f8c2a6966c0 1 -- 10.20.193.92:0/4009125901 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f8c000b5650 msgr2=0x7f8c000d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:51.249 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.245+0000 7f8c2a6966c0 1 --2- 10.20.193.92:0/4009125901 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f8c000b5650 0x7f8c000d5b00 secure :-1 s=READY pgs=136 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c14004750 tx=0x7f8c14009390 comp rx=0 tx=0).stop 2026-02-13T04:00:51.249 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.245+0000 7f8c2a6966c0 1 -- 10.20.193.92:0/4009125901 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8c241199a0 msgr2=0x7f8c240fdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:51.249 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.245+0000 7f8c2a6966c0 1 --2- 10.20.193.92:0/4009125901 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8c241199a0 0x7f8c240fdf80 secure :-1 s=READY pgs=177 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8c18004750 tx=0x7f8c1800be00 comp rx=0 tx=0).stop 2026-02-13T04:00:51.249 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.245+0000 7f8c2a6966c0 1 -- 10.20.193.92:0/4009125901 shutdown_connections 2026-02-13T04:00:51.249 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.245+0000 7f8c2a6966c0 1 --2- 10.20.193.92:0/4009125901 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f8c000b5650 0x7f8c000d5b00 unknown :-1 s=CLOSED pgs=136 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:51.249 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.245+0000 7f8c2a6966c0 1 --2- 10.20.193.92:0/4009125901 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8c2411b3f0 0x7f8c24103340 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:51.250 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.245+0000 7f8c2a6966c0 1 --2- 10.20.193.92:0/4009125901 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8c241199a0 0x7f8c240fdf80 unknown :-1 s=CLOSED pgs=177 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:51.250 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.245+0000 7f8c2a6966c0 1 --2- 10.20.193.92:0/4009125901 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f8c24118f30 0x7f8c240fda40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:51.250 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.245+0000 7f8c2a6966c0 1 -- 10.20.193.92:0/4009125901 >> 10.20.193.92:0/4009125901 conn(0x7f8c2405b290 msgr2=0x7f8c240f82e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:51.250 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.245+0000 7f8c2a6966c0 1 -- 10.20.193.92:0/4009125901 shutdown_connections 2026-02-13T04:00:51.250 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.245+0000 7f8c2a6966c0 1 -- 10.20.193.92:0/4009125901 wait complete. 2026-02-13T04:00:51.352 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph fs set cephfs standby_count_wanted 0 2026-02-13T04:00:51.535 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:00:51.727 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.724+0000 7ff4950a76c0 1 -- 10.20.193.92:0/1625828865 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff49010fa50 msgr2=0x7ff490114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:51.727 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.724+0000 7ff4950a76c0 1 --2- 10.20.193.92:0/1625828865 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff49010fa50 0x7ff490114a90 secure :-1 s=READY pgs=85 gs=1 cs=0 l=1 c_cookie=3684901291052014884 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff480009970 tx=0x7ff48002ed10 comp rx=0 tx=0).stop 2026-02-13T04:00:51.728 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.724+0000 7ff4950a76c0 1 -- 10.20.193.92:0/1625828865 shutdown_connections 2026-02-13T04:00:51.728 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.724+0000 7ff4950a76c0 1 --2- 10.20.193.92:0/1625828865 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff49010fa50 0x7ff490114a90 unknown :-1 s=CLOSED pgs=85 gs=1 cs=0 l=1 c_cookie=3684901291052014884 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:51.728 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.724+0000 7ff4950a76c0 1 --2- 10.20.193.92:0/1625828865 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff490115270 0x7ff490175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:51.728 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.724+0000 7ff4950a76c0 1 --2- 10.20.193.92:0/1625828865 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff49010f060 0x7ff49010f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:51.728 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.724+0000 7ff4950a76c0 1 -- 10.20.193.92:0/1625828865 >> 10.20.193.92:0/1625828865 conn(0x7ff4900ec980 msgr2=0x7ff49010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:51.728 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.724+0000 7ff4950a76c0 1 -- 10.20.193.92:0/1625828865 shutdown_connections 2026-02-13T04:00:51.730 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.725+0000 7ff4950a76c0 1 -- 10.20.193.92:0/1625828865 wait complete. 2026-02-13T04:00:51.730 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.725+0000 7ff4950a76c0 1 Processor -- start 2026-02-13T04:00:51.730 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.726+0000 7ff4950a76c0 1 -- start start 2026-02-13T04:00:51.730 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.726+0000 7ff4950a76c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff49010f060 0x7ff49011ce90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:51.730 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.726+0000 7ff4950a76c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff490115270 0x7ff49011d3d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:51.730 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.726+0000 7ff4950a76c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff490122790 0x7ff490122c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:51.730 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.726+0000 7ff4950a76c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff4901231a0 con 0x7ff490122790 2026-02-13T04:00:51.731 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.726+0000 7ff4950a76c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff490123310 con 0x7ff49010f060 2026-02-13T04:00:51.731 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.726+0000 7ff4950a76c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7ff4901234d0 con 0x7ff490115270 2026-02-13T04:00:51.731 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.726+0000 7ff48f7fe6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff490115270 0x7ff49011d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:51.731 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.726+0000 7ff48ffff6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff49010f060 0x7ff49011ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:51.731 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.726+0000 7ff48f7fe6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff490115270 0x7ff49011d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:40374/0 (socket says 10.20.193.92:40374) 2026-02-13T04:00:51.731 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.726+0000 7ff48f7fe6c0 1 -- 10.20.193.92:0/1849197178 learned_addr learned my addr 10.20.193.92:0/1849197178 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:00:51.731 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.726+0000 7ff4948a66c0 1 --2- 10.20.193.92:0/1849197178 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff490122790 0x7ff490122c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:51.731 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.726+0000 7ff48f7fe6c0 1 -- 10.20.193.92:0/1849197178 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff49010f060 msgr2=0x7ff49011ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:51.731 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.726+0000 7ff48f7fe6c0 1 --2- 10.20.193.92:0/1849197178 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff49010f060 0x7ff49011ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:51.731 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.726+0000 7ff48f7fe6c0 1 -- 10.20.193.92:0/1849197178 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff490122790 msgr2=0x7ff490122c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:51.731 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.726+0000 7ff48f7fe6c0 1 --2- 10.20.193.92:0/1849197178 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff490122790 0x7ff490122c30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:51.731 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.726+0000 7ff48f7fe6c0 1 -- 10.20.193.92:0/1849197178 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff48400a5b0 con 0x7ff490115270 2026-02-13T04:00:51.732 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.726+0000 7ff4948a66c0 1 --2- 10.20.193.92:0/1849197178 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff490122790 0x7ff490122c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T04:00:51.732 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.726+0000 7ff48ffff6c0 1 --2- 10.20.193.92:0/1849197178 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff49010f060 0x7ff49011ce90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T04:00:51.732 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.727+0000 7ff48f7fe6c0 1 --2- 10.20.193.92:0/1849197178 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff490115270 0x7ff49011d3d0 secure :-1 s=READY pgs=82 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4800092e0 tx=0x7ff48002f820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:51.732 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.727+0000 7ff48d7fa6c0 1 -- 10.20.193.92:0/1849197178 <== mon.1 v2:10.20.193.158:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff480002ae0 con 0x7ff490115270 2026-02-13T04:00:51.732 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.727+0000 7ff4950a76c0 1 -- 10.20.193.92:0/1849197178 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff480009590 con 0x7ff490115270 2026-02-13T04:00:51.732 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.727+0000 7ff48d7fa6c0 1 -- 10.20.193.92:0/1849197178 <== mon.1 v2:10.20.193.158:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7ff48002fa10 con 0x7ff490115270 2026-02-13T04:00:51.732 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.727+0000 7ff48d7fa6c0 1 -- 10.20.193.92:0/1849197178 <== mon.1 v2:10.20.193.158:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff4800373b0 con 0x7ff490115270 2026-02-13T04:00:51.732 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.727+0000 7ff4950a76c0 1 -- 10.20.193.92:0/1849197178 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff490163be0 con 0x7ff490115270 2026-02-13T04:00:51.733 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.727+0000 7ff4950a76c0 1 -- 10.20.193.92:0/1849197178 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff490110330 con 0x7ff490115270 2026-02-13T04:00:51.733 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.730+0000 7ff48d7fa6c0 1 -- 10.20.193.92:0/1849197178 <== mon.1 v2:10.20.193.158:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7ff480002c40 con 0x7ff490115270 2026-02-13T04:00:51.734 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.731+0000 7ff48d7fa6c0 1 --2- 10.20.193.92:0/1849197178 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff4640b5650 0x7ff4640d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:51.734 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.732+0000 7ff48d7fa6c0 1 -- 10.20.193.92:0/1849197178 <== mon.1 v2:10.20.193.158:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7ff480107b50 con 0x7ff490115270 2026-02-13T04:00:51.735 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.732+0000 7ff48d7fa6c0 1 -- 10.20.193.92:0/1849197178 <== mon.1 v2:10.20.193.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff4801405e0 con 0x7ff490115270 2026-02-13T04:00:51.735 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.732+0000 7ff48ffff6c0 1 --2- 10.20.193.92:0/1849197178 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff4640b5650 0x7ff4640d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:51.735 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.732+0000 7ff48ffff6c0 1 --2- 10.20.193.92:0/1849197178 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff4640b5650 0x7ff4640d5b00 secure :-1 s=READY pgs=137 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff47c004750 tx=0x7ff47c009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:51.858 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:51.855+0000 7ff4950a76c0 1 -- 10.20.193.92:0/1849197178 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ff49010f430 con 0x7ff490115270 2026-02-13T04:00:52.046 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.043+0000 7ff48d7fa6c0 1 -- 10.20.193.92:0/1849197178 <== mon.1 v2:10.20.193.158:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7ff4800ca600 con 0x7ff490115270 2026-02-13T04:00:52.048 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.045+0000 7ff4950a76c0 1 -- 10.20.193.92:0/1849197178 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff4640b5650 msgr2=0x7ff4640d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:52.048 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.045+0000 7ff4950a76c0 1 --2- 10.20.193.92:0/1849197178 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff4640b5650 0x7ff4640d5b00 secure :-1 s=READY pgs=137 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff47c004750 tx=0x7ff47c009260 comp rx=0 tx=0).stop 2026-02-13T04:00:52.048 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.045+0000 7ff4950a76c0 1 -- 10.20.193.92:0/1849197178 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff490115270 msgr2=0x7ff49011d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:52.049 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.045+0000 7ff4950a76c0 1 --2- 10.20.193.92:0/1849197178 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff490115270 0x7ff49011d3d0 secure :-1 s=READY pgs=82 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4800092e0 tx=0x7ff48002f820 comp rx=0 tx=0).stop 2026-02-13T04:00:52.049 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.045+0000 7ff4950a76c0 1 -- 10.20.193.92:0/1849197178 shutdown_connections 2026-02-13T04:00:52.049 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.045+0000 7ff4950a76c0 1 --2- 10.20.193.92:0/1849197178 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff490122790 0x7ff490122c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:52.049 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.045+0000 7ff4950a76c0 1 --2- 10.20.193.92:0/1849197178 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff490115270 0x7ff49011d3d0 unknown :-1 s=CLOSED pgs=82 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:52.049 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.045+0000 7ff4950a76c0 1 --2- 10.20.193.92:0/1849197178 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff4640b5650 0x7ff4640d5b00 unknown :-1 s=CLOSED pgs=137 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:52.049 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.045+0000 7ff4950a76c0 1 --2- 10.20.193.92:0/1849197178 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff49010f060 0x7ff49011ce90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:52.049 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.045+0000 7ff4950a76c0 1 -- 10.20.193.92:0/1849197178 >> 10.20.193.92:0/1849197178 conn(0x7ff4900ec980 msgr2=0x7ff49010cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:52.049 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.045+0000 7ff4950a76c0 1 -- 10.20.193.92:0/1849197178 shutdown_connections 2026-02-13T04:00:52.049 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.045+0000 7ff4950a76c0 1 -- 10.20.193.92:0/1849197178 wait complete. 2026-02-13T04:00:52.122 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:52 trial092 ceph-mon[23047]: mds.? [v2:10.20.193.99:6838/147734840,v1:10.20.193.99:6839/147734840] up:active 2026-02-13T04:00:52.122 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:52 trial092 ceph-mon[23047]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T04:00:52.122 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:52 trial092 ceph-mon[23047]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T04:00:52.122 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:52 trial092 ceph-mon[23047]: pgmap v178: 97 pgs: 6 creating+peering, 41 unknown, 50 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 601 B/s wr, 1 op/s 2026-02-13T04:00:52.122 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:52 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/4009125901' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T04:00:52.122 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:52 trial092 ceph-mon[23047]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2026-02-13T04:00:52.123 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:52 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1849197178' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2026-02-13T04:00:52.152 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd', 'disabled'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2026-02-13T04:00:52.152 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph fs set cephfs max_mds 5 --yes-i-really-mean-it 2026-02-13T04:00:52.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:52 trial158 ceph-mon[27763]: mds.? [v2:10.20.193.99:6838/147734840,v1:10.20.193.99:6839/147734840] up:active 2026-02-13T04:00:52.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:52 trial158 ceph-mon[27763]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T04:00:52.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:52 trial158 ceph-mon[27763]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T04:00:52.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:52 trial158 ceph-mon[27763]: pgmap v178: 97 pgs: 6 creating+peering, 41 unknown, 50 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 601 B/s wr, 1 op/s 2026-02-13T04:00:52.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:52 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/4009125901' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T04:00:52.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:52 trial158 ceph-mon[27763]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2026-02-13T04:00:52.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:52 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/1849197178' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2026-02-13T04:00:52.335 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:00:52.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:52 trial099 ceph-mon[27808]: mds.? [v2:10.20.193.99:6838/147734840,v1:10.20.193.99:6839/147734840] up:active 2026-02-13T04:00:52.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:52 trial099 ceph-mon[27808]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T04:00:52.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:52 trial099 ceph-mon[27808]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T04:00:52.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:52 trial099 ceph-mon[27808]: pgmap v178: 97 pgs: 6 creating+peering, 41 unknown, 50 active+clean; 577 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 601 B/s wr, 1 op/s 2026-02-13T04:00:52.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:52 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/4009125901' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T04:00:52.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:52 trial099 ceph-mon[27808]: from='client.? ' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2026-02-13T04:00:52.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:52 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/1849197178' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2026-02-13T04:00:52.530 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.527+0000 7efe6b5776c0 1 -- 10.20.193.92:0/4049488410 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7efe6c10f060 msgr2=0x7efe6c10f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:52.530 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.527+0000 7efe6b5776c0 1 --2- 10.20.193.92:0/4049488410 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7efe6c10f060 0x7efe6c10f430 secure :-1 s=READY pgs=86 gs=2 cs=0 l=1 c_cookie=13833614279990210383 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe60009970 tx=0x7efe6002ed50 comp rx=0 tx=0).stop 2026-02-13T04:00:52.530 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.527+0000 7efe6b5776c0 1 -- 10.20.193.92:0/4049488410 shutdown_connections 2026-02-13T04:00:52.530 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.527+0000 7efe6b5776c0 1 --2- 10.20.193.92:0/4049488410 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7efe6c115270 0x7efe6c175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:52.530 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.527+0000 7efe6b5776c0 1 --2- 10.20.193.92:0/4049488410 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efe6c10fa50 0x7efe6c114a90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:52.530 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.527+0000 7efe6b5776c0 1 --2- 10.20.193.92:0/4049488410 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7efe6c10f060 0x7efe6c10f430 unknown :-1 s=CLOSED pgs=86 gs=2 cs=0 l=1 c_cookie=13833614279990210383 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:52.530 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.527+0000 7efe6b5776c0 1 -- 10.20.193.92:0/4049488410 >> 10.20.193.92:0/4049488410 conn(0x7efe6c0ec980 msgr2=0x7efe6c10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:52.530 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.527+0000 7efe6b5776c0 1 -- 10.20.193.92:0/4049488410 shutdown_connections 2026-02-13T04:00:52.530 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.527+0000 7efe6b5776c0 1 -- 10.20.193.92:0/4049488410 wait complete. 2026-02-13T04:00:52.530 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.528+0000 7efe6b5776c0 1 Processor -- start 2026-02-13T04:00:52.530 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.528+0000 7efe6b5776c0 1 -- start start 2026-02-13T04:00:52.531 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.528+0000 7efe6b5776c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efe6c10f060 0x7efe6c11cd40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:52.531 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.528+0000 7efe6b5776c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7efe6c115270 0x7efe6c11d280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:52.531 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.528+0000 7efe6b5776c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7efe6c122640 0x7efe6c122ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:52.531 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.528+0000 7efe6b5776c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7efe6c123050 con 0x7efe6c10f060 2026-02-13T04:00:52.531 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.528+0000 7efe6b5776c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7efe6c1231c0 con 0x7efe6c115270 2026-02-13T04:00:52.531 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.528+0000 7efe6b5776c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7efe6c123380 con 0x7efe6c122640 2026-02-13T04:00:52.531 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.528+0000 7efe6a5756c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efe6c10f060 0x7efe6c11cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:52.531 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.528+0000 7efe6a5756c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efe6c10f060 0x7efe6c11cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:57148/0 (socket says 10.20.193.92:57148) 2026-02-13T04:00:52.531 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.528+0000 7efe6a5756c0 1 -- 10.20.193.92:0/3068803487 learned_addr learned my addr 10.20.193.92:0/3068803487 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:00:52.531 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.528+0000 7efe69d746c0 1 --2- 10.20.193.92:0/3068803487 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7efe6c115270 0x7efe6c11d280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:52.531 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.528+0000 7efe6ad766c0 1 --2- 10.20.193.92:0/3068803487 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7efe6c122640 0x7efe6c122ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:52.531 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.529+0000 7efe6a5756c0 1 -- 10.20.193.92:0/3068803487 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7efe6c122640 msgr2=0x7efe6c122ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:52.531 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.529+0000 7efe6a5756c0 1 --2- 10.20.193.92:0/3068803487 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7efe6c122640 0x7efe6c122ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:52.531 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.529+0000 7efe6a5756c0 1 -- 10.20.193.92:0/3068803487 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7efe6c115270 msgr2=0x7efe6c11d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:52.531 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.529+0000 7efe6a5756c0 1 --2- 10.20.193.92:0/3068803487 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7efe6c115270 0x7efe6c11d280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:52.531 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.529+0000 7efe6a5756c0 1 -- 10.20.193.92:0/3068803487 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe60009590 con 0x7efe6c10f060 2026-02-13T04:00:52.531 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.529+0000 7efe6a5756c0 1 --2- 10.20.193.92:0/3068803487 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efe6c10f060 0x7efe6c11cd40 secure :-1 s=READY pgs=178 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe60005980 tx=0x7efe6002f820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:52.532 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.529+0000 7efe537fe6c0 1 -- 10.20.193.92:0/3068803487 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efe60002ae0 con 0x7efe6c10f060 2026-02-13T04:00:52.532 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.529+0000 7efe537fe6c0 1 -- 10.20.193.92:0/3068803487 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7efe6002fa10 con 0x7efe6c10f060 2026-02-13T04:00:52.532 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.529+0000 7efe537fe6c0 1 -- 10.20.193.92:0/3068803487 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efe60038380 con 0x7efe6c10f060 2026-02-13T04:00:52.532 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.529+0000 7efe6b5776c0 1 -- 10.20.193.92:0/3068803487 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe6c1637d0 con 0x7efe6c10f060 2026-02-13T04:00:52.532 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.529+0000 7efe6b5776c0 1 -- 10.20.193.92:0/3068803487 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe6c163c00 con 0x7efe6c10f060 2026-02-13T04:00:52.533 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.530+0000 7efe6b5776c0 1 -- 10.20.193.92:0/3068803487 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe6c110330 con 0x7efe6c10f060 2026-02-13T04:00:52.535 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.532+0000 7efe537fe6c0 1 -- 10.20.193.92:0/3068803487 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7efe60002c40 con 0x7efe6c10f060 2026-02-13T04:00:52.536 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.534+0000 7efe537fe6c0 1 --2- 10.20.193.92:0/3068803487 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7efe440b5750 0x7efe440d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:52.536 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.534+0000 7efe537fe6c0 1 -- 10.20.193.92:0/3068803487 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7efe60107a80 con 0x7efe6c10f060 2026-02-13T04:00:52.536 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.534+0000 7efe537fe6c0 1 -- 10.20.193.92:0/3068803487 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7efe601405e0 con 0x7efe6c10f060 2026-02-13T04:00:52.537 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.534+0000 7efe69d746c0 1 --2- 10.20.193.92:0/3068803487 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7efe440b5750 0x7efe440d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:52.537 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.534+0000 7efe69d746c0 1 --2- 10.20.193.92:0/3068803487 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7efe440b5750 0x7efe440d5c00 secure :-1 s=READY pgs=138 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe6c1236d0 tx=0x7efe54009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:52.660 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:52.657+0000 7efe6b5776c0 1 -- 10.20.193.92:0/3068803487 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5", "yes_i_really_mean_it": true} v 0) -- 0x7efe6c10f430 con 0x7efe6c10f060 2026-02-13T04:00:53.051 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.048+0000 7efe537fe6c0 1 -- 10.20.193.92:0/3068803487 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5", "yes_i_really_mean_it": true}]=0 v17) ==== 135+0+0 (secure 0 0 0) 0x7efe600ca530 con 0x7efe6c10f060 2026-02-13T04:00:53.054 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.050+0000 7efe6b5776c0 1 -- 10.20.193.92:0/3068803487 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7efe440b5750 msgr2=0x7efe440d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:53.054 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.050+0000 7efe6b5776c0 1 --2- 10.20.193.92:0/3068803487 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7efe440b5750 0x7efe440d5c00 secure :-1 s=READY pgs=138 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe6c1236d0 tx=0x7efe54009260 comp rx=0 tx=0).stop 2026-02-13T04:00:53.054 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.050+0000 7efe6b5776c0 1 -- 10.20.193.92:0/3068803487 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efe6c10f060 msgr2=0x7efe6c11cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:53.054 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.050+0000 7efe6b5776c0 1 --2- 10.20.193.92:0/3068803487 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efe6c10f060 0x7efe6c11cd40 secure :-1 s=READY pgs=178 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe60005980 tx=0x7efe6002f820 comp rx=0 tx=0).stop 2026-02-13T04:00:53.054 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.051+0000 7efe6b5776c0 1 -- 10.20.193.92:0/3068803487 shutdown_connections 2026-02-13T04:00:53.054 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.051+0000 7efe6b5776c0 1 --2- 10.20.193.92:0/3068803487 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7efe440b5750 0x7efe440d5c00 unknown :-1 s=CLOSED pgs=138 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:53.054 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.051+0000 7efe6b5776c0 1 --2- 10.20.193.92:0/3068803487 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7efe6c115270 0x7efe6c11d280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:53.054 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.051+0000 7efe6b5776c0 1 --2- 10.20.193.92:0/3068803487 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7efe6c122640 0x7efe6c122ae0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:53.055 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.051+0000 7efe6b5776c0 1 --2- 10.20.193.92:0/3068803487 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efe6c10f060 0x7efe6c11cd40 unknown :-1 s=CLOSED pgs=178 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:53.055 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.051+0000 7efe6b5776c0 1 -- 10.20.193.92:0/3068803487 >> 10.20.193.92:0/3068803487 conn(0x7efe6c0ec980 msgr2=0x7efe6c10cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:53.055 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.051+0000 7efe6b5776c0 1 -- 10.20.193.92:0/3068803487 shutdown_connections 2026-02-13T04:00:53.055 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.051+0000 7efe6b5776c0 1 -- 10.20.193.92:0/3068803487 wait complete. 2026-02-13T04:00:53.156 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph fs set cephfs allow_standby_replay true 2026-02-13T04:00:53.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:53 trial158 ceph-mon[27763]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2026-02-13T04:00:53.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:53 trial158 ceph-mon[27763]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T04:00:53.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:53 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/3068803487' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5", "yes_i_really_mean_it": true} : dispatch 2026-02-13T04:00:53.338 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:00:53.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:53 trial099 ceph-mon[27808]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2026-02-13T04:00:53.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:53 trial099 ceph-mon[27808]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T04:00:53.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:53 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/3068803487' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5", "yes_i_really_mean_it": true} : dispatch 2026-02-13T04:00:53.381 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:53 trial092 ceph-mon[23047]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2026-02-13T04:00:53.381 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:53 trial092 ceph-mon[23047]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T04:00:53.381 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:53 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/3068803487' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5", "yes_i_really_mean_it": true} : dispatch 2026-02-13T04:00:53.531 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.528+0000 7f90f655e6c0 1 -- 10.20.193.92:0/3338132203 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f90f0114190 msgr2=0x7f90f0115d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:53.531 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.528+0000 7f90f655e6c0 1 --2- 10.20.193.92:0/3338132203 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f90f0114190 0x7f90f0115d40 secure :-1 s=READY pgs=179 gs=1 cs=0 l=1 c_cookie=9132018555146444367 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90e40099a0 tx=0x7f90e402ed50 comp rx=0 tx=0).stop 2026-02-13T04:00:53.531 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.528+0000 7f90f655e6c0 1 -- 10.20.193.92:0/3338132203 shutdown_connections 2026-02-13T04:00:53.532 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.528+0000 7f90f655e6c0 1 --2- 10.20.193.92:0/3338132203 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f90f0116520 0x7f90f017a100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:53.532 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.528+0000 7f90f655e6c0 1 --2- 10.20.193.92:0/3338132203 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f90f0114190 0x7f90f0115d40 unknown :-1 s=CLOSED pgs=179 gs=1 cs=0 l=1 c_cookie=9132018555146444367 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:53.532 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.528+0000 7f90f655e6c0 1 --2- 10.20.193.92:0/3338132203 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f90f01137a0 0x7f90f0113b70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:53.532 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.528+0000 7f90f655e6c0 1 -- 10.20.193.92:0/3338132203 >> 10.20.193.92:0/3338132203 conn(0x7f90f0061510 msgr2=0x7f90f0061910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:53.532 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.528+0000 7f90f655e6c0 1 -- 10.20.193.92:0/3338132203 shutdown_connections 2026-02-13T04:00:53.534 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.529+0000 7f90f655e6c0 1 -- 10.20.193.92:0/3338132203 wait complete. 2026-02-13T04:00:53.534 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.529+0000 7f90f655e6c0 1 Processor -- start 2026-02-13T04:00:53.534 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.529+0000 7f90f655e6c0 1 -- start start 2026-02-13T04:00:53.534 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.530+0000 7f90f655e6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f90f01137a0 0x7f90f0121430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:53.534 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.530+0000 7f90f655e6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f90f0116520 0x7f90f0121970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:53.535 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.530+0000 7f90f655e6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f90f0126d30 0x7f90f01271d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:53.535 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.530+0000 7f90f655e6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f90f0127740 con 0x7f90f0126d30 2026-02-13T04:00:53.535 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.530+0000 7f90f655e6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f90f01278b0 con 0x7f90f0116520 2026-02-13T04:00:53.535 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.530+0000 7f90f655e6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f90f0127a70 con 0x7f90f01137a0 2026-02-13T04:00:53.535 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.530+0000 7f90f5d5d6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f90f0126d30 0x7f90f01271d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:53.535 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.530+0000 7f90f5d5d6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f90f0126d30 0x7f90f01271d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:57172/0 (socket says 10.20.193.92:57172) 2026-02-13T04:00:53.535 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.530+0000 7f90f5d5d6c0 1 -- 10.20.193.92:0/1048388227 learned_addr learned my addr 10.20.193.92:0/1048388227 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:00:53.535 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.530+0000 7f90f4d5b6c0 1 --2- 10.20.193.92:0/1048388227 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f90f0116520 0x7f90f0121970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:53.535 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.530+0000 7f90f555c6c0 1 --2- 10.20.193.92:0/1048388227 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f90f01137a0 0x7f90f0121430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:53.535 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.530+0000 7f90f5d5d6c0 1 -- 10.20.193.92:0/1048388227 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f90f01137a0 msgr2=0x7f90f0121430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:53.535 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.530+0000 7f90f5d5d6c0 1 --2- 10.20.193.92:0/1048388227 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f90f01137a0 0x7f90f0121430 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:53.536 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.530+0000 7f90f5d5d6c0 1 -- 10.20.193.92:0/1048388227 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f90f0116520 msgr2=0x7f90f0121970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:53.536 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.530+0000 7f90f5d5d6c0 1 --2- 10.20.193.92:0/1048388227 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f90f0116520 0x7f90f0121970 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:53.536 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.530+0000 7f90f5d5d6c0 1 -- 10.20.193.92:0/1048388227 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90e4009590 con 0x7f90f0126d30 2026-02-13T04:00:53.536 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.530+0000 7f90f4d5b6c0 1 --2- 10.20.193.92:0/1048388227 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f90f0116520 0x7f90f0121970 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T04:00:53.536 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.530+0000 7f90f5d5d6c0 1 --2- 10.20.193.92:0/1048388227 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f90f0126d30 0x7f90f01271d0 secure :-1 s=READY pgs=180 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90ec006ea0 tx=0x7f90ec00ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:53.536 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.530+0000 7f90deffd6c0 1 -- 10.20.193.92:0/1048388227 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f90ec003c40 con 0x7f90f0126d30 2026-02-13T04:00:53.536 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.530+0000 7f90deffd6c0 1 -- 10.20.193.92:0/1048388227 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f90ec003da0 con 0x7f90f0126d30 2026-02-13T04:00:53.536 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.530+0000 7f90f655e6c0 1 -- 10.20.193.92:0/1048388227 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90f0167f20 con 0x7f90f0126d30 2026-02-13T04:00:53.536 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.530+0000 7f90deffd6c0 1 -- 10.20.193.92:0/1048388227 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f90ec008440 con 0x7f90f0126d30 2026-02-13T04:00:53.536 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.531+0000 7f90f655e6c0 1 -- 10.20.193.92:0/1048388227 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90f01683b0 con 0x7f90f0126d30 2026-02-13T04:00:53.536 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.531+0000 7f90f655e6c0 1 -- 10.20.193.92:0/1048388227 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90f0114840 con 0x7f90f0126d30 2026-02-13T04:00:53.537 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.533+0000 7f90deffd6c0 1 -- 10.20.193.92:0/1048388227 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f90ec00d690 con 0x7f90f0126d30 2026-02-13T04:00:53.538 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.535+0000 7f90deffd6c0 1 --2- 10.20.193.92:0/1048388227 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f90c00b56d0 0x7f90c00d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:53.538 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.535+0000 7f90deffd6c0 1 -- 10.20.193.92:0/1048388227 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7f90ec0e4b40 con 0x7f90f0126d30 2026-02-13T04:00:53.538 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.535+0000 7f90f555c6c0 1 --2- 10.20.193.92:0/1048388227 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f90c00b56d0 0x7f90c00d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:53.539 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.535+0000 7f90deffd6c0 1 -- 10.20.193.92:0/1048388227 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f90ec11d5e0 con 0x7f90f0126d30 2026-02-13T04:00:53.539 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.536+0000 7f90f555c6c0 1 --2- 10.20.193.92:0/1048388227 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f90c00b56d0 0x7f90c00d5b80 secure :-1 s=READY pgs=139 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90e0004750 tx=0x7f90e0009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:53.662 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:53.659+0000 7f90f655e6c0 1 -- 10.20.193.92:0/1048388227 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f90f0113b70 con 0x7f90f0126d30 2026-02-13T04:00:54.057 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.054+0000 7f90deffd6c0 1 -- 10.20.193.92:0/1048388227 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v19) ==== 121+0+0 (secure 0 0 0) 0x7f90ec0a75f0 con 0x7f90f0126d30 2026-02-13T04:00:54.059 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.055+0000 7f90f655e6c0 1 -- 10.20.193.92:0/1048388227 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f90c00b56d0 msgr2=0x7f90c00d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:54.059 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.055+0000 7f90f655e6c0 1 --2- 10.20.193.92:0/1048388227 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f90c00b56d0 0x7f90c00d5b80 secure :-1 s=READY pgs=139 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90e0004750 tx=0x7f90e0009260 comp rx=0 tx=0).stop 2026-02-13T04:00:54.059 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.055+0000 7f90f655e6c0 1 -- 10.20.193.92:0/1048388227 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f90f0126d30 msgr2=0x7f90f01271d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:54.059 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.055+0000 7f90f655e6c0 1 --2- 10.20.193.92:0/1048388227 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f90f0126d30 0x7f90f01271d0 secure :-1 s=READY pgs=180 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f90ec006ea0 tx=0x7f90ec00ce50 comp rx=0 tx=0).stop 2026-02-13T04:00:54.059 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.055+0000 7f90f655e6c0 1 -- 10.20.193.92:0/1048388227 shutdown_connections 2026-02-13T04:00:54.059 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.055+0000 7f90f655e6c0 1 --2- 10.20.193.92:0/1048388227 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f90c00b56d0 0x7f90c00d5b80 unknown :-1 s=CLOSED pgs=139 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:54.059 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.055+0000 7f90f655e6c0 1 --2- 10.20.193.92:0/1048388227 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f90f0116520 0x7f90f0121970 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:54.059 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.055+0000 7f90f655e6c0 1 --2- 10.20.193.92:0/1048388227 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f90f0126d30 0x7f90f01271d0 unknown :-1 s=CLOSED pgs=180 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:54.059 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.055+0000 7f90f655e6c0 1 --2- 10.20.193.92:0/1048388227 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f90f01137a0 0x7f90f0121430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:54.060 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.055+0000 7f90f655e6c0 1 -- 10.20.193.92:0/1048388227 >> 10.20.193.92:0/1048388227 conn(0x7f90f0061510 msgr2=0x7f90f0116d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:54.060 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.056+0000 7f90f655e6c0 1 -- 10.20.193.92:0/1048388227 shutdown_connections 2026-02-13T04:00:54.060 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.056+0000 7f90f655e6c0 1 -- 10.20.193.92:0/1048388227 wait complete. 2026-02-13T04:00:54.165 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph fs set cephfs session_timeout 300 2026-02-13T04:00:54.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:54 trial158 ceph-mon[27763]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2026-02-13T04:00:54.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:54 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/3068803487' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5", "yes_i_really_mean_it": true}]': finished 2026-02-13T04:00:54.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:54 trial158 ceph-mon[27763]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2026-02-13T04:00:54.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:54 trial158 ceph-mon[27763]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T04:00:54.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:54 trial158 ceph-mon[27763]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2026-02-13T04:00:54.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:54 trial158 ceph-mon[27763]: daemon mds.i is now active in filesystem cephfs as rank 1 2026-02-13T04:00:54.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:54 trial158 ceph-mon[27763]: pgmap v179: 97 pgs: 6 creating+peering, 8 unknown, 83 active+clean; 578 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s wr, 8 op/s 2026-02-13T04:00:54.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:54 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/1048388227' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2026-02-13T04:00:54.348 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:00:54.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:54 trial099 ceph-mon[27808]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2026-02-13T04:00:54.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:54 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/3068803487' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5", "yes_i_really_mean_it": true}]': finished 2026-02-13T04:00:54.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:54 trial099 ceph-mon[27808]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2026-02-13T04:00:54.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:54 trial099 ceph-mon[27808]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T04:00:54.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:54 trial099 ceph-mon[27808]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2026-02-13T04:00:54.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:54 trial099 ceph-mon[27808]: daemon mds.i is now active in filesystem cephfs as rank 1 2026-02-13T04:00:54.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:54 trial099 ceph-mon[27808]: pgmap v179: 97 pgs: 6 creating+peering, 8 unknown, 83 active+clean; 578 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s wr, 8 op/s 2026-02-13T04:00:54.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:54 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/1048388227' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2026-02-13T04:00:54.391 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:54 trial092 ceph-mon[23047]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2026-02-13T04:00:54.391 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:54 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/3068803487' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5", "yes_i_really_mean_it": true}]': finished 2026-02-13T04:00:54.392 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:54 trial092 ceph-mon[23047]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2026-02-13T04:00:54.392 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:54 trial092 ceph-mon[23047]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2026-02-13T04:00:54.392 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:54 trial092 ceph-mon[23047]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2026-02-13T04:00:54.392 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:54 trial092 ceph-mon[23047]: daemon mds.i is now active in filesystem cephfs as rank 1 2026-02-13T04:00:54.392 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:54 trial092 ceph-mon[23047]: pgmap v179: 97 pgs: 6 creating+peering, 8 unknown, 83 active+clean; 578 KiB data, 325 MiB used, 8.2 TiB / 8.2 TiB avail; 2.8 KiB/s wr, 8 op/s 2026-02-13T04:00:54.392 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:54 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1048388227' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2026-02-13T04:00:54.539 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.535+0000 7f426a9e76c0 1 -- 10.20.193.92:0/2125065577 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f426410f060 msgr2=0x7f426410f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:54.539 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.535+0000 7f426a9e76c0 1 --2- 10.20.193.92:0/2125065577 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f426410f060 0x7f426410f430 secure :-1 s=READY pgs=181 gs=1 cs=0 l=1 c_cookie=11468866369516064908 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f42540099a0 tx=0x7f425402ed00 comp rx=0 tx=0).stop 2026-02-13T04:00:54.539 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.535+0000 7f426a9e76c0 1 -- 10.20.193.92:0/2125065577 shutdown_connections 2026-02-13T04:00:54.539 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.535+0000 7f426a9e76c0 1 --2- 10.20.193.92:0/2125065577 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4264115270 0x7f4264175c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:54.539 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.535+0000 7f426a9e76c0 1 --2- 10.20.193.92:0/2125065577 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f426410fa50 0x7f4264114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:54.539 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.535+0000 7f426a9e76c0 1 --2- 10.20.193.92:0/2125065577 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f426410f060 0x7f426410f430 unknown :-1 s=CLOSED pgs=181 gs=1 cs=0 l=1 c_cookie=11468866369516064908 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:54.539 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.535+0000 7f426a9e76c0 1 -- 10.20.193.92:0/2125065577 >> 10.20.193.92:0/2125065577 conn(0x7f42640ec980 msgr2=0x7f426410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:54.539 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.535+0000 7f426a9e76c0 1 -- 10.20.193.92:0/2125065577 shutdown_connections 2026-02-13T04:00:54.539 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.535+0000 7f426a9e76c0 1 -- 10.20.193.92:0/2125065577 wait complete. 2026-02-13T04:00:54.541 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.536+0000 7f426a9e76c0 1 Processor -- start 2026-02-13T04:00:54.541 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.536+0000 7f426a9e76c0 1 -- start start 2026-02-13T04:00:54.541 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.537+0000 7f426a9e76c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f426410f060 0x7f426411cef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:54.542 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.537+0000 7f426a9e76c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4264115270 0x7f426411d430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:54.542 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.537+0000 7f426a9e76c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f42641227f0 0x7f4264122c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:54.542 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.537+0000 7f426a9e76c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4264123200 con 0x7f426410f060 2026-02-13T04:00:54.542 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.537+0000 7f426a9e76c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4264123370 con 0x7f42641227f0 2026-02-13T04:00:54.542 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.537+0000 7f426a9e76c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f4264123530 con 0x7f4264115270 2026-02-13T04:00:54.542 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.537+0000 7f42699e56c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f426410f060 0x7f426411cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:54.542 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.537+0000 7f42699e56c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f426410f060 0x7f426411cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:57194/0 (socket says 10.20.193.92:57194) 2026-02-13T04:00:54.542 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.537+0000 7f42699e56c0 1 -- 10.20.193.92:0/1466732723 learned_addr learned my addr 10.20.193.92:0/1466732723 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:00:54.542 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.537+0000 7f426a1e66c0 1 --2- 10.20.193.92:0/1466732723 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f42641227f0 0x7f4264122c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:54.542 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.537+0000 7f42691e46c0 1 --2- 10.20.193.92:0/1466732723 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4264115270 0x7f426411d430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:54.543 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.537+0000 7f42699e56c0 1 -- 10.20.193.92:0/1466732723 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4264115270 msgr2=0x7f426411d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:54.543 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.537+0000 7f42699e56c0 1 --2- 10.20.193.92:0/1466732723 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4264115270 0x7f426411d430 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:54.543 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.537+0000 7f42699e56c0 1 -- 10.20.193.92:0/1466732723 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f42641227f0 msgr2=0x7f4264122c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:54.543 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.537+0000 7f42699e56c0 1 --2- 10.20.193.92:0/1466732723 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f42641227f0 0x7f4264122c90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:54.543 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.537+0000 7f42699e56c0 1 -- 10.20.193.92:0/1466732723 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4254009590 con 0x7f426410f060 2026-02-13T04:00:54.543 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.537+0000 7f42699e56c0 1 --2- 10.20.193.92:0/1466732723 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f426410f060 0x7f426411cef0 secure :-1 s=READY pgs=182 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4254031fd0 tx=0x7f425402f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:54.543 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.537+0000 7f4252ffd6c0 1 -- 10.20.193.92:0/1466732723 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f42540026b0 con 0x7f426410f060 2026-02-13T04:00:54.543 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.537+0000 7f4252ffd6c0 1 -- 10.20.193.92:0/1466732723 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f4254002d40 con 0x7f426410f060 2026-02-13T04:00:54.543 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.537+0000 7f4252ffd6c0 1 -- 10.20.193.92:0/1466732723 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4254007670 con 0x7f426410f060 2026-02-13T04:00:54.543 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.537+0000 7f426a9e76c0 1 -- 10.20.193.92:0/1466732723 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4264163980 con 0x7f426410f060 2026-02-13T04:00:54.543 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.537+0000 7f426a9e76c0 1 -- 10.20.193.92:0/1466732723 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4264163db0 con 0x7f426410f060 2026-02-13T04:00:54.543 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.538+0000 7f426a9e76c0 1 -- 10.20.193.92:0/1466732723 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4264110330 con 0x7f426410f060 2026-02-13T04:00:54.544 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.540+0000 7f4252ffd6c0 1 -- 10.20.193.92:0/1466732723 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f4254002810 con 0x7f426410f060 2026-02-13T04:00:54.545 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.542+0000 7f4252ffd6c0 1 --2- 10.20.193.92:0/1466732723 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f42400b56d0 0x7f42400d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:54.545 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.542+0000 7f4252ffd6c0 1 -- 10.20.193.92:0/1466732723 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7f4254107cb0 con 0x7f426410f060 2026-02-13T04:00:54.545 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.542+0000 7f4252ffd6c0 1 -- 10.20.193.92:0/1466732723 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4254108130 con 0x7f426410f060 2026-02-13T04:00:54.545 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.542+0000 7f42691e46c0 1 --2- 10.20.193.92:0/1466732723 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f42400b56d0 0x7f42400d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:54.546 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.543+0000 7f42691e46c0 1 --2- 10.20.193.92:0/1466732723 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f42400b56d0 0x7f42400d5b80 secure :-1 s=READY pgs=140 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4258005980 tx=0x7f4258005910 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:54.670 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:54.667+0000 7f426a9e76c0 1 -- 10.20.193.92:0/1466732723 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f426410fa50 con 0x7f426410f060 2026-02-13T04:00:55.063 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.060+0000 7f4252ffd6c0 1 -- 10.20.193.92:0/1466732723 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v21) ==== 115+0+0 (secure 0 0 0) 0x7f42540ca760 con 0x7f426410f060 2026-02-13T04:00:55.065 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.062+0000 7f426a9e76c0 1 -- 10.20.193.92:0/1466732723 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f42400b56d0 msgr2=0x7f42400d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:55.065 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.062+0000 7f426a9e76c0 1 --2- 10.20.193.92:0/1466732723 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f42400b56d0 0x7f42400d5b80 secure :-1 s=READY pgs=140 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4258005980 tx=0x7f4258005910 comp rx=0 tx=0).stop 2026-02-13T04:00:55.065 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.062+0000 7f426a9e76c0 1 -- 10.20.193.92:0/1466732723 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f426410f060 msgr2=0x7f426411cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:55.066 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.062+0000 7f426a9e76c0 1 --2- 10.20.193.92:0/1466732723 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f426410f060 0x7f426411cef0 secure :-1 s=READY pgs=182 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4254031fd0 tx=0x7f425402f810 comp rx=0 tx=0).stop 2026-02-13T04:00:55.066 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.062+0000 7f426a9e76c0 1 -- 10.20.193.92:0/1466732723 shutdown_connections 2026-02-13T04:00:55.066 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.062+0000 7f426a9e76c0 1 --2- 10.20.193.92:0/1466732723 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f42400b56d0 0x7f42400d5b80 unknown :-1 s=CLOSED pgs=140 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:55.066 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.062+0000 7f426a9e76c0 1 --2- 10.20.193.92:0/1466732723 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f42641227f0 0x7f4264122c90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:55.066 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.062+0000 7f426a9e76c0 1 --2- 10.20.193.92:0/1466732723 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4264115270 0x7f426411d430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:55.066 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.062+0000 7f426a9e76c0 1 --2- 10.20.193.92:0/1466732723 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f426410f060 0x7f426411cef0 unknown :-1 s=CLOSED pgs=182 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:55.066 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.062+0000 7f426a9e76c0 1 -- 10.20.193.92:0/1466732723 >> 10.20.193.92:0/1466732723 conn(0x7f42640ec980 msgr2=0x7f426410cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:55.066 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.062+0000 7f426a9e76c0 1 -- 10.20.193.92:0/1466732723 shutdown_connections 2026-02-13T04:00:55.066 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.063+0000 7f426a9e76c0 1 -- 10.20.193.92:0/1466732723 wait complete. 2026-02-13T04:00:55.172 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2026-02-13T04:00:55.172 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph fs subvolumegroup create cephfs qa 2026-02-13T04:00:55.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:55 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/1048388227' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2026-02-13T04:00:55.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:55 trial158 ceph-mon[27763]: mds.? [v2:10.20.193.158:6838/2250447124,v1:10.20.193.158:6839/2250447124] up:active 2026-02-13T04:00:55.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:55 trial158 ceph-mon[27763]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2026-02-13T04:00:55.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:55 trial158 ceph-mon[27763]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2026-02-13T04:00:55.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:55 trial158 ceph-mon[27763]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2026-02-13T04:00:55.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:55 trial158 ceph-mon[27763]: daemon mds.h is now active in filesystem cephfs as rank 2 2026-02-13T04:00:55.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:55 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/1466732723' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2026-02-13T04:00:55.355 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:00:55.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:55 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/1048388227' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2026-02-13T04:00:55.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:55 trial099 ceph-mon[27808]: mds.? [v2:10.20.193.158:6838/2250447124,v1:10.20.193.158:6839/2250447124] up:active 2026-02-13T04:00:55.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:55 trial099 ceph-mon[27808]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2026-02-13T04:00:55.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:55 trial099 ceph-mon[27808]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2026-02-13T04:00:55.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:55 trial099 ceph-mon[27808]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2026-02-13T04:00:55.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:55 trial099 ceph-mon[27808]: daemon mds.h is now active in filesystem cephfs as rank 2 2026-02-13T04:00:55.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:55 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/1466732723' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2026-02-13T04:00:55.367 INFO:journalctl@ceph.mds.b.trial099.stdout:Feb 13 04:00:55 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-b[57261]: 2026-02-13T04:00:55.014+0000 7fc59f87b6c0 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2026-02-13T04:00:55.367 INFO:journalctl@ceph.mds.b.trial099.stdout:Feb 13 04:00:55 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-b[57261]: 2026-02-13T04:00:55.014+0000 7fc59f87b6c0 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2026-02-13T04:00:55.399 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:55 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1048388227' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2026-02-13T04:00:55.400 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:55 trial092 ceph-mon[23047]: mds.? [v2:10.20.193.158:6838/2250447124,v1:10.20.193.158:6839/2250447124] up:active 2026-02-13T04:00:55.400 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:55 trial092 ceph-mon[23047]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2026-02-13T04:00:55.400 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:55 trial092 ceph-mon[23047]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2026-02-13T04:00:55.400 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:55 trial092 ceph-mon[23047]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2026-02-13T04:00:55.400 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:55 trial092 ceph-mon[23047]: daemon mds.h is now active in filesystem cephfs as rank 2 2026-02-13T04:00:55.400 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:55 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1466732723' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2026-02-13T04:00:55.553 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.550+0000 7f004c20d6c0 1 -- 10.20.193.92:0/65141228 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f00441149c0 msgr2=0x7f0044114ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:55.554 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.550+0000 7f004c20d6c0 1 --2- 10.20.193.92:0/65141228 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f00441149c0 0x7f0044114ee0 secure :-1 s=READY pgs=183 gs=3 cs=0 l=1 c_cookie=9535196056256085493 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f004000aa40 tx=0x7f004002fe00 comp rx=0 tx=0).stop 2026-02-13T04:00:55.554 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.550+0000 7f004c20d6c0 1 -- 10.20.193.92:0/65141228 shutdown_connections 2026-02-13T04:00:55.554 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.550+0000 7f004c20d6c0 1 --2- 10.20.193.92:0/65141228 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0044113dc0 0x7f0044114210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:55.554 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.550+0000 7f004c20d6c0 1 --2- 10.20.193.92:0/65141228 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f00441149c0 0x7f0044114ee0 unknown :-1 s=CLOSED pgs=183 gs=3 cs=0 l=1 c_cookie=9535196056256085493 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:55.554 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.550+0000 7f004c20d6c0 1 --2- 10.20.193.92:0/65141228 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f004411b510 0x7f004411b8e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:55.554 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.550+0000 7f004c20d6c0 1 -- 10.20.193.92:0/65141228 >> 10.20.193.92:0/65141228 conn(0x7f0044058a50 msgr2=0x7f0044058e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:55.554 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.550+0000 7f004c20d6c0 1 -- 10.20.193.92:0/65141228 shutdown_connections 2026-02-13T04:00:55.554 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.550+0000 7f004c20d6c0 1 -- 10.20.193.92:0/65141228 wait complete. 2026-02-13T04:00:55.556 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.551+0000 7f004c20d6c0 1 Processor -- start 2026-02-13T04:00:55.556 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.551+0000 7f004c20d6c0 1 -- start start 2026-02-13T04:00:55.556 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.551+0000 7f004c20d6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0044113dc0 0x7f004412b660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:55.556 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.551+0000 7f004c20d6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f00441149c0 0x7f004412bba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:55.556 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.551+0000 7f004c20d6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f004411b510 0x7f0044130f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:55.557 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.551+0000 7f004c20d6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f00441315b0 con 0x7f0044113dc0 2026-02-13T04:00:55.557 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.551+0000 7f004c20d6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0044131720 con 0x7f004411b510 2026-02-13T04:00:55.557 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.551+0000 7f004c20d6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f00441318e0 con 0x7f00441149c0 2026-02-13T04:00:55.557 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.551+0000 7f0049f7e6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0044113dc0 0x7f004412b660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:55.557 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.551+0000 7f0049f7e6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0044113dc0 0x7f004412b660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:55674/0 (socket says 10.20.193.92:55674) 2026-02-13T04:00:55.557 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.551+0000 7f0049f7e6c0 1 -- 10.20.193.92:0/3898788354 learned_addr learned my addr 10.20.193.92:0/3898788354 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:00:55.557 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.551+0000 7f004977d6c0 1 --2- 10.20.193.92:0/3898788354 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f00441149c0 0x7f004412bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:55.557 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.551+0000 7f004a77f6c0 1 --2- 10.20.193.92:0/3898788354 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f004411b510 0x7f0044130f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:55.557 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.552+0000 7f0049f7e6c0 1 -- 10.20.193.92:0/3898788354 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f00441149c0 msgr2=0x7f004412bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:55.557 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.552+0000 7f0049f7e6c0 1 --2- 10.20.193.92:0/3898788354 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f00441149c0 0x7f004412bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:55.557 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.552+0000 7f0049f7e6c0 1 -- 10.20.193.92:0/3898788354 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f004411b510 msgr2=0x7f0044130f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:55.558 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.552+0000 7f0049f7e6c0 1 --2- 10.20.193.92:0/3898788354 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f004411b510 0x7f0044130f60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:55.558 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.552+0000 7f0049f7e6c0 1 -- 10.20.193.92:0/3898788354 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f004000a660 con 0x7f0044113dc0 2026-02-13T04:00:55.558 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.552+0000 7f0049f7e6c0 1 --2- 10.20.193.92:0/3898788354 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0044113dc0 0x7f004412b660 secure :-1 s=READY pgs=184 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0034009490 tx=0x7f003400bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:55.558 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.552+0000 7f0032ffd6c0 1 -- 10.20.193.92:0/3898788354 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0034004a80 con 0x7f0044113dc0 2026-02-13T04:00:55.558 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.552+0000 7f0032ffd6c0 1 -- 10.20.193.92:0/3898788354 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f0034009030 con 0x7f0044113dc0 2026-02-13T04:00:55.558 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.552+0000 7f0032ffd6c0 1 -- 10.20.193.92:0/3898788354 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00340071c0 con 0x7f0044113dc0 2026-02-13T04:00:55.558 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.552+0000 7f004c20d6c0 1 -- 10.20.193.92:0/3898788354 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0044131bc0 con 0x7f0044113dc0 2026-02-13T04:00:55.558 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.552+0000 7f004c20d6c0 1 -- 10.20.193.92:0/3898788354 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00441722a0 con 0x7f0044113dc0 2026-02-13T04:00:55.558 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.553+0000 7f004c20d6c0 1 -- 10.20.193.92:0/3898788354 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0044131de0 con 0x7f0044113dc0 2026-02-13T04:00:55.559 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.555+0000 7f0032ffd6c0 1 -- 10.20.193.92:0/3898788354 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f0034004e90 con 0x7f0044113dc0 2026-02-13T04:00:55.559 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.556+0000 7f0032ffd6c0 1 --2- 10.20.193.92:0/3898788354 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f00140b56d0 0x7f00140d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:55.560 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.557+0000 7f0032ffd6c0 1 -- 10.20.193.92:0/3898788354 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7f00340e3930 con 0x7f0044113dc0 2026-02-13T04:00:55.560 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.557+0000 7f004977d6c0 1 --2- 10.20.193.92:0/3898788354 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f00140b56d0 0x7f00140d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:55.560 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.557+0000 7f0032ffd6c0 1 -- 10.20.193.92:0/3898788354 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f00340e3db0 con 0x7f0044113dc0 2026-02-13T04:00:55.560 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.557+0000 7f004977d6c0 1 --2- 10.20.193.92:0/3898788354 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f00140b56d0 0x7f00140d5b80 secure :-1 s=READY pgs=141 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0044131ff0 tx=0x7f0038009390 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:55.677 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:55.673+0000 7f004c20d6c0 1 -- 10.20.193.92:0/3898788354 --> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f004412c7b0 con 0x7f00140b56d0 2026-02-13T04:00:55.934 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 04:00:55 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T04:00:55.683+0000 7fb17f16d6c0 -1 client.14760 error registering admin socket command: (17) File exists 2026-02-13T04:00:56.086 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.083+0000 7f0032ffd6c0 1 -- 10.20.193.92:0/3898788354 <== mgr.14187 v2:10.20.193.92:6800/4191527999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f004412c7b0 con 0x7f00140b56d0 2026-02-13T04:00:56.088 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.085+0000 7f004c20d6c0 1 -- 10.20.193.92:0/3898788354 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f00140b56d0 msgr2=0x7f00140d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:56.089 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.085+0000 7f004c20d6c0 1 --2- 10.20.193.92:0/3898788354 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f00140b56d0 0x7f00140d5b80 secure :-1 s=READY pgs=141 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0044131ff0 tx=0x7f0038009390 comp rx=0 tx=0).stop 2026-02-13T04:00:56.089 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.085+0000 7f004c20d6c0 1 -- 10.20.193.92:0/3898788354 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0044113dc0 msgr2=0x7f004412b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:56.089 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.085+0000 7f004c20d6c0 1 --2- 10.20.193.92:0/3898788354 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0044113dc0 0x7f004412b660 secure :-1 s=READY pgs=184 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0034009490 tx=0x7f003400bc50 comp rx=0 tx=0).stop 2026-02-13T04:00:56.089 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.085+0000 7f004c20d6c0 1 -- 10.20.193.92:0/3898788354 shutdown_connections 2026-02-13T04:00:56.089 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.085+0000 7f004c20d6c0 1 --2- 10.20.193.92:0/3898788354 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f00140b56d0 0x7f00140d5b80 unknown :-1 s=CLOSED pgs=141 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:56.089 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.085+0000 7f004c20d6c0 1 --2- 10.20.193.92:0/3898788354 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f004411b510 0x7f0044130f60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:56.089 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.085+0000 7f004c20d6c0 1 --2- 10.20.193.92:0/3898788354 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f00441149c0 0x7f004412bba0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:56.089 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.085+0000 7f004c20d6c0 1 --2- 10.20.193.92:0/3898788354 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0044113dc0 0x7f004412b660 unknown :-1 s=CLOSED pgs=184 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:56.089 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.085+0000 7f004c20d6c0 1 -- 10.20.193.92:0/3898788354 >> 10.20.193.92:0/3898788354 conn(0x7f0044058a50 msgr2=0x7f004411a380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:56.090 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.086+0000 7f004c20d6c0 1 -- 10.20.193.92:0/3898788354 shutdown_connections 2026-02-13T04:00:56.090 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.086+0000 7f004c20d6c0 1 -- 10.20.193.92:0/3898788354 wait complete. 2026-02-13T04:00:56.191 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2026-02-13T04:00:56.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:56 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/1466732723' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2026-02-13T04:00:56.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:56 trial158 ceph-mon[27763]: mds.? [v2:10.20.193.99:6836/1572110945,v1:10.20.193.99:6837/1572110945] up:active 2026-02-13T04:00:56.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:56 trial158 ceph-mon[27763]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2026-02-13T04:00:56.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:56 trial158 ceph-mon[27763]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2026-02-13T04:00:56.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:56 trial158 ceph-mon[27763]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2026-02-13T04:00:56.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:56 trial158 ceph-mon[27763]: daemon mds.c is now active in filesystem cephfs as rank 3 2026-02-13T04:00:56.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:56 trial158 ceph-mon[27763]: pgmap v180: 97 pgs: 97 active+clean; 579 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s wr, 9 op/s 2026-02-13T04:00:56.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:56 trial158 ceph-mon[27763]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T04:00:56.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:56 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/1466732723' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2026-02-13T04:00:56.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:56 trial099 ceph-mon[27808]: mds.? [v2:10.20.193.99:6836/1572110945,v1:10.20.193.99:6837/1572110945] up:active 2026-02-13T04:00:56.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:56 trial099 ceph-mon[27808]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2026-02-13T04:00:56.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:56 trial099 ceph-mon[27808]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2026-02-13T04:00:56.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:56 trial099 ceph-mon[27808]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2026-02-13T04:00:56.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:56 trial099 ceph-mon[27808]: daemon mds.c is now active in filesystem cephfs as rank 3 2026-02-13T04:00:56.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:56 trial099 ceph-mon[27808]: pgmap v180: 97 pgs: 97 active+clean; 579 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s wr, 9 op/s 2026-02-13T04:00:56.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:56 trial099 ceph-mon[27808]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T04:00:56.371 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:00:56.413 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:56 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1466732723' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2026-02-13T04:00:56.413 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:56 trial092 ceph-mon[23047]: mds.? [v2:10.20.193.99:6836/1572110945,v1:10.20.193.99:6837/1572110945] up:active 2026-02-13T04:00:56.413 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:56 trial092 ceph-mon[23047]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2026-02-13T04:00:56.414 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:56 trial092 ceph-mon[23047]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2026-02-13T04:00:56.414 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:56 trial092 ceph-mon[23047]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2026-02-13T04:00:56.414 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:56 trial092 ceph-mon[23047]: daemon mds.c is now active in filesystem cephfs as rank 3 2026-02-13T04:00:56.414 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:56 trial092 ceph-mon[23047]: pgmap v180: 97 pgs: 97 active+clean; 579 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.1 KiB/s wr, 9 op/s 2026-02-13T04:00:56.414 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:56 trial092 ceph-mon[23047]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T04:00:56.574 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.571+0000 7f7d8b2b96c0 1 -- 10.20.193.92:0/1338223036 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7d8410cfb0 msgr2=0x7f7d8410d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:56.575 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.571+0000 7f7d8b2b96c0 1 --2- 10.20.193.92:0/1338223036 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7d8410cfb0 0x7f7d8410d380 secure :-1 s=READY pgs=87 gs=2 cs=0 l=1 c_cookie=17297671615233246015 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d74009970 tx=0x7f7d7402ed10 comp rx=0 tx=0).stop 2026-02-13T04:00:56.575 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.571+0000 7f7d8b2b96c0 1 -- 10.20.193.92:0/1338223036 shutdown_connections 2026-02-13T04:00:56.575 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.571+0000 7f7d8b2b96c0 1 --2- 10.20.193.92:0/1338223036 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7d841131c0 0x7f7d84173b60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:56.575 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.571+0000 7f7d8b2b96c0 1 --2- 10.20.193.92:0/1338223036 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7d8410d9a0 0x7f7d841129e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:56.575 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.571+0000 7f7d8b2b96c0 1 --2- 10.20.193.92:0/1338223036 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7d8410cfb0 0x7f7d8410d380 unknown :-1 s=CLOSED pgs=87 gs=2 cs=0 l=1 c_cookie=17297671615233246015 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:56.575 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.571+0000 7f7d8b2b96c0 1 -- 10.20.193.92:0/1338223036 >> 10.20.193.92:0/1338223036 conn(0x7f7d840ea8b0 msgr2=0x7f7d8410acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:56.575 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.571+0000 7f7d8b2b96c0 1 -- 10.20.193.92:0/1338223036 shutdown_connections 2026-02-13T04:00:56.575 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.571+0000 7f7d8b2b96c0 1 -- 10.20.193.92:0/1338223036 wait complete. 2026-02-13T04:00:56.577 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.572+0000 7f7d8b2b96c0 1 Processor -- start 2026-02-13T04:00:56.577 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.572+0000 7f7d8b2b96c0 1 -- start start 2026-02-13T04:00:56.577 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.572+0000 7f7d8b2b96c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7d8410cfb0 0x7f7d840f48d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:56.577 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.572+0000 7f7d8b2b96c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7d841131c0 0x7f7d84173a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:56.577 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.572+0000 7f7d8b2b96c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7d840f4f00 0x7f7d840fa1d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:56.578 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.572+0000 7f7d8b2b96c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7d840f55f0 con 0x7f7d841131c0 2026-02-13T04:00:56.578 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.572+0000 7f7d8b2b96c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7d840fa710 con 0x7f7d8410cfb0 2026-02-13T04:00:56.578 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.572+0000 7f7d8b2b96c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f7d840fa8d0 con 0x7f7d840f4f00 2026-02-13T04:00:56.578 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.572+0000 7f7d8982b6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7d840f4f00 0x7f7d840fa1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:56.578 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.572+0000 7f7d8982b6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7d840f4f00 0x7f7d840fa1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:56582/0 (socket says 10.20.193.92:56582) 2026-02-13T04:00:56.578 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.572+0000 7f7d8982b6c0 1 -- 10.20.193.92:0/3810462579 learned_addr learned my addr 10.20.193.92:0/3810462579 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:00:56.578 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.572+0000 7f7d888296c0 1 --2- 10.20.193.92:0/3810462579 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7d841131c0 0x7f7d84173a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:56.578 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.572+0000 7f7d8902a6c0 1 --2- 10.20.193.92:0/3810462579 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7d8410cfb0 0x7f7d840f48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:56.578 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.572+0000 7f7d8982b6c0 1 -- 10.20.193.92:0/3810462579 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7d8410cfb0 msgr2=0x7f7d840f48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:56.578 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.573+0000 7f7d8982b6c0 1 --2- 10.20.193.92:0/3810462579 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7d8410cfb0 0x7f7d840f48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:56.579 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.573+0000 7f7d8982b6c0 1 -- 10.20.193.92:0/3810462579 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7d841131c0 msgr2=0x7f7d84173a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:56.579 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.573+0000 7f7d8982b6c0 1 --2- 10.20.193.92:0/3810462579 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7d841131c0 0x7f7d84173a60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:56.579 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.573+0000 7f7d8982b6c0 1 -- 10.20.193.92:0/3810462579 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d780094c0 con 0x7f7d840f4f00 2026-02-13T04:00:56.579 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.573+0000 7f7d8982b6c0 1 --2- 10.20.193.92:0/3810462579 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7d840f4f00 0x7f7d840fa1d0 secure :-1 s=READY pgs=83 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d8000c9b0 tx=0x7f7d8000ce80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:56.579 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.573+0000 7f7d727fc6c0 1 -- 10.20.193.92:0/3810462579 <== mon.1 v2:10.20.193.158:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7d80003c40 con 0x7f7d840f4f00 2026-02-13T04:00:56.579 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.573+0000 7f7d727fc6c0 1 -- 10.20.193.92:0/3810462579 <== mon.1 v2:10.20.193.158:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f7d80003da0 con 0x7f7d840f4f00 2026-02-13T04:00:56.579 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.573+0000 7f7d727fc6c0 1 -- 10.20.193.92:0/3810462579 <== mon.1 v2:10.20.193.158:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7d80008440 con 0x7f7d840f4f00 2026-02-13T04:00:56.579 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.573+0000 7f7d8b2b96c0 1 -- 10.20.193.92:0/3810462579 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d74009590 con 0x7f7d840f4f00 2026-02-13T04:00:56.579 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.573+0000 7f7d8b2b96c0 1 -- 10.20.193.92:0/3810462579 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d840faeb0 con 0x7f7d840f4f00 2026-02-13T04:00:56.579 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.574+0000 7f7d8b2b96c0 1 -- 10.20.193.92:0/3810462579 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d8410e280 con 0x7f7d840f4f00 2026-02-13T04:00:56.580 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.576+0000 7f7d727fc6c0 1 -- 10.20.193.92:0/3810462579 <== mon.1 v2:10.20.193.158:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f7d8000d6c0 con 0x7f7d840f4f00 2026-02-13T04:00:56.581 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.578+0000 7f7d727fc6c0 1 --2- 10.20.193.92:0/3810462579 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f7d600b5650 0x7f7d600d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:56.581 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.578+0000 7f7d727fc6c0 1 -- 10.20.193.92:0/3810462579 <== mon.1 v2:10.20.193.158:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7f7d800e4be0 con 0x7f7d840f4f00 2026-02-13T04:00:56.581 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.578+0000 7f7d8902a6c0 1 --2- 10.20.193.92:0/3810462579 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f7d600b5650 0x7f7d600d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:56.581 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.578+0000 7f7d727fc6c0 1 -- 10.20.193.92:0/3810462579 <== mon.1 v2:10.20.193.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7d8011d640 con 0x7f7d840f4f00 2026-02-13T04:00:56.581 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.578+0000 7f7d8902a6c0 1 --2- 10.20.193.92:0/3810462579 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f7d600b5650 0x7f7d600d5b00 secure :-1 s=READY pgs=142 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d740023e0 tx=0x7f7d74005c80 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:56.698 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.695+0000 7f7d8b2b96c0 1 -- 10.20.193.92:0/3810462579 --> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f7d840f5a20 con 0x7f7d600b5650 2026-02-13T04:00:56.712 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.709+0000 7f7d727fc6c0 1 -- 10.20.193.92:0/3810462579 <== mgr.14187 v2:10.20.193.92:6800/4191527999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7d840f5a20 con 0x7f7d600b5650 2026-02-13T04:00:56.714 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.711+0000 7f7d8b2b96c0 1 -- 10.20.193.92:0/3810462579 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f7d600b5650 msgr2=0x7f7d600d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:56.714 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.711+0000 7f7d8b2b96c0 1 --2- 10.20.193.92:0/3810462579 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f7d600b5650 0x7f7d600d5b00 secure :-1 s=READY pgs=142 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d740023e0 tx=0x7f7d74005c80 comp rx=0 tx=0).stop 2026-02-13T04:00:56.714 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.711+0000 7f7d8b2b96c0 1 -- 10.20.193.92:0/3810462579 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7d840f4f00 msgr2=0x7f7d840fa1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:56.714 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.711+0000 7f7d8b2b96c0 1 --2- 10.20.193.92:0/3810462579 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7d840f4f00 0x7f7d840fa1d0 secure :-1 s=READY pgs=83 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7d8000c9b0 tx=0x7f7d8000ce80 comp rx=0 tx=0).stop 2026-02-13T04:00:56.714 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.711+0000 7f7d8b2b96c0 1 -- 10.20.193.92:0/3810462579 shutdown_connections 2026-02-13T04:00:56.714 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.711+0000 7f7d8b2b96c0 1 --2- 10.20.193.92:0/3810462579 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7d840f4f00 0x7f7d840fa1d0 unknown :-1 s=CLOSED pgs=83 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:56.715 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.711+0000 7f7d8b2b96c0 1 --2- 10.20.193.92:0/3810462579 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7d841131c0 0x7f7d84173a60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:56.715 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.711+0000 7f7d8b2b96c0 1 --2- 10.20.193.92:0/3810462579 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f7d600b5650 0x7f7d600d5b00 unknown :-1 s=CLOSED pgs=142 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:56.715 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.711+0000 7f7d8b2b96c0 1 --2- 10.20.193.92:0/3810462579 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7d8410cfb0 0x7f7d840f48d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:56.715 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.711+0000 7f7d8b2b96c0 1 -- 10.20.193.92:0/3810462579 >> 10.20.193.92:0/3810462579 conn(0x7f7d840ea8b0 msgr2=0x7f7d840605e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:56.715 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.711+0000 7f7d8b2b96c0 1 -- 10.20.193.92:0/3810462579 shutdown_connections 2026-02-13T04:00:56.715 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:56.711+0000 7f7d8b2b96c0 1 -- 10.20.193.92:0/3810462579 wait complete. 2026-02-13T04:00:56.819 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2026-02-13T04:00:57.004 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:00:57.201 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.198+0000 7fe44cc5b6c0 1 -- 10.20.193.92:0/399819391 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe448115270 msgr2=0x7fe448175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:57.201 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.198+0000 7fe44cc5b6c0 1 --2- 10.20.193.92:0/399819391 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe448115270 0x7fe448175c10 secure :-1 s=READY pgs=88 gs=2 cs=0 l=1 c_cookie=10601182057211068440 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe43c006fd0 tx=0x7fe43c02fd30 comp rx=0 tx=0).stop 2026-02-13T04:00:57.202 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.198+0000 7fe44cc5b6c0 1 -- 10.20.193.92:0/399819391 shutdown_connections 2026-02-13T04:00:57.202 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.198+0000 7fe44cc5b6c0 1 --2- 10.20.193.92:0/399819391 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe448115270 0x7fe448175c10 unknown :-1 s=CLOSED pgs=88 gs=2 cs=0 l=1 c_cookie=10601182057211068440 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:57.202 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.198+0000 7fe44cc5b6c0 1 --2- 10.20.193.92:0/399819391 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe44810fa50 0x7fe448114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:57.202 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.198+0000 7fe44cc5b6c0 1 --2- 10.20.193.92:0/399819391 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe44810f060 0x7fe44810f430 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:57.202 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.198+0000 7fe44cc5b6c0 1 -- 10.20.193.92:0/399819391 >> 10.20.193.92:0/399819391 conn(0x7fe4480ec980 msgr2=0x7fe44810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:57.202 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.198+0000 7fe44cc5b6c0 1 -- 10.20.193.92:0/399819391 shutdown_connections 2026-02-13T04:00:57.202 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.198+0000 7fe44cc5b6c0 1 -- 10.20.193.92:0/399819391 wait complete. 2026-02-13T04:00:57.204 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.199+0000 7fe44cc5b6c0 1 Processor -- start 2026-02-13T04:00:57.204 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.199+0000 7fe44cc5b6c0 1 -- start start 2026-02-13T04:00:57.204 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.199+0000 7fe44cc5b6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe44810f060 0x7fe44811ce30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:57.204 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.199+0000 7fe44cc5b6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe448115270 0x7fe44811d370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:57.204 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.199+0000 7fe44cc5b6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe448122730 0x7fe448122bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:57.205 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.199+0000 7fe44cc5b6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe448123140 con 0x7fe448115270 2026-02-13T04:00:57.205 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.199+0000 7fe44cc5b6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe4481232b0 con 0x7fe448122730 2026-02-13T04:00:57.205 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.199+0000 7fe44cc5b6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fe448123470 con 0x7fe44810f060 2026-02-13T04:00:57.205 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.200+0000 7fe446ffd6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe448115270 0x7fe44811d370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:57.205 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.200+0000 7fe4477fe6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe44810f060 0x7fe44811ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:57.205 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.200+0000 7fe446ffd6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe448115270 0x7fe44811d370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:55736/0 (socket says 10.20.193.92:55736) 2026-02-13T04:00:57.205 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.200+0000 7fe446ffd6c0 1 -- 10.20.193.92:0/3180233943 learned_addr learned my addr 10.20.193.92:0/3180233943 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:00:57.205 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.200+0000 7fe447fff6c0 1 --2- 10.20.193.92:0/3180233943 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe448122730 0x7fe448122bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:57.205 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.200+0000 7fe446ffd6c0 1 -- 10.20.193.92:0/3180233943 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe44810f060 msgr2=0x7fe44811ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:57.205 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.200+0000 7fe446ffd6c0 1 --2- 10.20.193.92:0/3180233943 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe44810f060 0x7fe44811ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:57.205 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.200+0000 7fe446ffd6c0 1 -- 10.20.193.92:0/3180233943 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe448122730 msgr2=0x7fe448122bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:57.206 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.200+0000 7fe446ffd6c0 1 --2- 10.20.193.92:0/3180233943 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe448122730 0x7fe448122bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:57.206 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.200+0000 7fe446ffd6c0 1 -- 10.20.193.92:0/3180233943 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe43c00a5b0 con 0x7fe448115270 2026-02-13T04:00:57.206 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.200+0000 7fe446ffd6c0 1 --2- 10.20.193.92:0/3180233943 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe448115270 0x7fe44811d370 secure :-1 s=READY pgs=187 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe438005930 tx=0x7fe43800bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:57.206 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.200+0000 7fe444ff96c0 1 -- 10.20.193.92:0/3180233943 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe438004a80 con 0x7fe448115270 2026-02-13T04:00:57.206 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.200+0000 7fe444ff96c0 1 -- 10.20.193.92:0/3180233943 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fe438009030 con 0x7fe448115270 2026-02-13T04:00:57.206 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.200+0000 7fe444ff96c0 1 -- 10.20.193.92:0/3180233943 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe4380071c0 con 0x7fe448115270 2026-02-13T04:00:57.206 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.200+0000 7fe44cc5b6c0 1 -- 10.20.193.92:0/3180233943 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe448163920 con 0x7fe448115270 2026-02-13T04:00:57.206 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.200+0000 7fe44cc5b6c0 1 -- 10.20.193.92:0/3180233943 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe448163db0 con 0x7fe448115270 2026-02-13T04:00:57.206 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.201+0000 7fe44cc5b6c0 1 -- 10.20.193.92:0/3180233943 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe448110330 con 0x7fe448115270 2026-02-13T04:00:57.207 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.203+0000 7fe444ff96c0 1 -- 10.20.193.92:0/3180233943 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7fe438005000 con 0x7fe448115270 2026-02-13T04:00:57.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.205+0000 7fe444ff96c0 1 --2- 10.20.193.92:0/3180233943 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fe41c0b56d0 0x7fe41c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:57.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.205+0000 7fe444ff96c0 1 -- 10.20.193.92:0/3180233943 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7fe4380e3ac0 con 0x7fe448115270 2026-02-13T04:00:57.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.205+0000 7fe444ff96c0 1 -- 10.20.193.92:0/3180233943 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe43811c5e0 con 0x7fe448115270 2026-02-13T04:00:57.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.205+0000 7fe4477fe6c0 1 --2- 10.20.193.92:0/3180233943 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fe41c0b56d0 0x7fe41c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:57.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.205+0000 7fe4477fe6c0 1 --2- 10.20.193.92:0/3180233943 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fe41c0b56d0 0x7fe41c0d5b80 secure :-1 s=READY pgs=143 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe434004750 tx=0x7fe434009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:57.325 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.322+0000 7fe44cc5b6c0 1 -- 10.20.193.92:0/3180233943 --> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fe44810fa50 con 0x7fe41c0b56d0 2026-02-13T04:00:57.326 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:57 trial092 ceph-mon[23047]: mds.? [v2:10.20.193.158:6836/3994694149,v1:10.20.193.158:6837/3994694149] up:active 2026-02-13T04:00:57.326 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:57 trial092 ceph-mon[23047]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2026-02-13T04:00:57.326 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:57 trial092 ceph-mon[23047]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2026-02-13T04:00:57.326 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:57 trial092 ceph-mon[23047]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2026-02-13T04:00:57.326 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:57 trial092 ceph-mon[23047]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2026-02-13T04:00:57.326 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:57 trial092 ceph-mon[23047]: daemon mds.f is now active in filesystem cephfs as rank 4 2026-02-13T04:00:57.326 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:57 trial092 ceph-mon[23047]: from='client.24736 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T04:00:57.328 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.326+0000 7fe444ff96c0 1 -- 10.20.193.92:0/3180233943 <== mgr.14187 v2:10.20.193.92:6800/4191527999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fe44810fa50 con 0x7fe41c0b56d0 2026-02-13T04:00:57.329 INFO:teuthology.orchestra.run.trial092.stdout:/volumes/qa/sv_0/2a066e34-e963-47ea-8ca7-5526a38a7922 2026-02-13T04:00:57.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:57 trial158 ceph-mon[27763]: mds.? [v2:10.20.193.158:6836/3994694149,v1:10.20.193.158:6837/3994694149] up:active 2026-02-13T04:00:57.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:57 trial158 ceph-mon[27763]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2026-02-13T04:00:57.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:57 trial158 ceph-mon[27763]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2026-02-13T04:00:57.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:57 trial158 ceph-mon[27763]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2026-02-13T04:00:57.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:57 trial158 ceph-mon[27763]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2026-02-13T04:00:57.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:57 trial158 ceph-mon[27763]: daemon mds.f is now active in filesystem cephfs as rank 4 2026-02-13T04:00:57.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:57 trial158 ceph-mon[27763]: from='client.24736 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T04:00:57.331 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.327+0000 7fe44cc5b6c0 1 -- 10.20.193.92:0/3180233943 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fe41c0b56d0 msgr2=0x7fe41c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:57.331 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.327+0000 7fe44cc5b6c0 1 --2- 10.20.193.92:0/3180233943 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fe41c0b56d0 0x7fe41c0d5b80 secure :-1 s=READY pgs=143 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe434004750 tx=0x7fe434009260 comp rx=0 tx=0).stop 2026-02-13T04:00:57.331 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.327+0000 7fe44cc5b6c0 1 -- 10.20.193.92:0/3180233943 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe448115270 msgr2=0x7fe44811d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:57.331 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.327+0000 7fe44cc5b6c0 1 --2- 10.20.193.92:0/3180233943 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe448115270 0x7fe44811d370 secure :-1 s=READY pgs=187 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe438005930 tx=0x7fe43800bc50 comp rx=0 tx=0).stop 2026-02-13T04:00:57.331 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.327+0000 7fe44cc5b6c0 1 -- 10.20.193.92:0/3180233943 shutdown_connections 2026-02-13T04:00:57.331 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.327+0000 7fe44cc5b6c0 1 --2- 10.20.193.92:0/3180233943 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fe41c0b56d0 0x7fe41c0d5b80 unknown :-1 s=CLOSED pgs=143 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:57.331 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.327+0000 7fe44cc5b6c0 1 --2- 10.20.193.92:0/3180233943 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe448122730 0x7fe448122bd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:57.331 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.327+0000 7fe44cc5b6c0 1 --2- 10.20.193.92:0/3180233943 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe448115270 0x7fe44811d370 unknown :-1 s=CLOSED pgs=187 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:57.331 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.327+0000 7fe44cc5b6c0 1 --2- 10.20.193.92:0/3180233943 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe44810f060 0x7fe44811ce30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:57.331 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.327+0000 7fe44cc5b6c0 1 -- 10.20.193.92:0/3180233943 >> 10.20.193.92:0/3180233943 conn(0x7fe4480ec980 msgr2=0x7fe44810cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:57.332 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.327+0000 7fe44cc5b6c0 1 -- 10.20.193.92:0/3180233943 shutdown_connections 2026-02-13T04:00:57.332 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.327+0000 7fe44cc5b6c0 1 -- 10.20.193.92:0/3180233943 wait complete. 2026-02-13T04:00:57.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:57 trial099 ceph-mon[27808]: mds.? [v2:10.20.193.158:6836/3994694149,v1:10.20.193.158:6837/3994694149] up:active 2026-02-13T04:00:57.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:57 trial099 ceph-mon[27808]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2026-02-13T04:00:57.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:57 trial099 ceph-mon[27808]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2026-02-13T04:00:57.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:57 trial099 ceph-mon[27808]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2026-02-13T04:00:57.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:57 trial099 ceph-mon[27808]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2026-02-13T04:00:57.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:57 trial099 ceph-mon[27808]: daemon mds.f is now active in filesystem cephfs as rank 4 2026-02-13T04:00:57.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:57 trial099 ceph-mon[27808]: from='client.24736 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T04:00:57.433 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2026-02-13T04:00:57.616 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:00:57.814 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.810+0000 7f718e6666c0 1 -- 10.20.193.92:0/4180146534 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7188114190 msgr2=0x7f7188115d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:57.814 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.810+0000 7f718e6666c0 1 --2- 10.20.193.92:0/4180146534 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7188114190 0x7f7188115d40 secure :-1 s=READY pgs=89 gs=1 cs=0 l=1 c_cookie=17174124739481845524 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f717c009970 tx=0x7f717c02ed10 comp rx=0 tx=0).stop 2026-02-13T04:00:57.814 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.810+0000 7f718e6666c0 1 -- 10.20.193.92:0/4180146534 shutdown_connections 2026-02-13T04:00:57.814 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.810+0000 7f718e6666c0 1 --2- 10.20.193.92:0/4180146534 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7188114190 0x7f7188115d40 unknown :-1 s=CLOSED pgs=89 gs=1 cs=0 l=1 c_cookie=17174124739481845524 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:57.814 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.810+0000 7f718e6666c0 1 --2- 10.20.193.92:0/4180146534 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7188116520 0x7f718817a100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:57.814 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.810+0000 7f718e6666c0 1 --2- 10.20.193.92:0/4180146534 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f71881137a0 0x7f7188113b70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:57.814 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.810+0000 7f718e6666c0 1 -- 10.20.193.92:0/4180146534 >> 10.20.193.92:0/4180146534 conn(0x7f7188061510 msgr2=0x7f7188061910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:57.814 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.810+0000 7f718e6666c0 1 -- 10.20.193.92:0/4180146534 shutdown_connections 2026-02-13T04:00:57.814 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.810+0000 7f718e6666c0 1 -- 10.20.193.92:0/4180146534 wait complete. 2026-02-13T04:00:57.815 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.811+0000 7f718e6666c0 1 Processor -- start 2026-02-13T04:00:57.815 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.811+0000 7f718e6666c0 1 -- start start 2026-02-13T04:00:57.816 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.811+0000 7f718e6666c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f71881137a0 0x7f7188121310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:57.816 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.811+0000 7f718e6666c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7188116520 0x7f7188121850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:57.817 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.811+0000 7f718e6666c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7188126c10 0x7f71881270b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:57.817 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.811+0000 7f718e6666c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7188127620 con 0x7f71881137a0 2026-02-13T04:00:57.817 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.811+0000 7f718e6666c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7188127790 con 0x7f7188126c10 2026-02-13T04:00:57.817 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.811+0000 7f718e6666c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f7188127950 con 0x7f7188116520 2026-02-13T04:00:57.817 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.811+0000 7f718d6646c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f71881137a0 0x7f7188121310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:57.817 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.811+0000 7f718d6646c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f71881137a0 0x7f7188121310 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:55752/0 (socket says 10.20.193.92:55752) 2026-02-13T04:00:57.817 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.811+0000 7f718d6646c0 1 -- 10.20.193.92:0/79015991 learned_addr learned my addr 10.20.193.92:0/79015991 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:00:57.817 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.811+0000 7f718ce636c0 1 --2- 10.20.193.92:0/79015991 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7188116520 0x7f7188121850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:57.817 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.812+0000 7f718de656c0 1 --2- 10.20.193.92:0/79015991 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7188126c10 0x7f71881270b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:57.817 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.812+0000 7f718d6646c0 1 -- 10.20.193.92:0/79015991 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7188116520 msgr2=0x7f7188121850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:57.818 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.812+0000 7f718d6646c0 1 --2- 10.20.193.92:0/79015991 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7188116520 0x7f7188121850 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:57.818 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.812+0000 7f718d6646c0 1 -- 10.20.193.92:0/79015991 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7188126c10 msgr2=0x7f71881270b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:57.818 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.812+0000 7f718d6646c0 1 --2- 10.20.193.92:0/79015991 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7188126c10 0x7f71881270b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:57.818 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.812+0000 7f718d6646c0 1 -- 10.20.193.92:0/79015991 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f717c009590 con 0x7f71881137a0 2026-02-13T04:00:57.818 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.812+0000 7f718ce636c0 1 --2- 10.20.193.92:0/79015991 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7188116520 0x7f7188121850 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T04:00:57.818 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.812+0000 7f718d6646c0 1 --2- 10.20.193.92:0/79015991 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f71881137a0 0x7f7188121310 secure :-1 s=READY pgs=188 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7178009490 tx=0x7f717800bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:57.818 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.812+0000 7f718de656c0 1 --2- 10.20.193.92:0/79015991 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7188126c10 0x7f71881270b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T04:00:57.818 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.812+0000 7f71767fc6c0 1 -- 10.20.193.92:0/79015991 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7178004a80 con 0x7f71881137a0 2026-02-13T04:00:57.818 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.812+0000 7f71767fc6c0 1 -- 10.20.193.92:0/79015991 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f7178009030 con 0x7f71881137a0 2026-02-13T04:00:57.818 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.812+0000 7f718e6666c0 1 -- 10.20.193.92:0/79015991 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7188167e00 con 0x7f71881137a0 2026-02-13T04:00:57.818 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.812+0000 7f718e6666c0 1 -- 10.20.193.92:0/79015991 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71881682e0 con 0x7f71881137a0 2026-02-13T04:00:57.818 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.812+0000 7f71767fc6c0 1 -- 10.20.193.92:0/79015991 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f71780071c0 con 0x7f71881137a0 2026-02-13T04:00:57.819 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.813+0000 7f718e6666c0 1 -- 10.20.193.92:0/79015991 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7188114840 con 0x7f71881137a0 2026-02-13T04:00:57.819 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.815+0000 7f71767fc6c0 1 -- 10.20.193.92:0/79015991 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 15) ==== 157083+0+0 (secure 0 0 0) 0x7f7178004060 con 0x7f71881137a0 2026-02-13T04:00:57.820 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.817+0000 7f71767fc6c0 1 --2- 10.20.193.92:0/79015991 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f71640b56d0 0x7f71640d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:57.820 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.817+0000 7f71767fc6c0 1 -- 10.20.193.92:0/79015991 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7f71780e3be0 con 0x7f71881137a0 2026-02-13T04:00:57.820 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.817+0000 7f718ce636c0 1 --2- 10.20.193.92:0/79015991 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f71640b56d0 0x7f71640d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:57.820 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.817+0000 7f71767fc6c0 1 -- 10.20.193.92:0/79015991 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f717811c640 con 0x7f71881137a0 2026-02-13T04:00:57.820 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.817+0000 7f718ce636c0 1 --2- 10.20.193.92:0/79015991 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f71640b56d0 0x7f71640d5b80 secure :-1 s=READY pgs=144 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f717c0023e0 tx=0x7f717c0071c0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:57.938 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.935+0000 7f718e6666c0 1 -- 10.20.193.92:0/79015991 --> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f7188122460 con 0x7f71640b56d0 2026-02-13T04:00:57.954 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.951+0000 7f71767fc6c0 1 -- 10.20.193.92:0/79015991 <== mgr.14187 v2:10.20.193.92:6800/4191527999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f7188122460 con 0x7f71640b56d0 2026-02-13T04:00:57.956 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.953+0000 7f718e6666c0 1 -- 10.20.193.92:0/79015991 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f71640b56d0 msgr2=0x7f71640d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:57.956 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.953+0000 7f718e6666c0 1 --2- 10.20.193.92:0/79015991 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f71640b56d0 0x7f71640d5b80 secure :-1 s=READY pgs=144 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f717c0023e0 tx=0x7f717c0071c0 comp rx=0 tx=0).stop 2026-02-13T04:00:57.956 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.953+0000 7f718e6666c0 1 -- 10.20.193.92:0/79015991 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f71881137a0 msgr2=0x7f7188121310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:57.956 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.953+0000 7f718e6666c0 1 --2- 10.20.193.92:0/79015991 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f71881137a0 0x7f7188121310 secure :-1 s=READY pgs=188 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7178009490 tx=0x7f717800bca0 comp rx=0 tx=0).stop 2026-02-13T04:00:57.957 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.953+0000 7f718e6666c0 1 -- 10.20.193.92:0/79015991 shutdown_connections 2026-02-13T04:00:57.957 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.953+0000 7f718e6666c0 1 --2- 10.20.193.92:0/79015991 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f71640b56d0 0x7f71640d5b80 unknown :-1 s=CLOSED pgs=144 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:57.957 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.953+0000 7f718e6666c0 1 --2- 10.20.193.92:0/79015991 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7188126c10 0x7f71881270b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:57.957 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.953+0000 7f718e6666c0 1 --2- 10.20.193.92:0/79015991 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7188116520 0x7f7188121850 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:57.957 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.953+0000 7f718e6666c0 1 --2- 10.20.193.92:0/79015991 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f71881137a0 0x7f7188121310 unknown :-1 s=CLOSED pgs=188 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:57.957 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.953+0000 7f718e6666c0 1 -- 10.20.193.92:0/79015991 >> 10.20.193.92:0/79015991 conn(0x7f7188061510 msgr2=0x7f7188062970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:57.957 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.953+0000 7f718e6666c0 1 -- 10.20.193.92:0/79015991 shutdown_connections 2026-02-13T04:00:57.957 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:57.953+0000 7f718e6666c0 1 -- 10.20.193.92:0/79015991 wait complete. 2026-02-13T04:00:58.058 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2026-02-13T04:00:58.242 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:00:58.285 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:58 trial092 ceph-mon[23047]: mds.? [v2:10.20.193.158:6834/3920757139,v1:10.20.193.158:6835/3920757139] up:active 2026-02-13T04:00:58.286 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:58 trial092 ceph-mon[23047]: fsmap cephfs:5 7 up:standby 5 up:active 2026-02-13T04:00:58.286 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:58 trial092 ceph-mon[23047]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2026-02-13T04:00:58.286 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:58 trial092 ceph-mon[23047]: pgmap v181: 97 pgs: 97 active+clean; 590 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 7.2 KiB/s wr, 18 op/s 2026-02-13T04:00:58.286 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:58 trial092 ceph-mon[23047]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T04:00:58.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:58 trial158 ceph-mon[27763]: mds.? [v2:10.20.193.158:6834/3920757139,v1:10.20.193.158:6835/3920757139] up:active 2026-02-13T04:00:58.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:58 trial158 ceph-mon[27763]: fsmap cephfs:5 7 up:standby 5 up:active 2026-02-13T04:00:58.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:58 trial158 ceph-mon[27763]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2026-02-13T04:00:58.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:58 trial158 ceph-mon[27763]: pgmap v181: 97 pgs: 97 active+clean; 590 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 7.2 KiB/s wr, 18 op/s 2026-02-13T04:00:58.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:58 trial158 ceph-mon[27763]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T04:00:58.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:58 trial099 ceph-mon[27808]: mds.? [v2:10.20.193.158:6834/3920757139,v1:10.20.193.158:6835/3920757139] up:active 2026-02-13T04:00:58.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:58 trial099 ceph-mon[27808]: fsmap cephfs:5 7 up:standby 5 up:active 2026-02-13T04:00:58.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:58 trial099 ceph-mon[27808]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2026-02-13T04:00:58.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:58 trial099 ceph-mon[27808]: pgmap v181: 97 pgs: 97 active+clean; 590 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 7.2 KiB/s wr, 18 op/s 2026-02-13T04:00:58.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:58 trial099 ceph-mon[27808]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T04:00:58.442 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.439+0000 7effba5336c0 1 -- 10.20.193.92:0/1207961473 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7effb4110d40 msgr2=0x7effb4111700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:58.442 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.439+0000 7effba5336c0 1 --2- 10.20.193.92:0/1207961473 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7effb4110d40 0x7effb4111700 secure :-1 s=READY pgs=189 gs=1 cs=0 l=1 c_cookie=7977945723469774076 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7effb000aa40 tx=0x7effb002fde0 comp rx=0 tx=0).stop 2026-02-13T04:00:58.442 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.439+0000 7effba5336c0 1 -- 10.20.193.92:0/1207961473 shutdown_connections 2026-02-13T04:00:58.442 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.439+0000 7effba5336c0 1 --2- 10.20.193.92:0/1207961473 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7effb4110d40 0x7effb4111700 unknown :-1 s=CLOSED pgs=189 gs=1 cs=0 l=1 c_cookie=7977945723469774076 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:58.442 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.439+0000 7effba5336c0 1 --2- 10.20.193.92:0/1207961473 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7effb410b730 0x7effb4110590 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:58.442 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.439+0000 7effba5336c0 1 --2- 10.20.193.92:0/1207961473 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7effb410ad40 0x7effb410b110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:58.442 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.439+0000 7effba5336c0 1 -- 10.20.193.92:0/1207961473 >> 10.20.193.92:0/1207961473 conn(0x7effb40638a0 msgr2=0x7effb4109040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:58.442 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.439+0000 7effba5336c0 1 -- 10.20.193.92:0/1207961473 shutdown_connections 2026-02-13T04:00:58.442 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.439+0000 7effba5336c0 1 -- 10.20.193.92:0/1207961473 wait complete. 2026-02-13T04:00:58.443 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.440+0000 7effba5336c0 1 Processor -- start 2026-02-13T04:00:58.443 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.440+0000 7effba5336c0 1 -- start start 2026-02-13T04:00:58.443 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.440+0000 7effba5336c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7effb410ad40 0x7effb4122310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:58.443 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.441+0000 7effba5336c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7effb4110d40 0x7effb4122850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:58.443 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.441+0000 7effba5336c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7effb4127c10 0x7effb41280b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:58.443 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.441+0000 7effba5336c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7effb4128620 con 0x7effb4110d40 2026-02-13T04:00:58.443 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.441+0000 7effba5336c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7effb4128790 con 0x7effb410ad40 2026-02-13T04:00:58.443 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.441+0000 7effba5336c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7effb4128950 con 0x7effb4127c10 2026-02-13T04:00:58.444 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.441+0000 7effb8d306c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7effb4110d40 0x7effb4122850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:58.444 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.441+0000 7effb95316c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7effb410ad40 0x7effb4122310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:58.444 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.441+0000 7effb95316c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7effb410ad40 0x7effb4122310 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:42288/0 (socket says 10.20.193.92:42288) 2026-02-13T04:00:58.444 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.441+0000 7effb95316c0 1 -- 10.20.193.92:0/391878706 learned_addr learned my addr 10.20.193.92:0/391878706 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:00:58.444 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.441+0000 7effb9d326c0 1 --2- 10.20.193.92:0/391878706 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7effb4127c10 0x7effb41280b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:58.444 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.441+0000 7effb95316c0 1 -- 10.20.193.92:0/391878706 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7effb4127c10 msgr2=0x7effb41280b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:58.444 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.441+0000 7effb95316c0 1 --2- 10.20.193.92:0/391878706 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7effb4127c10 0x7effb41280b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:58.444 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.441+0000 7effb95316c0 1 -- 10.20.193.92:0/391878706 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7effb4110d40 msgr2=0x7effb4122850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:58.444 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.441+0000 7effb95316c0 1 --2- 10.20.193.92:0/391878706 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7effb4110d40 0x7effb4122850 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:58.444 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.441+0000 7effb95316c0 1 -- 10.20.193.92:0/391878706 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb000a660 con 0x7effb410ad40 2026-02-13T04:00:58.444 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.441+0000 7effb95316c0 1 --2- 10.20.193.92:0/391878706 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7effb410ad40 0x7effb4122310 secure :-1 s=READY pgs=90 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7effa4009490 tx=0x7effa400bca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:58.444 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.441+0000 7effa27fc6c0 1 -- 10.20.193.92:0/391878706 <== mon.2 v2:10.20.193.99:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7effa4004a80 con 0x7effb410ad40 2026-02-13T04:00:58.444 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.441+0000 7effa27fc6c0 1 -- 10.20.193.92:0/391878706 <== mon.2 v2:10.20.193.99:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7effa4009030 con 0x7effb410ad40 2026-02-13T04:00:58.444 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.442+0000 7effba5336c0 1 -- 10.20.193.92:0/391878706 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effb4168e00 con 0x7effb410ad40 2026-02-13T04:00:58.444 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.442+0000 7effa27fc6c0 1 -- 10.20.193.92:0/391878706 <== mon.2 v2:10.20.193.99:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7effa4007440 con 0x7effb410ad40 2026-02-13T04:00:58.444 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.442+0000 7effba5336c0 1 -- 10.20.193.92:0/391878706 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effb4169290 con 0x7effb410ad40 2026-02-13T04:00:58.445 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.442+0000 7effba5336c0 1 -- 10.20.193.92:0/391878706 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effb410be30 con 0x7effb410ad40 2026-02-13T04:00:58.447 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.444+0000 7effa27fc6c0 1 -- 10.20.193.92:0/391878706 <== mon.2 v2:10.20.193.99:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7effa4004060 con 0x7effb410ad40 2026-02-13T04:00:58.448 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.446+0000 7effa27fc6c0 1 --2- 10.20.193.92:0/391878706 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7eff900b56e0 0x7eff900d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:58.449 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.446+0000 7effa27fc6c0 1 -- 10.20.193.92:0/391878706 <== mon.2 v2:10.20.193.99:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7effa40e3c70 con 0x7effb410ad40 2026-02-13T04:00:58.449 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.446+0000 7effa27fc6c0 1 -- 10.20.193.92:0/391878706 <== mon.2 v2:10.20.193.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7effa40e40f0 con 0x7effb410ad40 2026-02-13T04:00:58.449 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.447+0000 7effb8d306c0 1 --2- 10.20.193.92:0/391878706 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7eff900b56e0 0x7eff900d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:58.450 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.447+0000 7effb8d306c0 1 --2- 10.20.193.92:0/391878706 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7eff900b56e0 0x7eff900d5b90 secure :-1 s=READY pgs=145 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7effb4128ca0 tx=0x7effa8009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:58.567 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.564+0000 7effba5336c0 1 -- 10.20.193.92:0/391878706 --> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7effb41234f0 con 0x7eff900b56e0 2026-02-13T04:00:58.570 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.568+0000 7effa27fc6c0 1 -- 10.20.193.92:0/391878706 <== mgr.14187 v2:10.20.193.92:6800/4191527999 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7effa8009970 con 0x7eff900b56e0 2026-02-13T04:00:58.570 INFO:teuthology.orchestra.run.trial092.stdout:/volumes/qa/sv_1/014c3ac1-4c5a-40e4-8fc6-ac3ff23f96f8 2026-02-13T04:00:58.571 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.569+0000 7effba5336c0 1 -- 10.20.193.92:0/391878706 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7eff900b56e0 msgr2=0x7eff900d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:58.571 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.569+0000 7effba5336c0 1 --2- 10.20.193.92:0/391878706 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7eff900b56e0 0x7eff900d5b90 secure :-1 s=READY pgs=145 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7effb4128ca0 tx=0x7effa8009260 comp rx=0 tx=0).stop 2026-02-13T04:00:58.571 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.569+0000 7effba5336c0 1 -- 10.20.193.92:0/391878706 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7effb410ad40 msgr2=0x7effb4122310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:58.571 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.569+0000 7effba5336c0 1 --2- 10.20.193.92:0/391878706 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7effb410ad40 0x7effb4122310 secure :-1 s=READY pgs=90 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7effa4009490 tx=0x7effa400bca0 comp rx=0 tx=0).stop 2026-02-13T04:00:58.572 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.569+0000 7effba5336c0 1 -- 10.20.193.92:0/391878706 shutdown_connections 2026-02-13T04:00:58.572 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.569+0000 7effba5336c0 1 --2- 10.20.193.92:0/391878706 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7effb4127c10 0x7effb41280b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:58.572 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.569+0000 7effba5336c0 1 --2- 10.20.193.92:0/391878706 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7effb4110d40 0x7effb4122850 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:58.572 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.569+0000 7effba5336c0 1 --2- 10.20.193.92:0/391878706 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7eff900b56e0 0x7eff900d5b90 unknown :-1 s=CLOSED pgs=145 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:58.572 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.569+0000 7effba5336c0 1 --2- 10.20.193.92:0/391878706 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7effb410ad40 0x7effb4122310 unknown :-1 s=CLOSED pgs=90 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:58.572 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.569+0000 7effba5336c0 1 -- 10.20.193.92:0/391878706 >> 10.20.193.92:0/391878706 conn(0x7effb40638a0 msgr2=0x7effb410db40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:58.572 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.569+0000 7effba5336c0 1 -- 10.20.193.92:0/391878706 shutdown_connections 2026-02-13T04:00:58.572 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:58.569+0000 7effba5336c0 1 -- 10.20.193.92:0/391878706 wait complete. 2026-02-13T04:00:58.672 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph fs dump --format=json 2026-02-13T04:00:58.854 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:00:59.056 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.052+0000 7f32758806c0 1 -- 10.20.193.92:0/1490272897 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3270115270 msgr2=0x7f3270175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:59.056 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.052+0000 7f32758806c0 1 --2- 10.20.193.92:0/1490272897 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3270115270 0x7f3270175c10 secure :-1 s=READY pgs=190 gs=1 cs=0 l=1 c_cookie=5421798169326999742 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f326c00a9b0 tx=0x7f326c02fd60 comp rx=0 tx=0).stop 2026-02-13T04:00:59.056 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.052+0000 7f32758806c0 1 -- 10.20.193.92:0/1490272897 shutdown_connections 2026-02-13T04:00:59.056 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.052+0000 7f32758806c0 1 --2- 10.20.193.92:0/1490272897 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f327010fa50 0x7f3270114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:59.056 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.052+0000 7f32758806c0 1 --2- 10.20.193.92:0/1490272897 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3270115270 0x7f3270175c10 unknown :-1 s=CLOSED pgs=190 gs=1 cs=0 l=1 c_cookie=5421798169326999742 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:59.056 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.052+0000 7f32758806c0 1 --2- 10.20.193.92:0/1490272897 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f327010f060 0x7f327010f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:59.056 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.052+0000 7f32758806c0 1 -- 10.20.193.92:0/1490272897 >> 10.20.193.92:0/1490272897 conn(0x7f32700ec980 msgr2=0x7f327010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:59.056 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.052+0000 7f32758806c0 1 -- 10.20.193.92:0/1490272897 shutdown_connections 2026-02-13T04:00:59.057 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.052+0000 7f32758806c0 1 -- 10.20.193.92:0/1490272897 wait complete. 2026-02-13T04:00:59.058 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.053+0000 7f32758806c0 1 Processor -- start 2026-02-13T04:00:59.058 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.053+0000 7f32758806c0 1 -- start start 2026-02-13T04:00:59.058 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.054+0000 7f32758806c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f327010f060 0x7f327011cdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:59.059 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.054+0000 7f32758806c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3270115270 0x7f327011d330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:59.059 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.054+0000 7f32758806c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f32701226f0 0x7f3270122b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:59.059 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.054+0000 7f32758806c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3270123100 con 0x7f3270115270 2026-02-13T04:00:59.059 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.054+0000 7f32758806c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f3270123270 con 0x7f32701226f0 2026-02-13T04:00:59.059 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.054+0000 7f32758806c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f3270123430 con 0x7f327010f060 2026-02-13T04:00:59.059 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.054+0000 7f327487e6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f327010f060 0x7f327011cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:59.059 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.054+0000 7f327487e6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f327010f060 0x7f327011cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:56652/0 (socket says 10.20.193.92:56652) 2026-02-13T04:00:59.059 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.054+0000 7f327487e6c0 1 -- 10.20.193.92:0/492621161 learned_addr learned my addr 10.20.193.92:0/492621161 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:00:59.059 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.054+0000 7f327507f6c0 1 --2- 10.20.193.92:0/492621161 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f32701226f0 0x7f3270122b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:59.059 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.054+0000 7f3267fff6c0 1 --2- 10.20.193.92:0/492621161 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3270115270 0x7f327011d330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:59.059 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.054+0000 7f327487e6c0 1 -- 10.20.193.92:0/492621161 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f32701226f0 msgr2=0x7f3270122b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:59.060 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.054+0000 7f327487e6c0 1 --2- 10.20.193.92:0/492621161 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f32701226f0 0x7f3270122b90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:59.060 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.054+0000 7f327487e6c0 1 -- 10.20.193.92:0/492621161 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3270115270 msgr2=0x7f327011d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:59.060 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.054+0000 7f327487e6c0 1 --2- 10.20.193.92:0/492621161 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3270115270 0x7f327011d330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:59.060 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.054+0000 7f327487e6c0 1 -- 10.20.193.92:0/492621161 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f326c00a5b0 con 0x7f327010f060 2026-02-13T04:00:59.060 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.054+0000 7f3267fff6c0 1 --2- 10.20.193.92:0/492621161 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3270115270 0x7f327011d330 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T04:00:59.060 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.054+0000 7f327487e6c0 1 --2- 10.20.193.92:0/492621161 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f327010f060 0x7f327011cdf0 secure :-1 s=READY pgs=84 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3260005950 tx=0x7f326000bca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:59.060 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.054+0000 7f3265ffb6c0 1 -- 10.20.193.92:0/492621161 <== mon.1 v2:10.20.193.158:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3260004460 con 0x7f327010f060 2026-02-13T04:00:59.060 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.054+0000 7f32758806c0 1 -- 10.20.193.92:0/492621161 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32701638e0 con 0x7f327010f060 2026-02-13T04:00:59.060 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.054+0000 7f3265ffb6c0 1 -- 10.20.193.92:0/492621161 <== mon.1 v2:10.20.193.158:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f32600045c0 con 0x7f327010f060 2026-02-13T04:00:59.060 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.054+0000 7f3265ffb6c0 1 -- 10.20.193.92:0/492621161 <== mon.1 v2:10.20.193.158:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f3260003af0 con 0x7f327010f060 2026-02-13T04:00:59.060 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.054+0000 7f32758806c0 1 -- 10.20.193.92:0/492621161 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3270163d70 con 0x7f327010f060 2026-02-13T04:00:59.060 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.055+0000 7f32758806c0 1 -- 10.20.193.92:0/492621161 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3270110330 con 0x7f327010f060 2026-02-13T04:00:59.061 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.057+0000 7f3265ffb6c0 1 -- 10.20.193.92:0/492621161 <== mon.1 v2:10.20.193.158:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f3260005240 con 0x7f327010f060 2026-02-13T04:00:59.062 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.059+0000 7f3265ffb6c0 1 --2- 10.20.193.92:0/492621161 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f324c0b56e0 0x7f324c0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:59.062 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.059+0000 7f3265ffb6c0 1 -- 10.20.193.92:0/492621161 <== mon.1 v2:10.20.193.158:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7f32600e3d00 con 0x7f327010f060 2026-02-13T04:00:59.062 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.059+0000 7f3267fff6c0 1 --2- 10.20.193.92:0/492621161 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f324c0b56e0 0x7f324c0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:59.062 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.059+0000 7f3265ffb6c0 1 -- 10.20.193.92:0/492621161 <== mon.1 v2:10.20.193.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f32600e4180 con 0x7f327010f060 2026-02-13T04:00:59.063 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.060+0000 7f3267fff6c0 1 --2- 10.20.193.92:0/492621161 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f324c0b56e0 0x7f324c0d5b90 secure :-1 s=READY pgs=146 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3270123780 tx=0x7f3258009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:59.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:59 trial092 ceph-mon[23047]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T04:00:59.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:59 trial092 ceph-mon[23047]: mgrmap e16: x(active, since 2m), standbys: z, y 2026-02-13T04:00:59.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:00:59 trial092 ceph-mon[23047]: from='client.24758 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T04:00:59.185 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.182+0000 7f32758806c0 1 -- 10.20.193.92:0/492621161 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f327010f430 con 0x7f327010f060 2026-02-13T04:00:59.186 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.183+0000 7f3265ffb6c0 1 -- 10.20.193.92:0/492621161 <== mon.1 v2:10.20.193.158:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+12002 (secure 0 0 0) 0x7f32600a6650 con 0x7f327010f060 2026-02-13T04:00:59.186 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:00:59.186 INFO:teuthology.orchestra.run.trial092.stdout:{"epoch":26,"btime":"2026-02-13T04:00:57:075628+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14637,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.92:6835/3399599706","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6834","nonce":3399599706},{"type":"v1","addr":"10.20.193.92:6835","nonce":3399599706}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14667,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"10.20.193.92:6839/2488042022","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6838","nonce":2488042022},{"type":"v1","addr":"10.20.193.92:6839","nonce":2488042022}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false,"allow_referent_inodes":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2026-02-13T04:00:49.313254+0000","modified":"2026-02-13T04:00:57.075620+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24659,"mds_1":24637,"mds_2":24629,"mds_3":24625,"mds_4":24619},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14679":{"gid":14679,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.92:6841/1865944627","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6840","nonce":1865944627},{"type":"v1","addr":"10.20.193.92:6841","nonce":1865944627}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24586":{"gid":24586,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.158:6833/2722781962","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6832","nonce":2722781962},{"type":"v1","addr":"10.20.193.158:6833","nonce":2722781962}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24590":{"gid":24590,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.99:6833/2198675163","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6832","nonce":2198675163},{"type":"v1","addr":"10.20.193.99:6833","nonce":2198675163}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24604":{"gid":24604,"name":"d","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.92:6837/2861428966","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6836","nonce":2861428966},{"type":"v1","addr":"10.20.193.92:6837","nonce":2861428966}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24608":{"gid":24608,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"10.20.193.99:6835/1712552217","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6834","nonce":1712552217},{"type":"v1","addr":"10.20.193.99:6835","nonce":1712552217}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24619":{"gid":24619,"name":"f","rank":4,"incarnation":24,"state":"up:active","state_seq":6,"addr":"10.20.193.158:6835/3920757139","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6834","nonce":3920757139},{"type":"v1","addr":"10.20.193.158:6835","nonce":3920757139}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24625":{"gid":24625,"name":"c","rank":3,"incarnation":22,"state":"up:active","state_seq":6,"addr":"10.20.193.158:6837/3994694149","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6836","nonce":3994694149},{"type":"v1","addr":"10.20.193.158:6837","nonce":3994694149}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24629":{"gid":24629,"name":"h","rank":2,"incarnation":20,"state":"up:active","state_seq":5,"addr":"10.20.193.99:6837/1572110945","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6836","nonce":1572110945},{"type":"v1","addr":"10.20.193.99:6837","nonce":1572110945}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24637":{"gid":24637,"name":"i","rank":1,"incarnation":18,"state":"up:active","state_seq":5,"addr":"10.20.193.158:6839/2250447124","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6838","nonce":2250447124},{"type":"v1","addr":"10.20.193.158:6839","nonce":2250447124}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24659":{"gid":24659,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"10.20.193.99:6839/147734840","addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6838","nonce":147734840},{"type":"v1","addr":"10.20.193.99:6839","nonce":147734840}]},"join_fscid":-1,"export_targets":[],"features":4544132024016699391,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24659,"qdb_cluster":[24659,24637,24629,24625,24619]},"id":1}]} 2026-02-13T04:00:59.187 INFO:teuthology.orchestra.run.trial092.stderr:dumped fsmap epoch 26 2026-02-13T04:00:59.187 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.184+0000 7f32758806c0 1 -- 10.20.193.92:0/492621161 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f324c0b56e0 msgr2=0x7f324c0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:59.187 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.184+0000 7f32758806c0 1 --2- 10.20.193.92:0/492621161 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f324c0b56e0 0x7f324c0d5b90 secure :-1 s=READY pgs=146 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3270123780 tx=0x7f3258009260 comp rx=0 tx=0).stop 2026-02-13T04:00:59.187 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.184+0000 7f32758806c0 1 -- 10.20.193.92:0/492621161 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f327010f060 msgr2=0x7f327011cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:59.188 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.184+0000 7f32758806c0 1 --2- 10.20.193.92:0/492621161 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f327010f060 0x7f327011cdf0 secure :-1 s=READY pgs=84 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3260005950 tx=0x7f326000bca0 comp rx=0 tx=0).stop 2026-02-13T04:00:59.188 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.184+0000 7f32758806c0 1 -- 10.20.193.92:0/492621161 shutdown_connections 2026-02-13T04:00:59.188 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.184+0000 7f32758806c0 1 --2- 10.20.193.92:0/492621161 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f324c0b56e0 0x7f324c0d5b90 unknown :-1 s=CLOSED pgs=146 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:59.188 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.184+0000 7f32758806c0 1 --2- 10.20.193.92:0/492621161 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f32701226f0 0x7f3270122b90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:59.188 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.184+0000 7f32758806c0 1 --2- 10.20.193.92:0/492621161 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f3270115270 0x7f327011d330 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:59.188 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.184+0000 7f32758806c0 1 --2- 10.20.193.92:0/492621161 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f327010f060 0x7f327011cdf0 unknown :-1 s=CLOSED pgs=84 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:59.188 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.184+0000 7f32758806c0 1 -- 10.20.193.92:0/492621161 >> 10.20.193.92:0/492621161 conn(0x7f32700ec980 msgr2=0x7f327010cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:59.188 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.184+0000 7f32758806c0 1 -- 10.20.193.92:0/492621161 shutdown_connections 2026-02-13T04:00:59.188 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.184+0000 7f32758806c0 1 -- 10.20.193.92:0/492621161 wait complete. 2026-02-13T04:00:59.289 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T04:00:59.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:59 trial099 ceph-mon[27808]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T04:00:59.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:59 trial099 ceph-mon[27808]: mgrmap e16: x(active, since 2m), standbys: z, y 2026-02-13T04:00:59.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:00:59 trial099 ceph-mon[27808]: from='client.24758 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T04:00:59.470 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:00:59.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:59 trial158 ceph-mon[27763]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T04:00:59.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:59 trial158 ceph-mon[27763]: mgrmap e16: x(active, since 2m), standbys: z, y 2026-02-13T04:00:59.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:00:59 trial158 ceph-mon[27763]: from='client.24758 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2026-02-13T04:00:59.658 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.655+0000 7f7dbdab06c0 1 -- 10.20.193.92:0/2662449831 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7db810f060 msgr2=0x7f7db810f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:59.659 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.655+0000 7f7dbdab06c0 1 --2- 10.20.193.92:0/2662449831 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7db810f060 0x7f7db810f430 secure :-1 s=READY pgs=191 gs=1 cs=0 l=1 c_cookie=16771422976295091554 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7da80099a0 tx=0x7f7da802ed00 comp rx=0 tx=0).stop 2026-02-13T04:00:59.659 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.655+0000 7f7dbdab06c0 1 -- 10.20.193.92:0/2662449831 shutdown_connections 2026-02-13T04:00:59.659 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.655+0000 7f7dbdab06c0 1 --2- 10.20.193.92:0/2662449831 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7db8115270 0x7f7db8175c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:59.659 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.655+0000 7f7dbdab06c0 1 --2- 10.20.193.92:0/2662449831 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7db810fa50 0x7f7db8114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:59.659 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.655+0000 7f7dbdab06c0 1 --2- 10.20.193.92:0/2662449831 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7db810f060 0x7f7db810f430 unknown :-1 s=CLOSED pgs=191 gs=1 cs=0 l=1 c_cookie=16771422976295091554 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:59.659 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.655+0000 7f7dbdab06c0 1 -- 10.20.193.92:0/2662449831 >> 10.20.193.92:0/2662449831 conn(0x7f7db80ec980 msgr2=0x7f7db810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:59.659 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.655+0000 7f7dbdab06c0 1 -- 10.20.193.92:0/2662449831 shutdown_connections 2026-02-13T04:00:59.659 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.655+0000 7f7dbdab06c0 1 -- 10.20.193.92:0/2662449831 wait complete. 2026-02-13T04:00:59.659 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.656+0000 7f7dbdab06c0 1 Processor -- start 2026-02-13T04:00:59.661 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.656+0000 7f7dbdab06c0 1 -- start start 2026-02-13T04:00:59.661 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.656+0000 7f7dbdab06c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7db810f060 0x7f7db811ce70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:59.661 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.656+0000 7f7dbdab06c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7db8115270 0x7f7db811d3b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:59.661 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.656+0000 7f7dbdab06c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7db8122770 0x7f7db8122c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:59.661 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.656+0000 7f7dbdab06c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7db8123180 con 0x7f7db8115270 2026-02-13T04:00:59.661 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.656+0000 7f7dbdab06c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7db81232f0 con 0x7f7db8122770 2026-02-13T04:00:59.661 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.656+0000 7f7dbdab06c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f7db81234b0 con 0x7f7db810f060 2026-02-13T04:00:59.662 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.656+0000 7f7daffff6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7db8115270 0x7f7db811d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:59.662 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.656+0000 7f7dbcaae6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7db810f060 0x7f7db811ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:59.662 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.656+0000 7f7daffff6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7db8115270 0x7f7db811d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:55812/0 (socket says 10.20.193.92:55812) 2026-02-13T04:00:59.662 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.656+0000 7f7daffff6c0 1 -- 10.20.193.92:0/3918757258 learned_addr learned my addr 10.20.193.92:0/3918757258 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:00:59.662 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.656+0000 7f7dbd2af6c0 1 --2- 10.20.193.92:0/3918757258 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7db8122770 0x7f7db8122c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:59.662 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.656+0000 7f7daffff6c0 1 -- 10.20.193.92:0/3918757258 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7db810f060 msgr2=0x7f7db811ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:59.662 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.656+0000 7f7daffff6c0 1 --2- 10.20.193.92:0/3918757258 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7db810f060 0x7f7db811ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:59.662 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.656+0000 7f7daffff6c0 1 -- 10.20.193.92:0/3918757258 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7db8122770 msgr2=0x7f7db8122c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:59.662 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.656+0000 7f7daffff6c0 1 --2- 10.20.193.92:0/3918757258 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7db8122770 0x7f7db8122c10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:59.662 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.656+0000 7f7daffff6c0 1 -- 10.20.193.92:0/3918757258 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7da8009590 con 0x7f7db8115270 2026-02-13T04:00:59.662 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.657+0000 7f7daffff6c0 1 --2- 10.20.193.92:0/3918757258 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7db8115270 0x7f7db811d3b0 secure :-1 s=READY pgs=192 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7da0005dc0 tx=0x7f7da000bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:59.663 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.657+0000 7f7dadffb6c0 1 -- 10.20.193.92:0/3918757258 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7da0004250 con 0x7f7db8115270 2026-02-13T04:00:59.663 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.657+0000 7f7dadffb6c0 1 -- 10.20.193.92:0/3918757258 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f7da0009070 con 0x7f7db8115270 2026-02-13T04:00:59.663 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.657+0000 7f7dbdab06c0 1 -- 10.20.193.92:0/3918757258 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7db8163960 con 0x7f7db8115270 2026-02-13T04:00:59.663 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.657+0000 7f7dbdab06c0 1 -- 10.20.193.92:0/3918757258 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7db8163df0 con 0x7f7db8115270 2026-02-13T04:00:59.663 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.657+0000 7f7dadffb6c0 1 -- 10.20.193.92:0/3918757258 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7da00071c0 con 0x7f7db8115270 2026-02-13T04:00:59.663 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.657+0000 7f7dbdab06c0 1 -- 10.20.193.92:0/3918757258 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7db8110330 con 0x7f7db8115270 2026-02-13T04:00:59.663 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.660+0000 7f7dadffb6c0 1 -- 10.20.193.92:0/3918757258 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f7da00043b0 con 0x7f7db8115270 2026-02-13T04:00:59.665 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.662+0000 7f7dadffb6c0 1 --2- 10.20.193.92:0/3918757258 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f7d940b56e0 0x7f7d940d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:00:59.665 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.662+0000 7f7dadffb6c0 1 -- 10.20.193.92:0/3918757258 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7f7da00e3c30 con 0x7f7db8115270 2026-02-13T04:00:59.665 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.662+0000 7f7dbcaae6c0 1 --2- 10.20.193.92:0/3918757258 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f7d940b56e0 0x7f7d940d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:00:59.665 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.662+0000 7f7dadffb6c0 1 -- 10.20.193.92:0/3918757258 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7da00e40b0 con 0x7f7db8115270 2026-02-13T04:00:59.666 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.662+0000 7f7dbcaae6c0 1 --2- 10.20.193.92:0/3918757258 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f7d940b56e0 0x7f7d940d5b90 secure :-1 s=READY pgs=147 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7da8005b40 tx=0x7f7da80023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:00:59.766 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.763+0000 7f7dbdab06c0 1 -- 10.20.193.92:0/3918757258 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7db811dfc0 con 0x7f7db8115270 2026-02-13T04:00:59.767 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.764+0000 7f7dadffb6c0 1 -- 10.20.193.92:0/3918757258 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22330 (secure 0 0 0) 0x7f7da00a6580 con 0x7f7db8115270 2026-02-13T04:00:59.767 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:00:59.767 INFO:teuthology.orchestra.run.trial092.stdout:{"epoch":76,"fsid":"1fefccae-0890-11f1-bcc5-d404e6e7d460","created":"2026-02-13T03:57:51.342799+0000","modified":"2026-02-13T04:00:50.465887+0000","last_up_change":"2026-02-13T04:00:28.570362+0000","last_in_change":"2026-02-13T04:00:20.284718+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T03:59:12.044389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-13T04:00:46.979064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-13T04:00:48.319223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8527c214-a46e-4505-b9a0-dc55e7cf6b55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6802","nonce":2375200644},{"type":"v1","addr":"10.20.193.92:6803","nonce":2375200644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6804","nonce":2375200644},{"type":"v1","addr":"10.20.193.92:6805","nonce":2375200644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6808","nonce":2375200644},{"type":"v1","addr":"10.20.193.92:6809","nonce":2375200644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6806","nonce":2375200644},{"type":"v1","addr":"10.20.193.92:6807","nonce":2375200644}]},"public_addr":"10.20.193.92:6803/2375200644","cluster_addr":"10.20.193.92:6805/2375200644","heartbeat_back_addr":"10.20.193.92:6809/2375200644","heartbeat_front_addr":"10.20.193.92:6807/2375200644","state":["exists","up"]},{"osd":1,"uuid":"253e5e0e-8571-4add-81e5-ca92934b8171","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6800","nonce":3943455734},{"type":"v1","addr":"10.20.193.99:6801","nonce":3943455734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6802","nonce":3943455734},{"type":"v1","addr":"10.20.193.99:6803","nonce":3943455734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6806","nonce":3943455734},{"type":"v1","addr":"10.20.193.99:6807","nonce":3943455734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6804","nonce":3943455734},{"type":"v1","addr":"10.20.193.99:6805","nonce":3943455734}]},"public_addr":"10.20.193.99:6801/3943455734","cluster_addr":"10.20.193.99:6803/3943455734","heartbeat_back_addr":"10.20.193.99:6807/3943455734","heartbeat_front_addr":"10.20.193.99:6805/3943455734","state":["exists","up"]},{"osd":2,"uuid":"e94c2f5c-ce8a-484e-9cf3-e436edc16bdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6800","nonce":676925869},{"type":"v1","addr":"10.20.193.158:6801","nonce":676925869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6802","nonce":676925869},{"type":"v1","addr":"10.20.193.158:6803","nonce":676925869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6806","nonce":676925869},{"type":"v1","addr":"10.20.193.158:6807","nonce":676925869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6804","nonce":676925869},{"type":"v1","addr":"10.20.193.158:6805","nonce":676925869}]},"public_addr":"10.20.193.158:6801/676925869","cluster_addr":"10.20.193.158:6803/676925869","heartbeat_back_addr":"10.20.193.158:6807/676925869","heartbeat_front_addr":"10.20.193.158:6805/676925869","state":["exists","up"]},{"osd":3,"uuid":"91080154-0bd8-4e06-832e-1590d7784229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6810","nonce":4168983230},{"type":"v1","addr":"10.20.193.92:6811","nonce":4168983230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6812","nonce":4168983230},{"type":"v1","addr":"10.20.193.92:6813","nonce":4168983230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6816","nonce":4168983230},{"type":"v1","addr":"10.20.193.92:6817","nonce":4168983230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6814","nonce":4168983230},{"type":"v1","addr":"10.20.193.92:6815","nonce":4168983230}]},"public_addr":"10.20.193.92:6811/4168983230","cluster_addr":"10.20.193.92:6813/4168983230","heartbeat_back_addr":"10.20.193.92:6817/4168983230","heartbeat_front_addr":"10.20.193.92:6815/4168983230","state":["exists","up"]},{"osd":4,"uuid":"fec31143-d966-4f9b-8021-73e24c1b4d32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6808","nonce":1135109881},{"type":"v1","addr":"10.20.193.99:6809","nonce":1135109881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6810","nonce":1135109881},{"type":"v1","addr":"10.20.193.99:6811","nonce":1135109881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6814","nonce":1135109881},{"type":"v1","addr":"10.20.193.99:6815","nonce":1135109881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6812","nonce":1135109881},{"type":"v1","addr":"10.20.193.99:6813","nonce":1135109881}]},"public_addr":"10.20.193.99:6809/1135109881","cluster_addr":"10.20.193.99:6811/1135109881","heartbeat_back_addr":"10.20.193.99:6815/1135109881","heartbeat_front_addr":"10.20.193.99:6813/1135109881","state":["exists","up"]},{"osd":5,"uuid":"fcb06e7c-2900-49d9-9b39-6521200cd89a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6808","nonce":428074602},{"type":"v1","addr":"10.20.193.158:6809","nonce":428074602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6810","nonce":428074602},{"type":"v1","addr":"10.20.193.158:6811","nonce":428074602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6814","nonce":428074602},{"type":"v1","addr":"10.20.193.158:6815","nonce":428074602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6812","nonce":428074602},{"type":"v1","addr":"10.20.193.158:6813","nonce":428074602}]},"public_addr":"10.20.193.158:6809/428074602","cluster_addr":"10.20.193.158:6811/428074602","heartbeat_back_addr":"10.20.193.158:6815/428074602","heartbeat_front_addr":"10.20.193.158:6813/428074602","state":["exists","up"]},{"osd":6,"uuid":"17251a9f-8203-4bdf-87c5-1bd31254f2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6818","nonce":1823230093},{"type":"v1","addr":"10.20.193.92:6819","nonce":1823230093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6820","nonce":1823230093},{"type":"v1","addr":"10.20.193.92:6821","nonce":1823230093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6824","nonce":1823230093},{"type":"v1","addr":"10.20.193.92:6825","nonce":1823230093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6822","nonce":1823230093},{"type":"v1","addr":"10.20.193.92:6823","nonce":1823230093}]},"public_addr":"10.20.193.92:6819/1823230093","cluster_addr":"10.20.193.92:6821/1823230093","heartbeat_back_addr":"10.20.193.92:6825/1823230093","heartbeat_front_addr":"10.20.193.92:6823/1823230093","state":["exists","up"]},{"osd":7,"uuid":"6775e50d-691e-472f-a99e-d6cd4786d4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6816","nonce":3951959773},{"type":"v1","addr":"10.20.193.99:6817","nonce":3951959773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6818","nonce":3951959773},{"type":"v1","addr":"10.20.193.99:6819","nonce":3951959773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6822","nonce":3951959773},{"type":"v1","addr":"10.20.193.99:6823","nonce":3951959773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6820","nonce":3951959773},{"type":"v1","addr":"10.20.193.99:6821","nonce":3951959773}]},"public_addr":"10.20.193.99:6817/3951959773","cluster_addr":"10.20.193.99:6819/3951959773","heartbeat_back_addr":"10.20.193.99:6823/3951959773","heartbeat_front_addr":"10.20.193.99:6821/3951959773","state":["exists","up"]},{"osd":8,"uuid":"a6be4612-8a0a-4590-95a9-82b973ad4c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6816","nonce":1505536261},{"type":"v1","addr":"10.20.193.158:6817","nonce":1505536261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6818","nonce":1505536261},{"type":"v1","addr":"10.20.193.158:6819","nonce":1505536261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6822","nonce":1505536261},{"type":"v1","addr":"10.20.193.158:6823","nonce":1505536261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6820","nonce":1505536261},{"type":"v1","addr":"10.20.193.158:6821","nonce":1505536261}]},"public_addr":"10.20.193.158:6817/1505536261","cluster_addr":"10.20.193.158:6819/1505536261","heartbeat_back_addr":"10.20.193.158:6823/1505536261","heartbeat_front_addr":"10.20.193.158:6821/1505536261","state":["exists","up"]},{"osd":9,"uuid":"b51a7c23-3bba-4404-8b3a-462a2870b83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6826","nonce":3596797929},{"type":"v1","addr":"10.20.193.92:6827","nonce":3596797929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6828","nonce":3596797929},{"type":"v1","addr":"10.20.193.92:6829","nonce":3596797929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6832","nonce":3596797929},{"type":"v1","addr":"10.20.193.92:6833","nonce":3596797929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6830","nonce":3596797929},{"type":"v1","addr":"10.20.193.92:6831","nonce":3596797929}]},"public_addr":"10.20.193.92:6827/3596797929","cluster_addr":"10.20.193.92:6829/3596797929","heartbeat_back_addr":"10.20.193.92:6833/3596797929","heartbeat_front_addr":"10.20.193.92:6831/3596797929","state":["exists","up"]},{"osd":10,"uuid":"dda9bd0a-0359-4889-ad2d-8da7602164cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6824","nonce":4260536068},{"type":"v1","addr":"10.20.193.99:6825","nonce":4260536068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6826","nonce":4260536068},{"type":"v1","addr":"10.20.193.99:6827","nonce":4260536068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6830","nonce":4260536068},{"type":"v1","addr":"10.20.193.99:6831","nonce":4260536068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6828","nonce":4260536068},{"type":"v1","addr":"10.20.193.99:6829","nonce":4260536068}]},"public_addr":"10.20.193.99:6825/4260536068","cluster_addr":"10.20.193.99:6827/4260536068","heartbeat_back_addr":"10.20.193.99:6831/4260536068","heartbeat_front_addr":"10.20.193.99:6829/4260536068","state":["exists","up"]},{"osd":11,"uuid":"8e78b081-0fe6-49a4-879b-094cfb14783c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6824","nonce":2019612524},{"type":"v1","addr":"10.20.193.158:6825","nonce":2019612524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6826","nonce":2019612524},{"type":"v1","addr":"10.20.193.158:6827","nonce":2019612524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6830","nonce":2019612524},{"type":"v1","addr":"10.20.193.158:6831","nonce":2019612524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6828","nonce":2019612524},{"type":"v1","addr":"10.20.193.158:6829","nonce":2019612524}]},"public_addr":"10.20.193.158:6825/2019612524","cluster_addr":"10.20.193.158:6827/2019612524","heartbeat_back_addr":"10.20.193.158:6831/2019612524","heartbeat_front_addr":"10.20.193.158:6829/2019612524","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:58:53.806082+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:59:01.539380+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:59:08.639667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:59:19.253252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:59:27.067122+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:59:34.359212+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:59:45.274527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:59:52.962680+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T04:00:00.299816+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T04:00:11.400008+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T04:00:19.328513+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T04:00:26.837283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.92:0/1237375916":"2026-02-14T03:58:33.822496+0000","10.20.193.92:6800/1986528669":"2026-02-14T03:58:33.822496+0000","10.20.193.92:0/1967601204":"2026-02-14T03:58:33.822496+0000","10.20.193.92:0/2687491302":"2026-02-14T03:57:59.617461+0000","10.20.193.92:6801/1986528669":"2026-02-14T03:58:33.822496+0000","10.20.193.92:0/3477507155":"2026-02-14T03:58:33.822496+0000","10.20.193.92:0/3506092440":"2026-02-14T03:57:59.617461+0000","10.20.193.92:6801/3709134212":"2026-02-14T03:57:59.617461+0000","10.20.193.92:6800/3709134212":"2026-02-14T03:57:59.617461+0000","10.20.193.92:0/1198638193":"2026-02-14T03:57:59.617461+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T04:00:59.768 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.765+0000 7f7dbdab06c0 1 -- 10.20.193.92:0/3918757258 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f7d940b56e0 msgr2=0x7f7d940d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:59.768 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.765+0000 7f7dbdab06c0 1 --2- 10.20.193.92:0/3918757258 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f7d940b56e0 0x7f7d940d5b90 secure :-1 s=READY pgs=147 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7da8005b40 tx=0x7f7da80023a0 comp rx=0 tx=0).stop 2026-02-13T04:00:59.769 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.765+0000 7f7dbdab06c0 1 -- 10.20.193.92:0/3918757258 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7db8115270 msgr2=0x7f7db811d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:00:59.769 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.765+0000 7f7dbdab06c0 1 --2- 10.20.193.92:0/3918757258 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7db8115270 0x7f7db811d3b0 secure :-1 s=READY pgs=192 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7da0005dc0 tx=0x7f7da000bbb0 comp rx=0 tx=0).stop 2026-02-13T04:00:59.769 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.765+0000 7f7dbdab06c0 1 -- 10.20.193.92:0/3918757258 shutdown_connections 2026-02-13T04:00:59.769 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.765+0000 7f7dbdab06c0 1 --2- 10.20.193.92:0/3918757258 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f7d940b56e0 0x7f7d940d5b90 unknown :-1 s=CLOSED pgs=147 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:59.769 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.765+0000 7f7dbdab06c0 1 --2- 10.20.193.92:0/3918757258 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7db8122770 0x7f7db8122c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:59.769 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.765+0000 7f7dbdab06c0 1 --2- 10.20.193.92:0/3918757258 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7db8115270 0x7f7db811d3b0 unknown :-1 s=CLOSED pgs=192 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:59.769 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.765+0000 7f7dbdab06c0 1 --2- 10.20.193.92:0/3918757258 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7db810f060 0x7f7db811ce70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:00:59.769 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.765+0000 7f7dbdab06c0 1 -- 10.20.193.92:0/3918757258 >> 10.20.193.92:0/3918757258 conn(0x7f7db80ec980 msgr2=0x7f7db810cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:00:59.769 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.765+0000 7f7dbdab06c0 1 -- 10.20.193.92:0/3918757258 shutdown_connections 2026-02-13T04:00:59.769 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:00:59.765+0000 7f7dbdab06c0 1 -- 10.20.193.92:0/3918757258 wait complete. 2026-02-13T04:00:59.905 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-13T04:00:59.906 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph pg dump --format=json 2026-02-13T04:01:00.089 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:00.284 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.281+0000 7f8a3aa046c0 1 -- 10.20.193.92:0/2506053951 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8a34115270 msgr2=0x7f8a34175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:00.285 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.281+0000 7f8a3aa046c0 1 --2- 10.20.193.92:0/2506053951 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8a34115270 0x7f8a34175c10 secure :-1 s=READY pgs=193 gs=3 cs=0 l=1 c_cookie=16340699617870666462 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a3000a9b0 tx=0x7f8a3002fd20 comp rx=0 tx=0).stop 2026-02-13T04:01:00.285 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.281+0000 7f8a3aa046c0 1 -- 10.20.193.92:0/2506053951 shutdown_connections 2026-02-13T04:01:00.285 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.281+0000 7f8a3aa046c0 1 --2- 10.20.193.92:0/2506053951 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8a34115270 0x7f8a34175c10 unknown :-1 s=CLOSED pgs=193 gs=3 cs=0 l=1 c_cookie=16340699617870666462 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:00.285 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.281+0000 7f8a3aa046c0 1 --2- 10.20.193.92:0/2506053951 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f8a3410fa50 0x7f8a34114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:00.285 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.281+0000 7f8a3aa046c0 1 --2- 10.20.193.92:0/2506053951 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8a3410f060 0x7f8a3410f430 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:00.285 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.281+0000 7f8a3aa046c0 1 -- 10.20.193.92:0/2506053951 >> 10.20.193.92:0/2506053951 conn(0x7f8a340ec980 msgr2=0x7f8a3410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:00.285 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.281+0000 7f8a3aa046c0 1 -- 10.20.193.92:0/2506053951 shutdown_connections 2026-02-13T04:01:00.285 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.281+0000 7f8a3aa046c0 1 -- 10.20.193.92:0/2506053951 wait complete. 2026-02-13T04:01:00.287 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.282+0000 7f8a3aa046c0 1 Processor -- start 2026-02-13T04:01:00.287 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.282+0000 7f8a3aa046c0 1 -- start start 2026-02-13T04:01:00.287 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.282+0000 7f8a3aa046c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8a3410f060 0x7f8a3411cd90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:00.287 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.282+0000 7f8a3aa046c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8a34115270 0x7f8a3411d2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:00.288 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.282+0000 7f8a3aa046c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f8a34122690 0x7f8a34122b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:00.288 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.282+0000 7f8a3aa046c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8a341230a0 con 0x7f8a34115270 2026-02-13T04:01:00.288 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.282+0000 7f8a3aa046c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8a34123210 con 0x7f8a3410f060 2026-02-13T04:01:00.288 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.282+0000 7f8a3aa046c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f8a341233d0 con 0x7f8a34122690 2026-02-13T04:01:00.288 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.282+0000 7f8a392016c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8a34115270 0x7f8a3411d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:00.288 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.283+0000 7f8a3a2036c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f8a34122690 0x7f8a34122b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:00.288 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.283+0000 7f8a39a026c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8a3410f060 0x7f8a3411cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:00.288 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.283+0000 7f8a3a2036c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f8a34122690 0x7f8a34122b30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:56692/0 (socket says 10.20.193.92:56692) 2026-02-13T04:01:00.288 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.283+0000 7f8a3a2036c0 1 -- 10.20.193.92:0/1753796311 learned_addr learned my addr 10.20.193.92:0/1753796311 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:00.288 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.283+0000 7f8a3a2036c0 1 -- 10.20.193.92:0/1753796311 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8a3410f060 msgr2=0x7f8a3411cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:00.288 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.283+0000 7f8a3a2036c0 1 --2- 10.20.193.92:0/1753796311 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8a3410f060 0x7f8a3411cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:00.289 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.283+0000 7f8a3a2036c0 1 -- 10.20.193.92:0/1753796311 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8a34115270 msgr2=0x7f8a3411d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:00.289 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.283+0000 7f8a3a2036c0 1 --2- 10.20.193.92:0/1753796311 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8a34115270 0x7f8a3411d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:00.289 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.283+0000 7f8a3a2036c0 1 -- 10.20.193.92:0/1753796311 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a3000a5b0 con 0x7f8a34122690 2026-02-13T04:01:00.289 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.283+0000 7f8a392016c0 1 --2- 10.20.193.92:0/1753796311 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8a34115270 0x7f8a3411d2d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T04:01:00.289 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.283+0000 7f8a3a2036c0 1 --2- 10.20.193.92:0/1753796311 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f8a34122690 0x7f8a34122b30 secure :-1 s=READY pgs=85 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a3000a580 tx=0x7f8a3000a170 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:00.289 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.283+0000 7f8a22ffd6c0 1 -- 10.20.193.92:0/1753796311 <== mon.1 v2:10.20.193.158:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a30003810 con 0x7f8a34122690 2026-02-13T04:01:00.289 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.283+0000 7f8a22ffd6c0 1 -- 10.20.193.92:0/1753796311 <== mon.1 v2:10.20.193.158:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f8a300083e0 con 0x7f8a34122690 2026-02-13T04:01:00.289 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.283+0000 7f8a3aa046c0 1 -- 10.20.193.92:0/1753796311 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a34163820 con 0x7f8a34122690 2026-02-13T04:01:00.289 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.283+0000 7f8a22ffd6c0 1 -- 10.20.193.92:0/1753796311 <== mon.1 v2:10.20.193.158:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8a300372d0 con 0x7f8a34122690 2026-02-13T04:01:00.289 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.284+0000 7f8a3aa046c0 1 -- 10.20.193.92:0/1753796311 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a34163c50 con 0x7f8a34122690 2026-02-13T04:01:00.289 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.284+0000 7f8a3aa046c0 1 -- 10.20.193.92:0/1753796311 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a34110330 con 0x7f8a34122690 2026-02-13T04:01:00.290 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.286+0000 7f8a22ffd6c0 1 -- 10.20.193.92:0/1753796311 <== mon.1 v2:10.20.193.158:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f8a30003970 con 0x7f8a34122690 2026-02-13T04:01:00.290 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.288+0000 7f8a22ffd6c0 1 --2- 10.20.193.92:0/1753796311 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f8a100b5760 0x7f8a100d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:00.291 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.288+0000 7f8a22ffd6c0 1 -- 10.20.193.92:0/1753796311 <== mon.1 v2:10.20.193.158:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7f8a30108c50 con 0x7f8a34122690 2026-02-13T04:01:00.291 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.288+0000 7f8a22ffd6c0 1 -- 10.20.193.92:0/1753796311 <== mon.1 v2:10.20.193.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f8a301090d0 con 0x7f8a34122690 2026-02-13T04:01:00.291 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.288+0000 7f8a39a026c0 1 --2- 10.20.193.92:0/1753796311 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f8a100b5760 0x7f8a100d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:00.291 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.288+0000 7f8a39a026c0 1 --2- 10.20.193.92:0/1753796311 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f8a100b5760 0x7f8a100d5c10 secure :-1 s=READY pgs=148 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a24005b40 tx=0x7f8a24009310 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:00.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:00 trial099 ceph-mon[27808]: pgmap v182: 97 pgs: 97 active+clean; 591 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 1.4 KiB/s rd, 7.7 KiB/s wr, 22 op/s 2026-02-13T04:01:00.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:00 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/492621161' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T04:01:00.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:00 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/3918757258' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T04:01:00.367 INFO:journalctl@ceph.mds.b.trial099.stdout:Feb 13 04:01:00 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-b[57261]: 2026-02-13T04:01:00.014+0000 7fc59f87b6c0 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2026-02-13T04:01:00.367 INFO:journalctl@ceph.mds.b.trial099.stdout:Feb 13 04:01:00 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-b[57261]: 2026-02-13T04:01:00.014+0000 7fc59f87b6c0 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2026-02-13T04:01:00.390 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.387+0000 7f8a3aa046c0 1 -- 10.20.193.92:0/1753796311 --> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8a3411df70 con 0x7f8a100b5760 2026-02-13T04:01:00.391 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:00 trial092 ceph-mon[23047]: pgmap v182: 97 pgs: 97 active+clean; 591 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 1.4 KiB/s rd, 7.7 KiB/s wr, 22 op/s 2026-02-13T04:01:00.391 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:00 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/492621161' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T04:01:00.391 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:00 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/3918757258' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T04:01:00.394 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.391+0000 7f8a22ffd6c0 1 -- 10.20.193.92:0/1753796311 <== mgr.14187 v2:10.20.193.92:6800/4191527999 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258924 (secure 0 0 0) 0x7f8a24009a00 con 0x7f8a100b5760 2026-02-13T04:01:00.397 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:01:00.399 INFO:teuthology.orchestra.run.trial092.stderr:dumped all 2026-02-13T04:01:00.401 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.393+0000 7f8a3aa046c0 1 -- 10.20.193.92:0/1753796311 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f8a100b5760 msgr2=0x7f8a100d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:00.401 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.393+0000 7f8a3aa046c0 1 --2- 10.20.193.92:0/1753796311 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f8a100b5760 0x7f8a100d5c10 secure :-1 s=READY pgs=148 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a24005b40 tx=0x7f8a24009310 comp rx=0 tx=0).stop 2026-02-13T04:01:00.401 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.393+0000 7f8a3aa046c0 1 -- 10.20.193.92:0/1753796311 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f8a34122690 msgr2=0x7f8a34122b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:00.401 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.393+0000 7f8a3aa046c0 1 --2- 10.20.193.92:0/1753796311 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f8a34122690 0x7f8a34122b30 secure :-1 s=READY pgs=85 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a3000a580 tx=0x7f8a3000a170 comp rx=0 tx=0).stop 2026-02-13T04:01:00.401 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.393+0000 7f8a3aa046c0 1 -- 10.20.193.92:0/1753796311 shutdown_connections 2026-02-13T04:01:00.401 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.393+0000 7f8a3aa046c0 1 --2- 10.20.193.92:0/1753796311 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f8a34122690 0x7f8a34122b30 unknown :-1 s=CLOSED pgs=85 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:00.401 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.393+0000 7f8a3aa046c0 1 --2- 10.20.193.92:0/1753796311 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8a34115270 0x7f8a3411d2d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:00.401 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.393+0000 7f8a3aa046c0 1 --2- 10.20.193.92:0/1753796311 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f8a100b5760 0x7f8a100d5c10 unknown :-1 s=CLOSED pgs=148 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:00.401 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.393+0000 7f8a3aa046c0 1 --2- 10.20.193.92:0/1753796311 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8a3410f060 0x7f8a3411cd90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:00.402 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.393+0000 7f8a3aa046c0 1 -- 10.20.193.92:0/1753796311 >> 10.20.193.92:0/1753796311 conn(0x7f8a340ec980 msgr2=0x7f8a3410cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:00.402 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.393+0000 7f8a3aa046c0 1 -- 10.20.193.92:0/1753796311 shutdown_connections 2026-02-13T04:01:00.402 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.394+0000 7f8a3aa046c0 1 -- 10.20.193.92:0/1753796311 wait complete. 2026-02-13T04:01:00.532 INFO:teuthology.orchestra.run.trial092.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2026-02-13T04:00:59.088547+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605517,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":129,"num_read_kb":112,"num_write":390,"num_write_kb":3790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":324,"ondisk_log_size":324,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":333676,"kb_used_data":10108,"kb_used_omap":444,"kb_used_meta":322883,"kb_avail":8807704724,"statfs":{"total":9019431321600,"available":9019089637376,"internally_reserved":0,"allocated":10350592,"data_stored":6567087,"data_compressed":115305,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":454689,"internal_metadata":330633183},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15149,"num_objects":91,"num_object_clones":0,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":15,"num_read_kb":13,"num_write":201,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.622088"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722515+0000","last_change":"2026-02-13T04:00:49.479956+0000","last_active":"2026-02-13T04:00:50.722515+0000","last_peered":"2026-02-13T04:00:50.722515+0000","last_clean":"2026-02-13T04:00:50.722515+0000","last_became_active":"2026-02-13T04:00:49.479727+0000","last_became_peered":"2026-02-13T04:00:49.479727+0000","last_unstale":"2026-02-13T04:00:50.722515+0000","last_undegraded":"2026-02-13T04:00:50.722515+0000","last_fullsized":"2026-02-13T04:00:50.722515+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:47:26.793095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469620+0000","last_change":"2026-02-13T04:00:49.482313+0000","last_active":"2026-02-13T04:00:50.469620+0000","last_peered":"2026-02-13T04:00:50.469620+0000","last_clean":"2026-02-13T04:00:50.469620+0000","last_became_active":"2026-02-13T04:00:49.482220+0000","last_became_peered":"2026-02-13T04:00:49.482220+0000","last_unstale":"2026-02-13T04:00:50.469620+0000","last_undegraded":"2026-02-13T04:00:50.469620+0000","last_fullsized":"2026-02-13T04:00:50.469620+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:31:30.541675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469513+0000","last_change":"2026-02-13T04:00:49.475309+0000","last_active":"2026-02-13T04:00:50.469513+0000","last_peered":"2026-02-13T04:00:50.469513+0000","last_clean":"2026-02-13T04:00:50.469513+0000","last_became_active":"2026-02-13T04:00:49.474397+0000","last_became_peered":"2026-02-13T04:00:49.474397+0000","last_unstale":"2026-02-13T04:00:50.469513+0000","last_undegraded":"2026-02-13T04:00:50.469513+0000","last_fullsized":"2026-02-13T04:00:50.469513+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:12:33.930204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.468755+0000","last_change":"2026-02-13T04:00:49.478672+0000","last_active":"2026-02-13T04:00:50.468755+0000","last_peered":"2026-02-13T04:00:50.468755+0000","last_clean":"2026-02-13T04:00:50.468755+0000","last_became_active":"2026-02-13T04:00:49.477706+0000","last_became_peered":"2026-02-13T04:00:49.477706+0000","last_unstale":"2026-02-13T04:00:50.468755+0000","last_undegraded":"2026-02-13T04:00:50.468755+0000","last_fullsized":"2026-02-13T04:00:50.468755+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:18:15.978107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722339+0000","last_change":"2026-02-13T04:00:49.479066+0000","last_active":"2026-02-13T04:00:50.722339+0000","last_peered":"2026-02-13T04:00:50.722339+0000","last_clean":"2026-02-13T04:00:50.722339+0000","last_became_active":"2026-02-13T04:00:49.478908+0000","last_became_peered":"2026-02-13T04:00:49.478908+0000","last_unstale":"2026-02-13T04:00:50.722339+0000","last_undegraded":"2026-02-13T04:00:50.722339+0000","last_fullsized":"2026-02-13T04:00:50.722339+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:23:17.185580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.468647+0000","last_change":"2026-02-13T04:00:49.473377+0000","last_active":"2026-02-13T04:00:50.468647+0000","last_peered":"2026-02-13T04:00:50.468647+0000","last_clean":"2026-02-13T04:00:50.468647+0000","last_became_active":"2026-02-13T04:00:49.473101+0000","last_became_peered":"2026-02-13T04:00:49.473101+0000","last_unstale":"2026-02-13T04:00:50.468647+0000","last_undegraded":"2026-02-13T04:00:50.468647+0000","last_fullsized":"2026-02-13T04:00:50.468647+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:13:24.278254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.909973+0000","last_change":"2026-02-13T04:00:49.474399+0000","last_active":"2026-02-13T04:00:50.909973+0000","last_peered":"2026-02-13T04:00:50.909973+0000","last_clean":"2026-02-13T04:00:50.909973+0000","last_became_active":"2026-02-13T04:00:49.474190+0000","last_became_peered":"2026-02-13T04:00:49.474190+0000","last_unstale":"2026-02-13T04:00:50.909973+0000","last_undegraded":"2026-02-13T04:00:50.909973+0000","last_fullsized":"2026-02-13T04:00:50.909973+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:58:56.035600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.468618+0000","last_change":"2026-02-13T04:00:49.479881+0000","last_active":"2026-02-13T04:00:50.468618+0000","last_peered":"2026-02-13T04:00:50.468618+0000","last_clean":"2026-02-13T04:00:50.468618+0000","last_became_active":"2026-02-13T04:00:49.477264+0000","last_became_peered":"2026-02-13T04:00:49.477264+0000","last_unstale":"2026-02-13T04:00:50.468618+0000","last_undegraded":"2026-02-13T04:00:50.468618+0000","last_fullsized":"2026-02-13T04:00:50.468618+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:44:11.954643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.720863+0000","last_change":"2026-02-13T04:00:49.474129+0000","last_active":"2026-02-13T04:00:50.720863+0000","last_peered":"2026-02-13T04:00:50.720863+0000","last_clean":"2026-02-13T04:00:50.720863+0000","last_became_active":"2026-02-13T04:00:49.473954+0000","last_became_peered":"2026-02-13T04:00:49.473954+0000","last_unstale":"2026-02-13T04:00:50.720863+0000","last_undegraded":"2026-02-13T04:00:50.720863+0000","last_fullsized":"2026-02-13T04:00:50.720863+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:57:22.870845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469105+0000","last_change":"2026-02-13T04:00:49.473093+0000","last_active":"2026-02-13T04:00:50.469105+0000","last_peered":"2026-02-13T04:00:50.469105+0000","last_clean":"2026-02-13T04:00:50.469105+0000","last_became_active":"2026-02-13T04:00:49.472808+0000","last_became_peered":"2026-02-13T04:00:49.472808+0000","last_unstale":"2026-02-13T04:00:50.469105+0000","last_undegraded":"2026-02-13T04:00:50.469105+0000","last_fullsized":"2026-02-13T04:00:50.469105+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:43:54.901711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.910473+0000","last_change":"2026-02-13T04:00:49.474383+0000","last_active":"2026-02-13T04:00:50.910473+0000","last_peered":"2026-02-13T04:00:50.910473+0000","last_clean":"2026-02-13T04:00:50.910473+0000","last_became_active":"2026-02-13T04:00:49.473948+0000","last_became_peered":"2026-02-13T04:00:49.473948+0000","last_unstale":"2026-02-13T04:00:50.910473+0000","last_undegraded":"2026-02-13T04:00:50.910473+0000","last_fullsized":"2026-02-13T04:00:50.910473+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:55:08.451894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.468849+0000","last_change":"2026-02-13T04:00:49.477579+0000","last_active":"2026-02-13T04:00:50.468849+0000","last_peered":"2026-02-13T04:00:50.468849+0000","last_clean":"2026-02-13T04:00:50.468849+0000","last_became_active":"2026-02-13T04:00:49.473854+0000","last_became_peered":"2026-02-13T04:00:49.473854+0000","last_unstale":"2026-02-13T04:00:50.468849+0000","last_undegraded":"2026-02-13T04:00:50.468849+0000","last_fullsized":"2026-02-13T04:00:50.468849+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:12:19.444223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.721290+0000","last_change":"2026-02-13T04:00:49.476339+0000","last_active":"2026-02-13T04:00:50.721290+0000","last_peered":"2026-02-13T04:00:50.721290+0000","last_clean":"2026-02-13T04:00:50.721290+0000","last_became_active":"2026-02-13T04:00:49.476269+0000","last_became_peered":"2026-02-13T04:00:49.476269+0000","last_unstale":"2026-02-13T04:00:50.721290+0000","last_undegraded":"2026-02-13T04:00:50.721290+0000","last_fullsized":"2026-02-13T04:00:50.721290+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:51:34.159138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.470257+0000","last_change":"2026-02-13T04:00:49.475689+0000","last_active":"2026-02-13T04:00:50.470257+0000","last_peered":"2026-02-13T04:00:50.470257+0000","last_clean":"2026-02-13T04:00:50.470257+0000","last_became_active":"2026-02-13T04:00:49.475254+0000","last_became_peered":"2026-02-13T04:00:49.475254+0000","last_unstale":"2026-02-13T04:00:50.470257+0000","last_undegraded":"2026-02-13T04:00:50.470257+0000","last_fullsized":"2026-02-13T04:00:50.470257+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:44:04.115649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469299+0000","last_change":"2026-02-13T04:00:49.478457+0000","last_active":"2026-02-13T04:00:50.469299+0000","last_peered":"2026-02-13T04:00:50.469299+0000","last_clean":"2026-02-13T04:00:50.469299+0000","last_became_active":"2026-02-13T04:00:49.478351+0000","last_became_peered":"2026-02-13T04:00:49.478351+0000","last_unstale":"2026-02-13T04:00:50.469299+0000","last_undegraded":"2026-02-13T04:00:50.469299+0000","last_fullsized":"2026-02-13T04:00:50.469299+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:03:26.642290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.720495+0000","last_change":"2026-02-13T04:00:49.476182+0000","last_active":"2026-02-13T04:00:50.720495+0000","last_peered":"2026-02-13T04:00:50.720495+0000","last_clean":"2026-02-13T04:00:50.720495+0000","last_became_active":"2026-02-13T04:00:49.476070+0000","last_became_peered":"2026-02-13T04:00:49.476070+0000","last_unstale":"2026-02-13T04:00:50.720495+0000","last_undegraded":"2026-02-13T04:00:50.720495+0000","last_fullsized":"2026-02-13T04:00:50.720495+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:04:29.238236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722540+0000","last_change":"2026-02-13T04:00:49.482695+0000","last_active":"2026-02-13T04:00:50.722540+0000","last_peered":"2026-02-13T04:00:50.722540+0000","last_clean":"2026-02-13T04:00:50.722540+0000","last_became_active":"2026-02-13T04:00:49.482487+0000","last_became_peered":"2026-02-13T04:00:49.482487+0000","last_unstale":"2026-02-13T04:00:50.722540+0000","last_undegraded":"2026-02-13T04:00:50.722540+0000","last_fullsized":"2026-02-13T04:00:50.722540+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:17:10.991068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469800+0000","last_change":"2026-02-13T04:00:49.473784+0000","last_active":"2026-02-13T04:00:50.469800+0000","last_peered":"2026-02-13T04:00:50.469800+0000","last_clean":"2026-02-13T04:00:50.469800+0000","last_became_active":"2026-02-13T04:00:49.473653+0000","last_became_peered":"2026-02-13T04:00:49.473653+0000","last_unstale":"2026-02-13T04:00:50.469800+0000","last_undegraded":"2026-02-13T04:00:50.469800+0000","last_fullsized":"2026-02-13T04:00:50.469800+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:47:48.283470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722687+0000","last_change":"2026-02-13T04:00:49.476692+0000","last_active":"2026-02-13T04:00:50.722687+0000","last_peered":"2026-02-13T04:00:50.722687+0000","last_clean":"2026-02-13T04:00:50.722687+0000","last_became_active":"2026-02-13T04:00:49.476507+0000","last_became_peered":"2026-02-13T04:00:49.476507+0000","last_unstale":"2026-02-13T04:00:50.722687+0000","last_undegraded":"2026-02-13T04:00:50.722687+0000","last_fullsized":"2026-02-13T04:00:50.722687+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:48:00.193446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722223+0000","last_change":"2026-02-13T04:00:49.480680+0000","last_active":"2026-02-13T04:00:50.722223+0000","last_peered":"2026-02-13T04:00:50.722223+0000","last_clean":"2026-02-13T04:00:50.722223+0000","last_became_active":"2026-02-13T04:00:49.480429+0000","last_became_peered":"2026-02-13T04:00:49.480429+0000","last_unstale":"2026-02-13T04:00:50.722223+0000","last_undegraded":"2026-02-13T04:00:50.722223+0000","last_fullsized":"2026-02-13T04:00:50.722223+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:59:07.789528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.721354+0000","last_change":"2026-02-13T04:00:49.478790+0000","last_active":"2026-02-13T04:00:50.721354+0000","last_peered":"2026-02-13T04:00:50.721354+0000","last_clean":"2026-02-13T04:00:50.721354+0000","last_became_active":"2026-02-13T04:00:49.478542+0000","last_became_peered":"2026-02-13T04:00:49.478542+0000","last_unstale":"2026-02-13T04:00:50.721354+0000","last_undegraded":"2026-02-13T04:00:50.721354+0000","last_fullsized":"2026-02-13T04:00:50.721354+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:20:02.089377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.720635+0000","last_change":"2026-02-13T04:00:49.480725+0000","last_active":"2026-02-13T04:00:50.720635+0000","last_peered":"2026-02-13T04:00:50.720635+0000","last_clean":"2026-02-13T04:00:50.720635+0000","last_became_active":"2026-02-13T04:00:49.480629+0000","last_became_peered":"2026-02-13T04:00:49.480629+0000","last_unstale":"2026-02-13T04:00:50.720635+0000","last_undegraded":"2026-02-13T04:00:50.720635+0000","last_fullsized":"2026-02-13T04:00:50.720635+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:58:01.268671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.468709+0000","last_change":"2026-02-13T04:00:49.477665+0000","last_active":"2026-02-13T04:00:50.468709+0000","last_peered":"2026-02-13T04:00:50.468709+0000","last_clean":"2026-02-13T04:00:50.468709+0000","last_became_active":"2026-02-13T04:00:49.477495+0000","last_became_peered":"2026-02-13T04:00:49.477495+0000","last_unstale":"2026-02-13T04:00:50.468709+0000","last_undegraded":"2026-02-13T04:00:50.468709+0000","last_fullsized":"2026-02-13T04:00:50.468709+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:59:53.668023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469843+0000","last_change":"2026-02-13T04:00:49.482438+0000","last_active":"2026-02-13T04:00:50.469843+0000","last_peered":"2026-02-13T04:00:50.469843+0000","last_clean":"2026-02-13T04:00:50.469843+0000","last_became_active":"2026-02-13T04:00:49.482330+0000","last_became_peered":"2026-02-13T04:00:49.482330+0000","last_unstale":"2026-02-13T04:00:50.469843+0000","last_undegraded":"2026-02-13T04:00:50.469843+0000","last_fullsized":"2026-02-13T04:00:50.469843+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:22:36.817612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469056+0000","last_change":"2026-02-13T04:00:49.477434+0000","last_active":"2026-02-13T04:00:50.469056+0000","last_peered":"2026-02-13T04:00:50.469056+0000","last_clean":"2026-02-13T04:00:50.469056+0000","last_became_active":"2026-02-13T04:00:49.477191+0000","last_became_peered":"2026-02-13T04:00:49.477191+0000","last_unstale":"2026-02-13T04:00:50.469056+0000","last_undegraded":"2026-02-13T04:00:50.469056+0000","last_fullsized":"2026-02-13T04:00:50.469056+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:37:48.389471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722779+0000","last_change":"2026-02-13T04:00:49.474549+0000","last_active":"2026-02-13T04:00:50.722779+0000","last_peered":"2026-02-13T04:00:50.722779+0000","last_clean":"2026-02-13T04:00:50.722779+0000","last_became_active":"2026-02-13T04:00:49.474357+0000","last_became_peered":"2026-02-13T04:00:49.474357+0000","last_unstale":"2026-02-13T04:00:50.722779+0000","last_undegraded":"2026-02-13T04:00:50.722779+0000","last_fullsized":"2026-02-13T04:00:50.722779+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:29:00.130538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722309+0000","last_change":"2026-02-13T04:00:49.476543+0000","last_active":"2026-02-13T04:00:50.722309+0000","last_peered":"2026-02-13T04:00:50.722309+0000","last_clean":"2026-02-13T04:00:50.722309+0000","last_became_active":"2026-02-13T04:00:49.476269+0000","last_became_peered":"2026-02-13T04:00:49.476269+0000","last_unstale":"2026-02-13T04:00:50.722309+0000","last_undegraded":"2026-02-13T04:00:50.722309+0000","last_fullsized":"2026-02-13T04:00:50.722309+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:51:34.541577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.721455+0000","last_change":"2026-02-13T04:00:49.480227+0000","last_active":"2026-02-13T04:00:50.721455+0000","last_peered":"2026-02-13T04:00:50.721455+0000","last_clean":"2026-02-13T04:00:50.721455+0000","last_became_active":"2026-02-13T04:00:49.480117+0000","last_became_peered":"2026-02-13T04:00:49.480117+0000","last_unstale":"2026-02-13T04:00:50.721455+0000","last_undegraded":"2026-02-13T04:00:50.721455+0000","last_fullsized":"2026-02-13T04:00:50.721455+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:57:45.182937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469454+0000","last_change":"2026-02-13T04:00:49.479873+0000","last_active":"2026-02-13T04:00:50.469454+0000","last_peered":"2026-02-13T04:00:50.469454+0000","last_clean":"2026-02-13T04:00:50.469454+0000","last_became_active":"2026-02-13T04:00:49.479764+0000","last_became_peered":"2026-02-13T04:00:49.479764+0000","last_unstale":"2026-02-13T04:00:50.469454+0000","last_undegraded":"2026-02-13T04:00:50.469454+0000","last_fullsized":"2026-02-13T04:00:50.469454+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:59:09.259456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722421+0000","last_change":"2026-02-13T04:00:49.478971+0000","last_active":"2026-02-13T04:00:50.722421+0000","last_peered":"2026-02-13T04:00:50.722421+0000","last_clean":"2026-02-13T04:00:50.722421+0000","last_became_active":"2026-02-13T04:00:49.478770+0000","last_became_peered":"2026-02-13T04:00:49.478770+0000","last_unstale":"2026-02-13T04:00:50.722421+0000","last_undegraded":"2026-02-13T04:00:50.722421+0000","last_fullsized":"2026-02-13T04:00:50.722421+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:41:03.291420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722355+0000","last_change":"2026-02-13T04:00:49.475701+0000","last_active":"2026-02-13T04:00:50.722355+0000","last_peered":"2026-02-13T04:00:50.722355+0000","last_clean":"2026-02-13T04:00:50.722355+0000","last_became_active":"2026-02-13T04:00:49.475238+0000","last_became_peered":"2026-02-13T04:00:49.475238+0000","last_unstale":"2026-02-13T04:00:50.722355+0000","last_undegraded":"2026-02-13T04:00:50.722355+0000","last_fullsized":"2026-02-13T04:00:50.722355+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:53:42.399821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722110+0000","last_change":"2026-02-13T04:00:49.476461+0000","last_active":"2026-02-13T04:00:50.722110+0000","last_peered":"2026-02-13T04:00:50.722110+0000","last_clean":"2026-02-13T04:00:50.722110+0000","last_became_active":"2026-02-13T04:00:49.476249+0000","last_became_peered":"2026-02-13T04:00:49.476249+0000","last_unstale":"2026-02-13T04:00:50.722110+0000","last_undegraded":"2026-02-13T04:00:50.722110+0000","last_fullsized":"2026-02-13T04:00:50.722110+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:54:58.933497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722340+0000","last_change":"2026-02-13T04:00:49.475811+0000","last_active":"2026-02-13T04:00:50.722340+0000","last_peered":"2026-02-13T04:00:50.722340+0000","last_clean":"2026-02-13T04:00:50.722340+0000","last_became_active":"2026-02-13T04:00:49.475618+0000","last_became_peered":"2026-02-13T04:00:49.475618+0000","last_unstale":"2026-02-13T04:00:50.722340+0000","last_undegraded":"2026-02-13T04:00:50.722340+0000","last_fullsized":"2026-02-13T04:00:50.722340+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:22:47.756470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"76'5","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:53.057249+0000","last_change":"2026-02-13T04:00:48.693027+0000","last_active":"2026-02-13T04:00:53.057249+0000","last_peered":"2026-02-13T04:00:53.057249+0000","last_clean":"2026-02-13T04:00:53.057249+0000","last_became_active":"2026-02-13T04:00:48.692784+0000","last_became_peered":"2026-02-13T04:00:48.692784+0000","last_unstale":"2026-02-13T04:00:53.057249+0000","last_undegraded":"2026-02-13T04:00:53.057249+0000","last_fullsized":"2026-02-13T04:00:53.057249+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:12:41.834516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469782+0000","last_change":"2026-02-13T04:00:49.482026+0000","last_active":"2026-02-13T04:00:50.469782+0000","last_peered":"2026-02-13T04:00:50.469782+0000","last_clean":"2026-02-13T04:00:50.469782+0000","last_became_active":"2026-02-13T04:00:49.481905+0000","last_became_peered":"2026-02-13T04:00:49.481905+0000","last_unstale":"2026-02-13T04:00:50.469782+0000","last_undegraded":"2026-02-13T04:00:50.469782+0000","last_fullsized":"2026-02-13T04:00:50.469782+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:05:21.043555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"76'7","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:55.067925+0000","last_change":"2026-02-13T04:00:48.691792+0000","last_active":"2026-02-13T04:00:55.067925+0000","last_peered":"2026-02-13T04:00:55.067925+0000","last_clean":"2026-02-13T04:00:55.067925+0000","last_became_active":"2026-02-13T04:00:48.691630+0000","last_became_peered":"2026-02-13T04:00:48.691630+0000","last_unstale":"2026-02-13T04:00:55.067925+0000","last_undegraded":"2026-02-13T04:00:55.067925+0000","last_fullsized":"2026-02-13T04:00:55.067925+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:32:00.435154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"76'3","reported_seq":19,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:54.062781+0000","last_change":"2026-02-13T04:00:48.695910+0000","last_active":"2026-02-13T04:00:54.062781+0000","last_peered":"2026-02-13T04:00:54.062781+0000","last_clean":"2026-02-13T04:00:54.062781+0000","last_became_active":"2026-02-13T04:00:48.695729+0000","last_became_peered":"2026-02-13T04:00:48.695729+0000","last_unstale":"2026-02-13T04:00:54.062781+0000","last_undegraded":"2026-02-13T04:00:54.062781+0000","last_fullsized":"2026-02-13T04:00:54.062781+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:31:27.918317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.468699+0000","last_change":"2026-02-13T04:00:49.481361+0000","last_active":"2026-02-13T04:00:50.468699+0000","last_peered":"2026-02-13T04:00:50.468699+0000","last_clean":"2026-02-13T04:00:50.468699+0000","last_became_active":"2026-02-13T04:00:49.481073+0000","last_became_peered":"2026-02-13T04:00:49.481073+0000","last_unstale":"2026-02-13T04:00:50.468699+0000","last_undegraded":"2026-02-13T04:00:50.468699+0000","last_fullsized":"2026-02-13T04:00:50.468699+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:55:00.151374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"76'2","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:53.056511+0000","last_change":"2026-02-13T04:00:48.692833+0000","last_active":"2026-02-13T04:00:53.056511+0000","last_peered":"2026-02-13T04:00:53.056511+0000","last_clean":"2026-02-13T04:00:53.056511+0000","last_became_active":"2026-02-13T04:00:48.692566+0000","last_became_peered":"2026-02-13T04:00:48.692566+0000","last_unstale":"2026-02-13T04:00:53.056511+0000","last_undegraded":"2026-02-13T04:00:53.056511+0000","last_fullsized":"2026-02-13T04:00:53.056511+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:01:30.821370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469695+0000","last_change":"2026-02-13T04:00:49.479585+0000","last_active":"2026-02-13T04:00:50.469695+0000","last_peered":"2026-02-13T04:00:50.469695+0000","last_clean":"2026-02-13T04:00:50.469695+0000","last_became_active":"2026-02-13T04:00:49.479155+0000","last_became_peered":"2026-02-13T04:00:49.479155+0000","last_unstale":"2026-02-13T04:00:50.469695+0000","last_undegraded":"2026-02-13T04:00:50.469695+0000","last_fullsized":"2026-02-13T04:00:50.469695+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:04:32.865189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"76'4","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:53.056924+0000","last_change":"2026-02-13T04:00:48.697295+0000","last_active":"2026-02-13T04:00:53.056924+0000","last_peered":"2026-02-13T04:00:53.056924+0000","last_clean":"2026-02-13T04:00:53.056924+0000","last_became_active":"2026-02-13T04:00:48.697115+0000","last_became_peered":"2026-02-13T04:00:48.697115+0000","last_unstale":"2026-02-13T04:00:53.056924+0000","last_undegraded":"2026-02-13T04:00:53.056924+0000","last_fullsized":"2026-02-13T04:00:53.056924+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:41:11.697570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.720845+0000","last_change":"2026-02-13T04:00:49.474447+0000","last_active":"2026-02-13T04:00:50.720845+0000","last_peered":"2026-02-13T04:00:50.720845+0000","last_clean":"2026-02-13T04:00:50.720845+0000","last_became_active":"2026-02-13T04:00:49.473707+0000","last_became_peered":"2026-02-13T04:00:49.473707+0000","last_unstale":"2026-02-13T04:00:50.720845+0000","last_undegraded":"2026-02-13T04:00:50.720845+0000","last_fullsized":"2026-02-13T04:00:50.720845+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:33:16.764134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"76'2","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:53.056350+0000","last_change":"2026-02-13T04:00:48.691107+0000","last_active":"2026-02-13T04:00:53.056350+0000","last_peered":"2026-02-13T04:00:53.056350+0000","last_clean":"2026-02-13T04:00:53.056350+0000","last_became_active":"2026-02-13T04:00:48.690883+0000","last_became_peered":"2026-02-13T04:00:48.690883+0000","last_unstale":"2026-02-13T04:00:53.056350+0000","last_undegraded":"2026-02-13T04:00:53.056350+0000","last_fullsized":"2026-02-13T04:00:53.056350+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:42:12.911922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469851+0000","last_change":"2026-02-13T04:00:49.479316+0000","last_active":"2026-02-13T04:00:50.469851+0000","last_peered":"2026-02-13T04:00:50.469851+0000","last_clean":"2026-02-13T04:00:50.469851+0000","last_became_active":"2026-02-13T04:00:49.479237+0000","last_became_peered":"2026-02-13T04:00:49.479237+0000","last_unstale":"2026-02-13T04:00:50.469851+0000","last_undegraded":"2026-02-13T04:00:50.469851+0000","last_fullsized":"2026-02-13T04:00:50.469851+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:42:22.094924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"76'5","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:53.058181+0000","last_change":"2026-02-13T04:00:48.694972+0000","last_active":"2026-02-13T04:00:53.058181+0000","last_peered":"2026-02-13T04:00:53.058181+0000","last_clean":"2026-02-13T04:00:53.058181+0000","last_became_active":"2026-02-13T04:00:48.694866+0000","last_became_peered":"2026-02-13T04:00:48.694866+0000","last_unstale":"2026-02-13T04:00:53.058181+0000","last_undegraded":"2026-02-13T04:00:53.058181+0000","last_fullsized":"2026-02-13T04:00:53.058181+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:21:39.815574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.720774+0000","last_change":"2026-02-13T04:00:49.473770+0000","last_active":"2026-02-13T04:00:50.720774+0000","last_peered":"2026-02-13T04:00:50.720774+0000","last_clean":"2026-02-13T04:00:50.720774+0000","last_became_active":"2026-02-13T04:00:49.473571+0000","last_became_peered":"2026-02-13T04:00:49.473571+0000","last_unstale":"2026-02-13T04:00:50.720774+0000","last_undegraded":"2026-02-13T04:00:50.720774+0000","last_fullsized":"2026-02-13T04:00:50.720774+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:20:31.775093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"76'13","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:56.080183+0000","last_change":"2026-02-13T04:00:48.691199+0000","last_active":"2026-02-13T04:00:56.080183+0000","last_peered":"2026-02-13T04:00:56.080183+0000","last_clean":"2026-02-13T04:00:56.080183+0000","last_became_active":"2026-02-13T04:00:48.690955+0000","last_became_peered":"2026-02-13T04:00:48.690955+0000","last_unstale":"2026-02-13T04:00:56.080183+0000","last_undegraded":"2026-02-13T04:00:56.080183+0000","last_fullsized":"2026-02-13T04:00:56.080183+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:41:58.570616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8385,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722495+0000","last_change":"2026-02-13T04:00:49.474461+0000","last_active":"2026-02-13T04:00:50.722495+0000","last_peered":"2026-02-13T04:00:50.722495+0000","last_clean":"2026-02-13T04:00:50.722495+0000","last_became_active":"2026-02-13T04:00:49.474220+0000","last_became_peered":"2026-02-13T04:00:49.474220+0000","last_unstale":"2026-02-13T04:00:50.722495+0000","last_undegraded":"2026-02-13T04:00:50.722495+0000","last_fullsized":"2026-02-13T04:00:50.722495+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:04:21.521507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"76'9","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:56.077188+0000","last_change":"2026-02-13T04:00:48.698134+0000","last_active":"2026-02-13T04:00:56.077188+0000","last_peered":"2026-02-13T04:00:56.077188+0000","last_clean":"2026-02-13T04:00:56.077188+0000","last_became_active":"2026-02-13T04:00:48.697958+0000","last_became_peered":"2026-02-13T04:00:48.697958+0000","last_unstale":"2026-02-13T04:00:56.077188+0000","last_undegraded":"2026-02-13T04:00:56.077188+0000","last_fullsized":"2026-02-13T04:00:56.077188+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:55:21.688751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.721213+0000","last_change":"2026-02-13T04:00:49.481860+0000","last_active":"2026-02-13T04:00:50.721213+0000","last_peered":"2026-02-13T04:00:50.721213+0000","last_clean":"2026-02-13T04:00:50.721213+0000","last_became_active":"2026-02-13T04:00:49.481735+0000","last_became_peered":"2026-02-13T04:00:49.481735+0000","last_unstale":"2026-02-13T04:00:50.721213+0000","last_undegraded":"2026-02-13T04:00:50.721213+0000","last_fullsized":"2026-02-13T04:00:50.721213+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:13:15.403655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"76'4","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:53.057356+0000","last_change":"2026-02-13T04:00:48.700556+0000","last_active":"2026-02-13T04:00:53.057356+0000","last_peered":"2026-02-13T04:00:53.057356+0000","last_clean":"2026-02-13T04:00:53.057356+0000","last_became_active":"2026-02-13T04:00:48.700417+0000","last_became_peered":"2026-02-13T04:00:48.700417+0000","last_unstale":"2026-02-13T04:00:53.057356+0000","last_undegraded":"2026-02-13T04:00:53.057356+0000","last_fullsized":"2026-02-13T04:00:53.057356+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:53:13.088594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.910386+0000","last_change":"2026-02-13T04:00:49.477823+0000","last_active":"2026-02-13T04:00:50.910386+0000","last_peered":"2026-02-13T04:00:50.910386+0000","last_clean":"2026-02-13T04:00:50.910386+0000","last_became_active":"2026-02-13T04:00:49.477688+0000","last_became_peered":"2026-02-13T04:00:49.477688+0000","last_unstale":"2026-02-13T04:00:50.910386+0000","last_undegraded":"2026-02-13T04:00:50.910386+0000","last_fullsized":"2026-02-13T04:00:50.910386+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:38:51.114912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"76'6","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:57.081513+0000","last_change":"2026-02-13T04:00:48.689958+0000","last_active":"2026-02-13T04:00:57.081513+0000","last_peered":"2026-02-13T04:00:57.081513+0000","last_clean":"2026-02-13T04:00:57.081513+0000","last_became_active":"2026-02-13T04:00:48.689800+0000","last_became_peered":"2026-02-13T04:00:48.689800+0000","last_unstale":"2026-02-13T04:00:57.081513+0000","last_undegraded":"2026-02-13T04:00:57.081513+0000","last_fullsized":"2026-02-13T04:00:57.081513+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:57:29.593581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":998,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.909974+0000","last_change":"2026-02-13T04:00:49.474922+0000","last_active":"2026-02-13T04:00:50.909974+0000","last_peered":"2026-02-13T04:00:50.909974+0000","last_clean":"2026-02-13T04:00:50.909974+0000","last_became_active":"2026-02-13T04:00:49.474798+0000","last_became_peered":"2026-02-13T04:00:49.474798+0000","last_unstale":"2026-02-13T04:00:50.909974+0000","last_undegraded":"2026-02-13T04:00:50.909974+0000","last_fullsized":"2026-02-13T04:00:50.909974+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:24:58.395490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"76'17","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:55.069298+0000","last_change":"2026-02-13T04:00:48.697186+0000","last_active":"2026-02-13T04:00:55.069298+0000","last_peered":"2026-02-13T04:00:55.069298+0000","last_clean":"2026-02-13T04:00:55.069298+0000","last_became_active":"2026-02-13T04:00:48.696965+0000","last_became_peered":"2026-02-13T04:00:48.696965+0000","last_unstale":"2026-02-13T04:00:55.069298+0000","last_undegraded":"2026-02-13T04:00:55.069298+0000","last_fullsized":"2026-02-13T04:00:55.069298+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:56:20.600423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469600+0000","last_change":"2026-02-13T04:00:49.478825+0000","last_active":"2026-02-13T04:00:50.469600+0000","last_peered":"2026-02-13T04:00:50.469600+0000","last_clean":"2026-02-13T04:00:50.469600+0000","last_became_active":"2026-02-13T04:00:49.478665+0000","last_became_peered":"2026-02-13T04:00:49.478665+0000","last_unstale":"2026-02-13T04:00:50.469600+0000","last_undegraded":"2026-02-13T04:00:50.469600+0000","last_fullsized":"2026-02-13T04:00:50.469600+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:30:36.733228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"76'2","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:51.979236+0000","last_change":"2026-02-13T04:00:48.691503+0000","last_active":"2026-02-13T04:00:51.979236+0000","last_peered":"2026-02-13T04:00:51.979236+0000","last_clean":"2026-02-13T04:00:51.979236+0000","last_became_active":"2026-02-13T04:00:48.691259+0000","last_became_peered":"2026-02-13T04:00:48.691259+0000","last_unstale":"2026-02-13T04:00:51.979236+0000","last_undegraded":"2026-02-13T04:00:51.979236+0000","last_fullsized":"2026-02-13T04:00:51.979236+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:34:28.622800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722403+0000","last_change":"2026-02-13T04:00:49.480630+0000","last_active":"2026-02-13T04:00:50.722403+0000","last_peered":"2026-02-13T04:00:50.722403+0000","last_clean":"2026-02-13T04:00:50.722403+0000","last_became_active":"2026-02-13T04:00:49.480389+0000","last_became_peered":"2026-02-13T04:00:49.480389+0000","last_unstale":"2026-02-13T04:00:50.722403+0000","last_undegraded":"2026-02-13T04:00:50.722403+0000","last_fullsized":"2026-02-13T04:00:50.722403+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:57:06.972169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"76'5","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:56.077127+0000","last_change":"2026-02-13T04:00:48.699907+0000","last_active":"2026-02-13T04:00:56.077127+0000","last_peered":"2026-02-13T04:00:56.077127+0000","last_clean":"2026-02-13T04:00:56.077127+0000","last_became_active":"2026-02-13T04:00:48.699680+0000","last_became_peered":"2026-02-13T04:00:48.699680+0000","last_unstale":"2026-02-13T04:00:56.077127+0000","last_undegraded":"2026-02-13T04:00:56.077127+0000","last_fullsized":"2026-02-13T04:00:56.077127+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:59:04.468050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.910539+0000","last_change":"2026-02-13T04:00:49.474061+0000","last_active":"2026-02-13T04:00:50.910539+0000","last_peered":"2026-02-13T04:00:50.910539+0000","last_clean":"2026-02-13T04:00:50.910539+0000","last_became_active":"2026-02-13T04:00:49.473775+0000","last_became_peered":"2026-02-13T04:00:49.473775+0000","last_unstale":"2026-02-13T04:00:50.910539+0000","last_undegraded":"2026-02-13T04:00:50.910539+0000","last_fullsized":"2026-02-13T04:00:50.910539+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:17:55.919908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"76'2","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:51.072262+0000","last_change":"2026-02-13T04:00:48.700390+0000","last_active":"2026-02-13T04:00:51.072262+0000","last_peered":"2026-02-13T04:00:51.072262+0000","last_clean":"2026-02-13T04:00:51.072262+0000","last_became_active":"2026-02-13T04:00:48.700274+0000","last_became_peered":"2026-02-13T04:00:48.700274+0000","last_unstale":"2026-02-13T04:00:51.072262+0000","last_undegraded":"2026-02-13T04:00:51.072262+0000","last_fullsized":"2026-02-13T04:00:51.072262+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:42:57.951202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.910348+0000","last_change":"2026-02-13T04:00:49.473385+0000","last_active":"2026-02-13T04:00:50.910348+0000","last_peered":"2026-02-13T04:00:50.910348+0000","last_clean":"2026-02-13T04:00:50.910348+0000","last_became_active":"2026-02-13T04:00:49.473169+0000","last_became_peered":"2026-02-13T04:00:49.473169+0000","last_unstale":"2026-02-13T04:00:50.910348+0000","last_undegraded":"2026-02-13T04:00:50.910348+0000","last_fullsized":"2026-02-13T04:00:50.910348+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:39:38.736962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"76'6","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:55.070646+0000","last_change":"2026-02-13T04:00:48.697672+0000","last_active":"2026-02-13T04:00:55.070646+0000","last_peered":"2026-02-13T04:00:55.070646+0000","last_clean":"2026-02-13T04:00:55.070646+0000","last_became_active":"2026-02-13T04:00:48.697508+0000","last_became_peered":"2026-02-13T04:00:48.697508+0000","last_unstale":"2026-02-13T04:00:55.070646+0000","last_undegraded":"2026-02-13T04:00:55.070646+0000","last_fullsized":"2026-02-13T04:00:55.070646+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:06:23.149951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1602,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.910511+0000","last_change":"2026-02-13T04:00:49.474120+0000","last_active":"2026-02-13T04:00:50.910511+0000","last_peered":"2026-02-13T04:00:50.910511+0000","last_clean":"2026-02-13T04:00:50.910511+0000","last_became_active":"2026-02-13T04:00:49.473810+0000","last_became_peered":"2026-02-13T04:00:49.473810+0000","last_unstale":"2026-02-13T04:00:50.910511+0000","last_undegraded":"2026-02-13T04:00:50.910511+0000","last_fullsized":"2026-02-13T04:00:50.910511+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:19:59.822379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'152","reported_seq":345,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.910012+0000","last_change":"2026-02-13T04:00:24.257474+0000","last_active":"2026-02-13T04:00:50.910012+0000","last_peered":"2026-02-13T04:00:50.910012+0000","last_clean":"2026-02-13T04:00:50.910012+0000","last_became_active":"2026-02-13T04:00:24.257034+0000","last_became_peered":"2026-02-13T04:00:24.257034+0000","last_unstale":"2026-02-13T04:00:50.910012+0000","last_undegraded":"2026-02-13T04:00:50.910012+0000","last_fullsized":"2026-02-13T04:00:50.910012+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:59:12.660085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:59:12.660085+0000","last_clean_scrub_stamp":"2026-02-13T03:59:12.660085+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:39:33.745502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"76'6","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:57.079518+0000","last_change":"2026-02-13T04:00:48.692792+0000","last_active":"2026-02-13T04:00:57.079518+0000","last_peered":"2026-02-13T04:00:57.079518+0000","last_clean":"2026-02-13T04:00:57.079518+0000","last_became_active":"2026-02-13T04:00:48.692666+0000","last_became_peered":"2026-02-13T04:00:48.692666+0000","last_unstale":"2026-02-13T04:00:57.079518+0000","last_undegraded":"2026-02-13T04:00:57.079518+0000","last_fullsized":"2026-02-13T04:00:57.079518+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:32:34.713449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469917+0000","last_change":"2026-02-13T04:00:49.480086+0000","last_active":"2026-02-13T04:00:50.469917+0000","last_peered":"2026-02-13T04:00:50.469917+0000","last_clean":"2026-02-13T04:00:50.469917+0000","last_became_active":"2026-02-13T04:00:49.477323+0000","last_became_peered":"2026-02-13T04:00:49.477323+0000","last_unstale":"2026-02-13T04:00:50.469917+0000","last_undegraded":"2026-02-13T04:00:50.469917+0000","last_fullsized":"2026-02-13T04:00:50.469917+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:59:23.446340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"76'3","reported_seq":19,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:54.060508+0000","last_change":"2026-02-13T04:00:48.691498+0000","last_active":"2026-02-13T04:00:54.060508+0000","last_peered":"2026-02-13T04:00:54.060508+0000","last_clean":"2026-02-13T04:00:54.060508+0000","last_became_active":"2026-02-13T04:00:48.691356+0000","last_became_peered":"2026-02-13T04:00:48.691356+0000","last_unstale":"2026-02-13T04:00:54.060508+0000","last_undegraded":"2026-02-13T04:00:54.060508+0000","last_fullsized":"2026-02-13T04:00:54.060508+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:52:50.006515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.721111+0000","last_change":"2026-02-13T04:00:49.479452+0000","last_active":"2026-02-13T04:00:50.721111+0000","last_peered":"2026-02-13T04:00:50.721111+0000","last_clean":"2026-02-13T04:00:50.721111+0000","last_became_active":"2026-02-13T04:00:49.479354+0000","last_became_peered":"2026-02-13T04:00:49.479354+0000","last_unstale":"2026-02-13T04:00:50.721111+0000","last_undegraded":"2026-02-13T04:00:50.721111+0000","last_fullsized":"2026-02-13T04:00:50.721111+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:46:41.444877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:57.080017+0000","last_change":"2026-02-13T04:00:48.696889+0000","last_active":"2026-02-13T04:00:57.080017+0000","last_peered":"2026-02-13T04:00:57.080017+0000","last_clean":"2026-02-13T04:00:57.080017+0000","last_became_active":"2026-02-13T04:00:48.696722+0000","last_became_peered":"2026-02-13T04:00:48.696722+0000","last_unstale":"2026-02-13T04:00:57.080017+0000","last_undegraded":"2026-02-13T04:00:57.080017+0000","last_fullsized":"2026-02-13T04:00:57.080017+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:14:45.512084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469888+0000","last_change":"2026-02-13T04:00:49.478833+0000","last_active":"2026-02-13T04:00:50.469888+0000","last_peered":"2026-02-13T04:00:50.469888+0000","last_clean":"2026-02-13T04:00:50.469888+0000","last_became_active":"2026-02-13T04:00:49.478661+0000","last_became_peered":"2026-02-13T04:00:49.478661+0000","last_unstale":"2026-02-13T04:00:50.469888+0000","last_undegraded":"2026-02-13T04:00:50.469888+0000","last_fullsized":"2026-02-13T04:00:50.469888+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:19:27.081820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"76'1","reported_seq":17,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.910360+0000","last_change":"2026-02-13T04:00:48.691941+0000","last_active":"2026-02-13T04:00:50.910360+0000","last_peered":"2026-02-13T04:00:50.910360+0000","last_clean":"2026-02-13T04:00:50.910360+0000","last_became_active":"2026-02-13T04:00:48.691773+0000","last_became_peered":"2026-02-13T04:00:48.691773+0000","last_unstale":"2026-02-13T04:00:50.910360+0000","last_undegraded":"2026-02-13T04:00:50.910360+0000","last_fullsized":"2026-02-13T04:00:50.910360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:42:13.810742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.468946+0000","last_change":"2026-02-13T04:00:49.477705+0000","last_active":"2026-02-13T04:00:50.468946+0000","last_peered":"2026-02-13T04:00:50.468946+0000","last_clean":"2026-02-13T04:00:50.468946+0000","last_became_active":"2026-02-13T04:00:49.477600+0000","last_became_peered":"2026-02-13T04:00:49.477600+0000","last_unstale":"2026-02-13T04:00:50.468946+0000","last_undegraded":"2026-02-13T04:00:50.468946+0000","last_fullsized":"2026-02-13T04:00:50.468946+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:38:17.010092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"76'1","reported_seq":17,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469620+0000","last_change":"2026-02-13T04:00:48.698484+0000","last_active":"2026-02-13T04:00:50.469620+0000","last_peered":"2026-02-13T04:00:50.469620+0000","last_clean":"2026-02-13T04:00:50.469620+0000","last_became_active":"2026-02-13T04:00:48.698054+0000","last_became_peered":"2026-02-13T04:00:48.698054+0000","last_unstale":"2026-02-13T04:00:50.469620+0000","last_undegraded":"2026-02-13T04:00:50.469620+0000","last_fullsized":"2026-02-13T04:00:50.469620+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:44:12.728961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469014+0000","last_change":"2026-02-13T04:00:49.475436+0000","last_active":"2026-02-13T04:00:50.469014+0000","last_peered":"2026-02-13T04:00:50.469014+0000","last_clean":"2026-02-13T04:00:50.469014+0000","last_became_active":"2026-02-13T04:00:49.475301+0000","last_became_peered":"2026-02-13T04:00:49.475301+0000","last_unstale":"2026-02-13T04:00:50.469014+0000","last_undegraded":"2026-02-13T04:00:50.469014+0000","last_fullsized":"2026-02-13T04:00:50.469014+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:01:52.755952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"76'4","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:55.070468+0000","last_change":"2026-02-13T04:00:48.697244+0000","last_active":"2026-02-13T04:00:55.070468+0000","last_peered":"2026-02-13T04:00:55.070468+0000","last_clean":"2026-02-13T04:00:55.070468+0000","last_became_active":"2026-02-13T04:00:48.697000+0000","last_became_peered":"2026-02-13T04:00:48.697000+0000","last_unstale":"2026-02-13T04:00:55.070468+0000","last_undegraded":"2026-02-13T04:00:55.070468+0000","last_fullsized":"2026-02-13T04:00:55.070468+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:01:34.413201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.721388+0000","last_change":"2026-02-13T04:00:49.479594+0000","last_active":"2026-02-13T04:00:50.721388+0000","last_peered":"2026-02-13T04:00:50.721388+0000","last_clean":"2026-02-13T04:00:50.721388+0000","last_became_active":"2026-02-13T04:00:49.479339+0000","last_became_peered":"2026-02-13T04:00:49.479339+0000","last_unstale":"2026-02-13T04:00:50.721388+0000","last_undegraded":"2026-02-13T04:00:50.721388+0000","last_fullsized":"2026-02-13T04:00:50.721388+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:53:38.743418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"76'9","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:57.037937+0000","last_change":"2026-02-13T04:00:48.700184+0000","last_active":"2026-02-13T04:00:57.037937+0000","last_peered":"2026-02-13T04:00:57.037937+0000","last_clean":"2026-02-13T04:00:57.037937+0000","last_became_active":"2026-02-13T04:00:48.699830+0000","last_became_peered":"2026-02-13T04:00:48.699830+0000","last_unstale":"2026-02-13T04:00:57.037937+0000","last_undegraded":"2026-02-13T04:00:57.037937+0000","last_fullsized":"2026-02-13T04:00:57.037937+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:33:36.683841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469071+0000","last_change":"2026-02-13T04:00:49.479398+0000","last_active":"2026-02-13T04:00:50.469071+0000","last_peered":"2026-02-13T04:00:50.469071+0000","last_clean":"2026-02-13T04:00:50.469071+0000","last_became_active":"2026-02-13T04:00:49.478123+0000","last_became_peered":"2026-02-13T04:00:49.478123+0000","last_unstale":"2026-02-13T04:00:50.469071+0000","last_undegraded":"2026-02-13T04:00:50.469071+0000","last_fullsized":"2026-02-13T04:00:50.469071+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:27:11.747352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"76'7","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:56.076080+0000","last_change":"2026-02-13T04:00:48.693990+0000","last_active":"2026-02-13T04:00:56.076080+0000","last_peered":"2026-02-13T04:00:56.076080+0000","last_clean":"2026-02-13T04:00:56.076080+0000","last_became_active":"2026-02-13T04:00:48.693900+0000","last_became_peered":"2026-02-13T04:00:48.693900+0000","last_unstale":"2026-02-13T04:00:56.076080+0000","last_undegraded":"2026-02-13T04:00:56.076080+0000","last_fullsized":"2026-02-13T04:00:56.076080+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:30:06.422983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469681+0000","last_change":"2026-02-13T04:00:49.482955+0000","last_active":"2026-02-13T04:00:50.469681+0000","last_peered":"2026-02-13T04:00:50.469681+0000","last_clean":"2026-02-13T04:00:50.469681+0000","last_became_active":"2026-02-13T04:00:49.482763+0000","last_became_peered":"2026-02-13T04:00:49.482763+0000","last_unstale":"2026-02-13T04:00:50.469681+0000","last_undegraded":"2026-02-13T04:00:50.469681+0000","last_fullsized":"2026-02-13T04:00:50.469681+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:57:57.634076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"76'2","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:53.057146+0000","last_change":"2026-02-13T04:00:48.691700+0000","last_active":"2026-02-13T04:00:53.057146+0000","last_peered":"2026-02-13T04:00:53.057146+0000","last_clean":"2026-02-13T04:00:53.057146+0000","last_became_active":"2026-02-13T04:00:48.691589+0000","last_became_peered":"2026-02-13T04:00:48.691589+0000","last_unstale":"2026-02-13T04:00:53.057146+0000","last_undegraded":"2026-02-13T04:00:53.057146+0000","last_fullsized":"2026-02-13T04:00:53.057146+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:11:12.096183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722064+0000","last_change":"2026-02-13T04:00:49.474149+0000","last_active":"2026-02-13T04:00:50.722064+0000","last_peered":"2026-02-13T04:00:50.722064+0000","last_clean":"2026-02-13T04:00:50.722064+0000","last_became_active":"2026-02-13T04:00:49.473736+0000","last_became_peered":"2026-02-13T04:00:49.473736+0000","last_unstale":"2026-02-13T04:00:50.722064+0000","last_undegraded":"2026-02-13T04:00:50.722064+0000","last_fullsized":"2026-02-13T04:00:50.722064+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:25:56.827117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"76'5","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:55.070320+0000","last_change":"2026-02-13T04:00:48.697874+0000","last_active":"2026-02-13T04:00:55.070320+0000","last_peered":"2026-02-13T04:00:55.070320+0000","last_clean":"2026-02-13T04:00:55.070320+0000","last_became_active":"2026-02-13T04:00:48.697771+0000","last_became_peered":"2026-02-13T04:00:48.697771+0000","last_unstale":"2026-02-13T04:00:55.070320+0000","last_undegraded":"2026-02-13T04:00:55.070320+0000","last_fullsized":"2026-02-13T04:00:55.070320+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:08:04.185025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722259+0000","last_change":"2026-02-13T04:00:49.482790+0000","last_active":"2026-02-13T04:00:50.722259+0000","last_peered":"2026-02-13T04:00:50.722259+0000","last_clean":"2026-02-13T04:00:50.722259+0000","last_became_active":"2026-02-13T04:00:49.482576+0000","last_became_peered":"2026-02-13T04:00:49.482576+0000","last_unstale":"2026-02-13T04:00:50.722259+0000","last_undegraded":"2026-02-13T04:00:50.722259+0000","last_fullsized":"2026-02-13T04:00:50.722259+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:32:27.345836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"76'2","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:55.056354+0000","last_change":"2026-02-13T04:00:48.700697+0000","last_active":"2026-02-13T04:00:55.056354+0000","last_peered":"2026-02-13T04:00:55.056354+0000","last_clean":"2026-02-13T04:00:55.056354+0000","last_became_active":"2026-02-13T04:00:48.700486+0000","last_became_peered":"2026-02-13T04:00:48.700486+0000","last_unstale":"2026-02-13T04:00:55.056354+0000","last_undegraded":"2026-02-13T04:00:55.056354+0000","last_fullsized":"2026-02-13T04:00:55.056354+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:12:01.767319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469076+0000","last_change":"2026-02-13T04:00:49.479587+0000","last_active":"2026-02-13T04:00:50.469076+0000","last_peered":"2026-02-13T04:00:50.469076+0000","last_clean":"2026-02-13T04:00:50.469076+0000","last_became_active":"2026-02-13T04:00:49.478914+0000","last_became_peered":"2026-02-13T04:00:49.478914+0000","last_unstale":"2026-02-13T04:00:50.469076+0000","last_undegraded":"2026-02-13T04:00:50.469076+0000","last_fullsized":"2026-02-13T04:00:50.469076+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:17:27.267886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"76'4","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:53.056783+0000","last_change":"2026-02-13T04:00:48.693343+0000","last_active":"2026-02-13T04:00:53.056783+0000","last_peered":"2026-02-13T04:00:53.056783+0000","last_clean":"2026-02-13T04:00:53.056783+0000","last_became_active":"2026-02-13T04:00:48.692911+0000","last_became_peered":"2026-02-13T04:00:48.692911+0000","last_unstale":"2026-02-13T04:00:53.056783+0000","last_undegraded":"2026-02-13T04:00:53.056783+0000","last_fullsized":"2026-02-13T04:00:53.056783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:54:45.498989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.910234+0000","last_change":"2026-02-13T04:00:49.475224+0000","last_active":"2026-02-13T04:00:50.910234+0000","last_peered":"2026-02-13T04:00:50.910234+0000","last_clean":"2026-02-13T04:00:50.910234+0000","last_became_active":"2026-02-13T04:00:49.475101+0000","last_became_peered":"2026-02-13T04:00:49.475101+0000","last_unstale":"2026-02-13T04:00:50.910234+0000","last_undegraded":"2026-02-13T04:00:50.910234+0000","last_fullsized":"2026-02-13T04:00:50.910234+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:14:50.281702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469957+0000","last_change":"2026-02-13T04:00:49.478859+0000","last_active":"2026-02-13T04:00:50.469957+0000","last_peered":"2026-02-13T04:00:50.469957+0000","last_clean":"2026-02-13T04:00:50.469957+0000","last_became_active":"2026-02-13T04:00:49.478702+0000","last_became_peered":"2026-02-13T04:00:49.478702+0000","last_unstale":"2026-02-13T04:00:50.469957+0000","last_undegraded":"2026-02-13T04:00:50.469957+0000","last_fullsized":"2026-02-13T04:00:50.469957+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:37:22.794457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"76'5","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:56.076264+0000","last_change":"2026-02-13T04:00:48.693367+0000","last_active":"2026-02-13T04:00:56.076264+0000","last_peered":"2026-02-13T04:00:56.076264+0000","last_clean":"2026-02-13T04:00:56.076264+0000","last_became_active":"2026-02-13T04:00:48.692994+0000","last_became_peered":"2026-02-13T04:00:48.692994+0000","last_unstale":"2026-02-13T04:00:56.076264+0000","last_undegraded":"2026-02-13T04:00:56.076264+0000","last_fullsized":"2026-02-13T04:00:56.076264+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:39:31.460593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.720749+0000","last_change":"2026-02-13T04:00:49.478041+0000","last_active":"2026-02-13T04:00:50.720749+0000","last_peered":"2026-02-13T04:00:50.720749+0000","last_clean":"2026-02-13T04:00:50.720749+0000","last_became_active":"2026-02-13T04:00:49.477881+0000","last_became_peered":"2026-02-13T04:00:49.477881+0000","last_unstale":"2026-02-13T04:00:50.720749+0000","last_undegraded":"2026-02-13T04:00:50.720749+0000","last_fullsized":"2026-02-13T04:00:50.720749+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:18:39.952084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"76'11","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:56.076365+0000","last_change":"2026-02-13T04:00:48.693403+0000","last_active":"2026-02-13T04:00:56.076365+0000","last_peered":"2026-02-13T04:00:56.076365+0000","last_clean":"2026-02-13T04:00:56.076365+0000","last_became_active":"2026-02-13T04:00:48.693036+0000","last_became_peered":"2026-02-13T04:00:48.693036+0000","last_unstale":"2026-02-13T04:00:56.076365+0000","last_undegraded":"2026-02-13T04:00:56.076365+0000","last_fullsized":"2026-02-13T04:00:56.076365+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:11:26.056818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469797+0000","last_change":"2026-02-13T04:00:49.477916+0000","last_active":"2026-02-13T04:00:50.469797+0000","last_peered":"2026-02-13T04:00:50.469797+0000","last_clean":"2026-02-13T04:00:50.469797+0000","last_became_active":"2026-02-13T04:00:49.477821+0000","last_became_peered":"2026-02-13T04:00:49.477821+0000","last_unstale":"2026-02-13T04:00:50.469797+0000","last_undegraded":"2026-02-13T04:00:50.469797+0000","last_fullsized":"2026-02-13T04:00:50.469797+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:28:08.763696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"76'2","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.697310+0000","last_change":"2026-02-13T04:00:48.696707+0000","last_active":"2026-02-13T04:00:50.697310+0000","last_peered":"2026-02-13T04:00:50.697310+0000","last_clean":"2026-02-13T04:00:50.697310+0000","last_became_active":"2026-02-13T04:00:48.696565+0000","last_became_peered":"2026-02-13T04:00:48.696565+0000","last_unstale":"2026-02-13T04:00:50.697310+0000","last_undegraded":"2026-02-13T04:00:50.697310+0000","last_fullsized":"2026-02-13T04:00:50.697310+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:22:58.352215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469060+0000","last_change":"2026-02-13T04:00:49.476851+0000","last_active":"2026-02-13T04:00:50.469060+0000","last_peered":"2026-02-13T04:00:50.469060+0000","last_clean":"2026-02-13T04:00:50.469060+0000","last_became_active":"2026-02-13T04:00:49.476687+0000","last_became_peered":"2026-02-13T04:00:49.476687+0000","last_unstale":"2026-02-13T04:00:50.469060+0000","last_undegraded":"2026-02-13T04:00:50.469060+0000","last_fullsized":"2026-02-13T04:00:50.469060+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:33:58.923183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"76'13","reported_seq":32,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:57.081586+0000","last_change":"2026-02-13T04:00:48.695808+0000","last_active":"2026-02-13T04:00:57.081586+0000","last_peered":"2026-02-13T04:00:57.081586+0000","last_clean":"2026-02-13T04:00:57.081586+0000","last_became_active":"2026-02-13T04:00:48.695558+0000","last_became_peered":"2026-02-13T04:00:48.695558+0000","last_unstale":"2026-02-13T04:00:57.081586+0000","last_undegraded":"2026-02-13T04:00:57.081586+0000","last_fullsized":"2026-02-13T04:00:57.081586+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:50:53.268602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":15149,"num_objects":91,"num_object_clones":0,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":15,"num_read_kb":13,"num_write":201,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":84293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":183548,"internal_metadata":0},"log_size":172,"ondisk_log_size":172,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":3542208,"data_compressed":228962,"data_compressed_allocated":270336,"data_compressed_original":3522560,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678023,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27764,"kb_used_data":800,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":733975436,"statfs":{"total":751619276800,"available":751590846464,"internally_reserved":0,"allocated":819200,"data_stored":395863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8794,"internal_metadata":27581862},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906952,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27864,"kb_used_data":900,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":733975336,"statfs":{"total":751619276800,"available":751590744064,"internally_reserved":0,"allocated":921600,"data_stored":989589,"data_compressed":38435,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":29455,"internal_metadata":27561201},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037770,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27800,"kb_used_data":836,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":733975400,"statfs":{"total":751619276800,"available":751590809600,"internally_reserved":0,"allocated":856064,"data_stored":397007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29415,"internal_metadata":27561241},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266700,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27796,"kb_used_data":832,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975404,"statfs":{"total":751619276800,"available":751590813696,"internally_reserved":0,"allocated":851968,"data_stored":397407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34036,"internal_metadata":27556620},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495629,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27828,"kb_used_data":864,"kb_used_omap":32,"kb_used_meta":26911,"kb_avail":733975372,"statfs":{"total":751619276800,"available":751590780928,"internally_reserved":0,"allocated":884736,"data_stored":988045,"data_compressed":38435,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":33254,"internal_metadata":27557402},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626447,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27784,"kb_used_data":820,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975416,"statfs":{"total":751619276800,"available":751590825984,"internally_reserved":0,"allocated":839680,"data_stored":396702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34098,"internal_metadata":27556558},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855377,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27852,"kb_used_data":888,"kb_used_omap":36,"kb_used_meta":26907,"kb_avail":733975348,"statfs":{"total":751619276800,"available":751590756352,"internally_reserved":0,"allocated":909312,"data_stored":988513,"data_compressed":38435,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":37286,"internal_metadata":27553370},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986195,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27784,"kb_used_data":820,"kb_used_omap":44,"kb_used_meta":26899,"kb_avail":733975416,"statfs":{"total":751619276800,"available":751590825984,"internally_reserved":0,"allocated":839680,"data_stored":396973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45151,"internal_metadata":27545505},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215124,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27788,"kb_used_data":824,"kb_used_omap":46,"kb_used_meta":26897,"kb_avail":733975412,"statfs":{"total":751619276800,"available":751590821888,"internally_reserved":0,"allocated":843776,"data_stored":396271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47657,"internal_metadata":27542999},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476759,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27808,"kb_used_data":844,"kb_used_omap":57,"kb_used_meta":26886,"kb_avail":733975392,"statfs":{"total":751619276800,"available":751590801408,"internally_reserved":0,"allocated":864256,"data_stored":399491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":59309,"internal_metadata":27531347},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607576,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27812,"kb_used_data":848,"kb_used_omap":45,"kb_used_meta":26898,"kb_avail":733975388,"statfs":{"total":751619276800,"available":751590797312,"internally_reserved":0,"allocated":868352,"data_stored":423253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":46360,"internal_metadata":27544296},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738393,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27796,"kb_used_data":832,"kb_used_omap":48,"kb_used_meta":26895,"kb_avail":733975404,"statfs":{"total":751619276800,"available":751590813696,"internally_reserved":0,"allocated":851968,"data_stored":397973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49874,"internal_metadata":27540782},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36787,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38435,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38435,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38435,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38435,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38435,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10042,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":50803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3361,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":11199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":50439,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1917,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31677,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7116,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13465,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4105,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23778,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23981,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":10553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11283,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2384,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T04:01:00.540 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph pg dump --format=json 2026-02-13T04:01:00.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:00 trial158 ceph-mon[27763]: pgmap v182: 97 pgs: 97 active+clean; 591 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 1.4 KiB/s rd, 7.7 KiB/s wr, 22 op/s 2026-02-13T04:01:00.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:00 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/492621161' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2026-02-13T04:01:00.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:00 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/3918757258' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T04:01:00.721 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:00.914 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.909+0000 7f88875c26c0 1 -- 10.20.193.92:0/2124035439 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f88801137a0 msgr2=0x7f8880113b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:00.914 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.909+0000 7f88875c26c0 1 --2- 10.20.193.92:0/2124035439 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f88801137a0 0x7f8880113b70 secure :-1 s=READY pgs=194 gs=1 cs=0 l=1 c_cookie=728592365826032349 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88780099a0 tx=0x7f887802ed00 comp rx=0 tx=0).stop 2026-02-13T04:01:00.914 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.909+0000 7f88875c26c0 1 -- 10.20.193.92:0/2124035439 shutdown_connections 2026-02-13T04:01:00.914 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.909+0000 7f88875c26c0 1 --2- 10.20.193.92:0/2124035439 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8880116520 0x7f888017a100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:00.914 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.909+0000 7f88875c26c0 1 --2- 10.20.193.92:0/2124035439 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f8880114190 0x7f8880115d40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:00.914 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.909+0000 7f88875c26c0 1 --2- 10.20.193.92:0/2124035439 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f88801137a0 0x7f8880113b70 unknown :-1 s=CLOSED pgs=194 gs=1 cs=0 l=1 c_cookie=728592365826032349 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:00.915 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.909+0000 7f88875c26c0 1 -- 10.20.193.92:0/2124035439 >> 10.20.193.92:0/2124035439 conn(0x7f8880061510 msgr2=0x7f8880061910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:00.915 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.909+0000 7f88875c26c0 1 -- 10.20.193.92:0/2124035439 shutdown_connections 2026-02-13T04:01:00.915 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.910+0000 7f88875c26c0 1 -- 10.20.193.92:0/2124035439 wait complete. 2026-02-13T04:01:00.915 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.910+0000 7f88875c26c0 1 Processor -- start 2026-02-13T04:01:00.915 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.910+0000 7f88875c26c0 1 -- start start 2026-02-13T04:01:00.915 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.911+0000 7f88875c26c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f88801137a0 0x7f8880121480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:00.915 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.911+0000 7f88875c26c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8880116520 0x7f88801219c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:00.915 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.911+0000 7f88875c26c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f8880126d80 0x7f8880127220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:00.915 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.911+0000 7f88875c26c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8880127790 con 0x7f8880116520 2026-02-13T04:01:00.915 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.911+0000 7f88875c26c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8880127900 con 0x7f88801137a0 2026-02-13T04:01:00.915 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.911+0000 7f88875c26c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f8880127ac0 con 0x7f8880126d80 2026-02-13T04:01:00.915 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.911+0000 7f88865c06c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f88801137a0 0x7f8880121480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:00.916 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.911+0000 7f88865c06c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f88801137a0 0x7f8880121480 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:42346/0 (socket says 10.20.193.92:42346) 2026-02-13T04:01:00.916 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.911+0000 7f88865c06c0 1 -- 10.20.193.92:0/2040166579 learned_addr learned my addr 10.20.193.92:0/2040166579 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:00.916 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.911+0000 7f8885dbf6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8880116520 0x7f88801219c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:00.916 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.911+0000 7f8886dc16c0 1 --2- 10.20.193.92:0/2040166579 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f8880126d80 0x7f8880127220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:00.917 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.911+0000 7f88865c06c0 1 -- 10.20.193.92:0/2040166579 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f8880126d80 msgr2=0x7f8880127220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:00.917 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.911+0000 7f88865c06c0 1 --2- 10.20.193.92:0/2040166579 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f8880126d80 0x7f8880127220 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:00.917 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.911+0000 7f88865c06c0 1 -- 10.20.193.92:0/2040166579 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8880116520 msgr2=0x7f88801219c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:00.917 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.911+0000 7f88865c06c0 1 --2- 10.20.193.92:0/2040166579 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8880116520 0x7f88801219c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:00.917 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.911+0000 7f88865c06c0 1 -- 10.20.193.92:0/2040166579 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8878009590 con 0x7f88801137a0 2026-02-13T04:01:00.917 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.911+0000 7f8885dbf6c0 1 --2- 10.20.193.92:0/2040166579 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8880116520 0x7f88801219c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T04:01:00.917 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.912+0000 7f88865c06c0 1 --2- 10.20.193.92:0/2040166579 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f88801137a0 0x7f8880121480 secure :-1 s=READY pgs=91 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8878031fd0 tx=0x7f887802f810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:00.918 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.912+0000 7f886b7fe6c0 1 -- 10.20.193.92:0/2040166579 <== mon.2 v2:10.20.193.99:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f88780026b0 con 0x7f88801137a0 2026-02-13T04:01:00.918 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.912+0000 7f886b7fe6c0 1 -- 10.20.193.92:0/2040166579 <== mon.2 v2:10.20.193.99:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f8878002d40 con 0x7f88801137a0 2026-02-13T04:01:00.918 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.912+0000 7f88875c26c0 1 -- 10.20.193.92:0/2040166579 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8880167f10 con 0x7f88801137a0 2026-02-13T04:01:00.918 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.912+0000 7f88875c26c0 1 -- 10.20.193.92:0/2040166579 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8880168340 con 0x7f88801137a0 2026-02-13T04:01:00.918 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.912+0000 7f886b7fe6c0 1 -- 10.20.193.92:0/2040166579 <== mon.2 v2:10.20.193.99:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8878007670 con 0x7f88801137a0 2026-02-13T04:01:00.918 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.912+0000 7f88697fa6c0 1 -- 10.20.193.92:0/2040166579 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8880114840 con 0x7f88801137a0 2026-02-13T04:01:00.918 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.915+0000 7f886b7fe6c0 1 -- 10.20.193.92:0/2040166579 <== mon.2 v2:10.20.193.99:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f8878002810 con 0x7f88801137a0 2026-02-13T04:01:00.919 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.916+0000 7f886b7fe6c0 1 --2- 10.20.193.92:0/2040166579 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f885c0b56e0 0x7f885c0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:00.920 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.916+0000 7f886b7fe6c0 1 -- 10.20.193.92:0/2040166579 <== mon.2 v2:10.20.193.99:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7f8878107d60 con 0x7f88801137a0 2026-02-13T04:01:00.920 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.917+0000 7f8885dbf6c0 1 --2- 10.20.193.92:0/2040166579 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f885c0b56e0 0x7f885c0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:00.920 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.917+0000 7f886b7fe6c0 1 -- 10.20.193.92:0/2040166579 <== mon.2 v2:10.20.193.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f88781081e0 con 0x7f88801137a0 2026-02-13T04:01:00.920 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:00.917+0000 7f8885dbf6c0 1 --2- 10.20.193.92:0/2040166579 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f885c0b56e0 0x7f885c0d5b90 secure :-1 s=READY pgs=149 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8880127e10 tx=0x7f886c009390 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:01.018 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.015+0000 7f88697fa6c0 1 -- 10.20.193.92:0/2040166579 --> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f88801225d0 con 0x7f885c0b56e0 2026-02-13T04:01:01.021 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.018+0000 7f886b7fe6c0 1 -- 10.20.193.92:0/2040166579 <== mgr.14187 v2:10.20.193.92:6800/4191527999 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258924 (secure 0 0 0) 0x7f88801225d0 con 0x7f885c0b56e0 2026-02-13T04:01:01.023 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:01:01.025 INFO:teuthology.orchestra.run.trial092.stderr:dumped all 2026-02-13T04:01:01.027 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.020+0000 7f88697fa6c0 1 -- 10.20.193.92:0/2040166579 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f885c0b56e0 msgr2=0x7f885c0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:01.027 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.020+0000 7f88697fa6c0 1 --2- 10.20.193.92:0/2040166579 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f885c0b56e0 0x7f885c0d5b90 secure :-1 s=READY pgs=149 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8880127e10 tx=0x7f886c009390 comp rx=0 tx=0).stop 2026-02-13T04:01:01.027 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.020+0000 7f88697fa6c0 1 -- 10.20.193.92:0/2040166579 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f88801137a0 msgr2=0x7f8880121480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:01.027 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.020+0000 7f88697fa6c0 1 --2- 10.20.193.92:0/2040166579 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f88801137a0 0x7f8880121480 secure :-1 s=READY pgs=91 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8878031fd0 tx=0x7f887802f810 comp rx=0 tx=0).stop 2026-02-13T04:01:01.027 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.021+0000 7f88697fa6c0 1 -- 10.20.193.92:0/2040166579 shutdown_connections 2026-02-13T04:01:01.027 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.021+0000 7f88697fa6c0 1 --2- 10.20.193.92:0/2040166579 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f8880126d80 0x7f8880127220 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:01.027 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.021+0000 7f88697fa6c0 1 --2- 10.20.193.92:0/2040166579 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8880116520 0x7f88801219c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:01.027 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.021+0000 7f88697fa6c0 1 --2- 10.20.193.92:0/2040166579 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f885c0b56e0 0x7f885c0d5b90 unknown :-1 s=CLOSED pgs=149 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:01.027 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.021+0000 7f88697fa6c0 1 --2- 10.20.193.92:0/2040166579 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f88801137a0 0x7f8880121480 unknown :-1 s=CLOSED pgs=91 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:01.027 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.021+0000 7f88697fa6c0 1 -- 10.20.193.92:0/2040166579 >> 10.20.193.92:0/2040166579 conn(0x7f8880061510 msgr2=0x7f8880116d50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:01.028 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.021+0000 7f88697fa6c0 1 -- 10.20.193.92:0/2040166579 shutdown_connections 2026-02-13T04:01:01.028 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.021+0000 7f88697fa6c0 1 -- 10.20.193.92:0/2040166579 wait complete. 2026-02-13T04:01:01.127 INFO:teuthology.orchestra.run.trial092.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2026-02-13T04:00:59.088547+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605517,"num_objects":93,"num_object_clones":0,"num_object_copies":279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":93,"num_whiteouts":0,"num_read":129,"num_read_kb":112,"num_write":390,"num_write_kb":3790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":324,"ondisk_log_size":324,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":333676,"kb_used_data":10108,"kb_used_omap":444,"kb_used_meta":322883,"kb_avail":8807704724,"statfs":{"total":9019431321600,"available":9019089637376,"internally_reserved":0,"allocated":10350592,"data_stored":6567087,"data_compressed":115305,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":454689,"internal_metadata":330633183},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":15149,"num_objects":91,"num_object_clones":0,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":15,"num_read_kb":13,"num_write":201,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.622088"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722515+0000","last_change":"2026-02-13T04:00:49.479956+0000","last_active":"2026-02-13T04:00:50.722515+0000","last_peered":"2026-02-13T04:00:50.722515+0000","last_clean":"2026-02-13T04:00:50.722515+0000","last_became_active":"2026-02-13T04:00:49.479727+0000","last_became_peered":"2026-02-13T04:00:49.479727+0000","last_unstale":"2026-02-13T04:00:50.722515+0000","last_undegraded":"2026-02-13T04:00:50.722515+0000","last_fullsized":"2026-02-13T04:00:50.722515+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:47:26.793095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469620+0000","last_change":"2026-02-13T04:00:49.482313+0000","last_active":"2026-02-13T04:00:50.469620+0000","last_peered":"2026-02-13T04:00:50.469620+0000","last_clean":"2026-02-13T04:00:50.469620+0000","last_became_active":"2026-02-13T04:00:49.482220+0000","last_became_peered":"2026-02-13T04:00:49.482220+0000","last_unstale":"2026-02-13T04:00:50.469620+0000","last_undegraded":"2026-02-13T04:00:50.469620+0000","last_fullsized":"2026-02-13T04:00:50.469620+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:31:30.541675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469513+0000","last_change":"2026-02-13T04:00:49.475309+0000","last_active":"2026-02-13T04:00:50.469513+0000","last_peered":"2026-02-13T04:00:50.469513+0000","last_clean":"2026-02-13T04:00:50.469513+0000","last_became_active":"2026-02-13T04:00:49.474397+0000","last_became_peered":"2026-02-13T04:00:49.474397+0000","last_unstale":"2026-02-13T04:00:50.469513+0000","last_undegraded":"2026-02-13T04:00:50.469513+0000","last_fullsized":"2026-02-13T04:00:50.469513+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:12:33.930204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.468755+0000","last_change":"2026-02-13T04:00:49.478672+0000","last_active":"2026-02-13T04:00:50.468755+0000","last_peered":"2026-02-13T04:00:50.468755+0000","last_clean":"2026-02-13T04:00:50.468755+0000","last_became_active":"2026-02-13T04:00:49.477706+0000","last_became_peered":"2026-02-13T04:00:49.477706+0000","last_unstale":"2026-02-13T04:00:50.468755+0000","last_undegraded":"2026-02-13T04:00:50.468755+0000","last_fullsized":"2026-02-13T04:00:50.468755+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:18:15.978107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722339+0000","last_change":"2026-02-13T04:00:49.479066+0000","last_active":"2026-02-13T04:00:50.722339+0000","last_peered":"2026-02-13T04:00:50.722339+0000","last_clean":"2026-02-13T04:00:50.722339+0000","last_became_active":"2026-02-13T04:00:49.478908+0000","last_became_peered":"2026-02-13T04:00:49.478908+0000","last_unstale":"2026-02-13T04:00:50.722339+0000","last_undegraded":"2026-02-13T04:00:50.722339+0000","last_fullsized":"2026-02-13T04:00:50.722339+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:23:17.185580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.468647+0000","last_change":"2026-02-13T04:00:49.473377+0000","last_active":"2026-02-13T04:00:50.468647+0000","last_peered":"2026-02-13T04:00:50.468647+0000","last_clean":"2026-02-13T04:00:50.468647+0000","last_became_active":"2026-02-13T04:00:49.473101+0000","last_became_peered":"2026-02-13T04:00:49.473101+0000","last_unstale":"2026-02-13T04:00:50.468647+0000","last_undegraded":"2026-02-13T04:00:50.468647+0000","last_fullsized":"2026-02-13T04:00:50.468647+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:13:24.278254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.909973+0000","last_change":"2026-02-13T04:00:49.474399+0000","last_active":"2026-02-13T04:00:50.909973+0000","last_peered":"2026-02-13T04:00:50.909973+0000","last_clean":"2026-02-13T04:00:50.909973+0000","last_became_active":"2026-02-13T04:00:49.474190+0000","last_became_peered":"2026-02-13T04:00:49.474190+0000","last_unstale":"2026-02-13T04:00:50.909973+0000","last_undegraded":"2026-02-13T04:00:50.909973+0000","last_fullsized":"2026-02-13T04:00:50.909973+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:58:56.035600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.468618+0000","last_change":"2026-02-13T04:00:49.479881+0000","last_active":"2026-02-13T04:00:50.468618+0000","last_peered":"2026-02-13T04:00:50.468618+0000","last_clean":"2026-02-13T04:00:50.468618+0000","last_became_active":"2026-02-13T04:00:49.477264+0000","last_became_peered":"2026-02-13T04:00:49.477264+0000","last_unstale":"2026-02-13T04:00:50.468618+0000","last_undegraded":"2026-02-13T04:00:50.468618+0000","last_fullsized":"2026-02-13T04:00:50.468618+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:44:11.954643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.720863+0000","last_change":"2026-02-13T04:00:49.474129+0000","last_active":"2026-02-13T04:00:50.720863+0000","last_peered":"2026-02-13T04:00:50.720863+0000","last_clean":"2026-02-13T04:00:50.720863+0000","last_became_active":"2026-02-13T04:00:49.473954+0000","last_became_peered":"2026-02-13T04:00:49.473954+0000","last_unstale":"2026-02-13T04:00:50.720863+0000","last_undegraded":"2026-02-13T04:00:50.720863+0000","last_fullsized":"2026-02-13T04:00:50.720863+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:57:22.870845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469105+0000","last_change":"2026-02-13T04:00:49.473093+0000","last_active":"2026-02-13T04:00:50.469105+0000","last_peered":"2026-02-13T04:00:50.469105+0000","last_clean":"2026-02-13T04:00:50.469105+0000","last_became_active":"2026-02-13T04:00:49.472808+0000","last_became_peered":"2026-02-13T04:00:49.472808+0000","last_unstale":"2026-02-13T04:00:50.469105+0000","last_undegraded":"2026-02-13T04:00:50.469105+0000","last_fullsized":"2026-02-13T04:00:50.469105+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:43:54.901711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.910473+0000","last_change":"2026-02-13T04:00:49.474383+0000","last_active":"2026-02-13T04:00:50.910473+0000","last_peered":"2026-02-13T04:00:50.910473+0000","last_clean":"2026-02-13T04:00:50.910473+0000","last_became_active":"2026-02-13T04:00:49.473948+0000","last_became_peered":"2026-02-13T04:00:49.473948+0000","last_unstale":"2026-02-13T04:00:50.910473+0000","last_undegraded":"2026-02-13T04:00:50.910473+0000","last_fullsized":"2026-02-13T04:00:50.910473+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:55:08.451894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.468849+0000","last_change":"2026-02-13T04:00:49.477579+0000","last_active":"2026-02-13T04:00:50.468849+0000","last_peered":"2026-02-13T04:00:50.468849+0000","last_clean":"2026-02-13T04:00:50.468849+0000","last_became_active":"2026-02-13T04:00:49.473854+0000","last_became_peered":"2026-02-13T04:00:49.473854+0000","last_unstale":"2026-02-13T04:00:50.468849+0000","last_undegraded":"2026-02-13T04:00:50.468849+0000","last_fullsized":"2026-02-13T04:00:50.468849+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:12:19.444223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.721290+0000","last_change":"2026-02-13T04:00:49.476339+0000","last_active":"2026-02-13T04:00:50.721290+0000","last_peered":"2026-02-13T04:00:50.721290+0000","last_clean":"2026-02-13T04:00:50.721290+0000","last_became_active":"2026-02-13T04:00:49.476269+0000","last_became_peered":"2026-02-13T04:00:49.476269+0000","last_unstale":"2026-02-13T04:00:50.721290+0000","last_undegraded":"2026-02-13T04:00:50.721290+0000","last_fullsized":"2026-02-13T04:00:50.721290+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:51:34.159138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.470257+0000","last_change":"2026-02-13T04:00:49.475689+0000","last_active":"2026-02-13T04:00:50.470257+0000","last_peered":"2026-02-13T04:00:50.470257+0000","last_clean":"2026-02-13T04:00:50.470257+0000","last_became_active":"2026-02-13T04:00:49.475254+0000","last_became_peered":"2026-02-13T04:00:49.475254+0000","last_unstale":"2026-02-13T04:00:50.470257+0000","last_undegraded":"2026-02-13T04:00:50.470257+0000","last_fullsized":"2026-02-13T04:00:50.470257+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:44:04.115649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469299+0000","last_change":"2026-02-13T04:00:49.478457+0000","last_active":"2026-02-13T04:00:50.469299+0000","last_peered":"2026-02-13T04:00:50.469299+0000","last_clean":"2026-02-13T04:00:50.469299+0000","last_became_active":"2026-02-13T04:00:49.478351+0000","last_became_peered":"2026-02-13T04:00:49.478351+0000","last_unstale":"2026-02-13T04:00:50.469299+0000","last_undegraded":"2026-02-13T04:00:50.469299+0000","last_fullsized":"2026-02-13T04:00:50.469299+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:03:26.642290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.720495+0000","last_change":"2026-02-13T04:00:49.476182+0000","last_active":"2026-02-13T04:00:50.720495+0000","last_peered":"2026-02-13T04:00:50.720495+0000","last_clean":"2026-02-13T04:00:50.720495+0000","last_became_active":"2026-02-13T04:00:49.476070+0000","last_became_peered":"2026-02-13T04:00:49.476070+0000","last_unstale":"2026-02-13T04:00:50.720495+0000","last_undegraded":"2026-02-13T04:00:50.720495+0000","last_fullsized":"2026-02-13T04:00:50.720495+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:04:29.238236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722540+0000","last_change":"2026-02-13T04:00:49.482695+0000","last_active":"2026-02-13T04:00:50.722540+0000","last_peered":"2026-02-13T04:00:50.722540+0000","last_clean":"2026-02-13T04:00:50.722540+0000","last_became_active":"2026-02-13T04:00:49.482487+0000","last_became_peered":"2026-02-13T04:00:49.482487+0000","last_unstale":"2026-02-13T04:00:50.722540+0000","last_undegraded":"2026-02-13T04:00:50.722540+0000","last_fullsized":"2026-02-13T04:00:50.722540+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:17:10.991068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469800+0000","last_change":"2026-02-13T04:00:49.473784+0000","last_active":"2026-02-13T04:00:50.469800+0000","last_peered":"2026-02-13T04:00:50.469800+0000","last_clean":"2026-02-13T04:00:50.469800+0000","last_became_active":"2026-02-13T04:00:49.473653+0000","last_became_peered":"2026-02-13T04:00:49.473653+0000","last_unstale":"2026-02-13T04:00:50.469800+0000","last_undegraded":"2026-02-13T04:00:50.469800+0000","last_fullsized":"2026-02-13T04:00:50.469800+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:47:48.283470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722687+0000","last_change":"2026-02-13T04:00:49.476692+0000","last_active":"2026-02-13T04:00:50.722687+0000","last_peered":"2026-02-13T04:00:50.722687+0000","last_clean":"2026-02-13T04:00:50.722687+0000","last_became_active":"2026-02-13T04:00:49.476507+0000","last_became_peered":"2026-02-13T04:00:49.476507+0000","last_unstale":"2026-02-13T04:00:50.722687+0000","last_undegraded":"2026-02-13T04:00:50.722687+0000","last_fullsized":"2026-02-13T04:00:50.722687+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:48:00.193446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722223+0000","last_change":"2026-02-13T04:00:49.480680+0000","last_active":"2026-02-13T04:00:50.722223+0000","last_peered":"2026-02-13T04:00:50.722223+0000","last_clean":"2026-02-13T04:00:50.722223+0000","last_became_active":"2026-02-13T04:00:49.480429+0000","last_became_peered":"2026-02-13T04:00:49.480429+0000","last_unstale":"2026-02-13T04:00:50.722223+0000","last_undegraded":"2026-02-13T04:00:50.722223+0000","last_fullsized":"2026-02-13T04:00:50.722223+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:59:07.789528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.721354+0000","last_change":"2026-02-13T04:00:49.478790+0000","last_active":"2026-02-13T04:00:50.721354+0000","last_peered":"2026-02-13T04:00:50.721354+0000","last_clean":"2026-02-13T04:00:50.721354+0000","last_became_active":"2026-02-13T04:00:49.478542+0000","last_became_peered":"2026-02-13T04:00:49.478542+0000","last_unstale":"2026-02-13T04:00:50.721354+0000","last_undegraded":"2026-02-13T04:00:50.721354+0000","last_fullsized":"2026-02-13T04:00:50.721354+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:20:02.089377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.720635+0000","last_change":"2026-02-13T04:00:49.480725+0000","last_active":"2026-02-13T04:00:50.720635+0000","last_peered":"2026-02-13T04:00:50.720635+0000","last_clean":"2026-02-13T04:00:50.720635+0000","last_became_active":"2026-02-13T04:00:49.480629+0000","last_became_peered":"2026-02-13T04:00:49.480629+0000","last_unstale":"2026-02-13T04:00:50.720635+0000","last_undegraded":"2026-02-13T04:00:50.720635+0000","last_fullsized":"2026-02-13T04:00:50.720635+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:58:01.268671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.468709+0000","last_change":"2026-02-13T04:00:49.477665+0000","last_active":"2026-02-13T04:00:50.468709+0000","last_peered":"2026-02-13T04:00:50.468709+0000","last_clean":"2026-02-13T04:00:50.468709+0000","last_became_active":"2026-02-13T04:00:49.477495+0000","last_became_peered":"2026-02-13T04:00:49.477495+0000","last_unstale":"2026-02-13T04:00:50.468709+0000","last_undegraded":"2026-02-13T04:00:50.468709+0000","last_fullsized":"2026-02-13T04:00:50.468709+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:59:53.668023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469843+0000","last_change":"2026-02-13T04:00:49.482438+0000","last_active":"2026-02-13T04:00:50.469843+0000","last_peered":"2026-02-13T04:00:50.469843+0000","last_clean":"2026-02-13T04:00:50.469843+0000","last_became_active":"2026-02-13T04:00:49.482330+0000","last_became_peered":"2026-02-13T04:00:49.482330+0000","last_unstale":"2026-02-13T04:00:50.469843+0000","last_undegraded":"2026-02-13T04:00:50.469843+0000","last_fullsized":"2026-02-13T04:00:50.469843+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:22:36.817612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469056+0000","last_change":"2026-02-13T04:00:49.477434+0000","last_active":"2026-02-13T04:00:50.469056+0000","last_peered":"2026-02-13T04:00:50.469056+0000","last_clean":"2026-02-13T04:00:50.469056+0000","last_became_active":"2026-02-13T04:00:49.477191+0000","last_became_peered":"2026-02-13T04:00:49.477191+0000","last_unstale":"2026-02-13T04:00:50.469056+0000","last_undegraded":"2026-02-13T04:00:50.469056+0000","last_fullsized":"2026-02-13T04:00:50.469056+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:37:48.389471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722779+0000","last_change":"2026-02-13T04:00:49.474549+0000","last_active":"2026-02-13T04:00:50.722779+0000","last_peered":"2026-02-13T04:00:50.722779+0000","last_clean":"2026-02-13T04:00:50.722779+0000","last_became_active":"2026-02-13T04:00:49.474357+0000","last_became_peered":"2026-02-13T04:00:49.474357+0000","last_unstale":"2026-02-13T04:00:50.722779+0000","last_undegraded":"2026-02-13T04:00:50.722779+0000","last_fullsized":"2026-02-13T04:00:50.722779+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:29:00.130538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722309+0000","last_change":"2026-02-13T04:00:49.476543+0000","last_active":"2026-02-13T04:00:50.722309+0000","last_peered":"2026-02-13T04:00:50.722309+0000","last_clean":"2026-02-13T04:00:50.722309+0000","last_became_active":"2026-02-13T04:00:49.476269+0000","last_became_peered":"2026-02-13T04:00:49.476269+0000","last_unstale":"2026-02-13T04:00:50.722309+0000","last_undegraded":"2026-02-13T04:00:50.722309+0000","last_fullsized":"2026-02-13T04:00:50.722309+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:51:34.541577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.721455+0000","last_change":"2026-02-13T04:00:49.480227+0000","last_active":"2026-02-13T04:00:50.721455+0000","last_peered":"2026-02-13T04:00:50.721455+0000","last_clean":"2026-02-13T04:00:50.721455+0000","last_became_active":"2026-02-13T04:00:49.480117+0000","last_became_peered":"2026-02-13T04:00:49.480117+0000","last_unstale":"2026-02-13T04:00:50.721455+0000","last_undegraded":"2026-02-13T04:00:50.721455+0000","last_fullsized":"2026-02-13T04:00:50.721455+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:57:45.182937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469454+0000","last_change":"2026-02-13T04:00:49.479873+0000","last_active":"2026-02-13T04:00:50.469454+0000","last_peered":"2026-02-13T04:00:50.469454+0000","last_clean":"2026-02-13T04:00:50.469454+0000","last_became_active":"2026-02-13T04:00:49.479764+0000","last_became_peered":"2026-02-13T04:00:49.479764+0000","last_unstale":"2026-02-13T04:00:50.469454+0000","last_undegraded":"2026-02-13T04:00:50.469454+0000","last_fullsized":"2026-02-13T04:00:50.469454+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:59:09.259456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722421+0000","last_change":"2026-02-13T04:00:49.478971+0000","last_active":"2026-02-13T04:00:50.722421+0000","last_peered":"2026-02-13T04:00:50.722421+0000","last_clean":"2026-02-13T04:00:50.722421+0000","last_became_active":"2026-02-13T04:00:49.478770+0000","last_became_peered":"2026-02-13T04:00:49.478770+0000","last_unstale":"2026-02-13T04:00:50.722421+0000","last_undegraded":"2026-02-13T04:00:50.722421+0000","last_fullsized":"2026-02-13T04:00:50.722421+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:41:03.291420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722355+0000","last_change":"2026-02-13T04:00:49.475701+0000","last_active":"2026-02-13T04:00:50.722355+0000","last_peered":"2026-02-13T04:00:50.722355+0000","last_clean":"2026-02-13T04:00:50.722355+0000","last_became_active":"2026-02-13T04:00:49.475238+0000","last_became_peered":"2026-02-13T04:00:49.475238+0000","last_unstale":"2026-02-13T04:00:50.722355+0000","last_undegraded":"2026-02-13T04:00:50.722355+0000","last_fullsized":"2026-02-13T04:00:50.722355+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:53:42.399821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722110+0000","last_change":"2026-02-13T04:00:49.476461+0000","last_active":"2026-02-13T04:00:50.722110+0000","last_peered":"2026-02-13T04:00:50.722110+0000","last_clean":"2026-02-13T04:00:50.722110+0000","last_became_active":"2026-02-13T04:00:49.476249+0000","last_became_peered":"2026-02-13T04:00:49.476249+0000","last_unstale":"2026-02-13T04:00:50.722110+0000","last_undegraded":"2026-02-13T04:00:50.722110+0000","last_fullsized":"2026-02-13T04:00:50.722110+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:54:58.933497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722340+0000","last_change":"2026-02-13T04:00:49.475811+0000","last_active":"2026-02-13T04:00:50.722340+0000","last_peered":"2026-02-13T04:00:50.722340+0000","last_clean":"2026-02-13T04:00:50.722340+0000","last_became_active":"2026-02-13T04:00:49.475618+0000","last_became_peered":"2026-02-13T04:00:49.475618+0000","last_unstale":"2026-02-13T04:00:50.722340+0000","last_undegraded":"2026-02-13T04:00:50.722340+0000","last_fullsized":"2026-02-13T04:00:50.722340+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:22:47.756470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"76'5","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:53.057249+0000","last_change":"2026-02-13T04:00:48.693027+0000","last_active":"2026-02-13T04:00:53.057249+0000","last_peered":"2026-02-13T04:00:53.057249+0000","last_clean":"2026-02-13T04:00:53.057249+0000","last_became_active":"2026-02-13T04:00:48.692784+0000","last_became_peered":"2026-02-13T04:00:48.692784+0000","last_unstale":"2026-02-13T04:00:53.057249+0000","last_undegraded":"2026-02-13T04:00:53.057249+0000","last_fullsized":"2026-02-13T04:00:53.057249+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:12:41.834516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469782+0000","last_change":"2026-02-13T04:00:49.482026+0000","last_active":"2026-02-13T04:00:50.469782+0000","last_peered":"2026-02-13T04:00:50.469782+0000","last_clean":"2026-02-13T04:00:50.469782+0000","last_became_active":"2026-02-13T04:00:49.481905+0000","last_became_peered":"2026-02-13T04:00:49.481905+0000","last_unstale":"2026-02-13T04:00:50.469782+0000","last_undegraded":"2026-02-13T04:00:50.469782+0000","last_fullsized":"2026-02-13T04:00:50.469782+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:05:21.043555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"76'7","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:55.067925+0000","last_change":"2026-02-13T04:00:48.691792+0000","last_active":"2026-02-13T04:00:55.067925+0000","last_peered":"2026-02-13T04:00:55.067925+0000","last_clean":"2026-02-13T04:00:55.067925+0000","last_became_active":"2026-02-13T04:00:48.691630+0000","last_became_peered":"2026-02-13T04:00:48.691630+0000","last_unstale":"2026-02-13T04:00:55.067925+0000","last_undegraded":"2026-02-13T04:00:55.067925+0000","last_fullsized":"2026-02-13T04:00:55.067925+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:32:00.435154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"76'3","reported_seq":19,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:54.062781+0000","last_change":"2026-02-13T04:00:48.695910+0000","last_active":"2026-02-13T04:00:54.062781+0000","last_peered":"2026-02-13T04:00:54.062781+0000","last_clean":"2026-02-13T04:00:54.062781+0000","last_became_active":"2026-02-13T04:00:48.695729+0000","last_became_peered":"2026-02-13T04:00:48.695729+0000","last_unstale":"2026-02-13T04:00:54.062781+0000","last_undegraded":"2026-02-13T04:00:54.062781+0000","last_fullsized":"2026-02-13T04:00:54.062781+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:31:27.918317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.468699+0000","last_change":"2026-02-13T04:00:49.481361+0000","last_active":"2026-02-13T04:00:50.468699+0000","last_peered":"2026-02-13T04:00:50.468699+0000","last_clean":"2026-02-13T04:00:50.468699+0000","last_became_active":"2026-02-13T04:00:49.481073+0000","last_became_peered":"2026-02-13T04:00:49.481073+0000","last_unstale":"2026-02-13T04:00:50.468699+0000","last_undegraded":"2026-02-13T04:00:50.468699+0000","last_fullsized":"2026-02-13T04:00:50.468699+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:55:00.151374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"76'2","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:53.056511+0000","last_change":"2026-02-13T04:00:48.692833+0000","last_active":"2026-02-13T04:00:53.056511+0000","last_peered":"2026-02-13T04:00:53.056511+0000","last_clean":"2026-02-13T04:00:53.056511+0000","last_became_active":"2026-02-13T04:00:48.692566+0000","last_became_peered":"2026-02-13T04:00:48.692566+0000","last_unstale":"2026-02-13T04:00:53.056511+0000","last_undegraded":"2026-02-13T04:00:53.056511+0000","last_fullsized":"2026-02-13T04:00:53.056511+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:01:30.821370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469695+0000","last_change":"2026-02-13T04:00:49.479585+0000","last_active":"2026-02-13T04:00:50.469695+0000","last_peered":"2026-02-13T04:00:50.469695+0000","last_clean":"2026-02-13T04:00:50.469695+0000","last_became_active":"2026-02-13T04:00:49.479155+0000","last_became_peered":"2026-02-13T04:00:49.479155+0000","last_unstale":"2026-02-13T04:00:50.469695+0000","last_undegraded":"2026-02-13T04:00:50.469695+0000","last_fullsized":"2026-02-13T04:00:50.469695+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:04:32.865189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"76'4","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:53.056924+0000","last_change":"2026-02-13T04:00:48.697295+0000","last_active":"2026-02-13T04:00:53.056924+0000","last_peered":"2026-02-13T04:00:53.056924+0000","last_clean":"2026-02-13T04:00:53.056924+0000","last_became_active":"2026-02-13T04:00:48.697115+0000","last_became_peered":"2026-02-13T04:00:48.697115+0000","last_unstale":"2026-02-13T04:00:53.056924+0000","last_undegraded":"2026-02-13T04:00:53.056924+0000","last_fullsized":"2026-02-13T04:00:53.056924+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:41:11.697570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.720845+0000","last_change":"2026-02-13T04:00:49.474447+0000","last_active":"2026-02-13T04:00:50.720845+0000","last_peered":"2026-02-13T04:00:50.720845+0000","last_clean":"2026-02-13T04:00:50.720845+0000","last_became_active":"2026-02-13T04:00:49.473707+0000","last_became_peered":"2026-02-13T04:00:49.473707+0000","last_unstale":"2026-02-13T04:00:50.720845+0000","last_undegraded":"2026-02-13T04:00:50.720845+0000","last_fullsized":"2026-02-13T04:00:50.720845+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:33:16.764134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"76'2","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:53.056350+0000","last_change":"2026-02-13T04:00:48.691107+0000","last_active":"2026-02-13T04:00:53.056350+0000","last_peered":"2026-02-13T04:00:53.056350+0000","last_clean":"2026-02-13T04:00:53.056350+0000","last_became_active":"2026-02-13T04:00:48.690883+0000","last_became_peered":"2026-02-13T04:00:48.690883+0000","last_unstale":"2026-02-13T04:00:53.056350+0000","last_undegraded":"2026-02-13T04:00:53.056350+0000","last_fullsized":"2026-02-13T04:00:53.056350+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:42:12.911922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469851+0000","last_change":"2026-02-13T04:00:49.479316+0000","last_active":"2026-02-13T04:00:50.469851+0000","last_peered":"2026-02-13T04:00:50.469851+0000","last_clean":"2026-02-13T04:00:50.469851+0000","last_became_active":"2026-02-13T04:00:49.479237+0000","last_became_peered":"2026-02-13T04:00:49.479237+0000","last_unstale":"2026-02-13T04:00:50.469851+0000","last_undegraded":"2026-02-13T04:00:50.469851+0000","last_fullsized":"2026-02-13T04:00:50.469851+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:42:22.094924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"76'5","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:53.058181+0000","last_change":"2026-02-13T04:00:48.694972+0000","last_active":"2026-02-13T04:00:53.058181+0000","last_peered":"2026-02-13T04:00:53.058181+0000","last_clean":"2026-02-13T04:00:53.058181+0000","last_became_active":"2026-02-13T04:00:48.694866+0000","last_became_peered":"2026-02-13T04:00:48.694866+0000","last_unstale":"2026-02-13T04:00:53.058181+0000","last_undegraded":"2026-02-13T04:00:53.058181+0000","last_fullsized":"2026-02-13T04:00:53.058181+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:21:39.815574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.720774+0000","last_change":"2026-02-13T04:00:49.473770+0000","last_active":"2026-02-13T04:00:50.720774+0000","last_peered":"2026-02-13T04:00:50.720774+0000","last_clean":"2026-02-13T04:00:50.720774+0000","last_became_active":"2026-02-13T04:00:49.473571+0000","last_became_peered":"2026-02-13T04:00:49.473571+0000","last_unstale":"2026-02-13T04:00:50.720774+0000","last_undegraded":"2026-02-13T04:00:50.720774+0000","last_fullsized":"2026-02-13T04:00:50.720774+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:20:31.775093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"76'13","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:56.080183+0000","last_change":"2026-02-13T04:00:48.691199+0000","last_active":"2026-02-13T04:00:56.080183+0000","last_peered":"2026-02-13T04:00:56.080183+0000","last_clean":"2026-02-13T04:00:56.080183+0000","last_became_active":"2026-02-13T04:00:48.690955+0000","last_became_peered":"2026-02-13T04:00:48.690955+0000","last_unstale":"2026-02-13T04:00:56.080183+0000","last_undegraded":"2026-02-13T04:00:56.080183+0000","last_fullsized":"2026-02-13T04:00:56.080183+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:41:58.570616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8385,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722495+0000","last_change":"2026-02-13T04:00:49.474461+0000","last_active":"2026-02-13T04:00:50.722495+0000","last_peered":"2026-02-13T04:00:50.722495+0000","last_clean":"2026-02-13T04:00:50.722495+0000","last_became_active":"2026-02-13T04:00:49.474220+0000","last_became_peered":"2026-02-13T04:00:49.474220+0000","last_unstale":"2026-02-13T04:00:50.722495+0000","last_undegraded":"2026-02-13T04:00:50.722495+0000","last_fullsized":"2026-02-13T04:00:50.722495+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:04:21.521507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"76'9","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:56.077188+0000","last_change":"2026-02-13T04:00:48.698134+0000","last_active":"2026-02-13T04:00:56.077188+0000","last_peered":"2026-02-13T04:00:56.077188+0000","last_clean":"2026-02-13T04:00:56.077188+0000","last_became_active":"2026-02-13T04:00:48.697958+0000","last_became_peered":"2026-02-13T04:00:48.697958+0000","last_unstale":"2026-02-13T04:00:56.077188+0000","last_undegraded":"2026-02-13T04:00:56.077188+0000","last_fullsized":"2026-02-13T04:00:56.077188+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:55:21.688751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.721213+0000","last_change":"2026-02-13T04:00:49.481860+0000","last_active":"2026-02-13T04:00:50.721213+0000","last_peered":"2026-02-13T04:00:50.721213+0000","last_clean":"2026-02-13T04:00:50.721213+0000","last_became_active":"2026-02-13T04:00:49.481735+0000","last_became_peered":"2026-02-13T04:00:49.481735+0000","last_unstale":"2026-02-13T04:00:50.721213+0000","last_undegraded":"2026-02-13T04:00:50.721213+0000","last_fullsized":"2026-02-13T04:00:50.721213+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:13:15.403655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"76'4","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:53.057356+0000","last_change":"2026-02-13T04:00:48.700556+0000","last_active":"2026-02-13T04:00:53.057356+0000","last_peered":"2026-02-13T04:00:53.057356+0000","last_clean":"2026-02-13T04:00:53.057356+0000","last_became_active":"2026-02-13T04:00:48.700417+0000","last_became_peered":"2026-02-13T04:00:48.700417+0000","last_unstale":"2026-02-13T04:00:53.057356+0000","last_undegraded":"2026-02-13T04:00:53.057356+0000","last_fullsized":"2026-02-13T04:00:53.057356+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:53:13.088594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.910386+0000","last_change":"2026-02-13T04:00:49.477823+0000","last_active":"2026-02-13T04:00:50.910386+0000","last_peered":"2026-02-13T04:00:50.910386+0000","last_clean":"2026-02-13T04:00:50.910386+0000","last_became_active":"2026-02-13T04:00:49.477688+0000","last_became_peered":"2026-02-13T04:00:49.477688+0000","last_unstale":"2026-02-13T04:00:50.910386+0000","last_undegraded":"2026-02-13T04:00:50.910386+0000","last_fullsized":"2026-02-13T04:00:50.910386+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:38:51.114912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"76'6","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:57.081513+0000","last_change":"2026-02-13T04:00:48.689958+0000","last_active":"2026-02-13T04:00:57.081513+0000","last_peered":"2026-02-13T04:00:57.081513+0000","last_clean":"2026-02-13T04:00:57.081513+0000","last_became_active":"2026-02-13T04:00:48.689800+0000","last_became_peered":"2026-02-13T04:00:48.689800+0000","last_unstale":"2026-02-13T04:00:57.081513+0000","last_undegraded":"2026-02-13T04:00:57.081513+0000","last_fullsized":"2026-02-13T04:00:57.081513+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:57:29.593581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":998,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.909974+0000","last_change":"2026-02-13T04:00:49.474922+0000","last_active":"2026-02-13T04:00:50.909974+0000","last_peered":"2026-02-13T04:00:50.909974+0000","last_clean":"2026-02-13T04:00:50.909974+0000","last_became_active":"2026-02-13T04:00:49.474798+0000","last_became_peered":"2026-02-13T04:00:49.474798+0000","last_unstale":"2026-02-13T04:00:50.909974+0000","last_undegraded":"2026-02-13T04:00:50.909974+0000","last_fullsized":"2026-02-13T04:00:50.909974+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:24:58.395490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"76'17","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:55.069298+0000","last_change":"2026-02-13T04:00:48.697186+0000","last_active":"2026-02-13T04:00:55.069298+0000","last_peered":"2026-02-13T04:00:55.069298+0000","last_clean":"2026-02-13T04:00:55.069298+0000","last_became_active":"2026-02-13T04:00:48.696965+0000","last_became_peered":"2026-02-13T04:00:48.696965+0000","last_unstale":"2026-02-13T04:00:55.069298+0000","last_undegraded":"2026-02-13T04:00:55.069298+0000","last_fullsized":"2026-02-13T04:00:55.069298+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:56:20.600423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469600+0000","last_change":"2026-02-13T04:00:49.478825+0000","last_active":"2026-02-13T04:00:50.469600+0000","last_peered":"2026-02-13T04:00:50.469600+0000","last_clean":"2026-02-13T04:00:50.469600+0000","last_became_active":"2026-02-13T04:00:49.478665+0000","last_became_peered":"2026-02-13T04:00:49.478665+0000","last_unstale":"2026-02-13T04:00:50.469600+0000","last_undegraded":"2026-02-13T04:00:50.469600+0000","last_fullsized":"2026-02-13T04:00:50.469600+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:30:36.733228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"76'2","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:51.979236+0000","last_change":"2026-02-13T04:00:48.691503+0000","last_active":"2026-02-13T04:00:51.979236+0000","last_peered":"2026-02-13T04:00:51.979236+0000","last_clean":"2026-02-13T04:00:51.979236+0000","last_became_active":"2026-02-13T04:00:48.691259+0000","last_became_peered":"2026-02-13T04:00:48.691259+0000","last_unstale":"2026-02-13T04:00:51.979236+0000","last_undegraded":"2026-02-13T04:00:51.979236+0000","last_fullsized":"2026-02-13T04:00:51.979236+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:34:28.622800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722403+0000","last_change":"2026-02-13T04:00:49.480630+0000","last_active":"2026-02-13T04:00:50.722403+0000","last_peered":"2026-02-13T04:00:50.722403+0000","last_clean":"2026-02-13T04:00:50.722403+0000","last_became_active":"2026-02-13T04:00:49.480389+0000","last_became_peered":"2026-02-13T04:00:49.480389+0000","last_unstale":"2026-02-13T04:00:50.722403+0000","last_undegraded":"2026-02-13T04:00:50.722403+0000","last_fullsized":"2026-02-13T04:00:50.722403+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:57:06.972169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"76'5","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:56.077127+0000","last_change":"2026-02-13T04:00:48.699907+0000","last_active":"2026-02-13T04:00:56.077127+0000","last_peered":"2026-02-13T04:00:56.077127+0000","last_clean":"2026-02-13T04:00:56.077127+0000","last_became_active":"2026-02-13T04:00:48.699680+0000","last_became_peered":"2026-02-13T04:00:48.699680+0000","last_unstale":"2026-02-13T04:00:56.077127+0000","last_undegraded":"2026-02-13T04:00:56.077127+0000","last_fullsized":"2026-02-13T04:00:56.077127+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:59:04.468050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.910539+0000","last_change":"2026-02-13T04:00:49.474061+0000","last_active":"2026-02-13T04:00:50.910539+0000","last_peered":"2026-02-13T04:00:50.910539+0000","last_clean":"2026-02-13T04:00:50.910539+0000","last_became_active":"2026-02-13T04:00:49.473775+0000","last_became_peered":"2026-02-13T04:00:49.473775+0000","last_unstale":"2026-02-13T04:00:50.910539+0000","last_undegraded":"2026-02-13T04:00:50.910539+0000","last_fullsized":"2026-02-13T04:00:50.910539+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:17:55.919908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"76'2","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:51.072262+0000","last_change":"2026-02-13T04:00:48.700390+0000","last_active":"2026-02-13T04:00:51.072262+0000","last_peered":"2026-02-13T04:00:51.072262+0000","last_clean":"2026-02-13T04:00:51.072262+0000","last_became_active":"2026-02-13T04:00:48.700274+0000","last_became_peered":"2026-02-13T04:00:48.700274+0000","last_unstale":"2026-02-13T04:00:51.072262+0000","last_undegraded":"2026-02-13T04:00:51.072262+0000","last_fullsized":"2026-02-13T04:00:51.072262+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:42:57.951202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.910348+0000","last_change":"2026-02-13T04:00:49.473385+0000","last_active":"2026-02-13T04:00:50.910348+0000","last_peered":"2026-02-13T04:00:50.910348+0000","last_clean":"2026-02-13T04:00:50.910348+0000","last_became_active":"2026-02-13T04:00:49.473169+0000","last_became_peered":"2026-02-13T04:00:49.473169+0000","last_unstale":"2026-02-13T04:00:50.910348+0000","last_undegraded":"2026-02-13T04:00:50.910348+0000","last_fullsized":"2026-02-13T04:00:50.910348+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:39:38.736962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"76'6","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:55.070646+0000","last_change":"2026-02-13T04:00:48.697672+0000","last_active":"2026-02-13T04:00:55.070646+0000","last_peered":"2026-02-13T04:00:55.070646+0000","last_clean":"2026-02-13T04:00:55.070646+0000","last_became_active":"2026-02-13T04:00:48.697508+0000","last_became_peered":"2026-02-13T04:00:48.697508+0000","last_unstale":"2026-02-13T04:00:55.070646+0000","last_undegraded":"2026-02-13T04:00:55.070646+0000","last_fullsized":"2026-02-13T04:00:55.070646+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:06:23.149951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1602,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.910511+0000","last_change":"2026-02-13T04:00:49.474120+0000","last_active":"2026-02-13T04:00:50.910511+0000","last_peered":"2026-02-13T04:00:50.910511+0000","last_clean":"2026-02-13T04:00:50.910511+0000","last_became_active":"2026-02-13T04:00:49.473810+0000","last_became_peered":"2026-02-13T04:00:49.473810+0000","last_unstale":"2026-02-13T04:00:50.910511+0000","last_undegraded":"2026-02-13T04:00:50.910511+0000","last_fullsized":"2026-02-13T04:00:50.910511+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:19:59.822379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'152","reported_seq":345,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.910012+0000","last_change":"2026-02-13T04:00:24.257474+0000","last_active":"2026-02-13T04:00:50.910012+0000","last_peered":"2026-02-13T04:00:50.910012+0000","last_clean":"2026-02-13T04:00:50.910012+0000","last_became_active":"2026-02-13T04:00:24.257034+0000","last_became_peered":"2026-02-13T04:00:24.257034+0000","last_unstale":"2026-02-13T04:00:50.910012+0000","last_undegraded":"2026-02-13T04:00:50.910012+0000","last_fullsized":"2026-02-13T04:00:50.910012+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:59:12.660085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:59:12.660085+0000","last_clean_scrub_stamp":"2026-02-13T03:59:12.660085+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:39:33.745502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"76'6","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:57.079518+0000","last_change":"2026-02-13T04:00:48.692792+0000","last_active":"2026-02-13T04:00:57.079518+0000","last_peered":"2026-02-13T04:00:57.079518+0000","last_clean":"2026-02-13T04:00:57.079518+0000","last_became_active":"2026-02-13T04:00:48.692666+0000","last_became_peered":"2026-02-13T04:00:48.692666+0000","last_unstale":"2026-02-13T04:00:57.079518+0000","last_undegraded":"2026-02-13T04:00:57.079518+0000","last_fullsized":"2026-02-13T04:00:57.079518+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:32:34.713449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469917+0000","last_change":"2026-02-13T04:00:49.480086+0000","last_active":"2026-02-13T04:00:50.469917+0000","last_peered":"2026-02-13T04:00:50.469917+0000","last_clean":"2026-02-13T04:00:50.469917+0000","last_became_active":"2026-02-13T04:00:49.477323+0000","last_became_peered":"2026-02-13T04:00:49.477323+0000","last_unstale":"2026-02-13T04:00:50.469917+0000","last_undegraded":"2026-02-13T04:00:50.469917+0000","last_fullsized":"2026-02-13T04:00:50.469917+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:59:23.446340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"76'3","reported_seq":19,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:54.060508+0000","last_change":"2026-02-13T04:00:48.691498+0000","last_active":"2026-02-13T04:00:54.060508+0000","last_peered":"2026-02-13T04:00:54.060508+0000","last_clean":"2026-02-13T04:00:54.060508+0000","last_became_active":"2026-02-13T04:00:48.691356+0000","last_became_peered":"2026-02-13T04:00:48.691356+0000","last_unstale":"2026-02-13T04:00:54.060508+0000","last_undegraded":"2026-02-13T04:00:54.060508+0000","last_fullsized":"2026-02-13T04:00:54.060508+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:52:50.006515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.721111+0000","last_change":"2026-02-13T04:00:49.479452+0000","last_active":"2026-02-13T04:00:50.721111+0000","last_peered":"2026-02-13T04:00:50.721111+0000","last_clean":"2026-02-13T04:00:50.721111+0000","last_became_active":"2026-02-13T04:00:49.479354+0000","last_became_peered":"2026-02-13T04:00:49.479354+0000","last_unstale":"2026-02-13T04:00:50.721111+0000","last_undegraded":"2026-02-13T04:00:50.721111+0000","last_fullsized":"2026-02-13T04:00:50.721111+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:46:41.444877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"76'5","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:57.080017+0000","last_change":"2026-02-13T04:00:48.696889+0000","last_active":"2026-02-13T04:00:57.080017+0000","last_peered":"2026-02-13T04:00:57.080017+0000","last_clean":"2026-02-13T04:00:57.080017+0000","last_became_active":"2026-02-13T04:00:48.696722+0000","last_became_peered":"2026-02-13T04:00:48.696722+0000","last_unstale":"2026-02-13T04:00:57.080017+0000","last_undegraded":"2026-02-13T04:00:57.080017+0000","last_fullsized":"2026-02-13T04:00:57.080017+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:14:45.512084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469888+0000","last_change":"2026-02-13T04:00:49.478833+0000","last_active":"2026-02-13T04:00:50.469888+0000","last_peered":"2026-02-13T04:00:50.469888+0000","last_clean":"2026-02-13T04:00:50.469888+0000","last_became_active":"2026-02-13T04:00:49.478661+0000","last_became_peered":"2026-02-13T04:00:49.478661+0000","last_unstale":"2026-02-13T04:00:50.469888+0000","last_undegraded":"2026-02-13T04:00:50.469888+0000","last_fullsized":"2026-02-13T04:00:50.469888+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:19:27.081820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"76'1","reported_seq":17,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.910360+0000","last_change":"2026-02-13T04:00:48.691941+0000","last_active":"2026-02-13T04:00:50.910360+0000","last_peered":"2026-02-13T04:00:50.910360+0000","last_clean":"2026-02-13T04:00:50.910360+0000","last_became_active":"2026-02-13T04:00:48.691773+0000","last_became_peered":"2026-02-13T04:00:48.691773+0000","last_unstale":"2026-02-13T04:00:50.910360+0000","last_undegraded":"2026-02-13T04:00:50.910360+0000","last_fullsized":"2026-02-13T04:00:50.910360+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:42:13.810742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.468946+0000","last_change":"2026-02-13T04:00:49.477705+0000","last_active":"2026-02-13T04:00:50.468946+0000","last_peered":"2026-02-13T04:00:50.468946+0000","last_clean":"2026-02-13T04:00:50.468946+0000","last_became_active":"2026-02-13T04:00:49.477600+0000","last_became_peered":"2026-02-13T04:00:49.477600+0000","last_unstale":"2026-02-13T04:00:50.468946+0000","last_undegraded":"2026-02-13T04:00:50.468946+0000","last_fullsized":"2026-02-13T04:00:50.468946+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:38:17.010092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"76'1","reported_seq":17,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469620+0000","last_change":"2026-02-13T04:00:48.698484+0000","last_active":"2026-02-13T04:00:50.469620+0000","last_peered":"2026-02-13T04:00:50.469620+0000","last_clean":"2026-02-13T04:00:50.469620+0000","last_became_active":"2026-02-13T04:00:48.698054+0000","last_became_peered":"2026-02-13T04:00:48.698054+0000","last_unstale":"2026-02-13T04:00:50.469620+0000","last_undegraded":"2026-02-13T04:00:50.469620+0000","last_fullsized":"2026-02-13T04:00:50.469620+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:44:12.728961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469014+0000","last_change":"2026-02-13T04:00:49.475436+0000","last_active":"2026-02-13T04:00:50.469014+0000","last_peered":"2026-02-13T04:00:50.469014+0000","last_clean":"2026-02-13T04:00:50.469014+0000","last_became_active":"2026-02-13T04:00:49.475301+0000","last_became_peered":"2026-02-13T04:00:49.475301+0000","last_unstale":"2026-02-13T04:00:50.469014+0000","last_undegraded":"2026-02-13T04:00:50.469014+0000","last_fullsized":"2026-02-13T04:00:50.469014+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:01:52.755952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"76'4","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:55.070468+0000","last_change":"2026-02-13T04:00:48.697244+0000","last_active":"2026-02-13T04:00:55.070468+0000","last_peered":"2026-02-13T04:00:55.070468+0000","last_clean":"2026-02-13T04:00:55.070468+0000","last_became_active":"2026-02-13T04:00:48.697000+0000","last_became_peered":"2026-02-13T04:00:48.697000+0000","last_unstale":"2026-02-13T04:00:55.070468+0000","last_undegraded":"2026-02-13T04:00:55.070468+0000","last_fullsized":"2026-02-13T04:00:55.070468+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:01:34.413201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.721388+0000","last_change":"2026-02-13T04:00:49.479594+0000","last_active":"2026-02-13T04:00:50.721388+0000","last_peered":"2026-02-13T04:00:50.721388+0000","last_clean":"2026-02-13T04:00:50.721388+0000","last_became_active":"2026-02-13T04:00:49.479339+0000","last_became_peered":"2026-02-13T04:00:49.479339+0000","last_unstale":"2026-02-13T04:00:50.721388+0000","last_undegraded":"2026-02-13T04:00:50.721388+0000","last_fullsized":"2026-02-13T04:00:50.721388+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:53:38.743418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"76'9","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:57.037937+0000","last_change":"2026-02-13T04:00:48.700184+0000","last_active":"2026-02-13T04:00:57.037937+0000","last_peered":"2026-02-13T04:00:57.037937+0000","last_clean":"2026-02-13T04:00:57.037937+0000","last_became_active":"2026-02-13T04:00:48.699830+0000","last_became_peered":"2026-02-13T04:00:48.699830+0000","last_unstale":"2026-02-13T04:00:57.037937+0000","last_undegraded":"2026-02-13T04:00:57.037937+0000","last_fullsized":"2026-02-13T04:00:57.037937+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:33:36.683841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469071+0000","last_change":"2026-02-13T04:00:49.479398+0000","last_active":"2026-02-13T04:00:50.469071+0000","last_peered":"2026-02-13T04:00:50.469071+0000","last_clean":"2026-02-13T04:00:50.469071+0000","last_became_active":"2026-02-13T04:00:49.478123+0000","last_became_peered":"2026-02-13T04:00:49.478123+0000","last_unstale":"2026-02-13T04:00:50.469071+0000","last_undegraded":"2026-02-13T04:00:50.469071+0000","last_fullsized":"2026-02-13T04:00:50.469071+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:27:11.747352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"76'7","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:56.076080+0000","last_change":"2026-02-13T04:00:48.693990+0000","last_active":"2026-02-13T04:00:56.076080+0000","last_peered":"2026-02-13T04:00:56.076080+0000","last_clean":"2026-02-13T04:00:56.076080+0000","last_became_active":"2026-02-13T04:00:48.693900+0000","last_became_peered":"2026-02-13T04:00:48.693900+0000","last_unstale":"2026-02-13T04:00:56.076080+0000","last_undegraded":"2026-02-13T04:00:56.076080+0000","last_fullsized":"2026-02-13T04:00:56.076080+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:30:06.422983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469681+0000","last_change":"2026-02-13T04:00:49.482955+0000","last_active":"2026-02-13T04:00:50.469681+0000","last_peered":"2026-02-13T04:00:50.469681+0000","last_clean":"2026-02-13T04:00:50.469681+0000","last_became_active":"2026-02-13T04:00:49.482763+0000","last_became_peered":"2026-02-13T04:00:49.482763+0000","last_unstale":"2026-02-13T04:00:50.469681+0000","last_undegraded":"2026-02-13T04:00:50.469681+0000","last_fullsized":"2026-02-13T04:00:50.469681+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:57:57.634076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"76'2","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:53.057146+0000","last_change":"2026-02-13T04:00:48.691700+0000","last_active":"2026-02-13T04:00:53.057146+0000","last_peered":"2026-02-13T04:00:53.057146+0000","last_clean":"2026-02-13T04:00:53.057146+0000","last_became_active":"2026-02-13T04:00:48.691589+0000","last_became_peered":"2026-02-13T04:00:48.691589+0000","last_unstale":"2026-02-13T04:00:53.057146+0000","last_undegraded":"2026-02-13T04:00:53.057146+0000","last_fullsized":"2026-02-13T04:00:53.057146+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:11:12.096183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722064+0000","last_change":"2026-02-13T04:00:49.474149+0000","last_active":"2026-02-13T04:00:50.722064+0000","last_peered":"2026-02-13T04:00:50.722064+0000","last_clean":"2026-02-13T04:00:50.722064+0000","last_became_active":"2026-02-13T04:00:49.473736+0000","last_became_peered":"2026-02-13T04:00:49.473736+0000","last_unstale":"2026-02-13T04:00:50.722064+0000","last_undegraded":"2026-02-13T04:00:50.722064+0000","last_fullsized":"2026-02-13T04:00:50.722064+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:25:56.827117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"76'5","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:55.070320+0000","last_change":"2026-02-13T04:00:48.697874+0000","last_active":"2026-02-13T04:00:55.070320+0000","last_peered":"2026-02-13T04:00:55.070320+0000","last_clean":"2026-02-13T04:00:55.070320+0000","last_became_active":"2026-02-13T04:00:48.697771+0000","last_became_peered":"2026-02-13T04:00:48.697771+0000","last_unstale":"2026-02-13T04:00:55.070320+0000","last_undegraded":"2026-02-13T04:00:55.070320+0000","last_fullsized":"2026-02-13T04:00:55.070320+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:08:04.185025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722259+0000","last_change":"2026-02-13T04:00:49.482790+0000","last_active":"2026-02-13T04:00:50.722259+0000","last_peered":"2026-02-13T04:00:50.722259+0000","last_clean":"2026-02-13T04:00:50.722259+0000","last_became_active":"2026-02-13T04:00:49.482576+0000","last_became_peered":"2026-02-13T04:00:49.482576+0000","last_unstale":"2026-02-13T04:00:50.722259+0000","last_undegraded":"2026-02-13T04:00:50.722259+0000","last_fullsized":"2026-02-13T04:00:50.722259+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:32:27.345836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"76'2","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:55.056354+0000","last_change":"2026-02-13T04:00:48.700697+0000","last_active":"2026-02-13T04:00:55.056354+0000","last_peered":"2026-02-13T04:00:55.056354+0000","last_clean":"2026-02-13T04:00:55.056354+0000","last_became_active":"2026-02-13T04:00:48.700486+0000","last_became_peered":"2026-02-13T04:00:48.700486+0000","last_unstale":"2026-02-13T04:00:55.056354+0000","last_undegraded":"2026-02-13T04:00:55.056354+0000","last_fullsized":"2026-02-13T04:00:55.056354+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:12:01.767319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469076+0000","last_change":"2026-02-13T04:00:49.479587+0000","last_active":"2026-02-13T04:00:50.469076+0000","last_peered":"2026-02-13T04:00:50.469076+0000","last_clean":"2026-02-13T04:00:50.469076+0000","last_became_active":"2026-02-13T04:00:49.478914+0000","last_became_peered":"2026-02-13T04:00:49.478914+0000","last_unstale":"2026-02-13T04:00:50.469076+0000","last_undegraded":"2026-02-13T04:00:50.469076+0000","last_fullsized":"2026-02-13T04:00:50.469076+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:17:27.267886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"76'4","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:53.056783+0000","last_change":"2026-02-13T04:00:48.693343+0000","last_active":"2026-02-13T04:00:53.056783+0000","last_peered":"2026-02-13T04:00:53.056783+0000","last_clean":"2026-02-13T04:00:53.056783+0000","last_became_active":"2026-02-13T04:00:48.692911+0000","last_became_peered":"2026-02-13T04:00:48.692911+0000","last_unstale":"2026-02-13T04:00:53.056783+0000","last_undegraded":"2026-02-13T04:00:53.056783+0000","last_fullsized":"2026-02-13T04:00:53.056783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:54:45.498989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.910234+0000","last_change":"2026-02-13T04:00:49.475224+0000","last_active":"2026-02-13T04:00:50.910234+0000","last_peered":"2026-02-13T04:00:50.910234+0000","last_clean":"2026-02-13T04:00:50.910234+0000","last_became_active":"2026-02-13T04:00:49.475101+0000","last_became_peered":"2026-02-13T04:00:49.475101+0000","last_unstale":"2026-02-13T04:00:50.910234+0000","last_undegraded":"2026-02-13T04:00:50.910234+0000","last_fullsized":"2026-02-13T04:00:50.910234+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:14:50.281702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469957+0000","last_change":"2026-02-13T04:00:49.478859+0000","last_active":"2026-02-13T04:00:50.469957+0000","last_peered":"2026-02-13T04:00:50.469957+0000","last_clean":"2026-02-13T04:00:50.469957+0000","last_became_active":"2026-02-13T04:00:49.478702+0000","last_became_peered":"2026-02-13T04:00:49.478702+0000","last_unstale":"2026-02-13T04:00:50.469957+0000","last_undegraded":"2026-02-13T04:00:50.469957+0000","last_fullsized":"2026-02-13T04:00:50.469957+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:37:22.794457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"76'5","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:56.076264+0000","last_change":"2026-02-13T04:00:48.693367+0000","last_active":"2026-02-13T04:00:56.076264+0000","last_peered":"2026-02-13T04:00:56.076264+0000","last_clean":"2026-02-13T04:00:56.076264+0000","last_became_active":"2026-02-13T04:00:48.692994+0000","last_became_peered":"2026-02-13T04:00:48.692994+0000","last_unstale":"2026-02-13T04:00:56.076264+0000","last_undegraded":"2026-02-13T04:00:56.076264+0000","last_fullsized":"2026-02-13T04:00:56.076264+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:39:31.460593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.720749+0000","last_change":"2026-02-13T04:00:49.478041+0000","last_active":"2026-02-13T04:00:50.720749+0000","last_peered":"2026-02-13T04:00:50.720749+0000","last_clean":"2026-02-13T04:00:50.720749+0000","last_became_active":"2026-02-13T04:00:49.477881+0000","last_became_peered":"2026-02-13T04:00:49.477881+0000","last_unstale":"2026-02-13T04:00:50.720749+0000","last_undegraded":"2026-02-13T04:00:50.720749+0000","last_fullsized":"2026-02-13T04:00:50.720749+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:18:39.952084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"76'11","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:56.076365+0000","last_change":"2026-02-13T04:00:48.693403+0000","last_active":"2026-02-13T04:00:56.076365+0000","last_peered":"2026-02-13T04:00:56.076365+0000","last_clean":"2026-02-13T04:00:56.076365+0000","last_became_active":"2026-02-13T04:00:48.693036+0000","last_became_peered":"2026-02-13T04:00:48.693036+0000","last_unstale":"2026-02-13T04:00:56.076365+0000","last_undegraded":"2026-02-13T04:00:56.076365+0000","last_fullsized":"2026-02-13T04:00:56.076365+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:11:26.056818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469797+0000","last_change":"2026-02-13T04:00:49.477916+0000","last_active":"2026-02-13T04:00:50.469797+0000","last_peered":"2026-02-13T04:00:50.469797+0000","last_clean":"2026-02-13T04:00:50.469797+0000","last_became_active":"2026-02-13T04:00:49.477821+0000","last_became_peered":"2026-02-13T04:00:49.477821+0000","last_unstale":"2026-02-13T04:00:50.469797+0000","last_undegraded":"2026-02-13T04:00:50.469797+0000","last_fullsized":"2026-02-13T04:00:50.469797+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:28:08.763696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"76'2","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.697310+0000","last_change":"2026-02-13T04:00:48.696707+0000","last_active":"2026-02-13T04:00:50.697310+0000","last_peered":"2026-02-13T04:00:50.697310+0000","last_clean":"2026-02-13T04:00:50.697310+0000","last_became_active":"2026-02-13T04:00:48.696565+0000","last_became_peered":"2026-02-13T04:00:48.696565+0000","last_unstale":"2026-02-13T04:00:50.697310+0000","last_undegraded":"2026-02-13T04:00:50.697310+0000","last_fullsized":"2026-02-13T04:00:50.697310+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:22:58.352215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469060+0000","last_change":"2026-02-13T04:00:49.476851+0000","last_active":"2026-02-13T04:00:50.469060+0000","last_peered":"2026-02-13T04:00:50.469060+0000","last_clean":"2026-02-13T04:00:50.469060+0000","last_became_active":"2026-02-13T04:00:49.476687+0000","last_became_peered":"2026-02-13T04:00:49.476687+0000","last_unstale":"2026-02-13T04:00:50.469060+0000","last_undegraded":"2026-02-13T04:00:50.469060+0000","last_fullsized":"2026-02-13T04:00:50.469060+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:33:58.923183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"76'13","reported_seq":32,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:57.081586+0000","last_change":"2026-02-13T04:00:48.695808+0000","last_active":"2026-02-13T04:00:57.081586+0000","last_peered":"2026-02-13T04:00:57.081586+0000","last_clean":"2026-02-13T04:00:57.081586+0000","last_became_active":"2026-02-13T04:00:48.695558+0000","last_became_peered":"2026-02-13T04:00:48.695558+0000","last_unstale":"2026-02-13T04:00:57.081586+0000","last_undegraded":"2026-02-13T04:00:57.081586+0000","last_fullsized":"2026-02-13T04:00:57.081586+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:50:53.268602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":15149,"num_objects":91,"num_object_clones":0,"num_object_copies":273,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":0,"num_read":15,"num_read_kb":13,"num_write":201,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":60,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":84293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":183548,"internal_metadata":0},"log_size":172,"ondisk_log_size":172,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":3542208,"data_compressed":228962,"data_compressed_allocated":270336,"data_compressed_original":3522560,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678023,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27764,"kb_used_data":800,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":733975436,"statfs":{"total":751619276800,"available":751590846464,"internally_reserved":0,"allocated":819200,"data_stored":395863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8794,"internal_metadata":27581862},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906952,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27864,"kb_used_data":900,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":733975336,"statfs":{"total":751619276800,"available":751590744064,"internally_reserved":0,"allocated":921600,"data_stored":989589,"data_compressed":38435,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":29455,"internal_metadata":27561201},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037770,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27800,"kb_used_data":836,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":733975400,"statfs":{"total":751619276800,"available":751590809600,"internally_reserved":0,"allocated":856064,"data_stored":397007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":29415,"internal_metadata":27561241},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266700,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27796,"kb_used_data":832,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975404,"statfs":{"total":751619276800,"available":751590813696,"internally_reserved":0,"allocated":851968,"data_stored":397407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34036,"internal_metadata":27556620},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495629,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27828,"kb_used_data":864,"kb_used_omap":32,"kb_used_meta":26911,"kb_avail":733975372,"statfs":{"total":751619276800,"available":751590780928,"internally_reserved":0,"allocated":884736,"data_stored":988045,"data_compressed":38435,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":33254,"internal_metadata":27557402},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626447,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27784,"kb_used_data":820,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975416,"statfs":{"total":751619276800,"available":751590825984,"internally_reserved":0,"allocated":839680,"data_stored":396702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34098,"internal_metadata":27556558},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855377,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27852,"kb_used_data":888,"kb_used_omap":36,"kb_used_meta":26907,"kb_avail":733975348,"statfs":{"total":751619276800,"available":751590756352,"internally_reserved":0,"allocated":909312,"data_stored":988513,"data_compressed":38435,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":37286,"internal_metadata":27553370},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986195,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27784,"kb_used_data":820,"kb_used_omap":44,"kb_used_meta":26899,"kb_avail":733975416,"statfs":{"total":751619276800,"available":751590825984,"internally_reserved":0,"allocated":839680,"data_stored":396973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45151,"internal_metadata":27545505},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215124,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27788,"kb_used_data":824,"kb_used_omap":46,"kb_used_meta":26897,"kb_avail":733975412,"statfs":{"total":751619276800,"available":751590821888,"internally_reserved":0,"allocated":843776,"data_stored":396271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47657,"internal_metadata":27542999},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476759,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27808,"kb_used_data":844,"kb_used_omap":57,"kb_used_meta":26886,"kb_avail":733975392,"statfs":{"total":751619276800,"available":751590801408,"internally_reserved":0,"allocated":864256,"data_stored":399491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":59309,"internal_metadata":27531347},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607576,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27812,"kb_used_data":848,"kb_used_omap":45,"kb_used_meta":26898,"kb_avail":733975388,"statfs":{"total":751619276800,"available":751590797312,"internally_reserved":0,"allocated":868352,"data_stored":423253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":46360,"internal_metadata":27544296},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738393,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27796,"kb_used_data":832,"kb_used_omap":48,"kb_used_meta":26895,"kb_avail":733975404,"statfs":{"total":751619276800,"available":751590813696,"internally_reserved":0,"allocated":851968,"data_stored":397973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49874,"internal_metadata":27540782},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36787,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38435,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38435,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38435,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38435,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38435,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10042,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":50803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3361,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":11199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":50439,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1917,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31677,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7116,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13465,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4105,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23778,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":23981,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":10553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11283,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2384,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T04:01:01.134 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-13T04:01:01.135 INFO:tasks.cephadm:Setting up client nodes... 2026-02-13T04:01:01.136 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2026-02-13T04:01:01.321 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:01.362 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:01 trial092 ceph-mon[23047]: from='client.24769 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T04:01:01.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:01 trial099 ceph-mon[27808]: from='client.24769 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T04:01:01.520 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.516+0000 7f1638a776c0 1 -- 10.20.193.92:0/3735365360 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1634118f00 msgr2=0x7f163417a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:01.520 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.516+0000 7f1638a776c0 1 --2- 10.20.193.92:0/3735365360 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1634118f00 0x7f163417a9d0 secure :-1 s=READY pgs=195 gs=1 cs=0 l=1 c_cookie=7515825700113012353 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f162800bbc0 tx=0x7f1628030f40 comp rx=0 tx=0).stop 2026-02-13T04:01:01.520 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.517+0000 7f1638a776c0 1 -- 10.20.193.92:0/3735365360 shutdown_connections 2026-02-13T04:01:01.520 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.517+0000 7f1638a776c0 1 --2- 10.20.193.92:0/3735365360 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1634118f00 0x7f163417a9d0 unknown :-1 s=CLOSED pgs=195 gs=1 cs=0 l=1 c_cookie=7515825700113012353 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:01.520 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.517+0000 7f1638a776c0 1 --2- 10.20.193.92:0/3735365360 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f163411a410 0x7f1634118720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:01.520 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.517+0000 7f1638a776c0 1 --2- 10.20.193.92:0/3735365360 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1634119a20 0x7f1634119df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:01.520 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.517+0000 7f1638a776c0 1 -- 10.20.193.92:0/3735365360 >> 10.20.193.92:0/3735365360 conn(0x7f1634059bb0 msgr2=0x7f163405a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:01.520 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.517+0000 7f1638a776c0 1 -- 10.20.193.92:0/3735365360 shutdown_connections 2026-02-13T04:01:01.521 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.517+0000 7f1638a776c0 1 -- 10.20.193.92:0/3735365360 wait complete. 2026-02-13T04:01:01.522 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.517+0000 7f1638a776c0 1 Processor -- start 2026-02-13T04:01:01.523 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.517+0000 7f1638a776c0 1 -- start start 2026-02-13T04:01:01.523 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.518+0000 7f1638a776c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1634118f00 0x7f16340fd2c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:01.523 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.518+0000 7f1638a776c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1634119a20 0x7f163417a8d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:01.523 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.518+0000 7f1638a776c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f16340fd8f0 0x7f1634102bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:01.523 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.518+0000 7f1638a776c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f16340fdfe0 con 0x7f1634118f00 2026-02-13T04:01:01.523 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.518+0000 7f1638a776c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1634103100 con 0x7f16340fd8f0 2026-02-13T04:01:01.523 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.518+0000 7f1638a776c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f16341032c0 con 0x7f1634119a20 2026-02-13T04:01:01.523 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.518+0000 7f1632ffd6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1634119a20 0x7f163417a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:01.523 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.518+0000 7f1633fff6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f16340fd8f0 0x7f1634102bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:01.523 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.518+0000 7f1632ffd6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1634119a20 0x7f163417a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:56730/0 (socket says 10.20.193.92:56730) 2026-02-13T04:01:01.523 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.518+0000 7f1632ffd6c0 1 -- 10.20.193.92:0/2822059171 learned_addr learned my addr 10.20.193.92:0/2822059171 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:01.524 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.518+0000 7f1632ffd6c0 1 -- 10.20.193.92:0/2822059171 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f16340fd8f0 msgr2=0x7f1634102bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:01.524 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.518+0000 7f1632ffd6c0 1 --2- 10.20.193.92:0/2822059171 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f16340fd8f0 0x7f1634102bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:01.524 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.518+0000 7f1632ffd6c0 1 -- 10.20.193.92:0/2822059171 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1634118f00 msgr2=0x7f16340fd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:01.524 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.518+0000 7f1632ffd6c0 1 --2- 10.20.193.92:0/2822059171 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1634118f00 0x7f16340fd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:01.524 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.518+0000 7f1632ffd6c0 1 -- 10.20.193.92:0/2822059171 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f162800b7b0 con 0x7f1634119a20 2026-02-13T04:01:01.524 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.518+0000 7f1633fff6c0 1 --2- 10.20.193.92:0/2822059171 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f16340fd8f0 0x7f1634102bc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T04:01:01.524 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.519+0000 7f1632ffd6c0 1 --2- 10.20.193.92:0/2822059171 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1634119a20 0x7f163417a8d0 secure :-1 s=READY pgs=86 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f162400b780 tx=0x7f162400bc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:01.524 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.519+0000 7f1630ff96c0 1 -- 10.20.193.92:0/2822059171 <== mon.1 v2:10.20.193.158:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1624004a80 con 0x7f1634119a20 2026-02-13T04:01:01.524 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.519+0000 7f1630ff96c0 1 -- 10.20.193.92:0/2822059171 <== mon.1 v2:10.20.193.158:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f1624009030 con 0x7f1634119a20 2026-02-13T04:01:01.524 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.519+0000 7f1630ff96c0 1 -- 10.20.193.92:0/2822059171 <== mon.1 v2:10.20.193.158:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f16240071c0 con 0x7f1634119a20 2026-02-13T04:01:01.524 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.519+0000 7f1638a776c0 1 -- 10.20.193.92:0/2822059171 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16341035a0 con 0x7f1634119a20 2026-02-13T04:01:01.524 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.519+0000 7f1638a776c0 1 -- 10.20.193.92:0/2822059171 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1634103a30 con 0x7f1634119a20 2026-02-13T04:01:01.525 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.520+0000 7f1638a776c0 1 -- 10.20.193.92:0/2822059171 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f163405b200 con 0x7f1634119a20 2026-02-13T04:01:01.525 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.522+0000 7f1630ff96c0 1 -- 10.20.193.92:0/2822059171 <== mon.1 v2:10.20.193.158:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f16240026b0 con 0x7f1634119a20 2026-02-13T04:01:01.527 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.524+0000 7f1630ff96c0 1 --2- 10.20.193.92:0/2822059171 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f16080b5760 0x7f16080d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:01.527 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.524+0000 7f1630ff96c0 1 -- 10.20.193.92:0/2822059171 <== mon.1 v2:10.20.193.158:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7f16240e3930 con 0x7f1634119a20 2026-02-13T04:01:01.527 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.524+0000 7f16337fe6c0 1 --2- 10.20.193.92:0/2822059171 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f16080b5760 0x7f16080d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:01.527 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.524+0000 7f1630ff96c0 1 -- 10.20.193.92:0/2822059171 <== mon.1 v2:10.20.193.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f16240e3db0 con 0x7f1634119a20 2026-02-13T04:01:01.527 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.524+0000 7f16337fe6c0 1 --2- 10.20.193.92:0/2822059171 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f16080b5760 0x7f16080d5c10 secure :-1 s=READY pgs=150 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1620004750 tx=0x7f16200096a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:01.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:01 trial158 ceph-mon[27763]: from='client.24769 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T04:01:01.665 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.662+0000 7f1638a776c0 1 -- 10.20.193.92:0/2822059171 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f1634103a30 con 0x7f1634119a20 2026-02-13T04:01:01.668 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.665+0000 7f1630ff96c0 1 -- 10.20.193.92:0/2822059171 <== mon.1 v2:10.20.193.158:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) ==== 170+0+59 (secure 0 0 0) 0x7f16240a6280 con 0x7f1634119a20 2026-02-13T04:01:01.668 INFO:teuthology.orchestra.run.trial092.stdout:[client.0] 2026-02-13T04:01:01.668 INFO:teuthology.orchestra.run.trial092.stdout: key = AQD9oY5pDfiRJxAAsUnh0lbh8TF7/B2PVH8XIw== 2026-02-13T04:01:01.669 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.666+0000 7f1638a776c0 1 -- 10.20.193.92:0/2822059171 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f16080b5760 msgr2=0x7f16080d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:01.670 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.666+0000 7f1638a776c0 1 --2- 10.20.193.92:0/2822059171 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f16080b5760 0x7f16080d5c10 secure :-1 s=READY pgs=150 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1620004750 tx=0x7f16200096a0 comp rx=0 tx=0).stop 2026-02-13T04:01:01.670 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.666+0000 7f1638a776c0 1 -- 10.20.193.92:0/2822059171 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1634119a20 msgr2=0x7f163417a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:01.670 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.666+0000 7f1638a776c0 1 --2- 10.20.193.92:0/2822059171 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1634119a20 0x7f163417a8d0 secure :-1 s=READY pgs=86 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f162400b780 tx=0x7f162400bc50 comp rx=0 tx=0).stop 2026-02-13T04:01:01.670 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.666+0000 7f1638a776c0 1 -- 10.20.193.92:0/2822059171 shutdown_connections 2026-02-13T04:01:01.670 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.666+0000 7f1638a776c0 1 --2- 10.20.193.92:0/2822059171 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f16080b5760 0x7f16080d5c10 unknown :-1 s=CLOSED pgs=150 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:01.670 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.666+0000 7f1638a776c0 1 --2- 10.20.193.92:0/2822059171 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f16340fd8f0 0x7f1634102bc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:01.670 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.666+0000 7f1638a776c0 1 --2- 10.20.193.92:0/2822059171 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1634119a20 0x7f163417a8d0 unknown :-1 s=CLOSED pgs=86 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:01.670 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.666+0000 7f1638a776c0 1 --2- 10.20.193.92:0/2822059171 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1634118f00 0x7f16340fd2c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:01.670 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.666+0000 7f1638a776c0 1 -- 10.20.193.92:0/2822059171 >> 10.20.193.92:0/2822059171 conn(0x7f1634059bb0 msgr2=0x7f1634115690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:01.670 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.667+0000 7f1638a776c0 1 -- 10.20.193.92:0/2822059171 shutdown_connections 2026-02-13T04:01:01.671 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:01.667+0000 7f1638a776c0 1 -- 10.20.193.92:0/2822059171 wait complete. 2026-02-13T04:01:01.773 DEBUG:teuthology.orchestra.run.trial092:> set -ex 2026-02-13T04:01:01.773 DEBUG:teuthology.orchestra.run.trial092:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2026-02-13T04:01:01.773 DEBUG:teuthology.orchestra.run.trial092:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-13T04:01:01.851 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph config log 1 --format=json 2026-02-13T04:01:02.072 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:02.202 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:02 trial092 ceph-mon[23047]: from='client.24782 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T04:01:02.202 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:02 trial092 ceph-mon[23047]: pgmap v183: 97 pgs: 97 active+clean; 592 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.0 KiB/s rd, 7.2 KiB/s wr, 22 op/s 2026-02-13T04:01:02.202 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:02 trial092 ceph-mon[23047]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-13T04:01:02.202 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:02 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/2822059171' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-13T04:01:02.202 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:02 trial092 ceph-mon[23047]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-13T04:01:02.264 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.261+0000 7f1ead30b6c0 1 -- 10.20.193.92:0/1403752728 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1ea8115270 msgr2=0x7f1ea8175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:02.264 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.261+0000 7f1ead30b6c0 1 --2- 10.20.193.92:0/1403752728 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1ea8115270 0x7f1ea8175c10 secure :-1 s=READY pgs=196 gs=1 cs=0 l=1 c_cookie=11527469268861527656 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1e9c00a9b0 tx=0x7f1e9c02fd60 comp rx=0 tx=0).stop 2026-02-13T04:01:02.264 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.261+0000 7f1ead30b6c0 1 -- 10.20.193.92:0/1403752728 shutdown_connections 2026-02-13T04:01:02.264 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.261+0000 7f1ead30b6c0 1 --2- 10.20.193.92:0/1403752728 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1ea810fa50 0x7f1ea8114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:02.264 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.261+0000 7f1ead30b6c0 1 --2- 10.20.193.92:0/1403752728 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1ea8115270 0x7f1ea8175c10 unknown :-1 s=CLOSED pgs=196 gs=1 cs=0 l=1 c_cookie=11527469268861527656 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:02.264 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.261+0000 7f1ead30b6c0 1 --2- 10.20.193.92:0/1403752728 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1ea810f060 0x7f1ea810f430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:02.264 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.261+0000 7f1ead30b6c0 1 -- 10.20.193.92:0/1403752728 >> 10.20.193.92:0/1403752728 conn(0x7f1ea80ec980 msgr2=0x7f1ea810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:02.265 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.261+0000 7f1ead30b6c0 1 -- 10.20.193.92:0/1403752728 shutdown_connections 2026-02-13T04:01:02.265 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.261+0000 7f1ead30b6c0 1 -- 10.20.193.92:0/1403752728 wait complete. 2026-02-13T04:01:02.265 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.262+0000 7f1ead30b6c0 1 Processor -- start 2026-02-13T04:01:02.266 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.262+0000 7f1ead30b6c0 1 -- start start 2026-02-13T04:01:02.266 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.262+0000 7f1ead30b6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1ea810f060 0x7f1ea811cdf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:02.266 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.262+0000 7f1ead30b6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1ea8115270 0x7f1ea811d330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:02.266 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.262+0000 7f1ead30b6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1ea81226f0 0x7f1ea8122b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:02.266 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.262+0000 7f1ead30b6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea8123100 con 0x7f1ea81226f0 2026-02-13T04:01:02.266 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.262+0000 7f1ead30b6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea8123270 con 0x7f1ea810f060 2026-02-13T04:01:02.266 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.262+0000 7f1ead30b6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea8123430 con 0x7f1ea8115270 2026-02-13T04:01:02.268 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.263+0000 7f1ea7fff6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1ea810f060 0x7f1ea811cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:02.268 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.263+0000 7f1ea7fff6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1ea810f060 0x7f1ea811cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:42372/0 (socket says 10.20.193.92:42372) 2026-02-13T04:01:02.268 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.263+0000 7f1ea7fff6c0 1 -- 10.20.193.92:0/648010323 learned_addr learned my addr 10.20.193.92:0/648010323 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:02.268 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.263+0000 7f1ea77fe6c0 1 --2- 10.20.193.92:0/648010323 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1ea8115270 0x7f1ea811d330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:02.268 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.263+0000 7f1eacb0a6c0 1 --2- 10.20.193.92:0/648010323 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1ea81226f0 0x7f1ea8122b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:02.268 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.263+0000 7f1ea7fff6c0 1 -- 10.20.193.92:0/648010323 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1ea8115270 msgr2=0x7f1ea811d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:02.268 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.263+0000 7f1ea7fff6c0 1 --2- 10.20.193.92:0/648010323 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1ea8115270 0x7f1ea811d330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:02.268 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.263+0000 7f1ea7fff6c0 1 -- 10.20.193.92:0/648010323 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1ea81226f0 msgr2=0x7f1ea8122b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:02.268 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.263+0000 7f1ea7fff6c0 1 --2- 10.20.193.92:0/648010323 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1ea81226f0 0x7f1ea8122b90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:02.268 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.263+0000 7f1ea7fff6c0 1 -- 10.20.193.92:0/648010323 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e98009590 con 0x7f1ea810f060 2026-02-13T04:01:02.269 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.263+0000 7f1ea77fe6c0 1 --2- 10.20.193.92:0/648010323 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1ea8115270 0x7f1ea811d330 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T04:01:02.269 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.263+0000 7f1ea7fff6c0 1 --2- 10.20.193.92:0/648010323 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1ea810f060 0x7f1ea811cdf0 secure :-1 s=READY pgs=92 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1e94009490 tx=0x7f1e9400bc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:02.269 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.263+0000 7f1ea57fa6c0 1 -- 10.20.193.92:0/648010323 <== mon.2 v2:10.20.193.99:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1e94004a80 con 0x7f1ea810f060 2026-02-13T04:01:02.269 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.263+0000 7f1ea57fa6c0 1 -- 10.20.193.92:0/648010323 <== mon.2 v2:10.20.193.99:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f1e94009030 con 0x7f1ea810f060 2026-02-13T04:01:02.269 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.263+0000 7f1ea57fa6c0 1 -- 10.20.193.92:0/648010323 <== mon.2 v2:10.20.193.99:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1e940071c0 con 0x7f1ea810f060 2026-02-13T04:01:02.269 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.263+0000 7f1ead30b6c0 1 -- 10.20.193.92:0/648010323 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e9c00a5b0 con 0x7f1ea810f060 2026-02-13T04:01:02.269 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.263+0000 7f1ead30b6c0 1 -- 10.20.193.92:0/648010323 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ea8163be0 con 0x7f1ea810f060 2026-02-13T04:01:02.269 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.264+0000 7f1ead30b6c0 1 -- 10.20.193.92:0/648010323 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ea8110330 con 0x7f1ea810f060 2026-02-13T04:01:02.270 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.266+0000 7f1ea57fa6c0 1 -- 10.20.193.92:0/648010323 <== mon.2 v2:10.20.193.99:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f1e94004e90 con 0x7f1ea810f060 2026-02-13T04:01:02.270 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.268+0000 7f1ea57fa6c0 1 --2- 10.20.193.92:0/648010323 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f1e7c0b5760 0x7f1e7c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:02.271 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.268+0000 7f1ea57fa6c0 1 -- 10.20.193.92:0/648010323 <== mon.2 v2:10.20.193.99:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7f1e940e3cf0 con 0x7f1ea810f060 2026-02-13T04:01:02.271 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.268+0000 7f1ea77fe6c0 1 --2- 10.20.193.92:0/648010323 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f1e7c0b5760 0x7f1e7c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:02.272 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.269+0000 7f1ea57fa6c0 1 -- 10.20.193.92:0/648010323 <== mon.2 v2:10.20.193.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1e940a6640 con 0x7f1ea810f060 2026-02-13T04:01:02.272 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.269+0000 7f1ea77fe6c0 1 --2- 10.20.193.92:0/648010323 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f1e7c0b5760 0x7f1e7c0d5c10 secure :-1 s=READY pgs=151 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1e98005b40 tx=0x7f1e98009310 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:02.372 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.369+0000 7f1ead30b6c0 1 -- 10.20.193.92:0/648010323 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f1ea810fa50 con 0x7f1ea810f060 2026-02-13T04:01:02.373 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.370+0000 7f1ea57fa6c0 1 -- 10.20.193.92:0/648010323 <== mon.2 v2:10.20.193.99:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v49) ==== 86+0+133 (secure 0 0 0) 0x7f1e940a97f0 con 0x7f1ea810f060 2026-02-13T04:01:02.373 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:01:02.374 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.371+0000 7f1ead30b6c0 1 -- 10.20.193.92:0/648010323 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f1e7c0b5760 msgr2=0x7f1e7c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:02.374 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.371+0000 7f1ead30b6c0 1 --2- 10.20.193.92:0/648010323 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f1e7c0b5760 0x7f1e7c0d5c10 secure :-1 s=READY pgs=151 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1e98005b40 tx=0x7f1e98009310 comp rx=0 tx=0).stop 2026-02-13T04:01:02.374 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.371+0000 7f1ead30b6c0 1 -- 10.20.193.92:0/648010323 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1ea810f060 msgr2=0x7f1ea811cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:02.374 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.371+0000 7f1ead30b6c0 1 --2- 10.20.193.92:0/648010323 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1ea810f060 0x7f1ea811cdf0 secure :-1 s=READY pgs=92 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1e94009490 tx=0x7f1e9400bc50 comp rx=0 tx=0).stop 2026-02-13T04:01:02.374 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.371+0000 7f1ead30b6c0 1 -- 10.20.193.92:0/648010323 shutdown_connections 2026-02-13T04:01:02.375 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.371+0000 7f1ead30b6c0 1 --2- 10.20.193.92:0/648010323 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1ea81226f0 0x7f1ea8122b90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:02.375 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.371+0000 7f1ead30b6c0 1 --2- 10.20.193.92:0/648010323 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1ea8115270 0x7f1ea811d330 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:02.375 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.371+0000 7f1ead30b6c0 1 --2- 10.20.193.92:0/648010323 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f1e7c0b5760 0x7f1e7c0d5c10 unknown :-1 s=CLOSED pgs=151 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:02.375 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.371+0000 7f1ead30b6c0 1 --2- 10.20.193.92:0/648010323 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1ea810f060 0x7f1ea811cdf0 unknown :-1 s=CLOSED pgs=92 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:02.375 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.371+0000 7f1ead30b6c0 1 -- 10.20.193.92:0/648010323 >> 10.20.193.92:0/648010323 conn(0x7f1ea80ec980 msgr2=0x7f1ea810cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:02.375 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.371+0000 7f1ead30b6c0 1 -- 10.20.193.92:0/648010323 shutdown_connections 2026-02-13T04:01:02.375 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.371+0000 7f1ead30b6c0 1 -- 10.20.193.92:0/648010323 wait complete. 2026-02-13T04:01:02.511 INFO:teuthology.orchestra.run.trial092.stdout:[{"version":49,"timestamp":"2026-02-13T04:00:44.295190+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2026-02-13T04:01:02.511 INFO:tasks.ceph_manager:config epoch is 49 2026-02-13T04:01:02.511 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-13T04:01:02.511 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2026-02-13T04:01:02.512 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph mgr dump --format=json 2026-02-13T04:01:02.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:02 trial158 ceph-mon[27763]: from='client.24782 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T04:01:02.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:02 trial158 ceph-mon[27763]: pgmap v183: 97 pgs: 97 active+clean; 592 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.0 KiB/s rd, 7.2 KiB/s wr, 22 op/s 2026-02-13T04:01:02.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:02 trial158 ceph-mon[27763]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-13T04:01:02.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:02 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/2822059171' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-13T04:01:02.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:02 trial158 ceph-mon[27763]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-13T04:01:02.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:02 trial099 ceph-mon[27808]: from='client.24782 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T04:01:02.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:02 trial099 ceph-mon[27808]: pgmap v183: 97 pgs: 97 active+clean; 592 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 2.0 KiB/s rd, 7.2 KiB/s wr, 22 op/s 2026-02-13T04:01:02.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:02 trial099 ceph-mon[27808]: from='client.? ' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-13T04:01:02.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:02 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/2822059171' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2026-02-13T04:01:02.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:02 trial099 ceph-mon[27808]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2026-02-13T04:01:02.694 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:02.888 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.885+0000 7fcd5a9696c0 1 -- 10.20.193.92:0/973061111 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fcd5410fbf0 msgr2=0x7fcd54114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:02.888 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.885+0000 7fcd5a9696c0 1 --2- 10.20.193.92:0/973061111 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fcd5410fbf0 0x7fcd54114c30 secure :-1 s=READY pgs=87 gs=3 cs=0 l=1 c_cookie=15534442822994633967 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd440099a0 tx=0x7fcd4402ed00 comp rx=0 tx=0).stop 2026-02-13T04:01:02.889 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.885+0000 7fcd5a9696c0 1 -- 10.20.193.92:0/973061111 shutdown_connections 2026-02-13T04:01:02.889 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.885+0000 7fcd5a9696c0 1 --2- 10.20.193.92:0/973061111 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fcd54115410 0x7fcd54175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:02.889 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.885+0000 7fcd5a9696c0 1 --2- 10.20.193.92:0/973061111 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fcd5410fbf0 0x7fcd54114c30 unknown :-1 s=CLOSED pgs=87 gs=3 cs=0 l=1 c_cookie=15534442822994633967 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:02.889 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.885+0000 7fcd5a9696c0 1 --2- 10.20.193.92:0/973061111 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fcd5410f200 0x7fcd5410f5d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:02.889 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.885+0000 7fcd5a9696c0 1 -- 10.20.193.92:0/973061111 >> 10.20.193.92:0/973061111 conn(0x7fcd540ecb00 msgr2=0x7fcd5410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:02.889 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.885+0000 7fcd5a9696c0 1 -- 10.20.193.92:0/973061111 shutdown_connections 2026-02-13T04:01:02.889 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.885+0000 7fcd5a9696c0 1 -- 10.20.193.92:0/973061111 wait complete. 2026-02-13T04:01:02.891 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.886+0000 7fcd5a9696c0 1 Processor -- start 2026-02-13T04:01:02.891 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.886+0000 7fcd5a9696c0 1 -- start start 2026-02-13T04:01:02.891 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.886+0000 7fcd5a9696c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fcd5410f200 0x7fcd54066730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:02.891 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.886+0000 7fcd5a9696c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fcd54115410 0x7fcd54062990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:02.891 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.886+0000 7fcd5a9696c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fcd54062f70 0x7fcd54063410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:02.891 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.886+0000 7fcd5a9696c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fcd54167a10 con 0x7fcd54062f70 2026-02-13T04:01:02.891 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.886+0000 7fcd5a9696c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fcd54167b80 con 0x7fcd54115410 2026-02-13T04:01:02.892 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.886+0000 7fcd5a9696c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fcd54167d40 con 0x7fcd5410f200 2026-02-13T04:01:02.892 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.886+0000 7fcd537fe6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fcd54115410 0x7fcd54062990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:02.892 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.886+0000 7fcd53fff6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fcd5410f200 0x7fcd54066730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:02.892 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.886+0000 7fcd53fff6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fcd5410f200 0x7fcd54066730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:56748/0 (socket says 10.20.193.92:56748) 2026-02-13T04:01:02.892 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.886+0000 7fcd53fff6c0 1 -- 10.20.193.92:0/1629897277 learned_addr learned my addr 10.20.193.92:0/1629897277 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:02.892 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.886+0000 7fcd58edb6c0 1 --2- 10.20.193.92:0/1629897277 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fcd54062f70 0x7fcd54063410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:02.892 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.887+0000 7fcd53fff6c0 1 -- 10.20.193.92:0/1629897277 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fcd54115410 msgr2=0x7fcd54062990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:02.892 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.887+0000 7fcd53fff6c0 1 --2- 10.20.193.92:0/1629897277 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fcd54115410 0x7fcd54062990 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:02.892 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.887+0000 7fcd53fff6c0 1 -- 10.20.193.92:0/1629897277 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fcd54062f70 msgr2=0x7fcd54063410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:02.892 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.887+0000 7fcd53fff6c0 1 --2- 10.20.193.92:0/1629897277 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fcd54062f70 0x7fcd54063410 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:02.892 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.887+0000 7fcd53fff6c0 1 -- 10.20.193.92:0/1629897277 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd44009590 con 0x7fcd5410f200 2026-02-13T04:01:02.892 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.887+0000 7fcd58edb6c0 1 --2- 10.20.193.92:0/1629897277 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fcd54062f70 0x7fcd54063410 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T04:01:02.893 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.887+0000 7fcd53fff6c0 1 --2- 10.20.193.92:0/1629897277 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fcd5410f200 0x7fcd54066730 secure :-1 s=READY pgs=88 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd40009490 tx=0x7fcd4000bc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:02.893 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.887+0000 7fcd517fa6c0 1 -- 10.20.193.92:0/1629897277 <== mon.1 v2:10.20.193.158:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcd40004a80 con 0x7fcd5410f200 2026-02-13T04:01:02.893 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.887+0000 7fcd517fa6c0 1 -- 10.20.193.92:0/1629897277 <== mon.1 v2:10.20.193.158:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fcd40009030 con 0x7fcd5410f200 2026-02-13T04:01:02.893 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.887+0000 7fcd517fa6c0 1 -- 10.20.193.92:0/1629897277 <== mon.1 v2:10.20.193.158:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fcd400071c0 con 0x7fcd5410f200 2026-02-13T04:01:02.893 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.887+0000 7fcd5a9696c0 1 -- 10.20.193.92:0/1629897277 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd54168020 con 0x7fcd5410f200 2026-02-13T04:01:02.893 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.887+0000 7fcd5a9696c0 1 -- 10.20.193.92:0/1629897277 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd54168500 con 0x7fcd5410f200 2026-02-13T04:01:02.893 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.888+0000 7fcd5a9696c0 1 -- 10.20.193.92:0/1629897277 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd541104d0 con 0x7fcd5410f200 2026-02-13T04:01:02.893 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.890+0000 7fcd517fa6c0 1 -- 10.20.193.92:0/1629897277 <== mon.1 v2:10.20.193.158:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fcd40004e90 con 0x7fcd5410f200 2026-02-13T04:01:02.895 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.892+0000 7fcd517fa6c0 1 --2- 10.20.193.92:0/1629897277 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fcd280b57e0 0x7fcd280d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:02.895 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.892+0000 7fcd517fa6c0 1 -- 10.20.193.92:0/1629897277 <== mon.1 v2:10.20.193.158:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7fcd400e3be0 con 0x7fcd5410f200 2026-02-13T04:01:02.895 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.892+0000 7fcd517fa6c0 1 -- 10.20.193.92:0/1629897277 <== mon.1 v2:10.20.193.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fcd4011c5e0 con 0x7fcd5410f200 2026-02-13T04:01:02.895 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.892+0000 7fcd537fe6c0 1 --2- 10.20.193.92:0/1629897277 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fcd280b57e0 0x7fcd280d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:02.895 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:02.892+0000 7fcd537fe6c0 1 --2- 10.20.193.92:0/1629897277 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fcd280b57e0 0x7fcd280d5c90 secure :-1 s=READY pgs=152 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd540664a0 tx=0x7fcd440023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:03.021 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.018+0000 7fcd5a9696c0 1 -- 10.20.193.92:0/1629897277 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fcd54063c90 con 0x7fcd5410f200 2026-02-13T04:01:03.024 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.021+0000 7fcd517fa6c0 1 -- 10.20.193.92:0/1629897277 <== mon.1 v2:10.20.193.158:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v16) ==== 74+0+297593 (secure 0 0 0) 0x7fcd400a6530 con 0x7fcd5410f200 2026-02-13T04:01:03.029 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:01:03.032 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.024+0000 7fcd5a9696c0 1 -- 10.20.193.92:0/1629897277 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fcd280b57e0 msgr2=0x7fcd280d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:03.032 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.024+0000 7fcd5a9696c0 1 --2- 10.20.193.92:0/1629897277 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fcd280b57e0 0x7fcd280d5c90 secure :-1 s=READY pgs=152 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd540664a0 tx=0x7fcd440023a0 comp rx=0 tx=0).stop 2026-02-13T04:01:03.032 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.024+0000 7fcd5a9696c0 1 -- 10.20.193.92:0/1629897277 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fcd5410f200 msgr2=0x7fcd54066730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:03.033 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.024+0000 7fcd5a9696c0 1 --2- 10.20.193.92:0/1629897277 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fcd5410f200 0x7fcd54066730 secure :-1 s=READY pgs=88 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd40009490 tx=0x7fcd4000bc50 comp rx=0 tx=0).stop 2026-02-13T04:01:03.033 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.024+0000 7fcd5a9696c0 1 -- 10.20.193.92:0/1629897277 shutdown_connections 2026-02-13T04:01:03.033 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.024+0000 7fcd5a9696c0 1 --2- 10.20.193.92:0/1629897277 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fcd280b57e0 0x7fcd280d5c90 unknown :-1 s=CLOSED pgs=152 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:03.033 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.024+0000 7fcd5a9696c0 1 --2- 10.20.193.92:0/1629897277 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fcd54115410 0x7fcd54062990 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:03.033 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.024+0000 7fcd5a9696c0 1 --2- 10.20.193.92:0/1629897277 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fcd54062f70 0x7fcd54063410 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:03.033 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.024+0000 7fcd5a9696c0 1 --2- 10.20.193.92:0/1629897277 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fcd5410f200 0x7fcd54066730 unknown :-1 s=CLOSED pgs=88 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:03.033 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.024+0000 7fcd5a9696c0 1 -- 10.20.193.92:0/1629897277 >> 10.20.193.92:0/1629897277 conn(0x7fcd540ecb00 msgr2=0x7fcd5410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:03.033 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.024+0000 7fcd5a9696c0 1 -- 10.20.193.92:0/1629897277 shutdown_connections 2026-02-13T04:01:03.033 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.024+0000 7fcd5a9696c0 1 -- 10.20.193.92:0/1629897277 wait complete. 2026-02-13T04:01:03.129 INFO:teuthology.orchestra.run.trial092.stdout:{"epoch":16,"flags":0,"active_gid":14187,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6800","nonce":4191527999},{"type":"v1","addr":"10.20.193.92:6801","nonce":4191527999}]},"active_addr":"10.20.193.92:6801/4191527999","active_change":"2026-02-13T03:58:33.822600+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[{"gid":24247,"name":"z","mgr_features":4544132024016699391,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24248,"name":"y","mgr_features":4544132024016699391,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","iostat","nfs","snap_schedule"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":4,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.92:0","nonce":2372330393}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.92:0","nonce":1759335850}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.92:0","nonce":3464631922}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.92:0","nonce":544800862}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.92:0","nonce":457589515}]}]} 2026-02-13T04:01:03.140 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2026-02-13T04:01:03.140 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2026-02-13T04:01:03.140 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T04:01:03.325 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:03.366 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:03 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/648010323' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-13T04:01:03.366 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:03 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1629897277' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-13T04:01:03.523 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.520+0000 7ff259b546c0 1 -- 10.20.193.92:0/2441812498 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff254115270 msgr2=0x7ff254175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:03.524 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.520+0000 7ff259b546c0 1 --2- 10.20.193.92:0/2441812498 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff254115270 0x7ff254175c10 secure :-1 s=READY pgs=197 gs=3 cs=0 l=1 c_cookie=11564379007694627466 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff25000a9b0 tx=0x7ff25002fd20 comp rx=0 tx=0).stop 2026-02-13T04:01:03.524 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.521+0000 7ff259b546c0 1 -- 10.20.193.92:0/2441812498 shutdown_connections 2026-02-13T04:01:03.524 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.521+0000 7ff259b546c0 1 --2- 10.20.193.92:0/2441812498 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff25410fa50 0x7ff254114a90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:03.524 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.521+0000 7ff259b546c0 1 --2- 10.20.193.92:0/2441812498 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff254115270 0x7ff254175c10 unknown :-1 s=CLOSED pgs=197 gs=3 cs=0 l=1 c_cookie=11564379007694627466 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:03.524 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.521+0000 7ff259b546c0 1 --2- 10.20.193.92:0/2441812498 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff25410f060 0x7ff25410f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:03.524 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.521+0000 7ff259b546c0 1 -- 10.20.193.92:0/2441812498 >> 10.20.193.92:0/2441812498 conn(0x7ff2540ec980 msgr2=0x7ff25410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:03.524 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.521+0000 7ff259b546c0 1 -- 10.20.193.92:0/2441812498 shutdown_connections 2026-02-13T04:01:03.524 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.521+0000 7ff259b546c0 1 -- 10.20.193.92:0/2441812498 wait complete. 2026-02-13T04:01:03.524 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.521+0000 7ff259b546c0 1 Processor -- start 2026-02-13T04:01:03.524 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.521+0000 7ff259b546c0 1 -- start start 2026-02-13T04:01:03.524 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.522+0000 7ff259b546c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff25410f060 0x7ff254066730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:03.524 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.522+0000 7ff259b546c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff254115270 0x7ff254062990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:03.524 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.522+0000 7ff259b546c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff254062f70 0x7ff254063410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:03.525 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.522+0000 7ff259b546c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff254167770 con 0x7ff25410f060 2026-02-13T04:01:03.525 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.522+0000 7ff259b546c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff2541678e0 con 0x7ff254062f70 2026-02-13T04:01:03.525 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.522+0000 7ff259b546c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7ff254167aa0 con 0x7ff254115270 2026-02-13T04:01:03.525 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.522+0000 7ff258b526c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff25410f060 0x7ff254066730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:03.525 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.522+0000 7ff258b526c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff25410f060 0x7ff254066730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:55928/0 (socket says 10.20.193.92:55928) 2026-02-13T04:01:03.525 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.522+0000 7ff258b526c0 1 -- 10.20.193.92:0/3822388363 learned_addr learned my addr 10.20.193.92:0/3822388363 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:03.525 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.522+0000 7ff24bfff6c0 1 --2- 10.20.193.92:0/3822388363 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff254115270 0x7ff254062990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:03.525 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.522+0000 7ff2593536c0 1 --2- 10.20.193.92:0/3822388363 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff254062f70 0x7ff254063410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:03.525 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.522+0000 7ff258b526c0 1 -- 10.20.193.92:0/3822388363 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff254115270 msgr2=0x7ff254062990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:03.525 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.522+0000 7ff258b526c0 1 --2- 10.20.193.92:0/3822388363 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff254115270 0x7ff254062990 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:03.525 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.522+0000 7ff258b526c0 1 -- 10.20.193.92:0/3822388363 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff254062f70 msgr2=0x7ff254063410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:03.525 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.522+0000 7ff258b526c0 1 --2- 10.20.193.92:0/3822388363 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff254062f70 0x7ff254063410 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:03.525 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.522+0000 7ff258b526c0 1 -- 10.20.193.92:0/3822388363 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff25000a5b0 con 0x7ff25410f060 2026-02-13T04:01:03.525 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.522+0000 7ff258b526c0 1 --2- 10.20.193.92:0/3822388363 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff25410f060 0x7ff254066730 secure :-1 s=READY pgs=198 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff244005950 tx=0x7ff24400bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:03.525 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.523+0000 7ff249ffb6c0 1 -- 10.20.193.92:0/3822388363 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff244004460 con 0x7ff25410f060 2026-02-13T04:01:03.525 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.523+0000 7ff249ffb6c0 1 -- 10.20.193.92:0/3822388363 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7ff2440045c0 con 0x7ff25410f060 2026-02-13T04:01:03.525 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.523+0000 7ff249ffb6c0 1 -- 10.20.193.92:0/3822388363 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff244003af0 con 0x7ff25410f060 2026-02-13T04:01:03.525 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.523+0000 7ff259b546c0 1 -- 10.20.193.92:0/3822388363 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff254167d80 con 0x7ff25410f060 2026-02-13T04:01:03.525 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.523+0000 7ff259b546c0 1 -- 10.20.193.92:0/3822388363 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff254168210 con 0x7ff25410f060 2026-02-13T04:01:03.526 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.523+0000 7ff259b546c0 1 -- 10.20.193.92:0/3822388363 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff254110330 con 0x7ff25410f060 2026-02-13T04:01:03.528 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.525+0000 7ff249ffb6c0 1 -- 10.20.193.92:0/3822388363 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7ff244005240 con 0x7ff25410f060 2026-02-13T04:01:03.529 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.527+0000 7ff249ffb6c0 1 --2- 10.20.193.92:0/3822388363 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff2300b5830 0x7ff2300d5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:03.529 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.527+0000 7ff249ffb6c0 1 -- 10.20.193.92:0/3822388363 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7ff2440e3a20 con 0x7ff25410f060 2026-02-13T04:01:03.530 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.527+0000 7ff24bfff6c0 1 --2- 10.20.193.92:0/3822388363 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff2300b5830 0x7ff2300d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:03.530 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.527+0000 7ff249ffb6c0 1 -- 10.20.193.92:0/3822388363 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff24411c5e0 con 0x7ff25410f060 2026-02-13T04:01:03.530 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.527+0000 7ff24bfff6c0 1 --2- 10.20.193.92:0/3822388363 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff2300b5830 0x7ff2300d5ce0 secure :-1 s=READY pgs=153 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff254113b70 tx=0x7ff23c0093f0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:03.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:03 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/648010323' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-13T04:01:03.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:03 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/1629897277' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-13T04:01:03.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:03 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/648010323' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2026-02-13T04:01:03.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:03 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/1629897277' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2026-02-13T04:01:03.631 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.628+0000 7ff259b546c0 1 -- 10.20.193.92:0/3822388363 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff25410f430 con 0x7ff25410f060 2026-02-13T04:01:03.632 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.629+0000 7ff249ffb6c0 1 -- 10.20.193.92:0/3822388363 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22330 (secure 0 0 0) 0x7ff2440a6370 con 0x7ff25410f060 2026-02-13T04:01:03.632 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:01:03.633 INFO:teuthology.orchestra.run.trial092.stdout:{"epoch":76,"fsid":"1fefccae-0890-11f1-bcc5-d404e6e7d460","created":"2026-02-13T03:57:51.342799+0000","modified":"2026-02-13T04:00:50.465887+0000","last_up_change":"2026-02-13T04:00:28.570362+0000","last_in_change":"2026-02-13T04:00:20.284718+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T03:59:12.044389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-13T04:00:46.979064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-13T04:00:48.319223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8527c214-a46e-4505-b9a0-dc55e7cf6b55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6802","nonce":2375200644},{"type":"v1","addr":"10.20.193.92:6803","nonce":2375200644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6804","nonce":2375200644},{"type":"v1","addr":"10.20.193.92:6805","nonce":2375200644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6808","nonce":2375200644},{"type":"v1","addr":"10.20.193.92:6809","nonce":2375200644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6806","nonce":2375200644},{"type":"v1","addr":"10.20.193.92:6807","nonce":2375200644}]},"public_addr":"10.20.193.92:6803/2375200644","cluster_addr":"10.20.193.92:6805/2375200644","heartbeat_back_addr":"10.20.193.92:6809/2375200644","heartbeat_front_addr":"10.20.193.92:6807/2375200644","state":["exists","up"]},{"osd":1,"uuid":"253e5e0e-8571-4add-81e5-ca92934b8171","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6800","nonce":3943455734},{"type":"v1","addr":"10.20.193.99:6801","nonce":3943455734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6802","nonce":3943455734},{"type":"v1","addr":"10.20.193.99:6803","nonce":3943455734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6806","nonce":3943455734},{"type":"v1","addr":"10.20.193.99:6807","nonce":3943455734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6804","nonce":3943455734},{"type":"v1","addr":"10.20.193.99:6805","nonce":3943455734}]},"public_addr":"10.20.193.99:6801/3943455734","cluster_addr":"10.20.193.99:6803/3943455734","heartbeat_back_addr":"10.20.193.99:6807/3943455734","heartbeat_front_addr":"10.20.193.99:6805/3943455734","state":["exists","up"]},{"osd":2,"uuid":"e94c2f5c-ce8a-484e-9cf3-e436edc16bdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6800","nonce":676925869},{"type":"v1","addr":"10.20.193.158:6801","nonce":676925869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6802","nonce":676925869},{"type":"v1","addr":"10.20.193.158:6803","nonce":676925869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6806","nonce":676925869},{"type":"v1","addr":"10.20.193.158:6807","nonce":676925869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6804","nonce":676925869},{"type":"v1","addr":"10.20.193.158:6805","nonce":676925869}]},"public_addr":"10.20.193.158:6801/676925869","cluster_addr":"10.20.193.158:6803/676925869","heartbeat_back_addr":"10.20.193.158:6807/676925869","heartbeat_front_addr":"10.20.193.158:6805/676925869","state":["exists","up"]},{"osd":3,"uuid":"91080154-0bd8-4e06-832e-1590d7784229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6810","nonce":4168983230},{"type":"v1","addr":"10.20.193.92:6811","nonce":4168983230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6812","nonce":4168983230},{"type":"v1","addr":"10.20.193.92:6813","nonce":4168983230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6816","nonce":4168983230},{"type":"v1","addr":"10.20.193.92:6817","nonce":4168983230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6814","nonce":4168983230},{"type":"v1","addr":"10.20.193.92:6815","nonce":4168983230}]},"public_addr":"10.20.193.92:6811/4168983230","cluster_addr":"10.20.193.92:6813/4168983230","heartbeat_back_addr":"10.20.193.92:6817/4168983230","heartbeat_front_addr":"10.20.193.92:6815/4168983230","state":["exists","up"]},{"osd":4,"uuid":"fec31143-d966-4f9b-8021-73e24c1b4d32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6808","nonce":1135109881},{"type":"v1","addr":"10.20.193.99:6809","nonce":1135109881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6810","nonce":1135109881},{"type":"v1","addr":"10.20.193.99:6811","nonce":1135109881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6814","nonce":1135109881},{"type":"v1","addr":"10.20.193.99:6815","nonce":1135109881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6812","nonce":1135109881},{"type":"v1","addr":"10.20.193.99:6813","nonce":1135109881}]},"public_addr":"10.20.193.99:6809/1135109881","cluster_addr":"10.20.193.99:6811/1135109881","heartbeat_back_addr":"10.20.193.99:6815/1135109881","heartbeat_front_addr":"10.20.193.99:6813/1135109881","state":["exists","up"]},{"osd":5,"uuid":"fcb06e7c-2900-49d9-9b39-6521200cd89a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6808","nonce":428074602},{"type":"v1","addr":"10.20.193.158:6809","nonce":428074602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6810","nonce":428074602},{"type":"v1","addr":"10.20.193.158:6811","nonce":428074602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6814","nonce":428074602},{"type":"v1","addr":"10.20.193.158:6815","nonce":428074602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6812","nonce":428074602},{"type":"v1","addr":"10.20.193.158:6813","nonce":428074602}]},"public_addr":"10.20.193.158:6809/428074602","cluster_addr":"10.20.193.158:6811/428074602","heartbeat_back_addr":"10.20.193.158:6815/428074602","heartbeat_front_addr":"10.20.193.158:6813/428074602","state":["exists","up"]},{"osd":6,"uuid":"17251a9f-8203-4bdf-87c5-1bd31254f2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6818","nonce":1823230093},{"type":"v1","addr":"10.20.193.92:6819","nonce":1823230093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6820","nonce":1823230093},{"type":"v1","addr":"10.20.193.92:6821","nonce":1823230093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6824","nonce":1823230093},{"type":"v1","addr":"10.20.193.92:6825","nonce":1823230093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6822","nonce":1823230093},{"type":"v1","addr":"10.20.193.92:6823","nonce":1823230093}]},"public_addr":"10.20.193.92:6819/1823230093","cluster_addr":"10.20.193.92:6821/1823230093","heartbeat_back_addr":"10.20.193.92:6825/1823230093","heartbeat_front_addr":"10.20.193.92:6823/1823230093","state":["exists","up"]},{"osd":7,"uuid":"6775e50d-691e-472f-a99e-d6cd4786d4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6816","nonce":3951959773},{"type":"v1","addr":"10.20.193.99:6817","nonce":3951959773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6818","nonce":3951959773},{"type":"v1","addr":"10.20.193.99:6819","nonce":3951959773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6822","nonce":3951959773},{"type":"v1","addr":"10.20.193.99:6823","nonce":3951959773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6820","nonce":3951959773},{"type":"v1","addr":"10.20.193.99:6821","nonce":3951959773}]},"public_addr":"10.20.193.99:6817/3951959773","cluster_addr":"10.20.193.99:6819/3951959773","heartbeat_back_addr":"10.20.193.99:6823/3951959773","heartbeat_front_addr":"10.20.193.99:6821/3951959773","state":["exists","up"]},{"osd":8,"uuid":"a6be4612-8a0a-4590-95a9-82b973ad4c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6816","nonce":1505536261},{"type":"v1","addr":"10.20.193.158:6817","nonce":1505536261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6818","nonce":1505536261},{"type":"v1","addr":"10.20.193.158:6819","nonce":1505536261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6822","nonce":1505536261},{"type":"v1","addr":"10.20.193.158:6823","nonce":1505536261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6820","nonce":1505536261},{"type":"v1","addr":"10.20.193.158:6821","nonce":1505536261}]},"public_addr":"10.20.193.158:6817/1505536261","cluster_addr":"10.20.193.158:6819/1505536261","heartbeat_back_addr":"10.20.193.158:6823/1505536261","heartbeat_front_addr":"10.20.193.158:6821/1505536261","state":["exists","up"]},{"osd":9,"uuid":"b51a7c23-3bba-4404-8b3a-462a2870b83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6826","nonce":3596797929},{"type":"v1","addr":"10.20.193.92:6827","nonce":3596797929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6828","nonce":3596797929},{"type":"v1","addr":"10.20.193.92:6829","nonce":3596797929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6832","nonce":3596797929},{"type":"v1","addr":"10.20.193.92:6833","nonce":3596797929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6830","nonce":3596797929},{"type":"v1","addr":"10.20.193.92:6831","nonce":3596797929}]},"public_addr":"10.20.193.92:6827/3596797929","cluster_addr":"10.20.193.92:6829/3596797929","heartbeat_back_addr":"10.20.193.92:6833/3596797929","heartbeat_front_addr":"10.20.193.92:6831/3596797929","state":["exists","up"]},{"osd":10,"uuid":"dda9bd0a-0359-4889-ad2d-8da7602164cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6824","nonce":4260536068},{"type":"v1","addr":"10.20.193.99:6825","nonce":4260536068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6826","nonce":4260536068},{"type":"v1","addr":"10.20.193.99:6827","nonce":4260536068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6830","nonce":4260536068},{"type":"v1","addr":"10.20.193.99:6831","nonce":4260536068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6828","nonce":4260536068},{"type":"v1","addr":"10.20.193.99:6829","nonce":4260536068}]},"public_addr":"10.20.193.99:6825/4260536068","cluster_addr":"10.20.193.99:6827/4260536068","heartbeat_back_addr":"10.20.193.99:6831/4260536068","heartbeat_front_addr":"10.20.193.99:6829/4260536068","state":["exists","up"]},{"osd":11,"uuid":"8e78b081-0fe6-49a4-879b-094cfb14783c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6824","nonce":2019612524},{"type":"v1","addr":"10.20.193.158:6825","nonce":2019612524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6826","nonce":2019612524},{"type":"v1","addr":"10.20.193.158:6827","nonce":2019612524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6830","nonce":2019612524},{"type":"v1","addr":"10.20.193.158:6831","nonce":2019612524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6828","nonce":2019612524},{"type":"v1","addr":"10.20.193.158:6829","nonce":2019612524}]},"public_addr":"10.20.193.158:6825/2019612524","cluster_addr":"10.20.193.158:6827/2019612524","heartbeat_back_addr":"10.20.193.158:6831/2019612524","heartbeat_front_addr":"10.20.193.158:6829/2019612524","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:58:53.806082+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:59:01.539380+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:59:08.639667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:59:19.253252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:59:27.067122+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:59:34.359212+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:59:45.274527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:59:52.962680+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T04:00:00.299816+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T04:00:11.400008+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T04:00:19.328513+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T04:00:26.837283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.92:0/1237375916":"2026-02-14T03:58:33.822496+0000","10.20.193.92:6800/1986528669":"2026-02-14T03:58:33.822496+0000","10.20.193.92:0/1967601204":"2026-02-14T03:58:33.822496+0000","10.20.193.92:0/2687491302":"2026-02-14T03:57:59.617461+0000","10.20.193.92:6801/1986528669":"2026-02-14T03:58:33.822496+0000","10.20.193.92:0/3477507155":"2026-02-14T03:58:33.822496+0000","10.20.193.92:0/3506092440":"2026-02-14T03:57:59.617461+0000","10.20.193.92:6801/3709134212":"2026-02-14T03:57:59.617461+0000","10.20.193.92:6800/3709134212":"2026-02-14T03:57:59.617461+0000","10.20.193.92:0/1198638193":"2026-02-14T03:57:59.617461+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T04:01:03.633 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.630+0000 7ff259b546c0 1 -- 10.20.193.92:0/3822388363 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff2300b5830 msgr2=0x7ff2300d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:03.633 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.630+0000 7ff259b546c0 1 --2- 10.20.193.92:0/3822388363 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff2300b5830 0x7ff2300d5ce0 secure :-1 s=READY pgs=153 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff254113b70 tx=0x7ff23c0093f0 comp rx=0 tx=0).stop 2026-02-13T04:01:03.634 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.630+0000 7ff259b546c0 1 -- 10.20.193.92:0/3822388363 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff25410f060 msgr2=0x7ff254066730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:03.634 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.630+0000 7ff259b546c0 1 --2- 10.20.193.92:0/3822388363 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff25410f060 0x7ff254066730 secure :-1 s=READY pgs=198 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff244005950 tx=0x7ff24400bca0 comp rx=0 tx=0).stop 2026-02-13T04:01:03.634 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.630+0000 7ff259b546c0 1 -- 10.20.193.92:0/3822388363 shutdown_connections 2026-02-13T04:01:03.634 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.630+0000 7ff259b546c0 1 --2- 10.20.193.92:0/3822388363 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff2300b5830 0x7ff2300d5ce0 unknown :-1 s=CLOSED pgs=153 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:03.634 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.630+0000 7ff259b546c0 1 --2- 10.20.193.92:0/3822388363 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff254062f70 0x7ff254063410 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:03.634 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.630+0000 7ff259b546c0 1 --2- 10.20.193.92:0/3822388363 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff254115270 0x7ff254062990 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:03.634 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.630+0000 7ff259b546c0 1 --2- 10.20.193.92:0/3822388363 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff25410f060 0x7ff254066730 unknown :-1 s=CLOSED pgs=198 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:03.634 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.630+0000 7ff259b546c0 1 -- 10.20.193.92:0/3822388363 >> 10.20.193.92:0/3822388363 conn(0x7ff2540ec980 msgr2=0x7ff25410cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:03.634 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.631+0000 7ff259b546c0 1 -- 10.20.193.92:0/3822388363 shutdown_connections 2026-02-13T04:01:03.634 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:03.631+0000 7ff259b546c0 1 -- 10.20.193.92:0/3822388363 wait complete. 2026-02-13T04:01:03.736 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2026-02-13T04:01:03.736 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph osd dump --format=json 2026-02-13T04:01:03.920 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:04.129 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.126+0000 7f15a58676c0 1 -- 10.20.193.92:0/3803026650 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f15a010f060 msgr2=0x7f15a010f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:04.129 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.126+0000 7f15a58676c0 1 --2- 10.20.193.92:0/3803026650 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f15a010f060 0x7f15a010f430 secure :-1 s=READY pgs=89 gs=1 cs=0 l=1 c_cookie=6087879726152971408 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f15900099a0 tx=0x7f159002ed00 comp rx=0 tx=0).stop 2026-02-13T04:01:04.129 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.126+0000 7f15a58676c0 1 -- 10.20.193.92:0/3803026650 shutdown_connections 2026-02-13T04:01:04.129 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.126+0000 7f15a58676c0 1 --2- 10.20.193.92:0/3803026650 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f15a010fa50 0x7f15a0114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:04.129 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.126+0000 7f15a58676c0 1 --2- 10.20.193.92:0/3803026650 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f15a0115270 0x7f15a0175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:04.129 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.126+0000 7f15a58676c0 1 --2- 10.20.193.92:0/3803026650 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f15a010f060 0x7f15a010f430 unknown :-1 s=CLOSED pgs=89 gs=1 cs=0 l=1 c_cookie=6087879726152971408 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:04.130 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.126+0000 7f15a58676c0 1 -- 10.20.193.92:0/3803026650 >> 10.20.193.92:0/3803026650 conn(0x7f15a00ec980 msgr2=0x7f15a010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:04.130 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.126+0000 7f15a58676c0 1 -- 10.20.193.92:0/3803026650 shutdown_connections 2026-02-13T04:01:04.130 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.126+0000 7f15a58676c0 1 -- 10.20.193.92:0/3803026650 wait complete. 2026-02-13T04:01:04.132 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.126+0000 7f15a58676c0 1 Processor -- start 2026-02-13T04:01:04.132 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.127+0000 7f15a58676c0 1 -- start start 2026-02-13T04:01:04.132 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.127+0000 7f15a58676c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f15a010f060 0x7f15a011ce70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:04.132 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.127+0000 7f15a58676c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f15a0115270 0x7f15a011d3b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:04.132 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.127+0000 7f15a58676c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f15a0122770 0x7f15a0122c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:04.132 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.127+0000 7f15a58676c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f15a0123180 con 0x7f15a0122770 2026-02-13T04:01:04.132 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.127+0000 7f15a58676c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f15a01232f0 con 0x7f15a0115270 2026-02-13T04:01:04.133 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.127+0000 7f15a58676c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f15a01234b0 con 0x7f15a010f060 2026-02-13T04:01:04.133 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.127+0000 7f15a48656c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f15a010f060 0x7f15a011ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:04.133 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.127+0000 7f15a50666c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f15a0122770 0x7f15a0122c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:04.133 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.127+0000 7f1597fff6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f15a0115270 0x7f15a011d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:04.133 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.127+0000 7f1597fff6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f15a0115270 0x7f15a011d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:42404/0 (socket says 10.20.193.92:42404) 2026-02-13T04:01:04.133 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.127+0000 7f1597fff6c0 1 -- 10.20.193.92:0/2506385230 learned_addr learned my addr 10.20.193.92:0/2506385230 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:04.133 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.127+0000 7f15a50666c0 1 -- 10.20.193.92:0/2506385230 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f15a010f060 msgr2=0x7f15a011ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:04.133 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.127+0000 7f15a50666c0 1 --2- 10.20.193.92:0/2506385230 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f15a010f060 0x7f15a011ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:04.133 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.127+0000 7f15a50666c0 1 -- 10.20.193.92:0/2506385230 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f15a0115270 msgr2=0x7f15a011d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:04.133 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.127+0000 7f15a50666c0 1 --2- 10.20.193.92:0/2506385230 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f15a0115270 0x7f15a011d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:04.133 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.127+0000 7f15a50666c0 1 -- 10.20.193.92:0/2506385230 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1590009590 con 0x7f15a0122770 2026-02-13T04:01:04.133 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.128+0000 7f15a50666c0 1 --2- 10.20.193.92:0/2506385230 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f15a0122770 0x7f15a0122c10 secure :-1 s=READY pgs=199 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f159c006fd0 tx=0x7f159c00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:04.134 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.128+0000 7f1595ffb6c0 1 -- 10.20.193.92:0/2506385230 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f159c003c40 con 0x7f15a0122770 2026-02-13T04:01:04.134 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.128+0000 7f1595ffb6c0 1 -- 10.20.193.92:0/2506385230 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f159c00a070 con 0x7f15a0122770 2026-02-13T04:01:04.134 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.128+0000 7f1595ffb6c0 1 -- 10.20.193.92:0/2506385230 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f159c0081c0 con 0x7f15a0122770 2026-02-13T04:01:04.134 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.128+0000 7f15a58676c0 1 -- 10.20.193.92:0/2506385230 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15a0163960 con 0x7f15a0122770 2026-02-13T04:01:04.134 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.128+0000 7f15a58676c0 1 -- 10.20.193.92:0/2506385230 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15a0163df0 con 0x7f15a0122770 2026-02-13T04:01:04.134 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.128+0000 7f15a58676c0 1 -- 10.20.193.92:0/2506385230 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15a0110330 con 0x7f15a0122770 2026-02-13T04:01:04.134 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.131+0000 7f1595ffb6c0 1 -- 10.20.193.92:0/2506385230 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f159c005860 con 0x7f15a0122770 2026-02-13T04:01:04.136 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.132+0000 7f1595ffb6c0 1 --2- 10.20.193.92:0/2506385230 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f157c0b56e0 0x7f157c0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:04.136 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.133+0000 7f1595ffb6c0 1 -- 10.20.193.92:0/2506385230 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7f159c0e4ac0 con 0x7f15a0122770 2026-02-13T04:01:04.136 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.133+0000 7f1595ffb6c0 1 -- 10.20.193.92:0/2506385230 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f159c11d5e0 con 0x7f15a0122770 2026-02-13T04:01:04.136 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.133+0000 7f15a48656c0 1 --2- 10.20.193.92:0/2506385230 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f157c0b56e0 0x7f157c0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:04.136 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.133+0000 7f15a48656c0 1 --2- 10.20.193.92:0/2506385230 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f157c0b56e0 0x7f157c0d5b90 secure :-1 s=READY pgs=154 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f15900098c0 tx=0x7f15900023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:04.236 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:04 trial092 ceph-mon[23047]: pgmap v184: 97 pgs: 97 active+clean; 637 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 8.9 KiB/s rd, 11 KiB/s wr, 24 op/s 2026-02-13T04:01:04.236 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:04 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/3822388363' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T04:01:04.236 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.233+0000 7f15a58676c0 1 -- 10.20.193.92:0/2506385230 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f15a010f430 con 0x7f15a0122770 2026-02-13T04:01:04.237 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.233+0000 7f1595ffb6c0 1 -- 10.20.193.92:0/2506385230 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+22330 (secure 0 0 0) 0x7f159c0a7410 con 0x7f15a0122770 2026-02-13T04:01:04.237 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:01:04.238 INFO:teuthology.orchestra.run.trial092.stdout:{"epoch":76,"fsid":"1fefccae-0890-11f1-bcc5-d404e6e7d460","created":"2026-02-13T03:57:51.342799+0000","modified":"2026-02-13T04:00:50.465887+0000","last_up_change":"2026-02-13T04:00:28.570362+0000","last_in_change":"2026-02-13T04:00:20.284718+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-13T03:59:12.044389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2026-02-13T04:00:46.979064+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2026-02-13T04:00:48.319223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8527c214-a46e-4505-b9a0-dc55e7cf6b55","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6802","nonce":2375200644},{"type":"v1","addr":"10.20.193.92:6803","nonce":2375200644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6804","nonce":2375200644},{"type":"v1","addr":"10.20.193.92:6805","nonce":2375200644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6808","nonce":2375200644},{"type":"v1","addr":"10.20.193.92:6809","nonce":2375200644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6806","nonce":2375200644},{"type":"v1","addr":"10.20.193.92:6807","nonce":2375200644}]},"public_addr":"10.20.193.92:6803/2375200644","cluster_addr":"10.20.193.92:6805/2375200644","heartbeat_back_addr":"10.20.193.92:6809/2375200644","heartbeat_front_addr":"10.20.193.92:6807/2375200644","state":["exists","up"]},{"osd":1,"uuid":"253e5e0e-8571-4add-81e5-ca92934b8171","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6800","nonce":3943455734},{"type":"v1","addr":"10.20.193.99:6801","nonce":3943455734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6802","nonce":3943455734},{"type":"v1","addr":"10.20.193.99:6803","nonce":3943455734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6806","nonce":3943455734},{"type":"v1","addr":"10.20.193.99:6807","nonce":3943455734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6804","nonce":3943455734},{"type":"v1","addr":"10.20.193.99:6805","nonce":3943455734}]},"public_addr":"10.20.193.99:6801/3943455734","cluster_addr":"10.20.193.99:6803/3943455734","heartbeat_back_addr":"10.20.193.99:6807/3943455734","heartbeat_front_addr":"10.20.193.99:6805/3943455734","state":["exists","up"]},{"osd":2,"uuid":"e94c2f5c-ce8a-484e-9cf3-e436edc16bdc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6800","nonce":676925869},{"type":"v1","addr":"10.20.193.158:6801","nonce":676925869}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6802","nonce":676925869},{"type":"v1","addr":"10.20.193.158:6803","nonce":676925869}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6806","nonce":676925869},{"type":"v1","addr":"10.20.193.158:6807","nonce":676925869}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6804","nonce":676925869},{"type":"v1","addr":"10.20.193.158:6805","nonce":676925869}]},"public_addr":"10.20.193.158:6801/676925869","cluster_addr":"10.20.193.158:6803/676925869","heartbeat_back_addr":"10.20.193.158:6807/676925869","heartbeat_front_addr":"10.20.193.158:6805/676925869","state":["exists","up"]},{"osd":3,"uuid":"91080154-0bd8-4e06-832e-1590d7784229","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6810","nonce":4168983230},{"type":"v1","addr":"10.20.193.92:6811","nonce":4168983230}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6812","nonce":4168983230},{"type":"v1","addr":"10.20.193.92:6813","nonce":4168983230}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6816","nonce":4168983230},{"type":"v1","addr":"10.20.193.92:6817","nonce":4168983230}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6814","nonce":4168983230},{"type":"v1","addr":"10.20.193.92:6815","nonce":4168983230}]},"public_addr":"10.20.193.92:6811/4168983230","cluster_addr":"10.20.193.92:6813/4168983230","heartbeat_back_addr":"10.20.193.92:6817/4168983230","heartbeat_front_addr":"10.20.193.92:6815/4168983230","state":["exists","up"]},{"osd":4,"uuid":"fec31143-d966-4f9b-8021-73e24c1b4d32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6808","nonce":1135109881},{"type":"v1","addr":"10.20.193.99:6809","nonce":1135109881}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6810","nonce":1135109881},{"type":"v1","addr":"10.20.193.99:6811","nonce":1135109881}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6814","nonce":1135109881},{"type":"v1","addr":"10.20.193.99:6815","nonce":1135109881}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6812","nonce":1135109881},{"type":"v1","addr":"10.20.193.99:6813","nonce":1135109881}]},"public_addr":"10.20.193.99:6809/1135109881","cluster_addr":"10.20.193.99:6811/1135109881","heartbeat_back_addr":"10.20.193.99:6815/1135109881","heartbeat_front_addr":"10.20.193.99:6813/1135109881","state":["exists","up"]},{"osd":5,"uuid":"fcb06e7c-2900-49d9-9b39-6521200cd89a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6808","nonce":428074602},{"type":"v1","addr":"10.20.193.158:6809","nonce":428074602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6810","nonce":428074602},{"type":"v1","addr":"10.20.193.158:6811","nonce":428074602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6814","nonce":428074602},{"type":"v1","addr":"10.20.193.158:6815","nonce":428074602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6812","nonce":428074602},{"type":"v1","addr":"10.20.193.158:6813","nonce":428074602}]},"public_addr":"10.20.193.158:6809/428074602","cluster_addr":"10.20.193.158:6811/428074602","heartbeat_back_addr":"10.20.193.158:6815/428074602","heartbeat_front_addr":"10.20.193.158:6813/428074602","state":["exists","up"]},{"osd":6,"uuid":"17251a9f-8203-4bdf-87c5-1bd31254f2e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6818","nonce":1823230093},{"type":"v1","addr":"10.20.193.92:6819","nonce":1823230093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6820","nonce":1823230093},{"type":"v1","addr":"10.20.193.92:6821","nonce":1823230093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6824","nonce":1823230093},{"type":"v1","addr":"10.20.193.92:6825","nonce":1823230093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6822","nonce":1823230093},{"type":"v1","addr":"10.20.193.92:6823","nonce":1823230093}]},"public_addr":"10.20.193.92:6819/1823230093","cluster_addr":"10.20.193.92:6821/1823230093","heartbeat_back_addr":"10.20.193.92:6825/1823230093","heartbeat_front_addr":"10.20.193.92:6823/1823230093","state":["exists","up"]},{"osd":7,"uuid":"6775e50d-691e-472f-a99e-d6cd4786d4b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6816","nonce":3951959773},{"type":"v1","addr":"10.20.193.99:6817","nonce":3951959773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6818","nonce":3951959773},{"type":"v1","addr":"10.20.193.99:6819","nonce":3951959773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6822","nonce":3951959773},{"type":"v1","addr":"10.20.193.99:6823","nonce":3951959773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6820","nonce":3951959773},{"type":"v1","addr":"10.20.193.99:6821","nonce":3951959773}]},"public_addr":"10.20.193.99:6817/3951959773","cluster_addr":"10.20.193.99:6819/3951959773","heartbeat_back_addr":"10.20.193.99:6823/3951959773","heartbeat_front_addr":"10.20.193.99:6821/3951959773","state":["exists","up"]},{"osd":8,"uuid":"a6be4612-8a0a-4590-95a9-82b973ad4c19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":53,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6816","nonce":1505536261},{"type":"v1","addr":"10.20.193.158:6817","nonce":1505536261}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6818","nonce":1505536261},{"type":"v1","addr":"10.20.193.158:6819","nonce":1505536261}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6822","nonce":1505536261},{"type":"v1","addr":"10.20.193.158:6823","nonce":1505536261}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6820","nonce":1505536261},{"type":"v1","addr":"10.20.193.158:6821","nonce":1505536261}]},"public_addr":"10.20.193.158:6817/1505536261","cluster_addr":"10.20.193.158:6819/1505536261","heartbeat_back_addr":"10.20.193.158:6823/1505536261","heartbeat_front_addr":"10.20.193.158:6821/1505536261","state":["exists","up"]},{"osd":9,"uuid":"b51a7c23-3bba-4404-8b3a-462a2870b83c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6826","nonce":3596797929},{"type":"v1","addr":"10.20.193.92:6827","nonce":3596797929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6828","nonce":3596797929},{"type":"v1","addr":"10.20.193.92:6829","nonce":3596797929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6832","nonce":3596797929},{"type":"v1","addr":"10.20.193.92:6833","nonce":3596797929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.92:6830","nonce":3596797929},{"type":"v1","addr":"10.20.193.92:6831","nonce":3596797929}]},"public_addr":"10.20.193.92:6827/3596797929","cluster_addr":"10.20.193.92:6829/3596797929","heartbeat_back_addr":"10.20.193.92:6833/3596797929","heartbeat_front_addr":"10.20.193.92:6831/3596797929","state":["exists","up"]},{"osd":10,"uuid":"dda9bd0a-0359-4889-ad2d-8da7602164cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":64,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6824","nonce":4260536068},{"type":"v1","addr":"10.20.193.99:6825","nonce":4260536068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6826","nonce":4260536068},{"type":"v1","addr":"10.20.193.99:6827","nonce":4260536068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6830","nonce":4260536068},{"type":"v1","addr":"10.20.193.99:6831","nonce":4260536068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.99:6828","nonce":4260536068},{"type":"v1","addr":"10.20.193.99:6829","nonce":4260536068}]},"public_addr":"10.20.193.99:6825/4260536068","cluster_addr":"10.20.193.99:6827/4260536068","heartbeat_back_addr":"10.20.193.99:6831/4260536068","heartbeat_front_addr":"10.20.193.99:6829/4260536068","state":["exists","up"]},{"osd":11,"uuid":"8e78b081-0fe6-49a4-879b-094cfb14783c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6824","nonce":2019612524},{"type":"v1","addr":"10.20.193.158:6825","nonce":2019612524}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6826","nonce":2019612524},{"type":"v1","addr":"10.20.193.158:6827","nonce":2019612524}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6830","nonce":2019612524},{"type":"v1","addr":"10.20.193.158:6831","nonce":2019612524}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.158:6828","nonce":2019612524},{"type":"v1","addr":"10.20.193.158:6829","nonce":2019612524}]},"public_addr":"10.20.193.158:6825/2019612524","cluster_addr":"10.20.193.158:6827/2019612524","heartbeat_back_addr":"10.20.193.158:6831/2019612524","heartbeat_front_addr":"10.20.193.158:6829/2019612524","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:58:53.806082+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:59:01.539380+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:59:08.639667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:59:19.253252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:59:27.067122+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:59:34.359212+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:59:45.274527+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T03:59:52.962680+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T04:00:00.299816+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T04:00:11.400008+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T04:00:19.328513+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-13T04:00:26.837283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"10.20.193.92:0/1237375916":"2026-02-14T03:58:33.822496+0000","10.20.193.92:6800/1986528669":"2026-02-14T03:58:33.822496+0000","10.20.193.92:0/1967601204":"2026-02-14T03:58:33.822496+0000","10.20.193.92:0/2687491302":"2026-02-14T03:57:59.617461+0000","10.20.193.92:6801/1986528669":"2026-02-14T03:58:33.822496+0000","10.20.193.92:0/3477507155":"2026-02-14T03:58:33.822496+0000","10.20.193.92:0/3506092440":"2026-02-14T03:57:59.617461+0000","10.20.193.92:6801/3709134212":"2026-02-14T03:57:59.617461+0000","10.20.193.92:6800/3709134212":"2026-02-14T03:57:59.617461+0000","10.20.193.92:0/1198638193":"2026-02-14T03:57:59.617461+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-13T04:01:04.238 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.234+0000 7f15a58676c0 1 -- 10.20.193.92:0/2506385230 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f157c0b56e0 msgr2=0x7f157c0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:04.238 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.234+0000 7f15a58676c0 1 --2- 10.20.193.92:0/2506385230 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f157c0b56e0 0x7f157c0d5b90 secure :-1 s=READY pgs=154 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f15900098c0 tx=0x7f15900023a0 comp rx=0 tx=0).stop 2026-02-13T04:01:04.238 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.234+0000 7f15a58676c0 1 -- 10.20.193.92:0/2506385230 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f15a0122770 msgr2=0x7f15a0122c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:04.239 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.234+0000 7f15a58676c0 1 --2- 10.20.193.92:0/2506385230 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f15a0122770 0x7f15a0122c10 secure :-1 s=READY pgs=199 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f159c006fd0 tx=0x7f159c00cc00 comp rx=0 tx=0).stop 2026-02-13T04:01:04.239 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.235+0000 7f15a58676c0 1 -- 10.20.193.92:0/2506385230 shutdown_connections 2026-02-13T04:01:04.239 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.235+0000 7f15a58676c0 1 --2- 10.20.193.92:0/2506385230 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f157c0b56e0 0x7f157c0d5b90 unknown :-1 s=CLOSED pgs=154 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:04.239 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.235+0000 7f15a58676c0 1 --2- 10.20.193.92:0/2506385230 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f15a0115270 0x7f15a011d3b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:04.239 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.235+0000 7f15a58676c0 1 --2- 10.20.193.92:0/2506385230 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f15a0122770 0x7f15a0122c10 unknown :-1 s=CLOSED pgs=199 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:04.239 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.235+0000 7f15a58676c0 1 --2- 10.20.193.92:0/2506385230 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f15a010f060 0x7f15a011ce70 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:04.239 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.235+0000 7f15a58676c0 1 -- 10.20.193.92:0/2506385230 >> 10.20.193.92:0/2506385230 conn(0x7f15a00ec980 msgr2=0x7f15a010cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:04.239 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.235+0000 7f15a58676c0 1 -- 10.20.193.92:0/2506385230 shutdown_connections 2026-02-13T04:01:04.239 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.235+0000 7f15a58676c0 1 -- 10.20.193.92:0/2506385230 wait complete. 2026-02-13T04:01:04.342 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph tell osd.0 flush_pg_stats 2026-02-13T04:01:04.343 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph tell osd.1 flush_pg_stats 2026-02-13T04:01:04.343 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph tell osd.2 flush_pg_stats 2026-02-13T04:01:04.344 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph tell osd.3 flush_pg_stats 2026-02-13T04:01:04.344 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph tell osd.4 flush_pg_stats 2026-02-13T04:01:04.345 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph tell osd.5 flush_pg_stats 2026-02-13T04:01:04.345 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph tell osd.6 flush_pg_stats 2026-02-13T04:01:04.346 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph tell osd.7 flush_pg_stats 2026-02-13T04:01:04.346 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph tell osd.8 flush_pg_stats 2026-02-13T04:01:04.347 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph tell osd.9 flush_pg_stats 2026-02-13T04:01:04.347 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph tell osd.10 flush_pg_stats 2026-02-13T04:01:04.347 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph tell osd.11 flush_pg_stats 2026-02-13T04:01:04.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:04 trial158 ceph-mon[27763]: pgmap v184: 97 pgs: 97 active+clean; 637 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 8.9 KiB/s rd, 11 KiB/s wr, 24 op/s 2026-02-13T04:01:04.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:04 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/3822388363' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T04:01:04.588 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:04.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:04 trial099 ceph-mon[27808]: pgmap v184: 97 pgs: 97 active+clean; 637 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 8.9 KiB/s rd, 11 KiB/s wr, 24 op/s 2026-02-13T04:01:04.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:04 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/3822388363' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T04:01:04.618 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:04.623 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:04.626 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:04.654 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:04.670 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:04.684 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:04.708 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:04.722 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:04.722 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:04.727 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:04.753 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:04.953 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.946+0000 7fe9036ac6c0 1 -- 10.20.193.92:0/2908515005 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe8fc10d7d0 msgr2=0x7fe8fc112810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:04.953 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.946+0000 7fe9036ac6c0 1 --2- 10.20.193.92:0/2908515005 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe8fc10d7d0 0x7fe8fc112810 secure :-1 s=READY pgs=93 gs=2 cs=0 l=1 c_cookie=4485600573800393465 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8e80098a0 tx=0x7fe8e802ec90 comp rx=0 tx=0).stop 2026-02-13T04:01:04.953 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.950+0000 7fe9036ac6c0 1 -- 10.20.193.92:0/2908515005 shutdown_connections 2026-02-13T04:01:04.953 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.950+0000 7fe9036ac6c0 1 --2- 10.20.193.92:0/2908515005 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe8fc10d7d0 0x7fe8fc112810 unknown :-1 s=CLOSED pgs=93 gs=2 cs=0 l=1 c_cookie=4485600573800393465 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:04.953 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.950+0000 7fe9036ac6c0 1 --2- 10.20.193.92:0/2908515005 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe8fc112ff0 0x7fe8fc173990 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:04.955 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.950+0000 7fe9036ac6c0 1 --2- 10.20.193.92:0/2908515005 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe8fc10cde0 0x7fe8fc10d1b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:04.955 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.952+0000 7fe9036ac6c0 1 -- 10.20.193.92:0/2908515005 >> 10.20.193.92:0/2908515005 conn(0x7fe8fc0ea6a0 msgr2=0x7fe8fc10aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:04.955 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.952+0000 7fe9036ac6c0 1 -- 10.20.193.92:0/2908515005 shutdown_connections 2026-02-13T04:01:04.955 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.952+0000 7fe9036ac6c0 1 -- 10.20.193.92:0/2908515005 wait complete. 2026-02-13T04:01:04.959 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.956+0000 7fe9036ac6c0 1 Processor -- start 2026-02-13T04:01:04.959 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.956+0000 7fe9036ac6c0 1 -- start start 2026-02-13T04:01:04.960 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.957+0000 7fe9036ac6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe8fc10cde0 0x7fe8fc060610 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:04.960 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.957+0000 7fe9036ac6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe8fc112ff0 0x7fe8fc060b50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:04.961 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.957+0000 7fe9036ac6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe8fc061090 0x7fe8fc113ac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:04.961 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.957+0000 7fe9036ac6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe8fc062680 con 0x7fe8fc10cde0 2026-02-13T04:01:04.961 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.957+0000 7fe9036ac6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe8fc114000 con 0x7fe8fc061090 2026-02-13T04:01:04.961 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.957+0000 7fe9036ac6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fe8fc1141c0 con 0x7fe8fc112ff0 2026-02-13T04:01:04.961 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.957+0000 7fe9026aa6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe8fc10cde0 0x7fe8fc060610 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:04.961 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.958+0000 7fe9026aa6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe8fc10cde0 0x7fe8fc060610 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:53116/0 (socket says 10.20.193.92:53116) 2026-02-13T04:01:04.962 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.958+0000 7fe9026aa6c0 1 -- 10.20.193.92:0/2947267812 learned_addr learned my addr 10.20.193.92:0/2947267812 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:04.962 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.958+0000 7fe902eab6c0 1 --2- 10.20.193.92:0/2947267812 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe8fc061090 0x7fe8fc113ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:04.962 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.958+0000 7fe901ea96c0 1 --2- 10.20.193.92:0/2947267812 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe8fc112ff0 0x7fe8fc060b50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:04.962 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.958+0000 7fe9026aa6c0 1 -- 10.20.193.92:0/2947267812 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe8fc112ff0 msgr2=0x7fe8fc060b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:04.962 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.958+0000 7fe9026aa6c0 1 --2- 10.20.193.92:0/2947267812 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe8fc112ff0 0x7fe8fc060b50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:04.963 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.958+0000 7fe9026aa6c0 1 -- 10.20.193.92:0/2947267812 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe8fc061090 msgr2=0x7fe8fc113ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:04.963 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.958+0000 7fe9026aa6c0 1 --2- 10.20.193.92:0/2947267812 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe8fc061090 0x7fe8fc113ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:04.963 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.958+0000 7fe9026aa6c0 1 -- 10.20.193.92:0/2947267812 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f000a5b0 con 0x7fe8fc10cde0 2026-02-13T04:01:04.963 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.959+0000 7fe9026aa6c0 1 --2- 10.20.193.92:0/2947267812 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe8fc10cde0 0x7fe8fc060610 secure :-1 s=READY pgs=200 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8f400baa0 tx=0x7fe8f400bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:04.963 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.959+0000 7fe8ef7fe6c0 1 -- 10.20.193.92:0/2947267812 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe8f4004a80 con 0x7fe8fc10cde0 2026-02-13T04:01:04.963 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.959+0000 7fe8ef7fe6c0 1 -- 10.20.193.92:0/2947267812 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fe8f4009030 con 0x7fe8fc10cde0 2026-02-13T04:01:04.963 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.959+0000 7fe8ef7fe6c0 1 -- 10.20.193.92:0/2947267812 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe8f4007440 con 0x7fe8fc10cde0 2026-02-13T04:01:04.963 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.959+0000 7fe9036ac6c0 1 -- 10.20.193.92:0/2947267812 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8e80094c0 con 0x7fe8fc10cde0 2026-02-13T04:01:04.964 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.960+0000 7fe9036ac6c0 1 -- 10.20.193.92:0/2947267812 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8fc1147a0 con 0x7fe8fc10cde0 2026-02-13T04:01:04.965 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.963+0000 7fe8ed7fa6c0 1 -- 10.20.193.92:0/2947267812 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe8fc052a50 con 0x7fe8fc10cde0 2026-02-13T04:01:04.969 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.965+0000 7fe8ef7fe6c0 1 -- 10.20.193.92:0/2947267812 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fe8f4004be0 con 0x7fe8fc10cde0 2026-02-13T04:01:04.969 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.967+0000 7fe8ef7fe6c0 1 --2- 10.20.193.92:0/2947267812 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fe8d80b57e0 0x7fe8d80d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:04.970 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.967+0000 7fe8ef7fe6c0 1 -- 10.20.193.92:0/2947267812 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7fe8f40e3cc0 con 0x7fe8fc10cde0 2026-02-13T04:01:04.971 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.968+0000 7fe901ea96c0 1 --2- 10.20.193.92:0/2947267812 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fe8d80b57e0 0x7fe8d80d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:04.971 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.968+0000 7fe8ef7fe6c0 1 --2- 10.20.193.92:0/2947267812 >> [v2:10.20.193.92:6802/2375200644,v1:10.20.193.92:6803/2375200644] conn(0x7fe8d80dcf50 0x7fe8d80fd360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:04.972 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.969+0000 7fe901ea96c0 1 --2- 10.20.193.92:0/2947267812 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fe8d80b57e0 0x7fe8d80d5c90 secure :-1 s=READY pgs=155 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8e80023e0 tx=0x7fe8e80092d0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:04.972 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.969+0000 7fe8ef7fe6c0 1 -- 10.20.193.92:0/2947267812 --> [v2:10.20.193.92:6802/2375200644,v1:10.20.193.92:6803/2375200644] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe8d80fda10 con 0x7fe8d80dcf50 2026-02-13T04:01:04.972 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.969+0000 7fe8ef7fe6c0 1 -- 10.20.193.92:0/2947267812 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7fe8f40e6280 con 0x7fe8fc10cde0 2026-02-13T04:01:04.974 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.971+0000 7fe902eab6c0 1 --2- 10.20.193.92:0/2947267812 >> [v2:10.20.193.92:6802/2375200644,v1:10.20.193.92:6803/2375200644] conn(0x7fe8d80dcf50 0x7fe8d80fd360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:04.974 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.972+0000 7fe902eab6c0 1 --2- 10.20.193.92:0/2947267812 >> [v2:10.20.193.92:6802/2375200644,v1:10.20.193.92:6803/2375200644] conn(0x7fe8d80dcf50 0x7fe8d80fd360 crc :-1 s=READY pgs=7 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:04.976 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.974+0000 7fe8ef7fe6c0 1 -- 10.20.193.92:0/2947267812 <== osd.0 v2:10.20.193.92:6802/2375200644 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7fe8d80fda10 con 0x7fe8d80dcf50 2026-02-13T04:01:04.988 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.985+0000 7f9c19b196c0 1 -- 10.20.193.92:0/2339696587 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f9c14114000 msgr2=0x7f9c141143d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:04.989 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.985+0000 7f9c127fc6c0 1 -- 10.20.193.92:0/2339696587 <== mon.1 v2:10.20.193.158:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9c0c0054a0 con 0x7f9c14114000 2026-02-13T04:01:04.989 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.985+0000 7f9c19b196c0 1 --2- 10.20.193.92:0/2339696587 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f9c14114000 0x7f9c141143d0 secure :-1 s=READY pgs=90 gs=1 cs=0 l=1 c_cookie=17937791787823767916 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c0c00aa40 tx=0x7f9c0c02fde0 comp rx=0 tx=0).stop 2026-02-13T04:01:04.989 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.985+0000 7f9c19b196c0 1 -- 10.20.193.92:0/2339696587 shutdown_connections 2026-02-13T04:01:04.989 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.985+0000 7f9c19b196c0 1 --2- 10.20.193.92:0/2339696587 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9c14116b30 0x7f9c1417a760 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:04.989 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.985+0000 7f9c19b196c0 1 --2- 10.20.193.92:0/2339696587 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9c141149f0 0x7f9c14116380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:04.989 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.985+0000 7f9c19b196c0 1 --2- 10.20.193.92:0/2339696587 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f9c14114000 0x7f9c141143d0 unknown :-1 s=CLOSED pgs=90 gs=1 cs=0 l=1 c_cookie=17937791787823767916 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:04.989 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.985+0000 7f9c19b196c0 1 -- 10.20.193.92:0/2339696587 >> 10.20.193.92:0/2339696587 conn(0x7f9c140586e0 msgr2=0x7f9c14058ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:04.990 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.986+0000 7f9c19b196c0 1 -- 10.20.193.92:0/2339696587 shutdown_connections 2026-02-13T04:01:04.990 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.986+0000 7f9c19b196c0 1 -- 10.20.193.92:0/2339696587 wait complete. 2026-02-13T04:01:04.992 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.987+0000 7f9c19b196c0 1 Processor -- start 2026-02-13T04:01:04.992 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.987+0000 7f9c19b196c0 1 -- start start 2026-02-13T04:01:04.992 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.987+0000 7f9c19b196c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9c14114000 0x7f9c140ff320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:04.992 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.988+0000 7f9c19b196c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f9c14116b30 0x7f9c1417a6b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:04.992 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.988+0000 7f9c19b196c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9c140ff980 0x7f9c14104c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:04.992 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.988+0000 7f9c19b196c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9c14105160 con 0x7f9c140ff980 2026-02-13T04:01:04.992 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.988+0000 7f9c19b196c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9c141052d0 con 0x7f9c14114000 2026-02-13T04:01:04.992 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.988+0000 7f9c19b196c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f9c14105490 con 0x7f9c14116b30 2026-02-13T04:01:04.992 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.988+0000 7f9c12ffd6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f9c14116b30 0x7f9c1417a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:04.993 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.988+0000 7f9c13fff6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9c140ff980 0x7f9c14104c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:04.993 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.988+0000 7f9c13fff6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9c140ff980 0x7f9c14104c20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:53142/0 (socket says 10.20.193.92:53142) 2026-02-13T04:01:04.993 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.988+0000 7f9c13fff6c0 1 -- 10.20.193.92:0/412185065 learned_addr learned my addr 10.20.193.92:0/412185065 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:04.993 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.989+0000 7f9c13fff6c0 1 -- 10.20.193.92:0/412185065 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f9c14116b30 msgr2=0x7f9c1417a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:04.993 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.989+0000 7f9c13fff6c0 1 --2- 10.20.193.92:0/412185065 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f9c14116b30 0x7f9c1417a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:04.994 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.989+0000 7f9c13fff6c0 1 -- 10.20.193.92:0/412185065 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9c14114000 msgr2=0x7f9c140ff320 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T04:01:04.994 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.989+0000 7f9c13fff6c0 1 --2- 10.20.193.92:0/412185065 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9c14114000 0x7f9c140ff320 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:04.994 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.989+0000 7f9c13fff6c0 1 -- 10.20.193.92:0/412185065 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bfc0071c0 con 0x7f9c140ff980 2026-02-13T04:01:04.994 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.989+0000 7f9c13fff6c0 1 --2- 10.20.193.92:0/412185065 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9c140ff980 0x7f9c14104c20 secure :-1 s=READY pgs=201 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c08005dc0 tx=0x7f9c0800bb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:04.994 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.989+0000 7f9c10ff96c0 1 -- 10.20.193.92:0/412185065 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9c08004250 con 0x7f9c140ff980 2026-02-13T04:01:04.994 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.989+0000 7f9c10ff96c0 1 -- 10.20.193.92:0/412185065 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f9c08009070 con 0x7f9c140ff980 2026-02-13T04:01:04.994 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.990+0000 7f9c10ff96c0 1 -- 10.20.193.92:0/412185065 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9c080071c0 con 0x7f9c140ff980 2026-02-13T04:01:04.994 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.990+0000 7f9c19b196c0 1 -- 10.20.193.92:0/412185065 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c0c00a660 con 0x7f9c140ff980 2026-02-13T04:01:04.995 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.990+0000 7f9c19b196c0 1 -- 10.20.193.92:0/412185065 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c14105a40 con 0x7f9c140ff980 2026-02-13T04:01:04.995 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.993+0000 7f9c10ff96c0 1 -- 10.20.193.92:0/412185065 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f9c080043b0 con 0x7f9c140ff980 2026-02-13T04:01:04.996 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.993+0000 7f9c19b196c0 1 -- 10.20.193.92:0/412185065 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9bd4000fe0 con 0x7f9c140ff980 2026-02-13T04:01:04.997 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.994+0000 7f9c10ff96c0 1 --2- 10.20.193.92:0/412185065 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f9bf80b5660 0x7f9bf80d5b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:04.997 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.994+0000 7f9c10ff96c0 1 -- 10.20.193.92:0/412185065 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7f9c080e3b40 con 0x7f9c140ff980 2026-02-13T04:01:04.998 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.995+0000 7f9c137fe6c0 1 --2- 10.20.193.92:0/412185065 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f9bf80b5660 0x7f9bf80d5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:04.998 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.995+0000 7f9c10ff96c0 1 --2- 10.20.193.92:0/412185065 >> [v2:10.20.193.92:6810/4168983230,v1:10.20.193.92:6811/4168983230] conn(0x7f9bf80dcc60 0x7f9bf80fd070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:04.998 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.995+0000 7f9c10ff96c0 1 -- 10.20.193.92:0/412185065 --> [v2:10.20.193.92:6810/4168983230,v1:10.20.193.92:6811/4168983230] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9bf80fd720 con 0x7f9bf80dcc60 2026-02-13T04:01:04.998 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.995+0000 7f9c10ff96c0 1 -- 10.20.193.92:0/412185065 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f9c080e6200 con 0x7f9c140ff980 2026-02-13T04:01:04.998 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.995+0000 7f9c12ffd6c0 1 --2- 10.20.193.92:0/412185065 >> [v2:10.20.193.92:6810/4168983230,v1:10.20.193.92:6811/4168983230] conn(0x7f9bf80dcc60 0x7f9bf80fd070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.001 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:04.999+0000 7f9c12ffd6c0 1 --2- 10.20.193.92:0/412185065 >> [v2:10.20.193.92:6810/4168983230,v1:10.20.193.92:6811/4168983230] conn(0x7f9bf80dcc60 0x7f9bf80fd070 crc :-1 s=READY pgs=10 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:05.002 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.000+0000 7f9c10ff96c0 1 -- 10.20.193.92:0/412185065 <== osd.3 v2:10.20.193.92:6810/4168983230 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f9bf80fd720 con 0x7f9bf80dcc60 2026-02-13T04:01:05.002 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.000+0000 7f9c137fe6c0 1 --2- 10.20.193.92:0/412185065 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f9bf80b5660 0x7f9bf80d5b10 secure :-1 s=READY pgs=156 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c0c00a990 tx=0x7f9c0c00a200 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:05.003 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.001+0000 7fe8ed7fa6c0 1 -- 10.20.193.92:0/2947267812 --> [v2:10.20.193.92:6802/2375200644,v1:10.20.193.92:6803/2375200644] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe8fc056ad0 con 0x7fe8d80dcf50 2026-02-13T04:01:05.004 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.001+0000 7fe8ef7fe6c0 1 -- 10.20.193.92:0/2947267812 <== osd.0 v2:10.20.193.92:6802/2375200644 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe8f000ab50 con 0x7fe8d80dcf50 2026-02-13T04:01:05.008 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.006+0000 7fe8ed7fa6c0 1 -- 10.20.193.92:0/2947267812 >> [v2:10.20.193.92:6802/2375200644,v1:10.20.193.92:6803/2375200644] conn(0x7fe8d80dcf50 msgr2=0x7fe8d80fd360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.009 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.006+0000 7fe8ed7fa6c0 1 --2- 10.20.193.92:0/2947267812 >> [v2:10.20.193.92:6802/2375200644,v1:10.20.193.92:6803/2375200644] conn(0x7fe8d80dcf50 0x7fe8d80fd360 crc :-1 s=READY pgs=7 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.011 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.009+0000 7fe8ed7fa6c0 1 -- 10.20.193.92:0/2947267812 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fe8d80b57e0 msgr2=0x7fe8d80d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.012 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.009+0000 7fe8ed7fa6c0 1 --2- 10.20.193.92:0/2947267812 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fe8d80b57e0 0x7fe8d80d5c90 secure :-1 s=READY pgs=155 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8e80023e0 tx=0x7fe8e80092d0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.012 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.009+0000 7fe8ed7fa6c0 1 -- 10.20.193.92:0/2947267812 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe8fc10cde0 msgr2=0x7fe8fc060610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.012 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.009+0000 7fe8ed7fa6c0 1 --2- 10.20.193.92:0/2947267812 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe8fc10cde0 0x7fe8fc060610 secure :-1 s=READY pgs=200 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8f400baa0 tx=0x7fe8f400bf70 comp rx=0 tx=0).stop 2026-02-13T04:01:05.012 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.009+0000 7fe902eab6c0 1 -- 10.20.193.92:0/2947267812 reap_dead start 2026-02-13T04:01:05.012 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.009+0000 7fe8ed7fa6c0 1 -- 10.20.193.92:0/2947267812 shutdown_connections 2026-02-13T04:01:05.013 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.009+0000 7fe8ed7fa6c0 1 -- 10.20.193.92:0/2947267812 >> 10.20.193.92:0/2947267812 conn(0x7fe8fc0ea6a0 msgr2=0x7fe8fc10aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:05.013 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.010+0000 7fe8ed7fa6c0 1 -- 10.20.193.92:0/2947267812 shutdown_connections 2026-02-13T04:01:05.013 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.010+0000 7fe8ed7fa6c0 1 -- 10.20.193.92:0/2947267812 wait complete. 2026-02-13T04:01:05.013 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.010+0000 7f462bfff6c0 1 -- 10.20.193.92:0/3199212101 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f462c114000 msgr2=0x7f462c1143d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.014 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.010+0000 7f462bfff6c0 1 --2- 10.20.193.92:0/3199212101 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f462c114000 0x7f462c1143d0 secure :-1 s=READY pgs=91 gs=2 cs=0 l=1 c_cookie=8614056216359230373 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4624006fd0 tx=0x7f462402fd40 comp rx=0 tx=0).stop 2026-02-13T04:01:05.019 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.015+0000 7ff8d54a16c0 1 -- 10.20.193.92:0/2821926436 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff8d01149f0 msgr2=0x7ff8d0116380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.019 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.016+0000 7ff8d54a16c0 1 --2- 10.20.193.92:0/2821926436 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff8d01149f0 0x7ff8d0116380 secure :-1 s=READY pgs=94 gs=3 cs=0 l=1 c_cookie=11007531115839912011 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8b80098a0 tx=0x7ff8b802ec70 comp rx=0 tx=0).stop 2026-02-13T04:01:05.019 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.016+0000 7ff8d54a16c0 1 -- 10.20.193.92:0/2821926436 shutdown_connections 2026-02-13T04:01:05.019 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.016+0000 7ff8d54a16c0 1 --2- 10.20.193.92:0/2821926436 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff8d01149f0 0x7ff8d0116380 unknown :-1 s=CLOSED pgs=94 gs=3 cs=0 l=1 c_cookie=11007531115839912011 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.020 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.016+0000 7ff8d54a16c0 1 --2- 10.20.193.92:0/2821926436 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff8d0116b30 0x7ff8d017a760 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.020 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.016+0000 7ff8d54a16c0 1 --2- 10.20.193.92:0/2821926436 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff8d0114000 0x7ff8d01143d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.020 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.016+0000 7ff8d54a16c0 1 -- 10.20.193.92:0/2821926436 >> 10.20.193.92:0/2821926436 conn(0x7ff8d00586e0 msgr2=0x7ff8d0058ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:05.020 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.016+0000 7ff8d54a16c0 1 -- 10.20.193.92:0/2821926436 shutdown_connections 2026-02-13T04:01:05.020 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.016+0000 7ff8d54a16c0 1 -- 10.20.193.92:0/2821926436 wait complete. 2026-02-13T04:01:05.021 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.017+0000 7fd30b7776c0 1 -- 10.20.193.92:0/448767266 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd3041149c0 msgr2=0x7fd304114ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.021 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.017+0000 7fd30b7776c0 1 --2- 10.20.193.92:0/448767266 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd3041149c0 0x7fd304114ee0 secure :-1 s=READY pgs=92 gs=3 cs=0 l=1 c_cookie=11909157761589387094 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2ec0098a0 tx=0x7fd2ec02ec40 comp rx=0 tx=0).stop 2026-02-13T04:01:05.022 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.017+0000 7fd30b7776c0 1 -- 10.20.193.92:0/448767266 shutdown_connections 2026-02-13T04:01:05.022 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.017+0000 7fd30b7776c0 1 --2- 10.20.193.92:0/448767266 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fd304113dc0 0x7fd304114210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.022 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.017+0000 7fd30b7776c0 1 --2- 10.20.193.92:0/448767266 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd3041149c0 0x7fd304114ee0 unknown :-1 s=CLOSED pgs=92 gs=3 cs=0 l=1 c_cookie=11909157761589387094 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.022 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.017+0000 7fd30b7776c0 1 --2- 10.20.193.92:0/448767266 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd30411b510 0x7fd30411b8e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.022 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.017+0000 7fd30b7776c0 1 -- 10.20.193.92:0/448767266 >> 10.20.193.92:0/448767266 conn(0x7fd304058a50 msgr2=0x7fd304058e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:05.022 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.017+0000 7fd30b7776c0 1 -- 10.20.193.92:0/448767266 shutdown_connections 2026-02-13T04:01:05.022 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.017+0000 7fd30b7776c0 1 -- 10.20.193.92:0/448767266 wait complete. 2026-02-13T04:01:05.022 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.017+0000 7ff8d54a16c0 1 Processor -- start 2026-02-13T04:01:05.023 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.018+0000 7fd30b7776c0 1 Processor -- start 2026-02-13T04:01:05.023 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.018+0000 7ff8d54a16c0 1 -- start start 2026-02-13T04:01:05.023 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.018+0000 7fd30b7776c0 1 -- start start 2026-02-13T04:01:05.025 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.019+0000 7ff8d54a16c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff8d0114000 0x7ff8d00fb120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.025 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.019+0000 7ff8d54a16c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff8d0116b30 0x7ff8d00fb660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.025 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.019+0000 7ff8ceffd6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff8d0114000 0x7ff8d00fb120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.025 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.019+0000 7ff8ceffd6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff8d0114000 0x7ff8d00fb120 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:45510/0 (socket says 10.20.193.92:45510) 2026-02-13T04:01:05.025 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.019+0000 7ff8ceffd6c0 1 -- 10.20.193.92:0/2804586374 learned_addr learned my addr 10.20.193.92:0/2804586374 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:05.025 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.020+0000 7ff8d54a16c0 1 --2- 10.20.193.92:0/2804586374 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff8d0100a20 0x7ff8d0100ec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.026 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.020+0000 7ff8d54a16c0 1 -- 10.20.193.92:0/2804586374 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d0101430 con 0x7ff8d0116b30 2026-02-13T04:01:05.026 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.020+0000 7ff8d54a16c0 1 -- 10.20.193.92:0/2804586374 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d01015a0 con 0x7ff8d0114000 2026-02-13T04:01:05.026 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.020+0000 7ff8d54a16c0 1 -- 10.20.193.92:0/2804586374 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7ff8d0101760 con 0x7ff8d0100a20 2026-02-13T04:01:05.026 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.020+0000 7ff8ce7fc6c0 1 --2- 10.20.193.92:0/2804586374 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff8d0116b30 0x7ff8d00fb660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.026 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.021+0000 7ff8ce7fc6c0 1 -- 10.20.193.92:0/2804586374 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff8d0100a20 msgr2=0x7ff8d0100ec0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T04:01:05.026 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.021+0000 7ff8ce7fc6c0 1 --2- 10.20.193.92:0/2804586374 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff8d0100a20 0x7ff8d0100ec0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.026 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.021+0000 7ff8ce7fc6c0 1 -- 10.20.193.92:0/2804586374 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff8d0114000 msgr2=0x7ff8d00fb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.026 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.021+0000 7ff8ce7fc6c0 1 --2- 10.20.193.92:0/2804586374 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff8d0114000 0x7ff8d00fb120 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.026 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.021+0000 7ff8ce7fc6c0 1 -- 10.20.193.92:0/2804586374 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8c40071c0 con 0x7ff8d0116b30 2026-02-13T04:01:05.026 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.021+0000 7ff8ce7fc6c0 1 --2- 10.20.193.92:0/2804586374 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff8d0116b30 0x7ff8d00fb660 secure :-1 s=READY pgs=202 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8b802f180 tx=0x7ff8b80054c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:05.026 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.022+0000 7ff8affff6c0 1 -- 10.20.193.92:0/2804586374 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8b802fca0 con 0x7ff8d0116b30 2026-02-13T04:01:05.027 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.018+0000 7f462bfff6c0 1 -- 10.20.193.92:0/3199212101 shutdown_connections 2026-02-13T04:01:05.027 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.018+0000 7f462bfff6c0 1 --2- 10.20.193.92:0/3199212101 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f462c114910 0x7f462c1161e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.027 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.018+0000 7f462bfff6c0 1 --2- 10.20.193.92:0/3199212101 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f462c116720 0x7f462c116ba0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.027 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.018+0000 7f462bfff6c0 1 --2- 10.20.193.92:0/3199212101 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f462c114000 0x7f462c1143d0 unknown :-1 s=CLOSED pgs=91 gs=2 cs=0 l=1 c_cookie=8614056216359230373 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.027 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.018+0000 7f462bfff6c0 1 -- 10.20.193.92:0/3199212101 >> 10.20.193.92:0/3199212101 conn(0x7f462c05aaa0 msgr2=0x7f462c05b290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:05.027 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.018+0000 7f462bfff6c0 1 -- 10.20.193.92:0/3199212101 shutdown_connections 2026-02-13T04:01:05.027 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.019+0000 7f462bfff6c0 1 -- 10.20.193.92:0/3199212101 wait complete. 2026-02-13T04:01:05.027 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.020+0000 7f462bfff6c0 1 Processor -- start 2026-02-13T04:01:05.027 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.021+0000 7f462bfff6c0 1 -- start start 2026-02-13T04:01:05.028 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.021+0000 7f462bfff6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f462c114000 0x7f462c1646d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.028 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.021+0000 7f462bfff6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f462c114910 0x7f462c164c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.028 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.021+0000 7f462bfff6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f462c116720 0x7f462c169fd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.028 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.021+0000 7f462bfff6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f462c16a5d0 con 0x7f462c114000 2026-02-13T04:01:05.028 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.021+0000 7f462bfff6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f462c16a740 con 0x7f462c116720 2026-02-13T04:01:05.028 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.021+0000 7f462bfff6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f462c16a900 con 0x7f462c114910 2026-02-13T04:01:05.028 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.021+0000 7f462affd6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f462c114000 0x7f462c1646d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.028 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.022+0000 7f462affd6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f462c114000 0x7f462c1646d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:53172/0 (socket says 10.20.193.92:53172) 2026-02-13T04:01:05.028 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.022+0000 7f462affd6c0 1 -- 10.20.193.92:0/122657672 learned_addr learned my addr 10.20.193.92:0/122657672 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:05.028 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.022+0000 7f462a7fc6c0 1 --2- 10.20.193.92:0/122657672 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f462c114910 0x7f462c164c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.029 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.022+0000 7ff8d54a16c0 1 -- 10.20.193.92:0/2804586374 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8b80094c0 con 0x7ff8d0116b30 2026-02-13T04:01:05.029 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.023+0000 7ff8affff6c0 1 -- 10.20.193.92:0/2804586374 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7ff8b802f860 con 0x7ff8d0116b30 2026-02-13T04:01:05.029 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.023+0000 7ff8affff6c0 1 -- 10.20.193.92:0/2804586374 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff8b802fca0 con 0x7ff8d0116b30 2026-02-13T04:01:05.029 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.023+0000 7ff8d54a16c0 1 -- 10.20.193.92:0/2804586374 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8d016bda0 con 0x7ff8d0116b30 2026-02-13T04:01:05.030 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.022+0000 7f462b7fe6c0 1 --2- 10.20.193.92:0/122657672 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f462c116720 0x7f462c169fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.030 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.023+0000 7f462a7fc6c0 1 -- 10.20.193.92:0/122657672 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f462c116720 msgr2=0x7f462c169fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.030 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.023+0000 7f462a7fc6c0 1 --2- 10.20.193.92:0/122657672 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f462c116720 0x7f462c169fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.030 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.023+0000 7f462a7fc6c0 1 -- 10.20.193.92:0/122657672 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f462c114000 msgr2=0x7f462c1646d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.030 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.023+0000 7f462a7fc6c0 1 --2- 10.20.193.92:0/122657672 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f462c114000 0x7f462c1646d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.030 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.023+0000 7f462a7fc6c0 1 -- 10.20.193.92:0/122657672 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f461c009590 con 0x7f462c114910 2026-02-13T04:01:05.030 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.023+0000 7f462a7fc6c0 1 --2- 10.20.193.92:0/122657672 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f462c114910 0x7f462c164c10 secure :-1 s=READY pgs=93 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f461c004750 tx=0x7f461c00bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:05.030 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.024+0000 7ff8adffb6c0 1 -- 10.20.193.92:0/2804586374 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff8d0052a50 con 0x7ff8d0116b30 2026-02-13T04:01:05.031 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.024+0000 7fd30b7776c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd304113dc0 0x7fd30412b5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.031 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.023+0000 7f460bfff6c0 1 -- 10.20.193.92:0/122657672 <== mon.1 v2:10.20.193.158:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f461c004250 con 0x7f462c114910 2026-02-13T04:01:05.031 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.025+0000 7f460bfff6c0 1 -- 10.20.193.92:0/122657672 <== mon.1 v2:10.20.193.158:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f461c002df0 con 0x7f462c114910 2026-02-13T04:01:05.032 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.025+0000 7f460bfff6c0 1 -- 10.20.193.92:0/122657672 <== mon.1 v2:10.20.193.158:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f461c007440 con 0x7f462c114910 2026-02-13T04:01:05.032 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.025+0000 7f462bfff6c0 1 -- 10.20.193.92:0/122657672 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f462400a5b0 con 0x7f462c114910 2026-02-13T04:01:05.032 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.026+0000 7f462bfff6c0 1 -- 10.20.193.92:0/122657672 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f462c16b140 con 0x7f462c114910 2026-02-13T04:01:05.032 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.025+0000 7fd30b7776c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd3041149c0 0x7fd30412bb20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.032 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.025+0000 7fd30b7776c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fd30411b510 0x7fd304130ee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.033 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.025+0000 7fd30b7776c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd304131530 con 0x7fd304113dc0 2026-02-13T04:01:05.033 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.025+0000 7fd30b7776c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd3041316a0 con 0x7fd30411b510 2026-02-13T04:01:05.033 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.025+0000 7fd30b7776c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fd304131860 con 0x7fd3041149c0 2026-02-13T04:01:05.033 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.025+0000 7fd3094e86c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd304113dc0 0x7fd30412b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.033 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.025+0000 7fd3094e86c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd304113dc0 0x7fd30412b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:53180/0 (socket says 10.20.193.92:53180) 2026-02-13T04:01:05.033 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.025+0000 7fd3094e86c0 1 -- 10.20.193.92:0/2802156147 learned_addr learned my addr 10.20.193.92:0/2802156147 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:05.033 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.025+0000 7fd309ce96c0 1 --2- 10.20.193.92:0/2802156147 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fd30411b510 0x7fd304130ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.033 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.025+0000 7fd308ce76c0 1 --2- 10.20.193.92:0/2802156147 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd3041149c0 0x7fd30412bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.033 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.025+0000 7fd3094e86c0 1 -- 10.20.193.92:0/2802156147 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd3041149c0 msgr2=0x7fd30412bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.033 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.025+0000 7fd3094e86c0 1 --2- 10.20.193.92:0/2802156147 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd3041149c0 0x7fd30412bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.033 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.025+0000 7fd3094e86c0 1 -- 10.20.193.92:0/2802156147 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fd30411b510 msgr2=0x7fd304130ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.034 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.025+0000 7fd3094e86c0 1 --2- 10.20.193.92:0/2802156147 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fd30411b510 0x7fd304130ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.034 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.025+0000 7fd3094e86c0 1 -- 10.20.193.92:0/2802156147 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd30000a660 con 0x7fd304113dc0 2026-02-13T04:01:05.034 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.026+0000 7fd3094e86c0 1 --2- 10.20.193.92:0/2802156147 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd304113dc0 0x7fd30412b5e0 secure :-1 s=READY pgs=203 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd300006df0 tx=0x7fd30000cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:05.034 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.026+0000 7fd2fa7fc6c0 1 -- 10.20.193.92:0/2802156147 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd300003c40 con 0x7fd304113dc0 2026-02-13T04:01:05.034 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.026+0000 7fd30b7776c0 1 -- 10.20.193.92:0/2802156147 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2ec0094c0 con 0x7fd304113dc0 2026-02-13T04:01:05.034 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.026+0000 7fd30b7776c0 1 -- 10.20.193.92:0/2802156147 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd304172070 con 0x7fd304113dc0 2026-02-13T04:01:05.034 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.026+0000 7fd2fa7fc6c0 1 -- 10.20.193.92:0/2802156147 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fd30000a070 con 0x7fd304113dc0 2026-02-13T04:01:05.034 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.026+0000 7fd2fa7fc6c0 1 -- 10.20.193.92:0/2802156147 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd300003c40 con 0x7fd304113dc0 2026-02-13T04:01:05.034 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.029+0000 7f1d58f2b6c0 1 -- 10.20.193.92:0/2517654507 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1d54114190 msgr2=0x7f1d54119140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.035 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.028+0000 7f460bfff6c0 1 -- 10.20.193.92:0/122657672 <== mon.1 v2:10.20.193.158:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f461c0075d0 con 0x7f462c114910 2026-02-13T04:01:05.035 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.029+0000 7f460bfff6c0 1 --2- 10.20.193.92:0/122657672 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f46040b58b0 0x7f46040d5d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.035 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.030+0000 7f460bfff6c0 1 -- 10.20.193.92:0/122657672 <== mon.1 v2:10.20.193.158:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7f461c0e3cf0 con 0x7f462c114910 2026-02-13T04:01:05.036 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.029+0000 7f1d58f2b6c0 1 --2- 10.20.193.92:0/2517654507 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1d54114190 0x7f1d54119140 secure :-1 s=READY pgs=204 gs=1 cs=0 l=1 c_cookie=10264462191759278391 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d4800aa40 tx=0x7f1d4802fe30 comp rx=0 tx=0).stop 2026-02-13T04:01:05.036 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.029+0000 7f1d515736c0 1 -- 10.20.193.92:0/2517654507 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1d48008440 con 0x7f1d54114190 2026-02-13T04:01:05.036 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.030+0000 7f1d58f2b6c0 1 -- 10.20.193.92:0/2517654507 shutdown_connections 2026-02-13T04:01:05.036 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.030+0000 7f1d58f2b6c0 1 --2- 10.20.193.92:0/2517654507 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1d541198f0 0x7f1d5417a2c0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.036 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.030+0000 7f1d58f2b6c0 1 --2- 10.20.193.92:0/2517654507 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1d54114190 0x7f1d54119140 unknown :-1 s=CLOSED pgs=204 gs=1 cs=0 l=1 c_cookie=10264462191759278391 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.037 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.030+0000 7f1d58f2b6c0 1 --2- 10.20.193.92:0/2517654507 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1d541137a0 0x7f1d54113b70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.037 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.031+0000 7f1d58f2b6c0 1 -- 10.20.193.92:0/2517654507 >> 10.20.193.92:0/2517654507 conn(0x7f1d54060760 msgr2=0x7f1d54060d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:05.037 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.031+0000 7f1d58f2b6c0 1 -- 10.20.193.92:0/2517654507 shutdown_connections 2026-02-13T04:01:05.037 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.031+0000 7f1d58f2b6c0 1 -- 10.20.193.92:0/2517654507 wait complete. 2026-02-13T04:01:05.037 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.030+0000 7fd2fa7fc6c0 1 -- 10.20.193.92:0/2802156147 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fd300005030 con 0x7fd304113dc0 2026-02-13T04:01:05.037 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.031+0000 7fd30b7776c0 1 -- 10.20.193.92:0/2802156147 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd304052a50 con 0x7fd304113dc0 2026-02-13T04:01:05.037 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.031+0000 7fd2fa7fc6c0 1 --2- 10.20.193.92:0/2802156147 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fd2dc0b5840 0x7fd2dc0d5cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.038 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.031+0000 7fd2fa7fc6c0 1 -- 10.20.193.92:0/2802156147 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7fd3000e4ab0 con 0x7fd304113dc0 2026-02-13T04:01:05.038 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.031+0000 7fd2fa7fc6c0 1 --2- 10.20.193.92:0/2802156147 >> [v2:10.20.193.158:6824/2019612524,v1:10.20.193.158:6825/2019612524] conn(0x7fd2dc0dcfb0 0x7fd2dc0fd3c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.038 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.031+0000 7fd2fa7fc6c0 1 -- 10.20.193.92:0/2802156147 --> [v2:10.20.193.158:6824/2019612524,v1:10.20.193.158:6825/2019612524] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd2dc0fda70 con 0x7fd2dc0dcfb0 2026-02-13T04:01:05.038 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.032+0000 7fd2fa7fc6c0 1 -- 10.20.193.92:0/2802156147 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7fd3000a7400 con 0x7fd304113dc0 2026-02-13T04:01:05.038 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.032+0000 7f462bfff6c0 1 --2- 10.20.193.92:0/122657672 >> [v2:10.20.193.158:6808/428074602,v1:10.20.193.158:6809/428074602] conn(0x7f45f8001600 0x7f45f8021ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.039 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.032+0000 7fd309ce96c0 1 --2- 10.20.193.92:0/2802156147 >> [v2:10.20.193.158:6824/2019612524,v1:10.20.193.158:6825/2019612524] conn(0x7fd2dc0dcfb0 0x7fd2dc0fd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.039 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.032+0000 7fd308ce76c0 1 --2- 10.20.193.92:0/2802156147 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fd2dc0b5840 0x7fd2dc0d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.039 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.032+0000 7f462bfff6c0 1 -- 10.20.193.92:0/122657672 --> [v2:10.20.193.158:6808/428074602,v1:10.20.193.158:6809/428074602] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f45f8024c10 con 0x7f45f8001600 2026-02-13T04:01:05.039 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.031+0000 7ff8affff6c0 1 -- 10.20.193.92:0/2804586374 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7ff8b80028c0 con 0x7ff8d0116b30 2026-02-13T04:01:05.040 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.032+0000 7f462b7fe6c0 1 --2- 10.20.193.92:0/122657672 >> [v2:10.20.193.158:6808/428074602,v1:10.20.193.158:6809/428074602] conn(0x7f45f8001600 0x7f45f8021ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.040 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.032+0000 7fd308ce76c0 1 --2- 10.20.193.92:0/2802156147 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fd2dc0b5840 0x7fd2dc0d5cf0 secure :-1 s=READY pgs=157 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd304131f70 tx=0x7fd2f4009390 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:05.040 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.032+0000 7f462b7fe6c0 1 --2- 10.20.193.92:0/122657672 >> [v2:10.20.193.158:6808/428074602,v1:10.20.193.158:6809/428074602] conn(0x7f45f8001600 0x7f45f8021ab0 crc :-1 s=READY pgs=14 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:05.041 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.033+0000 7fd309ce96c0 1 --2- 10.20.193.92:0/2802156147 >> [v2:10.20.193.158:6824/2019612524,v1:10.20.193.158:6825/2019612524] conn(0x7fd2dc0dcfb0 0x7fd2dc0fd3c0 crc :-1 s=READY pgs=7 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:05.041 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.033+0000 7f1d58f2b6c0 1 Processor -- start 2026-02-13T04:01:05.041 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.033+0000 7f1d58f2b6c0 1 -- start start 2026-02-13T04:01:05.041 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.033+0000 7f462affd6c0 1 --2- 10.20.193.92:0/122657672 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f46040b58b0 0x7f46040d5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.042 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.033+0000 7f460bfff6c0 1 -- 10.20.193.92:0/122657672 <== osd.5 v2:10.20.193.158:6808/428074602 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f45f8024c10 con 0x7f45f8001600 2026-02-13T04:01:05.042 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.033+0000 7f462affd6c0 1 --2- 10.20.193.92:0/122657672 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f46040b58b0 0x7f46040d5d60 secure :-1 s=READY pgs=158 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4624030250 tx=0x7f462400a510 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:05.042 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.034+0000 7f1d58f2b6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1d541137a0 0x7f1d5411a200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.042 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.034+0000 7f1d58f2b6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1d541198f0 0x7f1d5411a740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.042 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.034+0000 7fd2fa7fc6c0 1 -- 10.20.193.92:0/2802156147 <== osd.11 v2:10.20.193.158:6824/2019612524 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7fd2dc0fda70 con 0x7fd2dc0dcfb0 2026-02-13T04:01:05.044 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.035+0000 7f1d58f2b6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1d5411ac80 0x7f1d5415f270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.044 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.035+0000 7f1d58f2b6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5415f870 con 0x7f1d5411ac80 2026-02-13T04:01:05.044 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.035+0000 7f1d58f2b6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5415f9e0 con 0x7f1d541137a0 2026-02-13T04:01:05.044 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.035+0000 7f1d525756c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1d541137a0 0x7f1d5411a200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.045 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.035+0000 7f1d525756c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1d541137a0 0x7f1d5411a200 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:45544/0 (socket says 10.20.193.92:45544) 2026-02-13T04:01:05.045 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.035+0000 7f1d525756c0 1 -- 10.20.193.92:0/3491494869 learned_addr learned my addr 10.20.193.92:0/3491494869 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:05.045 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.036+0000 7f1d58f2b6c0 1 -- 10.20.193.92:0/3491494869 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f1d5415fba0 con 0x7f1d541198f0 2026-02-13T04:01:05.045 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.035+0000 7f1d51d746c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1d541198f0 0x7f1d5411a740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.045 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.036+0000 7f1d52d766c0 1 --2- 10.20.193.92:0/3491494869 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1d5411ac80 0x7f1d5415f270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.045 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.037+0000 7f1d51d746c0 1 -- 10.20.193.92:0/3491494869 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1d541137a0 msgr2=0x7f1d5411a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.045 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.037+0000 7f1d51d746c0 1 --2- 10.20.193.92:0/3491494869 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1d541137a0 0x7f1d5411a200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.045 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.037+0000 7f1d51d746c0 1 -- 10.20.193.92:0/3491494869 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1d5411ac80 msgr2=0x7f1d5415f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.045 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.037+0000 7f1d51d746c0 1 --2- 10.20.193.92:0/3491494869 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1d5411ac80 0x7f1d5415f270 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.045 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.038+0000 7f1d51d746c0 1 -- 10.20.193.92:0/3491494869 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d4800a660 con 0x7f1d541198f0 2026-02-13T04:01:05.045 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.038+0000 7f1d52d766c0 1 --2- 10.20.193.92:0/3491494869 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1d5411ac80 0x7f1d5415f270 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T04:01:05.045 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.039+0000 7f1d51d746c0 1 --2- 10.20.193.92:0/3491494869 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1d541198f0 0x7f1d5411a740 secure :-1 s=READY pgs=94 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d4800a990 tx=0x7f1d480064c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:05.045 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.040+0000 7f1d3b7fe6c0 1 -- 10.20.193.92:0/3491494869 <== mon.1 v2:10.20.193.158:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1d48003810 con 0x7f1d541198f0 2026-02-13T04:01:05.045 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.041+0000 7f1d3b7fe6c0 1 -- 10.20.193.92:0/3491494869 <== mon.1 v2:10.20.193.158:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f1d480086b0 con 0x7f1d541198f0 2026-02-13T04:01:05.045 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.041+0000 7f1d3b7fe6c0 1 -- 10.20.193.92:0/3491494869 <== mon.1 v2:10.20.193.158:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1d48032390 con 0x7f1d541198f0 2026-02-13T04:01:05.046 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.041+0000 7f1d58f2b6c0 1 -- 10.20.193.92:0/3491494869 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d5415fe20 con 0x7f1d541198f0 2026-02-13T04:01:05.046 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.041+0000 7f1d58f2b6c0 1 -- 10.20.193.92:0/3491494869 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d54160250 con 0x7f1d541198f0 2026-02-13T04:01:05.046 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.041+0000 7f462bfff6c0 1 -- 10.20.193.92:0/122657672 --> [v2:10.20.193.158:6808/428074602,v1:10.20.193.158:6809/428074602] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f45f8023d00 con 0x7f45f8001600 2026-02-13T04:01:05.046 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.042+0000 7f460bfff6c0 1 -- 10.20.193.92:0/122657672 <== osd.5 v2:10.20.193.158:6808/428074602 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f45f8023d00 con 0x7f45f8001600 2026-02-13T04:01:05.047 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.043+0000 7f462bfff6c0 1 -- 10.20.193.92:0/122657672 >> [v2:10.20.193.158:6808/428074602,v1:10.20.193.158:6809/428074602] conn(0x7f45f8001600 msgr2=0x7f45f8021ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.047 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.043+0000 7f462bfff6c0 1 --2- 10.20.193.92:0/122657672 >> [v2:10.20.193.158:6808/428074602,v1:10.20.193.158:6809/428074602] conn(0x7f45f8001600 0x7f45f8021ab0 crc :-1 s=READY pgs=14 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.047 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.043+0000 7f462bfff6c0 1 -- 10.20.193.92:0/122657672 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f46040b58b0 msgr2=0x7f46040d5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.047 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.043+0000 7f462bfff6c0 1 --2- 10.20.193.92:0/122657672 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f46040b58b0 0x7f46040d5d60 secure :-1 s=READY pgs=158 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4624030250 tx=0x7f462400a510 comp rx=0 tx=0).stop 2026-02-13T04:01:05.047 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.043+0000 7f462bfff6c0 1 -- 10.20.193.92:0/122657672 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f462c114910 msgr2=0x7f462c164c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.047 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.043+0000 7f462bfff6c0 1 --2- 10.20.193.92:0/122657672 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f462c114910 0x7f462c164c10 secure :-1 s=READY pgs=93 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f461c004750 tx=0x7f461c00bed0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.047 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.043+0000 7f462b7fe6c0 1 -- 10.20.193.92:0/122657672 reap_dead start 2026-02-13T04:01:05.047 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.044+0000 7f462bfff6c0 1 -- 10.20.193.92:0/122657672 shutdown_connections 2026-02-13T04:01:05.048 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.044+0000 7f462bfff6c0 1 -- 10.20.193.92:0/122657672 >> 10.20.193.92:0/122657672 conn(0x7f462c05aaa0 msgr2=0x7f462c1196f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:05.048 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.044+0000 7f462bfff6c0 1 -- 10.20.193.92:0/122657672 shutdown_connections 2026-02-13T04:01:05.048 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.044+0000 7f462bfff6c0 1 -- 10.20.193.92:0/122657672 wait complete. 2026-02-13T04:01:05.050 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.043+0000 7ff8affff6c0 1 --2- 10.20.193.92:0/2804586374 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff8a80b5840 0x7ff8a80d5cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.051 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.043+0000 7ff8affff6c0 1 -- 10.20.193.92:0/2804586374 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7ff8b8107980 con 0x7ff8d0116b30 2026-02-13T04:01:05.051 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.043+0000 7ff8affff6c0 1 --2- 10.20.193.92:0/2804586374 >> [v2:10.20.193.158:6816/1505536261,v1:10.20.193.158:6817/1505536261] conn(0x7ff8a80dcfb0 0x7ff8a80fd3c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.051 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.043+0000 7ff8affff6c0 1 -- 10.20.193.92:0/2804586374 --> [v2:10.20.193.158:6816/1505536261,v1:10.20.193.158:6817/1505536261] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff8a80fda70 con 0x7ff8a80dcfb0 2026-02-13T04:01:05.051 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.043+0000 7ff8affff6c0 1 -- 10.20.193.92:0/2804586374 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7ff8b8107cb0 con 0x7ff8d0116b30 2026-02-13T04:01:05.051 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.043+0000 7ff8cf7fe6c0 1 --2- 10.20.193.92:0/2804586374 >> [v2:10.20.193.158:6816/1505536261,v1:10.20.193.158:6817/1505536261] conn(0x7ff8a80dcfb0 0x7ff8a80fd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.051 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.044+0000 7ff8cf7fe6c0 1 --2- 10.20.193.92:0/2804586374 >> [v2:10.20.193.158:6816/1505536261,v1:10.20.193.158:6817/1505536261] conn(0x7ff8a80dcfb0 0x7ff8a80fd3c0 crc :-1 s=READY pgs=16 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:05.051 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.045+0000 7ff8ceffd6c0 1 --2- 10.20.193.92:0/2804586374 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff8a80b5840 0x7ff8a80d5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.052 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.045+0000 7ff8ceffd6c0 1 --2- 10.20.193.92:0/2804586374 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff8a80b5840 0x7ff8a80d5cf0 secure :-1 s=READY pgs=159 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8c0006ea0 tx=0x7ff8c000a310 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:05.061 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.058+0000 7ff8affff6c0 1 -- 10.20.193.92:0/2804586374 <== osd.8 v2:10.20.193.158:6816/1505536261 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7ff8a80fda70 con 0x7ff8a80dcfb0 2026-02-13T04:01:05.061 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.046+0000 7f1d3b7fe6c0 1 -- 10.20.193.92:0/3491494869 <== mon.1 v2:10.20.193.158:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f1d48003970 con 0x7f1d541198f0 2026-02-13T04:01:05.061 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.048+0000 7f1d3b7fe6c0 1 --2- 10.20.193.92:0/3491494869 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f1d2c0b5830 0x7f1d2c0d5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.061 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.049+0000 7f1d525756c0 1 --2- 10.20.193.92:0/3491494869 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f1d2c0b5830 0x7f1d2c0d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.062 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.049+0000 7f1d525756c0 1 --2- 10.20.193.92:0/3491494869 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f1d2c0b5830 0x7f1d2c0d5ce0 secure :-1 s=READY pgs=160 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d44009260 tx=0x7f1d44009440 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:05.062 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.050+0000 7f1d58f2b6c0 1 -- 10.20.193.92:0/3491494869 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1d54052a50 con 0x7f1d541198f0 2026-02-13T04:01:05.062 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.058+0000 7fc4c50436c0 1 -- 10.20.193.92:0/1384806667 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc4b80bd050 msgr2=0x7fc4b811d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.062 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.058+0000 7fc4c50436c0 1 --2- 10.20.193.92:0/1384806667 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc4b80bd050 0x7fc4b811d9f0 secure :-1 s=READY pgs=207 gs=2 cs=0 l=1 c_cookie=17196219778933981976 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4b000ac10 tx=0x7fc4b002ff90 comp rx=0 tx=0).stop 2026-02-13T04:01:05.062 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.041+0000 7feb99bd36c0 1 -- 10.20.193.92:0/2193016978 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7feb8c0c4e20 msgr2=0x7feb8c0c6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.062 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.041+0000 7feb99bd36c0 1 --2- 10.20.193.92:0/2193016978 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7feb8c0c4e20 0x7feb8c0c6950 secure :-1 s=READY pgs=205 gs=2 cs=0 l=1 c_cookie=2638651813554021708 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb94050640 tx=0x7feb9407f630 comp rx=0 tx=0).stop 2026-02-13T04:01:05.062 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.041+0000 7feb99bd36c0 1 -- 10.20.193.92:0/2193016978 shutdown_connections 2026-02-13T04:01:05.063 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.041+0000 7feb99bd36c0 1 --2- 10.20.193.92:0/2193016978 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7feb8c0c7130 0x7feb8c12ad10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.063 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.041+0000 7feb99bd36c0 1 --2- 10.20.193.92:0/2193016978 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7feb8c0c4e20 0x7feb8c0c6950 unknown :-1 s=CLOSED pgs=205 gs=2 cs=0 l=1 c_cookie=2638651813554021708 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.063 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.041+0000 7feb99bd36c0 1 --2- 10.20.193.92:0/2193016978 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7feb8c0c4430 0x7feb8c0c4800 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.063 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.041+0000 7feb99bd36c0 1 -- 10.20.193.92:0/2193016978 >> 10.20.193.92:0/2193016978 conn(0x7feb8c01c510 msgr2=0x7feb8c01cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:05.063 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.041+0000 7feb99bd36c0 1 -- 10.20.193.92:0/2193016978 shutdown_connections 2026-02-13T04:01:05.063 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.041+0000 7feb99bd36c0 1 -- 10.20.193.92:0/2193016978 wait complete. 2026-02-13T04:01:05.063 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.042+0000 7feb99bd36c0 1 Processor -- start 2026-02-13T04:01:05.063 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.042+0000 7feb99bd36c0 1 -- start start 2026-02-13T04:01:05.063 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.043+0000 7feb99bd36c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7feb8c0c4430 0x7feb8c0d1d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.063 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.043+0000 7feb99bd36c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7feb8c0c7130 0x7feb8c0d22c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.063 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.043+0000 7feb99bd36c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7feb8c0d2800 0x7feb8c11c460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.063 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.043+0000 7feb99bd36c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c11c9a0 con 0x7feb8c0c4430 2026-02-13T04:01:05.063 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.043+0000 7feb99bd36c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c11cb10 con 0x7feb8c0c7130 2026-02-13T04:01:05.063 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.043+0000 7feb99bd36c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c11ccd0 con 0x7feb8c0d2800 2026-02-13T04:01:05.064 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.043+0000 7feb927fc6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7feb8c0c7130 0x7feb8c0d22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.064 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.043+0000 7feb92ffd6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7feb8c0c4430 0x7feb8c0d1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.064 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.044+0000 7feb927fc6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7feb8c0c7130 0x7feb8c0d22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:45564/0 (socket says 10.20.193.92:45564) 2026-02-13T04:01:05.064 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.043+0000 7feb937fe6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7feb8c0d2800 0x7feb8c11c460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.064 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.044+0000 7feb937fe6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7feb8c0d2800 0x7feb8c11c460 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:51796/0 (socket says 10.20.193.92:51796) 2026-02-13T04:01:05.064 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.044+0000 7feb937fe6c0 1 -- 10.20.193.92:0/2091761026 learned_addr learned my addr 10.20.193.92:0/2091761026 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:05.064 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.044+0000 7feb92ffd6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7feb8c0c4430 0x7feb8c0d1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:53196/0 (socket says 10.20.193.92:53196) 2026-02-13T04:01:05.064 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.044+0000 7feb92ffd6c0 1 -- 10.20.193.92:0/2091761026 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7feb8c0d2800 msgr2=0x7feb8c11c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.064 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.044+0000 7feb92ffd6c0 1 --2- 10.20.193.92:0/2091761026 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7feb8c0d2800 0x7feb8c11c460 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.064 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.044+0000 7feb92ffd6c0 1 -- 10.20.193.92:0/2091761026 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7feb8c0c7130 msgr2=0x7feb8c0d22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.064 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.044+0000 7feb92ffd6c0 1 --2- 10.20.193.92:0/2091761026 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7feb8c0c7130 0x7feb8c0d22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.064 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.044+0000 7feb92ffd6c0 1 -- 10.20.193.92:0/2091761026 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb84009590 con 0x7feb8c0c4430 2026-02-13T04:01:05.064 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.044+0000 7feb92ffd6c0 1 --2- 10.20.193.92:0/2091761026 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7feb8c0c4430 0x7feb8c0d1d80 secure :-1 s=READY pgs=206 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb84004750 tx=0x7feb8400c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:05.064 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.045+0000 7feb90ff96c0 1 -- 10.20.193.92:0/2091761026 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb84004350 con 0x7feb8c0c4430 2026-02-13T04:01:05.064 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.045+0000 7feb90ff96c0 1 -- 10.20.193.92:0/2091761026 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7feb84009030 con 0x7feb8c0c4430 2026-02-13T04:01:05.065 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.045+0000 7feb90ff96c0 1 -- 10.20.193.92:0/2091761026 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb84007440 con 0x7feb8c0c4430 2026-02-13T04:01:05.065 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.045+0000 7feb99bd36c0 1 -- 10.20.193.92:0/2091761026 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb9404beb0 con 0x7feb8c0c4430 2026-02-13T04:01:05.065 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.046+0000 7feb99bd36c0 1 -- 10.20.193.92:0/2091761026 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb8c11d280 con 0x7feb8c0c4430 2026-02-13T04:01:05.065 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.058+0000 7f1d3b7fe6c0 1 -- 10.20.193.92:0/3491494869 <== mon.1 v2:10.20.193.158:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7f1d480cfed0 con 0x7f1d541198f0 2026-02-13T04:01:05.065 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.058+0000 7f1d3b7fe6c0 1 --2- 10.20.193.92:0/3491494869 >> [v2:10.20.193.99:6824/4260536068,v1:10.20.193.99:6825/4260536068] conn(0x7f1d2c0dcfa0 0x7f1d2c0fd3b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.065 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.048+0000 7feb6e7fc6c0 1 -- 10.20.193.92:0/2091761026 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7feb5c000fe0 con 0x7feb8c0c4430 2026-02-13T04:01:05.065 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.049+0000 7feb90ff96c0 1 -- 10.20.193.92:0/2091761026 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7feb840026b0 con 0x7feb8c0c4430 2026-02-13T04:01:05.066 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.050+0000 7feb90ff96c0 1 --2- 10.20.193.92:0/2091761026 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7feb680b5630 0x7feb680d5ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.066 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.050+0000 7feb90ff96c0 1 -- 10.20.193.92:0/2091761026 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7feb840e3ca0 con 0x7feb8c0c4430 2026-02-13T04:01:05.066 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.051+0000 7feb90ff96c0 1 --2- 10.20.193.92:0/2091761026 >> [v2:10.20.193.158:6800/676925869,v1:10.20.193.158:6801/676925869] conn(0x7feb680dcc30 0x7feb680fd040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.066 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.051+0000 7feb90ff96c0 1 -- 10.20.193.92:0/2091761026 --> [v2:10.20.193.158:6800/676925869,v1:10.20.193.158:6801/676925869] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feb680fd6f0 con 0x7feb680dcc30 2026-02-13T04:01:05.066 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.051+0000 7feb90ff96c0 1 -- 10.20.193.92:0/2091761026 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7feb840e6330 con 0x7feb8c0c4430 2026-02-13T04:01:05.066 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.051+0000 7feb937fe6c0 1 --2- 10.20.193.92:0/2091761026 >> [v2:10.20.193.158:6800/676925869,v1:10.20.193.158:6801/676925869] conn(0x7feb680dcc30 0x7feb680fd040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.066 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.052+0000 7feb927fc6c0 1 --2- 10.20.193.92:0/2091761026 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7feb680b5630 0x7feb680d5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.066 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.052+0000 7feb927fc6c0 1 --2- 10.20.193.92:0/2091761026 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7feb680b5630 0x7feb680d5ae0 secure :-1 s=READY pgs=161 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb9407fb40 tx=0x7feb94054020 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:05.066 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.052+0000 7feb937fe6c0 1 --2- 10.20.193.92:0/2091761026 >> [v2:10.20.193.158:6800/676925869,v1:10.20.193.158:6801/676925869] conn(0x7feb680dcc30 0x7feb680fd040 crc :-1 s=READY pgs=16 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:05.066 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.053+0000 7feb90ff96c0 1 -- 10.20.193.92:0/2091761026 <== osd.2 v2:10.20.193.158:6800/676925869 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7feb680fd6f0 con 0x7feb680dcc30 2026-02-13T04:01:05.066 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.059+0000 7fc4c50436c0 1 -- 10.20.193.92:0/1384806667 shutdown_connections 2026-02-13T04:01:05.067 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.059+0000 7f1d3b7fe6c0 1 -- 10.20.193.92:0/3491494869 --> [v2:10.20.193.99:6824/4260536068,v1:10.20.193.99:6825/4260536068] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1d2c0fda60 con 0x7f1d2c0dcfa0 2026-02-13T04:01:05.067 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.059+0000 7fc4c50436c0 1 --2- 10.20.193.92:0/1384806667 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc4b80bd050 0x7fc4b811d9f0 unknown :-1 s=CLOSED pgs=207 gs=2 cs=0 l=1 c_cookie=17196219778933981976 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.067 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.059+0000 7fc4c50436c0 1 --2- 10.20.193.92:0/1384806667 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fc4b80b7830 0x7fc4b80bc870 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.067 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.059+0000 7f1d3b7fe6c0 1 -- 10.20.193.92:0/3491494869 <== mon.1 v2:10.20.193.158:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f1d480cbb20 con 0x7f1d541198f0 2026-02-13T04:01:05.068 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.059+0000 7fc4c50436c0 1 --2- 10.20.193.92:0/1384806667 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fc4b80b6e40 0x7fc4b80b7210 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.068 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.059+0000 7fc4c50436c0 1 -- 10.20.193.92:0/1384806667 >> 10.20.193.92:0/1384806667 conn(0x7fc4b80946c0 msgr2=0x7fc4b80b4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:05.068 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.059+0000 7f1d52d766c0 1 --2- 10.20.193.92:0/3491494869 >> [v2:10.20.193.99:6824/4260536068,v1:10.20.193.99:6825/4260536068] conn(0x7f1d2c0dcfa0 0x7f1d2c0fd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.068 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.059+0000 7fc4c50436c0 1 -- 10.20.193.92:0/1384806667 shutdown_connections 2026-02-13T04:01:05.068 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.059+0000 7fc4c50436c0 1 -- 10.20.193.92:0/1384806667 wait complete. 2026-02-13T04:01:05.069 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.060+0000 7f1d52d766c0 1 --2- 10.20.193.92:0/3491494869 >> [v2:10.20.193.99:6824/4260536068,v1:10.20.193.99:6825/4260536068] conn(0x7f1d2c0dcfa0 0x7f1d2c0fd3b0 crc :-1 s=READY pgs=15 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:05.069 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.060+0000 7fc4c50436c0 1 Processor -- start 2026-02-13T04:01:05.069 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.061+0000 7f1d3b7fe6c0 1 -- 10.20.193.92:0/3491494869 <== osd.10 v2:10.20.193.99:6824/4260536068 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f1d2c0fda60 con 0x7f1d2c0dcfa0 2026-02-13T04:01:05.070 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.061+0000 7fc4c50436c0 1 -- start start 2026-02-13T04:01:05.070 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.061+0000 7fc4c50436c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fc4b80b6e40 0x7fc4b800cd10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.070 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.062+0000 7fc4c50436c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fc4b80bd050 0x7fc4b8008f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.070 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.062+0000 7fc4c50436c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc4b8009550 0x7fc4b80099f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.070 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.063+0000 7fc4c50436c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b810f500 con 0x7fc4b8009550 2026-02-13T04:01:05.070 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.063+0000 7fc4c50436c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b810f670 con 0x7fc4b80bd050 2026-02-13T04:01:05.070 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.063+0000 7fc4c50436c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b810f830 con 0x7fc4b80b6e40 2026-02-13T04:01:05.070 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.062+0000 7fc4be5756c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fc4b80bd050 0x7fc4b8008f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.070 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.063+0000 7fc4bf5776c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc4b8009550 0x7fc4b80099f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.070 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.063+0000 7fc4be5756c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fc4b80bd050 0x7fc4b8008f70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:45594/0 (socket says 10.20.193.92:45594) 2026-02-13T04:01:05.071 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.063+0000 7fc4be5756c0 1 -- 10.20.193.92:0/1137198087 learned_addr learned my addr 10.20.193.92:0/1137198087 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:05.071 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.062+0000 7fc4bed766c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fc4b80b6e40 0x7fc4b800cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.071 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.063+0000 7fc4bf5776c0 1 -- 10.20.193.92:0/1137198087 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fc4b80b6e40 msgr2=0x7fc4b800cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.071 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.063+0000 7fc4bf5776c0 1 --2- 10.20.193.92:0/1137198087 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fc4b80b6e40 0x7fc4b800cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.071 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.063+0000 7fc4bf5776c0 1 -- 10.20.193.92:0/1137198087 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fc4b80bd050 msgr2=0x7fc4b8008f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.071 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.063+0000 7fc4bf5776c0 1 --2- 10.20.193.92:0/1137198087 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fc4b80bd050 0x7fc4b8008f70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.071 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.063+0000 7fc4bf5776c0 1 -- 10.20.193.92:0/1137198087 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b000a5b0 con 0x7fc4b8009550 2026-02-13T04:01:05.071 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.063+0000 7fc4bed766c0 1 --2- 10.20.193.92:0/1137198087 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fc4b80b6e40 0x7fc4b800cd10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T04:01:05.071 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.064+0000 7fc4be5756c0 1 --2- 10.20.193.92:0/1137198087 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fc4b80bd050 0x7fc4b8008f70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T04:01:05.071 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.064+0000 7fc4bf5776c0 1 --2- 10.20.193.92:0/1137198087 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc4b8009550 0x7fc4b80099f0 secure :-1 s=READY pgs=208 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4b000ac10 tx=0x7fc4b0003bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:05.071 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.064+0000 7fc49ffff6c0 1 -- 10.20.193.92:0/1137198087 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc4b0005270 con 0x7fc4b8009550 2026-02-13T04:01:05.071 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.064+0000 7fc49ffff6c0 1 -- 10.20.193.92:0/1137198087 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fc4b0003e00 con 0x7fc4b8009550 2026-02-13T04:01:05.071 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.064+0000 7fc49ffff6c0 1 -- 10.20.193.92:0/1137198087 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc4b0037410 con 0x7fc4b8009550 2026-02-13T04:01:05.071 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.064+0000 7fc4c50436c0 1 -- 10.20.193.92:0/1137198087 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4b810fab0 con 0x7fc4b8009550 2026-02-13T04:01:05.072 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.064+0000 7fc4c50436c0 1 -- 10.20.193.92:0/1137198087 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4b810fee0 con 0x7fc4b8009550 2026-02-13T04:01:05.072 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.066+0000 7feb6e7fc6c0 1 -- 10.20.193.92:0/2091761026 --> [v2:10.20.193.158:6800/676925869,v1:10.20.193.158:6801/676925869] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7feb5c002d20 con 0x7feb680dcc30 2026-02-13T04:01:05.072 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.066+0000 7fc4c50436c0 1 -- 10.20.193.92:0/1137198087 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc48c000fe0 con 0x7fc4b8009550 2026-02-13T04:01:05.072 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.067+0000 7f9c19b196c0 1 -- 10.20.193.92:0/412185065 --> [v2:10.20.193.92:6810/4168983230,v1:10.20.193.92:6811/4168983230] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9bd4002d20 con 0x7f9bf80dcc60 2026-02-13T04:01:05.073 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.067+0000 7feb90ff96c0 1 -- 10.20.193.92:0/2091761026 <== osd.2 v2:10.20.193.158:6800/676925869 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7feb5c002d20 con 0x7feb680dcc30 2026-02-13T04:01:05.073 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.067+0000 7f9c10ff96c0 1 -- 10.20.193.92:0/412185065 <== osd.3 v2:10.20.193.92:6810/4168983230 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9bd4002d20 con 0x7f9bf80dcc60 2026-02-13T04:01:05.073 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.068+0000 7f9c19b196c0 1 -- 10.20.193.92:0/412185065 >> [v2:10.20.193.92:6810/4168983230,v1:10.20.193.92:6811/4168983230] conn(0x7f9bf80dcc60 msgr2=0x7f9bf80fd070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.074 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.068+0000 7f9c19b196c0 1 --2- 10.20.193.92:0/412185065 >> [v2:10.20.193.92:6810/4168983230,v1:10.20.193.92:6811/4168983230] conn(0x7f9bf80dcc60 0x7f9bf80fd070 crc :-1 s=READY pgs=10 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.074 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.068+0000 7f9c19b196c0 1 -- 10.20.193.92:0/412185065 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f9bf80b5660 msgr2=0x7f9bf80d5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.074 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.069+0000 7feb6e7fc6c0 1 -- 10.20.193.92:0/2091761026 >> [v2:10.20.193.158:6800/676925869,v1:10.20.193.158:6801/676925869] conn(0x7feb680dcc30 msgr2=0x7feb680fd040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.074 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.069+0000 7feb6e7fc6c0 1 --2- 10.20.193.92:0/2091761026 >> [v2:10.20.193.158:6800/676925869,v1:10.20.193.158:6801/676925869] conn(0x7feb680dcc30 0x7feb680fd040 crc :-1 s=READY pgs=16 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.074 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.068+0000 7f9c19b196c0 1 --2- 10.20.193.92:0/412185065 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f9bf80b5660 0x7f9bf80d5b10 secure :-1 s=READY pgs=156 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c0c00a990 tx=0x7f9c0c00a200 comp rx=0 tx=0).stop 2026-02-13T04:01:05.074 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.068+0000 7f9c19b196c0 1 -- 10.20.193.92:0/412185065 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9c140ff980 msgr2=0x7f9c14104c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.075 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.068+0000 7f9c19b196c0 1 --2- 10.20.193.92:0/412185065 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9c140ff980 0x7f9c14104c20 secure :-1 s=READY pgs=201 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c08005dc0 tx=0x7f9c0800bb60 comp rx=0 tx=0).stop 2026-02-13T04:01:05.075 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.068+0000 7f9c13fff6c0 1 -- 10.20.193.92:0/412185065 reap_dead start 2026-02-13T04:01:05.075 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.069+0000 7feb6e7fc6c0 1 -- 10.20.193.92:0/2091761026 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7feb680b5630 msgr2=0x7feb680d5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.076 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.069+0000 7feb6e7fc6c0 1 --2- 10.20.193.92:0/2091761026 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7feb680b5630 0x7feb680d5ae0 secure :-1 s=READY pgs=161 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb9407fb40 tx=0x7feb94054020 comp rx=0 tx=0).stop 2026-02-13T04:01:05.076 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.069+0000 7feb6e7fc6c0 1 -- 10.20.193.92:0/2091761026 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7feb8c0c4430 msgr2=0x7feb8c0d1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.076 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.069+0000 7feb6e7fc6c0 1 --2- 10.20.193.92:0/2091761026 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7feb8c0c4430 0x7feb8c0d1d80 secure :-1 s=READY pgs=206 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb84004750 tx=0x7feb8400c040 comp rx=0 tx=0).stop 2026-02-13T04:01:05.076 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.069+0000 7feb937fe6c0 1 -- 10.20.193.92:0/2091761026 reap_dead start 2026-02-13T04:01:05.076 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.069+0000 7feb6e7fc6c0 1 -- 10.20.193.92:0/2091761026 shutdown_connections 2026-02-13T04:01:05.076 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.069+0000 7feb6e7fc6c0 1 -- 10.20.193.92:0/2091761026 >> 10.20.193.92:0/2091761026 conn(0x7feb8c01c510 msgr2=0x7feb8c0c8190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:05.076 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.069+0000 7feb6e7fc6c0 1 -- 10.20.193.92:0/2091761026 shutdown_connections 2026-02-13T04:01:05.076 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.069+0000 7feb6e7fc6c0 1 -- 10.20.193.92:0/2091761026 wait complete. 2026-02-13T04:01:05.077 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.069+0000 7f9c19b196c0 1 -- 10.20.193.92:0/412185065 shutdown_connections 2026-02-13T04:01:05.077 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.069+0000 7f9c19b196c0 1 -- 10.20.193.92:0/412185065 >> 10.20.193.92:0/412185065 conn(0x7f9c140586e0 msgr2=0x7f9c140592a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:05.077 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.070+0000 7f9c19b196c0 1 -- 10.20.193.92:0/412185065 shutdown_connections 2026-02-13T04:01:05.077 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.070+0000 7f9c19b196c0 1 -- 10.20.193.92:0/412185065 wait complete. 2026-02-13T04:01:05.077 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.070+0000 7f97d35776c0 1 -- 10.20.193.92:0/2865895657 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f97d410fa50 msgr2=0x7f97d4114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.077 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.070+0000 7f97d35776c0 1 --2- 10.20.193.92:0/2865895657 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f97d410fa50 0x7f97d4114a90 secure :-1 s=READY pgs=95 gs=2 cs=0 l=1 c_cookie=31943616117745720 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97c80098d0 tx=0x7f97c802ec60 comp rx=0 tx=0).stop 2026-02-13T04:01:05.078 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.070+0000 7f97d35776c0 1 -- 10.20.193.92:0/2865895657 shutdown_connections 2026-02-13T04:01:05.078 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.070+0000 7f97d35776c0 1 --2- 10.20.193.92:0/2865895657 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f97d4115270 0x7f97d4175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.078 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.070+0000 7f97d35776c0 1 --2- 10.20.193.92:0/2865895657 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f97d410fa50 0x7f97d4114a90 unknown :-1 s=CLOSED pgs=95 gs=2 cs=0 l=1 c_cookie=31943616117745720 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.078 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.070+0000 7f97d35776c0 1 --2- 10.20.193.92:0/2865895657 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f97d410f060 0x7f97d410f430 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.078 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.070+0000 7f97d35776c0 1 -- 10.20.193.92:0/2865895657 >> 10.20.193.92:0/2865895657 conn(0x7f97d40ec980 msgr2=0x7f97d410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:05.078 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.070+0000 7f97d35776c0 1 -- 10.20.193.92:0/2865895657 shutdown_connections 2026-02-13T04:01:05.078 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.070+0000 7f97d35776c0 1 -- 10.20.193.92:0/2865895657 wait complete. 2026-02-13T04:01:05.078 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.071+0000 7f97d35776c0 1 Processor -- start 2026-02-13T04:01:05.078 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.071+0000 7f97d35776c0 1 -- start start 2026-02-13T04:01:05.078 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.071+0000 7fc49ffff6c0 1 -- 10.20.193.92:0/1137198087 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fc4b0008980 con 0x7fc4b8009550 2026-02-13T04:01:05.079 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.072+0000 7f97d35776c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f97d410f060 0x7f97d405c9b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.080 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.072+0000 7f97d35776c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f97d4115270 0x7f97d4175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.080 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.072+0000 7f97d35776c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f97d405e7d0 0x7f97d405cf50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.080 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.073+0000 7f97d25756c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f97d410f060 0x7f97d405c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.080 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.073+0000 7f97d35776c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f97d405d6e0 con 0x7f97d4115270 2026-02-13T04:01:05.080 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.073+0000 7f97d35776c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f97d405d850 con 0x7f97d410f060 2026-02-13T04:01:05.080 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.073+0000 7f97d35776c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f97d41032e0 con 0x7f97d405e7d0 2026-02-13T04:01:05.080 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.073+0000 7f97d2d766c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f97d405e7d0 0x7f97d405cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.080 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.073+0000 7f97d25756c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f97d410f060 0x7f97d405c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:45604/0 (socket says 10.20.193.92:45604) 2026-02-13T04:01:05.080 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.073+0000 7f97d25756c0 1 -- 10.20.193.92:0/4237356519 learned_addr learned my addr 10.20.193.92:0/4237356519 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:05.080 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.073+0000 7f97d1d746c0 1 --2- 10.20.193.92:0/4237356519 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f97d4115270 0x7f97d4175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.080 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.074+0000 7f97d25756c0 1 -- 10.20.193.92:0/4237356519 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f97d405e7d0 msgr2=0x7f97d405cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.080 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.074+0000 7f97d25756c0 1 --2- 10.20.193.92:0/4237356519 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f97d405e7d0 0x7f97d405cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.080 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.074+0000 7f97d25756c0 1 -- 10.20.193.92:0/4237356519 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f97d4115270 msgr2=0x7f97d4175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.081 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.074+0000 7ff8adffb6c0 1 -- 10.20.193.92:0/2804586374 --> [v2:10.20.193.158:6816/1505536261,v1:10.20.193.158:6817/1505536261] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff8d017db80 con 0x7ff8a80dcfb0 2026-02-13T04:01:05.081 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.075+0000 7ff8affff6c0 1 -- 10.20.193.92:0/2804586374 <== osd.8 v2:10.20.193.158:6816/1505536261 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff8d017db80 con 0x7ff8a80dcfb0 2026-02-13T04:01:05.081 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.076+0000 7fc49ffff6c0 1 --2- 10.20.193.92:0/1137198087 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fc4880b57e0 0x7fc4880d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.082 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.076+0000 7ff8adffb6c0 1 -- 10.20.193.92:0/2804586374 >> [v2:10.20.193.158:6816/1505536261,v1:10.20.193.158:6817/1505536261] conn(0x7ff8a80dcfb0 msgr2=0x7ff8a80fd3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.082 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.076+0000 7ff8adffb6c0 1 --2- 10.20.193.92:0/2804586374 >> [v2:10.20.193.158:6816/1505536261,v1:10.20.193.158:6817/1505536261] conn(0x7ff8a80dcfb0 0x7ff8a80fd3c0 crc :-1 s=READY pgs=16 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.082 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.076+0000 7ff8adffb6c0 1 -- 10.20.193.92:0/2804586374 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff8a80b5840 msgr2=0x7ff8a80d5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.082 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.076+0000 7ff8adffb6c0 1 --2- 10.20.193.92:0/2804586374 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff8a80b5840 0x7ff8a80d5cf0 secure :-1 s=READY pgs=159 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8c0006ea0 tx=0x7ff8c000a310 comp rx=0 tx=0).stop 2026-02-13T04:01:05.082 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.076+0000 7ff8adffb6c0 1 -- 10.20.193.92:0/2804586374 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff8d0116b30 msgr2=0x7ff8d00fb660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.082 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.076+0000 7ff8adffb6c0 1 --2- 10.20.193.92:0/2804586374 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff8d0116b30 0x7ff8d00fb660 secure :-1 s=READY pgs=202 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8b802f180 tx=0x7ff8b80054c0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.082 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.076+0000 7fc49ffff6c0 1 -- 10.20.193.92:0/1137198087 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7fc4b0108f90 con 0x7fc4b8009550 2026-02-13T04:01:05.083 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.077+0000 7f97d25756c0 1 --2- 10.20.193.92:0/4237356519 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f97d4115270 0x7f97d4175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.083 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.077+0000 7fc49ffff6c0 1 --2- 10.20.193.92:0/1137198087 >> [v2:10.20.193.99:6808/1135109881,v1:10.20.193.99:6809/1135109881] conn(0x7fc4880dcf50 0x7fc4880fd360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.083 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.077+0000 7fc49ffff6c0 1 -- 10.20.193.92:0/1137198087 --> [v2:10.20.193.99:6808/1135109881,v1:10.20.193.99:6809/1135109881] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc4880fda10 con 0x7fc4880dcf50 2026-02-13T04:01:05.083 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.077+0000 7fc49ffff6c0 1 -- 10.20.193.92:0/1137198087 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7fc4b01092c0 con 0x7fc4b8009550 2026-02-13T04:01:05.083 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.078+0000 7fc4be5756c0 1 --2- 10.20.193.92:0/1137198087 >> [v2:10.20.193.99:6808/1135109881,v1:10.20.193.99:6809/1135109881] conn(0x7fc4880dcf50 0x7fc4880fd360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.084 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.078+0000 7f1d58f2b6c0 1 -- 10.20.193.92:0/3491494869 --> [v2:10.20.193.99:6824/4260536068,v1:10.20.193.99:6825/4260536068] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1d5417dc80 con 0x7f1d2c0dcfa0 2026-02-13T04:01:05.084 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.077+0000 7f97d25756c0 1 -- 10.20.193.92:0/4237356519 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c80094c0 con 0x7f97d410f060 2026-02-13T04:01:05.084 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.077+0000 7f97d1d746c0 1 --2- 10.20.193.92:0/4237356519 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f97d4115270 0x7f97d4175b10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T04:01:05.084 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.078+0000 7f97d25756c0 1 --2- 10.20.193.92:0/4237356519 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f97d410f060 0x7f97d405c9b0 secure :-1 s=READY pgs=95 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97bc005e50 tx=0x7f97bc00bbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:05.084 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.078+0000 7f1d3b7fe6c0 1 -- 10.20.193.92:0/3491494869 <== osd.10 v2:10.20.193.99:6824/4260536068 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1d5417dc80 con 0x7f1d2c0dcfa0 2026-02-13T04:01:05.085 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.078+0000 7f97bb7fe6c0 1 -- 10.20.193.92:0/4237356519 <== mon.2 v2:10.20.193.99:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97bc004280 con 0x7f97d410f060 2026-02-13T04:01:05.085 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.079+0000 7f97bb7fe6c0 1 -- 10.20.193.92:0/4237356519 <== mon.2 v2:10.20.193.99:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f97bc0043e0 con 0x7f97d410f060 2026-02-13T04:01:05.085 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.079+0000 7f97bb7fe6c0 1 -- 10.20.193.92:0/4237356519 <== mon.2 v2:10.20.193.99:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97bc00ce40 con 0x7f97d410f060 2026-02-13T04:01:05.085 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.079+0000 7ff8cf7fe6c0 1 -- 10.20.193.92:0/2804586374 reap_dead start 2026-02-13T04:01:05.085 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.079+0000 7ff8adffb6c0 1 -- 10.20.193.92:0/2804586374 shutdown_connections 2026-02-13T04:01:05.085 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.079+0000 7ff8adffb6c0 1 -- 10.20.193.92:0/2804586374 >> 10.20.193.92:0/2804586374 conn(0x7ff8d00586e0 msgr2=0x7ff8d0059b00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:05.085 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.079+0000 7f97d35776c0 1 -- 10.20.193.92:0/4237356519 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97d41035c0 con 0x7f97d410f060 2026-02-13T04:01:05.086 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.080+0000 7f97d35776c0 1 -- 10.20.193.92:0/4237356519 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97d4103af0 con 0x7f97d410f060 2026-02-13T04:01:05.086 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.080+0000 7ff8adffb6c0 1 -- 10.20.193.92:0/2804586374 shutdown_connections 2026-02-13T04:01:05.086 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.080+0000 7fd30b7776c0 1 -- 10.20.193.92:0/2802156147 --> [v2:10.20.193.158:6824/2019612524,v1:10.20.193.158:6825/2019612524] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd3041192e0 con 0x7fd2dc0dcfb0 2026-02-13T04:01:05.086 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.080+0000 7f97d35776c0 1 -- 10.20.193.92:0/4237356519 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f97d4052a50 con 0x7f97d410f060 2026-02-13T04:01:05.086 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.080+0000 7ff8adffb6c0 1 -- 10.20.193.92:0/2804586374 wait complete. 2026-02-13T04:01:05.087 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.080+0000 7fd2fa7fc6c0 1 -- 10.20.193.92:0/2802156147 <== osd.11 v2:10.20.193.158:6824/2019612524 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd3041192e0 con 0x7fd2dc0dcfb0 2026-02-13T04:01:05.087 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.081+0000 7f1d58f2b6c0 1 -- 10.20.193.92:0/3491494869 >> [v2:10.20.193.99:6824/4260536068,v1:10.20.193.99:6825/4260536068] conn(0x7f1d2c0dcfa0 msgr2=0x7f1d2c0fd3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.087 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.081+0000 7f1d58f2b6c0 1 --2- 10.20.193.92:0/3491494869 >> [v2:10.20.193.99:6824/4260536068,v1:10.20.193.99:6825/4260536068] conn(0x7f1d2c0dcfa0 0x7f1d2c0fd3b0 crc :-1 s=READY pgs=15 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.087 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.081+0000 7f1d58f2b6c0 1 -- 10.20.193.92:0/3491494869 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f1d2c0b5830 msgr2=0x7f1d2c0d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.087 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.081+0000 7f1d58f2b6c0 1 --2- 10.20.193.92:0/3491494869 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f1d2c0b5830 0x7f1d2c0d5ce0 secure :-1 s=READY pgs=160 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d44009260 tx=0x7f1d44009440 comp rx=0 tx=0).stop 2026-02-13T04:01:05.088 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.081+0000 7f1d58f2b6c0 1 -- 10.20.193.92:0/3491494869 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1d541198f0 msgr2=0x7f1d5411a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.088 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.081+0000 7fc4be5756c0 1 --2- 10.20.193.92:0/1137198087 >> [v2:10.20.193.99:6808/1135109881,v1:10.20.193.99:6809/1135109881] conn(0x7fc4880dcf50 0x7fc4880fd360 crc :-1 s=READY pgs=15 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:05.088 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.081+0000 7fd30b7776c0 1 -- 10.20.193.92:0/2802156147 >> [v2:10.20.193.158:6824/2019612524,v1:10.20.193.158:6825/2019612524] conn(0x7fd2dc0dcfb0 msgr2=0x7fd2dc0fd3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.088 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.081+0000 7fc4bed766c0 1 --2- 10.20.193.92:0/1137198087 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fc4880b57e0 0x7fc4880d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.088 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.081+0000 7f1d58f2b6c0 1 --2- 10.20.193.92:0/3491494869 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1d541198f0 0x7f1d5411a740 secure :-1 s=READY pgs=94 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1d4800a990 tx=0x7f1d480064c0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.088 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.081+0000 7f1d52d766c0 1 -- 10.20.193.92:0/3491494869 reap_dead start 2026-02-13T04:01:05.089 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.081+0000 7fd30b7776c0 1 --2- 10.20.193.92:0/2802156147 >> [v2:10.20.193.158:6824/2019612524,v1:10.20.193.158:6825/2019612524] conn(0x7fd2dc0dcfb0 0x7fd2dc0fd3c0 crc :-1 s=READY pgs=7 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.089 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.081+0000 7f1d58f2b6c0 1 -- 10.20.193.92:0/3491494869 shutdown_connections 2026-02-13T04:01:05.089 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.081+0000 7f1d58f2b6c0 1 -- 10.20.193.92:0/3491494869 >> 10.20.193.92:0/3491494869 conn(0x7f1d54060760 msgr2=0x7f1d541159a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:05.089 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.082+0000 7fd30b7776c0 1 -- 10.20.193.92:0/2802156147 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fd2dc0b5840 msgr2=0x7fd2dc0d5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.089 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.082+0000 7fd30b7776c0 1 --2- 10.20.193.92:0/2802156147 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fd2dc0b5840 0x7fd2dc0d5cf0 secure :-1 s=READY pgs=157 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd304131f70 tx=0x7fd2f4009390 comp rx=0 tx=0).stop 2026-02-13T04:01:05.089 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.082+0000 7fc49ffff6c0 1 -- 10.20.193.92:0/1137198087 <== osd.4 v2:10.20.193.99:6808/1135109881 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7fc4880fda10 con 0x7fc4880dcf50 2026-02-13T04:01:05.090 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.082+0000 7fd30b7776c0 1 -- 10.20.193.92:0/2802156147 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd304113dc0 msgr2=0x7fd30412b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.090 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.082+0000 7fd30b7776c0 1 --2- 10.20.193.92:0/2802156147 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd304113dc0 0x7fd30412b5e0 secure :-1 s=READY pgs=203 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd300006df0 tx=0x7fd30000cf40 comp rx=0 tx=0).stop 2026-02-13T04:01:05.090 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.083+0000 7fd309ce96c0 1 -- 10.20.193.92:0/2802156147 reap_dead start 2026-02-13T04:01:05.090 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.083+0000 7fd30b7776c0 1 -- 10.20.193.92:0/2802156147 shutdown_connections 2026-02-13T04:01:05.090 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.083+0000 7fd30b7776c0 1 -- 10.20.193.92:0/2802156147 >> 10.20.193.92:0/2802156147 conn(0x7fd304058a50 msgr2=0x7fd3041182d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:05.090 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.083+0000 7fd30b7776c0 1 -- 10.20.193.92:0/2802156147 shutdown_connections 2026-02-13T04:01:05.090 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.083+0000 7fd30b7776c0 1 -- 10.20.193.92:0/2802156147 wait complete. 2026-02-13T04:01:05.090 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.083+0000 7f97bb7fe6c0 1 -- 10.20.193.92:0/4237356519 <== mon.2 v2:10.20.193.99:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f97bc00c410 con 0x7f97d410f060 2026-02-13T04:01:05.091 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.084+0000 7fc4bed766c0 1 --2- 10.20.193.92:0/1137198087 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fc4880b57e0 0x7fc4880d5c90 secure :-1 s=READY pgs=162 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4a8004770 tx=0x7fc4a8006e20 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:05.091 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.085+0000 7f97bb7fe6c0 1 --2- 10.20.193.92:0/4237356519 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f97a40b5760 0x7f97a40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.091 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.085+0000 7f97bb7fe6c0 1 -- 10.20.193.92:0/4237356519 <== mon.2 v2:10.20.193.99:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7f97bc0e3b50 con 0x7f97d410f060 2026-02-13T04:01:05.091 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.086+0000 7f97d1d746c0 1 --2- 10.20.193.92:0/4237356519 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f97a40b5760 0x7f97a40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.091 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.086+0000 7f97bb7fe6c0 1 --2- 10.20.193.92:0/4237356519 >> [v2:10.20.193.92:6818/1823230093,v1:10.20.193.92:6819/1823230093] conn(0x7f97a40dced0 0x7f97a40fd2e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.091 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.086+0000 7f97bb7fe6c0 1 -- 10.20.193.92:0/4237356519 --> [v2:10.20.193.92:6818/1823230093,v1:10.20.193.92:6819/1823230093] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f97a40fd990 con 0x7f97a40dced0 2026-02-13T04:01:05.091 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.086+0000 7f97bb7fe6c0 1 -- 10.20.193.92:0/4237356519 <== mon.2 v2:10.20.193.99:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f97bc0e3f70 con 0x7f97d410f060 2026-02-13T04:01:05.091 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.087+0000 7f97d1d746c0 1 --2- 10.20.193.92:0/4237356519 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f97a40b5760 0x7f97a40d5c10 secure :-1 s=READY pgs=163 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97d405e450 tx=0x7f97c80023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:05.091 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.087+0000 7f1d58f2b6c0 1 -- 10.20.193.92:0/3491494869 shutdown_connections 2026-02-13T04:01:05.091 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.087+0000 7f1d58f2b6c0 1 -- 10.20.193.92:0/3491494869 wait complete. 2026-02-13T04:01:05.092 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.087+0000 7f97d2d766c0 1 --2- 10.20.193.92:0/4237356519 >> [v2:10.20.193.92:6818/1823230093,v1:10.20.193.92:6819/1823230093] conn(0x7f97a40dced0 0x7f97a40fd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.092 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.088+0000 7f97d2d766c0 1 --2- 10.20.193.92:0/4237356519 >> [v2:10.20.193.92:6818/1823230093,v1:10.20.193.92:6819/1823230093] conn(0x7f97a40dced0 0x7f97a40fd2e0 crc :-1 s=READY pgs=13 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:05.092 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.090+0000 7f97bb7fe6c0 1 -- 10.20.193.92:0/4237356519 <== osd.6 v2:10.20.193.92:6818/1823230093 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f97a40fd990 con 0x7f97a40dced0 2026-02-13T04:01:05.093 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.090+0000 7fc4c50436c0 1 -- 10.20.193.92:0/1137198087 --> [v2:10.20.193.99:6808/1135109881,v1:10.20.193.99:6809/1135109881] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc48c002d20 con 0x7fc4880dcf50 2026-02-13T04:01:05.098 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.094+0000 7f84d514f6c0 1 -- 10.20.193.92:0/733612690 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f84d0114000 msgr2=0x7f84d01143d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.098 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.094+0000 7f84d514f6c0 1 --2- 10.20.193.92:0/733612690 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f84d0114000 0x7f84d01143d0 secure :-1 s=READY pgs=96 gs=2 cs=0 l=1 c_cookie=16936073130979458313 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84b8009fd0 tx=0x7f84b802fe60 comp rx=0 tx=0).stop 2026-02-13T04:01:05.098 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.095+0000 7f84d514f6c0 1 -- 10.20.193.92:0/733612690 shutdown_connections 2026-02-13T04:01:05.098 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.095+0000 7f84d514f6c0 1 --2- 10.20.193.92:0/733612690 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f84d0116b30 0x7f84d017a760 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.098 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.095+0000 7f84d514f6c0 1 --2- 10.20.193.92:0/733612690 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f84d01149f0 0x7f84d0116380 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.099 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.095+0000 7f84d514f6c0 1 --2- 10.20.193.92:0/733612690 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f84d0114000 0x7f84d01143d0 unknown :-1 s=CLOSED pgs=96 gs=2 cs=0 l=1 c_cookie=16936073130979458313 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.099 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.095+0000 7f84d514f6c0 1 -- 10.20.193.92:0/733612690 >> 10.20.193.92:0/733612690 conn(0x7f84d00586e0 msgr2=0x7f84d0058ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:05.099 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.096+0000 7f84d514f6c0 1 -- 10.20.193.92:0/733612690 shutdown_connections 2026-02-13T04:01:05.099 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.096+0000 7f84d514f6c0 1 -- 10.20.193.92:0/733612690 wait complete. 2026-02-13T04:01:05.099 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.097+0000 7f84d514f6c0 1 Processor -- start 2026-02-13T04:01:05.100 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.097+0000 7f84d514f6c0 1 -- start start 2026-02-13T04:01:05.101 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.098+0000 7f84d514f6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f84d0114000 0x7f84d0181fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.101 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.098+0000 7f84d514f6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f84d0116b30 0x7f84d017a6b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.101 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.098+0000 7f84d514f6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f84d01825b0 0x7f84d00f7df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.101 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.098+0000 7f84d514f6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f84d0182c80 con 0x7f84d0114000 2026-02-13T04:01:05.101 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.098+0000 7f84d514f6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f84d00f8330 con 0x7f84d01825b0 2026-02-13T04:01:05.101 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.098+0000 7f84d514f6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f84d00f84f0 con 0x7f84d0116b30 2026-02-13T04:01:05.101 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.098+0000 7f84ce5756c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f84d0116b30 0x7f84d017a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.102 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.098+0000 7f84ce5756c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f84d0116b30 0x7f84d017a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:51858/0 (socket says 10.20.193.92:51858) 2026-02-13T04:01:05.102 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.099+0000 7f84ce5756c0 1 -- 10.20.193.92:0/1464919901 learned_addr learned my addr 10.20.193.92:0/1464919901 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:05.102 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.098+0000 7f84cf5776c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f84d01825b0 0x7f84d00f7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.102 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.099+0000 7f84ce5756c0 1 -- 10.20.193.92:0/1464919901 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f84d01825b0 msgr2=0x7f84d00f7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.102 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.099+0000 7f84ce5756c0 1 --2- 10.20.193.92:0/1464919901 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f84d01825b0 0x7f84d00f7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.102 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.099+0000 7f84ce5756c0 1 -- 10.20.193.92:0/1464919901 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f84d0114000 msgr2=0x7f84d0181fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.102 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.099+0000 7f84ce5756c0 1 --2- 10.20.193.92:0/1464919901 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f84d0114000 0x7f84d0181fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.103 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.099+0000 7f84ce5756c0 1 -- 10.20.193.92:0/1464919901 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84b8009e40 con 0x7f84d0116b30 2026-02-13T04:01:05.103 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.099+0000 7f84ce5756c0 1 --2- 10.20.193.92:0/1464919901 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f84d0116b30 0x7f84d017a6b0 secure :-1 s=READY pgs=96 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84c000ca60 tx=0x7f84c000cf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:05.103 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.100+0000 7f84affff6c0 1 -- 10.20.193.92:0/1464919901 <== mon.1 v2:10.20.193.158:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f84c0003c40 con 0x7f84d0116b30 2026-02-13T04:01:05.103 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.100+0000 7f84affff6c0 1 -- 10.20.193.92:0/1464919901 <== mon.1 v2:10.20.193.158:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f84c0003da0 con 0x7f84d0116b30 2026-02-13T04:01:05.103 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.100+0000 7f84affff6c0 1 -- 10.20.193.92:0/1464919901 <== mon.1 v2:10.20.193.158:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f84c0008440 con 0x7f84d0116b30 2026-02-13T04:01:05.104 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.100+0000 7fa6e1c336c0 1 -- 10.20.193.92:0/1478124620 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa6dc1149f0 msgr2=0x7fa6dc1161e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.104 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.100+0000 7fa6e1c336c0 1 --2- 10.20.193.92:0/1478124620 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa6dc1149f0 0x7fa6dc1161e0 secure :-1 s=READY pgs=97 gs=2 cs=0 l=1 c_cookie=8108416529379648710 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa6c0009970 tx=0x7fa6c002ed10 comp rx=0 tx=0).stop 2026-02-13T04:01:05.104 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.100+0000 7fa6e1c336c0 1 -- 10.20.193.92:0/1478124620 shutdown_connections 2026-02-13T04:01:05.104 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.100+0000 7fa6e1c336c0 1 --2- 10.20.193.92:0/1478124620 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa6dc1149f0 0x7fa6dc1161e0 unknown :-1 s=CLOSED pgs=97 gs=2 cs=0 l=1 c_cookie=8108416529379648710 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.104 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.100+0000 7fa6e1c336c0 1 --2- 10.20.193.92:0/1478124620 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa6dc116990 0x7fa6dc17a5a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.104 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.100+0000 7f84d514f6c0 1 -- 10.20.193.92:0/1464919901 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84d00f87d0 con 0x7f84d0116b30 2026-02-13T04:01:05.105 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.100+0000 7fa6e1c336c0 1 --2- 10.20.193.92:0/1478124620 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa6dc114000 0x7fa6dc1143d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.105 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.100+0000 7fa6e1c336c0 1 -- 10.20.193.92:0/1478124620 >> 10.20.193.92:0/1478124620 conn(0x7fa6dc05aaa0 msgr2=0x7fa6dc05b290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:05.105 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.101+0000 7f84d514f6c0 1 -- 10.20.193.92:0/1464919901 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84d00f8c60 con 0x7f84d0116b30 2026-02-13T04:01:05.105 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.102+0000 7fa6e1c336c0 1 -- 10.20.193.92:0/1478124620 shutdown_connections 2026-02-13T04:01:05.105 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.102+0000 7fa6e1c336c0 1 -- 10.20.193.92:0/1478124620 wait complete. 2026-02-13T04:01:05.106 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.102+0000 7f84d514f6c0 1 -- 10.20.193.92:0/1464919901 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f84d0052a50 con 0x7f84d0116b30 2026-02-13T04:01:05.106 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.102+0000 7fc49ffff6c0 1 -- 10.20.193.92:0/1137198087 <== osd.4 v2:10.20.193.99:6808/1135109881 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc48c002d20 con 0x7fc4880dcf50 2026-02-13T04:01:05.106 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.103+0000 7fc49dffb6c0 1 -- 10.20.193.92:0/1137198087 >> [v2:10.20.193.99:6808/1135109881,v1:10.20.193.99:6809/1135109881] conn(0x7fc4880dcf50 msgr2=0x7fc4880fd360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.106 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.103+0000 7fc49dffb6c0 1 --2- 10.20.193.92:0/1137198087 >> [v2:10.20.193.99:6808/1135109881,v1:10.20.193.99:6809/1135109881] conn(0x7fc4880dcf50 0x7fc4880fd360 crc :-1 s=READY pgs=15 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.106 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.103+0000 7fc49dffb6c0 1 -- 10.20.193.92:0/1137198087 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fc4880b57e0 msgr2=0x7fc4880d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.106 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.103+0000 7fc49dffb6c0 1 --2- 10.20.193.92:0/1137198087 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fc4880b57e0 0x7fc4880d5c90 secure :-1 s=READY pgs=162 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4a8004770 tx=0x7fc4a8006e20 comp rx=0 tx=0).stop 2026-02-13T04:01:05.106 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.103+0000 7fc49dffb6c0 1 -- 10.20.193.92:0/1137198087 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc4b8009550 msgr2=0x7fc4b80099f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.106 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.103+0000 7fc49dffb6c0 1 --2- 10.20.193.92:0/1137198087 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc4b8009550 0x7fc4b80099f0 secure :-1 s=READY pgs=208 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc4b000ac10 tx=0x7fc4b0003bd0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.107 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.103+0000 7fc4bf5776c0 1 -- 10.20.193.92:0/1137198087 reap_dead start 2026-02-13T04:01:05.107 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.103+0000 7fa6e1c336c0 1 Processor -- start 2026-02-13T04:01:05.107 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.103+0000 7fc49dffb6c0 1 -- 10.20.193.92:0/1137198087 shutdown_connections 2026-02-13T04:01:05.107 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.103+0000 7fc49dffb6c0 1 -- 10.20.193.92:0/1137198087 >> 10.20.193.92:0/1137198087 conn(0x7fc4b80946c0 msgr2=0x7fc4b80b4aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:05.107 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.104+0000 7fc49dffb6c0 1 -- 10.20.193.92:0/1137198087 shutdown_connections 2026-02-13T04:01:05.108 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.104+0000 7fa6e1c336c0 1 -- start start 2026-02-13T04:01:05.108 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.104+0000 7fa6e1c336c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa6dc114000 0x7fa6dc0ff660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.108 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.105+0000 7fa6e1c336c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa6dc116990 0x7fa6dc17a510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.108 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.105+0000 7fa6e1c336c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa6dc0ffd50 0x7fa6dc104f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.109 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.105+0000 7fa6e1c336c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa6dc105450 con 0x7fa6dc114000 2026-02-13T04:01:05.109 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.105+0000 7fa6e1c336c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa6dc1055c0 con 0x7fa6dc116990 2026-02-13T04:01:05.109 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.105+0000 7fa6e1c336c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fa6dc105780 con 0x7fa6dc0ffd50 2026-02-13T04:01:05.109 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.105+0000 7fa6e0c316c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa6dc114000 0x7fa6dc0ff660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.109 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.105+0000 7fa6e0c316c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa6dc114000 0x7fa6dc0ff660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:53264/0 (socket says 10.20.193.92:53264) 2026-02-13T04:01:05.109 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.105+0000 7fa6e0c316c0 1 -- 10.20.193.92:0/1015104978 learned_addr learned my addr 10.20.193.92:0/1015104978 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:05.109 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.105+0000 7fa6e0c316c0 1 -- 10.20.193.92:0/1015104978 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa6dc0ffd50 msgr2=0x7fa6dc104f10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T04:01:05.109 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.105+0000 7fa6e0c316c0 1 --2- 10.20.193.92:0/1015104978 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa6dc0ffd50 0x7fa6dc104f10 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.109 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.105+0000 7fa6e0c316c0 1 -- 10.20.193.92:0/1015104978 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa6dc116990 msgr2=0x7fa6dc17a510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T04:01:05.109 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.105+0000 7fa6e0c316c0 1 --2- 10.20.193.92:0/1015104978 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa6dc116990 0x7fa6dc17a510 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.109 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.105+0000 7fa6e0c316c0 1 -- 10.20.193.92:0/1015104978 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6c0009590 con 0x7fa6dc114000 2026-02-13T04:01:05.109 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.104+0000 7fc49dffb6c0 1 -- 10.20.193.92:0/1137198087 wait complete. 2026-02-13T04:01:05.110 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.106+0000 7fa6e0c316c0 1 --2- 10.20.193.92:0/1015104978 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa6dc114000 0x7fa6dc0ff660 secure :-1 s=READY pgs=209 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa6d000d900 tx=0x7fa6d000ddd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:05.110 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.107+0000 7fa6d9ffb6c0 1 -- 10.20.193.92:0/1015104978 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa6d0005340 con 0x7fa6dc114000 2026-02-13T04:01:05.110 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.107+0000 7f84affff6c0 1 -- 10.20.193.92:0/1464919901 <== mon.1 v2:10.20.193.158:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f84c0005030 con 0x7f84d0116b30 2026-02-13T04:01:05.111 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.107+0000 7fa6e1c336c0 1 -- 10.20.193.92:0/1015104978 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6dc105a60 con 0x7fa6dc114000 2026-02-13T04:01:05.111 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.107+0000 7fa6d9ffb6c0 1 -- 10.20.193.92:0/1015104978 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fa6d0003d40 con 0x7fa6dc114000 2026-02-13T04:01:05.111 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.107+0000 7fa6d9ffb6c0 1 -- 10.20.193.92:0/1015104978 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa6d0008260 con 0x7fa6dc114000 2026-02-13T04:01:05.111 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.108+0000 7fa6e1c336c0 1 -- 10.20.193.92:0/1015104978 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6dc106230 con 0x7fa6dc114000 2026-02-13T04:01:05.111 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.108+0000 7fa6e1c336c0 1 -- 10.20.193.92:0/1015104978 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa6a0000fe0 con 0x7fa6dc114000 2026-02-13T04:01:05.112 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.109+0000 7f84affff6c0 1 --2- 10.20.193.92:0/1464919901 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f84a40b57e0 0x7f84a40d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.112 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.109+0000 7f84affff6c0 1 -- 10.20.193.92:0/1464919901 <== mon.1 v2:10.20.193.158:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7f84c00e4c60 con 0x7f84d0116b30 2026-02-13T04:01:05.113 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.110+0000 7f84affff6c0 1 --2- 10.20.193.92:0/1464919901 >> [v2:10.20.193.99:6800/3943455734,v1:10.20.193.99:6801/3943455734] conn(0x7f84a40dcf40 0x7f84a40fd350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.113 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.110+0000 7f84affff6c0 1 -- 10.20.193.92:0/1464919901 --> [v2:10.20.193.99:6800/3943455734,v1:10.20.193.99:6801/3943455734] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f84a40fda00 con 0x7f84a40dcf40 2026-02-13T04:01:05.113 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.110+0000 7f84affff6c0 1 -- 10.20.193.92:0/1464919901 <== mon.1 v2:10.20.193.158:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f84c00e7220 con 0x7f84d0116b30 2026-02-13T04:01:05.113 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.110+0000 7f84cf5776c0 1 --2- 10.20.193.92:0/1464919901 >> [v2:10.20.193.99:6800/3943455734,v1:10.20.193.99:6801/3943455734] conn(0x7f84a40dcf40 0x7f84a40fd350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.113 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.109+0000 7f9c01ffb6c0 1 -- 10.20.193.92:0/1607061316 <== mon.1 v2:10.20.193.158:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9bf8004290 con 0x7f9c04114000 2026-02-13T04:01:05.113 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.110+0000 7f84ced766c0 1 --2- 10.20.193.92:0/1464919901 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f84a40b57e0 0x7f84a40d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.114 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.109+0000 7f9c095186c0 1 -- 10.20.193.92:0/1607061316 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f9c04114000 msgr2=0x7f9c041143d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.114 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.109+0000 7f9c095186c0 1 --2- 10.20.193.92:0/1607061316 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f9c04114000 0x7f9c041143d0 secure :-1 s=READY pgs=97 gs=1 cs=0 l=1 c_cookie=3029916524055004623 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9bf80085b0 tx=0x7f9bf802ed10 comp rx=0 tx=0).stop 2026-02-13T04:01:05.114 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.110+0000 7f9c095186c0 1 -- 10.20.193.92:0/1607061316 shutdown_connections 2026-02-13T04:01:05.114 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.110+0000 7f9c095186c0 1 --2- 10.20.193.92:0/1607061316 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9c041149f0 0x7f9c04116380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.114 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.110+0000 7f9c095186c0 1 --2- 10.20.193.92:0/1607061316 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9c04116b30 0x7f9c0417a740 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.115 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.110+0000 7f9c095186c0 1 --2- 10.20.193.92:0/1607061316 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f9c04114000 0x7f9c041143d0 unknown :-1 s=CLOSED pgs=97 gs=1 cs=0 l=1 c_cookie=3029916524055004623 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.115 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.110+0000 7f9c095186c0 1 -- 10.20.193.92:0/1607061316 >> 10.20.193.92:0/1607061316 conn(0x7f9c04058a50 msgr2=0x7f9c04058e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:05.115 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.110+0000 7f9c095186c0 1 -- 10.20.193.92:0/1607061316 shutdown_connections 2026-02-13T04:01:05.115 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.110+0000 7f9c095186c0 1 -- 10.20.193.92:0/1607061316 wait complete. 2026-02-13T04:01:05.115 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.111+0000 7f9c095186c0 1 Processor -- start 2026-02-13T04:01:05.115 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.111+0000 7f84ced766c0 1 --2- 10.20.193.92:0/1464919901 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f84a40b57e0 0x7f84a40d5c90 secure :-1 s=READY pgs=164 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84b8009fd0 tx=0x7f84b80093c0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:05.116 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.113+0000 7f84cf5776c0 1 --2- 10.20.193.92:0/1464919901 >> [v2:10.20.193.99:6800/3943455734,v1:10.20.193.99:6801/3943455734] conn(0x7f84a40dcf40 0x7f84a40fd350 crc :-1 s=READY pgs=10 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:05.116 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.113+0000 7f97d35776c0 1 -- 10.20.193.92:0/4237356519 --> [v2:10.20.193.92:6818/1823230093,v1:10.20.193.92:6819/1823230093] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f97d4052a50 con 0x7f97a40dced0 2026-02-13T04:01:05.116 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.114+0000 7f97bb7fe6c0 1 -- 10.20.193.92:0/4237356519 <== osd.6 v2:10.20.193.92:6818/1823230093 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f97d4052a50 con 0x7f97a40dced0 2026-02-13T04:01:05.117 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.114+0000 7f84affff6c0 1 -- 10.20.193.92:0/1464919901 <== osd.1 v2:10.20.193.99:6800/3943455734 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f84a40fda00 con 0x7f84a40dcf40 2026-02-13T04:01:05.117 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.115+0000 7f97d35776c0 1 -- 10.20.193.92:0/4237356519 >> [v2:10.20.193.92:6818/1823230093,v1:10.20.193.92:6819/1823230093] conn(0x7f97a40dced0 msgr2=0x7f97a40fd2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.118 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.115+0000 7f97d35776c0 1 --2- 10.20.193.92:0/4237356519 >> [v2:10.20.193.92:6818/1823230093,v1:10.20.193.92:6819/1823230093] conn(0x7f97a40dced0 0x7f97a40fd2e0 crc :-1 s=READY pgs=13 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.120 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.118+0000 7f97d35776c0 1 -- 10.20.193.92:0/4237356519 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f97a40b5760 msgr2=0x7f97a40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.120 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.118+0000 7f97d35776c0 1 --2- 10.20.193.92:0/4237356519 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f97a40b5760 0x7f97a40d5c10 secure :-1 s=READY pgs=163 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97d405e450 tx=0x7f97c80023a0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.120 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.118+0000 7f97d35776c0 1 -- 10.20.193.92:0/4237356519 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f97d410f060 msgr2=0x7f97d405c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.121 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.118+0000 7f97d35776c0 1 --2- 10.20.193.92:0/4237356519 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f97d410f060 0x7f97d405c9b0 secure :-1 s=READY pgs=95 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97bc005e50 tx=0x7f97bc00bbf0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.121 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.118+0000 7f97d2d766c0 1 -- 10.20.193.92:0/4237356519 reap_dead start 2026-02-13T04:01:05.121 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.118+0000 7f97d35776c0 1 -- 10.20.193.92:0/4237356519 shutdown_connections 2026-02-13T04:01:05.121 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.118+0000 7f97d35776c0 1 -- 10.20.193.92:0/4237356519 >> 10.20.193.92:0/4237356519 conn(0x7f97d40ec980 msgr2=0x7f97d410d540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:05.121 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.118+0000 7f97d35776c0 1 -- 10.20.193.92:0/4237356519 shutdown_connections 2026-02-13T04:01:05.121 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.118+0000 7f97d35776c0 1 -- 10.20.193.92:0/4237356519 wait complete. 2026-02-13T04:01:05.131 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.128+0000 7f84d514f6c0 1 -- 10.20.193.92:0/1464919901 --> [v2:10.20.193.99:6800/3943455734,v1:10.20.193.99:6801/3943455734] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f84d017ce90 con 0x7f84a40dcf40 2026-02-13T04:01:05.134 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.131+0000 7f84affff6c0 1 -- 10.20.193.92:0/1464919901 <== osd.1 v2:10.20.193.99:6800/3943455734 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f84d017ce90 con 0x7f84a40dcf40 2026-02-13T04:01:05.135 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.132+0000 7f84d514f6c0 1 -- 10.20.193.92:0/1464919901 >> [v2:10.20.193.99:6800/3943455734,v1:10.20.193.99:6801/3943455734] conn(0x7f84a40dcf40 msgr2=0x7f84a40fd350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.135 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.132+0000 7f84d514f6c0 1 --2- 10.20.193.92:0/1464919901 >> [v2:10.20.193.99:6800/3943455734,v1:10.20.193.99:6801/3943455734] conn(0x7f84a40dcf40 0x7f84a40fd350 crc :-1 s=READY pgs=10 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.136 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.133+0000 7f84d514f6c0 1 -- 10.20.193.92:0/1464919901 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f84a40b57e0 msgr2=0x7f84a40d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.136 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.133+0000 7f84d514f6c0 1 --2- 10.20.193.92:0/1464919901 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f84a40b57e0 0x7f84a40d5c90 secure :-1 s=READY pgs=164 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84b8009fd0 tx=0x7f84b80093c0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.136 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.133+0000 7f84d514f6c0 1 -- 10.20.193.92:0/1464919901 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f84d0116b30 msgr2=0x7f84d017a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.136 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.133+0000 7f84d514f6c0 1 --2- 10.20.193.92:0/1464919901 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f84d0116b30 0x7f84d017a6b0 secure :-1 s=READY pgs=96 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84c000ca60 tx=0x7f84c000cf30 comp rx=0 tx=0).stop 2026-02-13T04:01:05.136 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.133+0000 7f84cf5776c0 1 -- 10.20.193.92:0/1464919901 reap_dead start 2026-02-13T04:01:05.136 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.134+0000 7f84d514f6c0 1 -- 10.20.193.92:0/1464919901 shutdown_connections 2026-02-13T04:01:05.137 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.134+0000 7f84d514f6c0 1 -- 10.20.193.92:0/1464919901 >> 10.20.193.92:0/1464919901 conn(0x7f84d00586e0 msgr2=0x7f84d0058d30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:05.140 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.126+0000 7fa6d9ffb6c0 1 -- 10.20.193.92:0/1015104978 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fa6d000a8c0 con 0x7fa6dc114000 2026-02-13T04:01:05.140 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.128+0000 7fa6d9ffb6c0 1 --2- 10.20.193.92:0/1015104978 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa6b40b5760 0x7fa6b40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.140 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.128+0000 7fa6d9ffb6c0 1 -- 10.20.193.92:0/1015104978 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7fa6d00e9060 con 0x7fa6dc114000 2026-02-13T04:01:05.141 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.128+0000 7fa6d9ffb6c0 1 --2- 10.20.193.92:0/1015104978 >> [v2:10.20.193.99:6816/3951959773,v1:10.20.193.99:6817/3951959773] conn(0x7fa6b40dced0 0x7fa6b40fd2e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.141 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.128+0000 7fa6d9ffb6c0 1 -- 10.20.193.92:0/1015104978 --> [v2:10.20.193.99:6816/3951959773,v1:10.20.193.99:6817/3951959773] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa6b40fd990 con 0x7fa6b40dced0 2026-02-13T04:01:05.141 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.128+0000 7fa6d9ffb6c0 1 -- 10.20.193.92:0/1015104978 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7fa6d00e9380 con 0x7fa6dc114000 2026-02-13T04:01:05.141 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.129+0000 7fa6dbfff6c0 1 --2- 10.20.193.92:0/1015104978 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa6b40b5760 0x7fa6b40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.141 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.130+0000 7fa6dbfff6c0 1 --2- 10.20.193.92:0/1015104978 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa6b40b5760 0x7fa6b40d5c10 secure :-1 s=READY pgs=165 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa6dc105fa0 tx=0x7fa6c00023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:05.141 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.132+0000 7fa6e14326c0 1 --2- 10.20.193.92:0/1015104978 >> [v2:10.20.193.99:6816/3951959773,v1:10.20.193.99:6817/3951959773] conn(0x7fa6b40dced0 0x7fa6b40fd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.141 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.132+0000 7fa6e14326c0 1 --2- 10.20.193.92:0/1015104978 >> [v2:10.20.193.99:6816/3951959773,v1:10.20.193.99:6817/3951959773] conn(0x7fa6b40dced0 0x7fa6b40fd2e0 crc :-1 s=READY pgs=11 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:05.141 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.133+0000 7fa6d9ffb6c0 1 -- 10.20.193.92:0/1015104978 <== osd.7 v2:10.20.193.99:6816/3951959773 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7fa6b40fd990 con 0x7fa6b40dced0 2026-02-13T04:01:05.150 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.147+0000 7f84d514f6c0 1 -- 10.20.193.92:0/1464919901 shutdown_connections 2026-02-13T04:01:05.150 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.147+0000 7f84d514f6c0 1 -- 10.20.193.92:0/1464919901 wait complete. 2026-02-13T04:01:05.153 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.135+0000 7f9c095186c0 1 -- start start 2026-02-13T04:01:05.153 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.135+0000 7f9c095186c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f9c04114000 0x7f9c040fba40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.154 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.135+0000 7f9c095186c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9c04116b30 0x7f9c0417a6b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.154 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.135+0000 7f9c095186c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9c040fc160 0x7f9c040f4c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.154 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.135+0000 7f9c095186c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9c040f51d0 con 0x7f9c040fc160 2026-02-13T04:01:05.154 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.150+0000 7fa6e1c336c0 1 -- 10.20.193.92:0/1015104978 --> [v2:10.20.193.99:6816/3951959773,v1:10.20.193.99:6817/3951959773] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa6a0002d20 con 0x7fa6b40dced0 2026-02-13T04:01:05.154 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.151+0000 7fa6d9ffb6c0 1 -- 10.20.193.92:0/1015104978 <== osd.7 v2:10.20.193.99:6816/3951959773 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa6a0002d20 con 0x7fa6b40dced0 2026-02-13T04:01:05.155 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.135+0000 7f9c095186c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9c040f5340 con 0x7f9c04116b30 2026-02-13T04:01:05.155 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.135+0000 7f9c095186c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f9c040f5500 con 0x7f9c04114000 2026-02-13T04:01:05.155 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.135+0000 7f9c037fe6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9c040fc160 0x7f9c040f4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.155 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.135+0000 7f9c037fe6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9c040fc160 0x7f9c040f4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:53276/0 (socket says 10.20.193.92:53276) 2026-02-13T04:01:05.155 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.135+0000 7f9c037fe6c0 1 -- 10.20.193.92:0/4047748112 learned_addr learned my addr 10.20.193.92:0/4047748112 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:05.155 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.136+0000 7f9c037fe6c0 1 -- 10.20.193.92:0/4047748112 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f9c04114000 msgr2=0x7f9c040fba40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T04:01:05.156 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.136+0000 7f9c037fe6c0 1 --2- 10.20.193.92:0/4047748112 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f9c04114000 0x7f9c040fba40 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.156 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.151+0000 7fa6e1c336c0 1 -- 10.20.193.92:0/1015104978 >> [v2:10.20.193.99:6816/3951959773,v1:10.20.193.99:6817/3951959773] conn(0x7fa6b40dced0 msgr2=0x7fa6b40fd2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.157 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.136+0000 7f9c037fe6c0 1 -- 10.20.193.92:0/4047748112 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9c04116b30 msgr2=0x7f9c0417a6b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T04:01:05.157 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.136+0000 7f9c037fe6c0 1 --2- 10.20.193.92:0/4047748112 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9c04116b30 0x7f9c0417a6b0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.157 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.136+0000 7f9c037fe6c0 1 -- 10.20.193.92:0/4047748112 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bf80081d0 con 0x7f9c040fc160 2026-02-13T04:01:05.157 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.136+0000 7f9c037fe6c0 1 --2- 10.20.193.92:0/4047748112 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9c040fc160 0x7f9c040f4c90 secure :-1 s=READY pgs=210 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9bf400c6c0 tx=0x7f9bf400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:05.157 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.136+0000 7f9be3fff6c0 1 -- 10.20.193.92:0/4047748112 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9bf4003a30 con 0x7f9c040fc160 2026-02-13T04:01:05.157 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.151+0000 7fa6e1c336c0 1 --2- 10.20.193.92:0/1015104978 >> [v2:10.20.193.99:6816/3951959773,v1:10.20.193.99:6817/3951959773] conn(0x7fa6b40dced0 0x7fa6b40fd2e0 crc :-1 s=READY pgs=11 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.157 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.151+0000 7fa6e1c336c0 1 -- 10.20.193.92:0/1015104978 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa6b40b5760 msgr2=0x7fa6b40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.157 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.151+0000 7fa6e1c336c0 1 --2- 10.20.193.92:0/1015104978 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa6b40b5760 0x7fa6b40d5c10 secure :-1 s=READY pgs=165 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa6dc105fa0 tx=0x7fa6c00023a0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.157 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.151+0000 7fa6e1c336c0 1 -- 10.20.193.92:0/1015104978 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa6dc114000 msgr2=0x7fa6dc0ff660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.158 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.151+0000 7fa6e1c336c0 1 --2- 10.20.193.92:0/1015104978 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa6dc114000 0x7fa6dc0ff660 secure :-1 s=READY pgs=209 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa6d000d900 tx=0x7fa6d000ddd0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.158 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.136+0000 7f9c095186c0 1 -- 10.20.193.92:0/4047748112 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c040f57e0 con 0x7f9c040fc160 2026-02-13T04:01:05.158 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.136+0000 7f9c095186c0 1 -- 10.20.193.92:0/4047748112 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c040fa880 con 0x7f9c040fc160 2026-02-13T04:01:05.158 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.136+0000 7f9be3fff6c0 1 -- 10.20.193.92:0/4047748112 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f9bf4005550 con 0x7f9c040fc160 2026-02-13T04:01:05.159 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.136+0000 7f9be3fff6c0 1 -- 10.20.193.92:0/4047748112 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9bf4003a30 con 0x7f9c040fc160 2026-02-13T04:01:05.159 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.137+0000 7f9c095186c0 1 -- 10.20.193.92:0/4047748112 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9bc8000fe0 con 0x7f9c040fc160 2026-02-13T04:01:05.159 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.140+0000 7f9be3fff6c0 1 -- 10.20.193.92:0/4047748112 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f9bf400dce0 con 0x7f9c040fc160 2026-02-13T04:01:05.159 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.142+0000 7f9be3fff6c0 1 --2- 10.20.193.92:0/4047748112 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f9bd00d7fd0 0x7f9bd00f8480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.159 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.142+0000 7f9be3fff6c0 1 -- 10.20.193.92:0/4047748112 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7f9bf40e4680 con 0x7f9c040fc160 2026-02-13T04:01:05.159 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.142+0000 7f9be3fff6c0 1 --2- 10.20.193.92:0/4047748112 >> [v2:10.20.193.92:6826/3596797929,v1:10.20.193.92:6827/3596797929] conn(0x7f9bd00ff740 0x7f9bd011fb50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.159 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.142+0000 7f9be3fff6c0 1 -- 10.20.193.92:0/4047748112 --> [v2:10.20.193.92:6826/3596797929,v1:10.20.193.92:6827/3596797929] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9bd0120200 con 0x7f9bd00ff740 2026-02-13T04:01:05.159 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.142+0000 7f9be3fff6c0 1 -- 10.20.193.92:0/4047748112 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f9bf40e4aa0 con 0x7f9c040fc160 2026-02-13T04:01:05.160 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.152+0000 7fa6e14326c0 1 -- 10.20.193.92:0/1015104978 reap_dead start 2026-02-13T04:01:05.160 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.152+0000 7fa6e1c336c0 1 -- 10.20.193.92:0/1015104978 shutdown_connections 2026-02-13T04:01:05.160 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.152+0000 7fa6e1c336c0 1 -- 10.20.193.92:0/1015104978 >> 10.20.193.92:0/1015104978 conn(0x7fa6dc05aaa0 msgr2=0x7fa6dc05dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:05.160 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.153+0000 7fa6e1c336c0 1 -- 10.20.193.92:0/1015104978 shutdown_connections 2026-02-13T04:01:05.160 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.153+0000 7fa6e1c336c0 1 -- 10.20.193.92:0/1015104978 wait complete. 2026-02-13T04:01:05.161 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.153+0000 7f9c02ffd6c0 1 --2- 10.20.193.92:0/4047748112 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f9bd00d7fd0 0x7f9bd00f8480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.161 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.154+0000 7f9c027fc6c0 1 --2- 10.20.193.92:0/4047748112 >> [v2:10.20.193.92:6826/3596797929,v1:10.20.193.92:6827/3596797929] conn(0x7f9bd00ff740 0x7f9bd011fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.161 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.154+0000 7f9c02ffd6c0 1 --2- 10.20.193.92:0/4047748112 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f9bd00d7fd0 0x7f9bd00f8480 secure :-1 s=READY pgs=166 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9bf802f220 tx=0x7f9bf8005c00 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:05.161 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.154+0000 7f9c027fc6c0 1 --2- 10.20.193.92:0/4047748112 >> [v2:10.20.193.92:6826/3596797929,v1:10.20.193.92:6827/3596797929] conn(0x7f9bd00ff740 0x7f9bd011fb50 crc :-1 s=READY pgs=12 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:05.161 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.155+0000 7f9be3fff6c0 1 -- 10.20.193.92:0/4047748112 <== osd.9 v2:10.20.193.92:6826/3596797929 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f9bd0120200 con 0x7f9bd00ff740 2026-02-13T04:01:05.167 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.164+0000 7f9c095186c0 1 -- 10.20.193.92:0/4047748112 --> [v2:10.20.193.92:6826/3596797929,v1:10.20.193.92:6827/3596797929] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9bc8002d20 con 0x7f9bd00ff740 2026-02-13T04:01:05.168 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.165+0000 7f9be3fff6c0 1 -- 10.20.193.92:0/4047748112 <== osd.9 v2:10.20.193.92:6826/3596797929 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9bc8002d20 con 0x7f9bd00ff740 2026-02-13T04:01:05.169 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.165+0000 7f9c095186c0 1 -- 10.20.193.92:0/4047748112 >> [v2:10.20.193.92:6826/3596797929,v1:10.20.193.92:6827/3596797929] conn(0x7f9bd00ff740 msgr2=0x7f9bd011fb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.169 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.165+0000 7f9c095186c0 1 --2- 10.20.193.92:0/4047748112 >> [v2:10.20.193.92:6826/3596797929,v1:10.20.193.92:6827/3596797929] conn(0x7f9bd00ff740 0x7f9bd011fb50 crc :-1 s=READY pgs=12 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.169 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.165+0000 7f9c095186c0 1 -- 10.20.193.92:0/4047748112 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f9bd00d7fd0 msgr2=0x7f9bd00f8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.169 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.165+0000 7f9c095186c0 1 --2- 10.20.193.92:0/4047748112 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f9bd00d7fd0 0x7f9bd00f8480 secure :-1 s=READY pgs=166 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9bf802f220 tx=0x7f9bf8005c00 comp rx=0 tx=0).stop 2026-02-13T04:01:05.169 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.165+0000 7f9c095186c0 1 -- 10.20.193.92:0/4047748112 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9c040fc160 msgr2=0x7f9c040f4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.169 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.165+0000 7f9c095186c0 1 --2- 10.20.193.92:0/4047748112 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9c040fc160 0x7f9c040f4c90 secure :-1 s=READY pgs=210 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9bf400c6c0 tx=0x7f9bf400cb90 comp rx=0 tx=0).stop 2026-02-13T04:01:05.169 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.165+0000 7f9c037fe6c0 1 -- 10.20.193.92:0/4047748112 reap_dead start 2026-02-13T04:01:05.175 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.172+0000 7f9c095186c0 1 -- 10.20.193.92:0/4047748112 shutdown_connections 2026-02-13T04:01:05.175 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.172+0000 7f9c095186c0 1 -- 10.20.193.92:0/4047748112 >> 10.20.193.92:0/4047748112 conn(0x7f9c04058a50 msgr2=0x7f9c04117360 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:05.175 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.172+0000 7f9c095186c0 1 -- 10.20.193.92:0/4047748112 shutdown_connections 2026-02-13T04:01:05.175 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.172+0000 7f9c095186c0 1 -- 10.20.193.92:0/4047748112 wait complete. 2026-02-13T04:01:05.251 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:05 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/2506385230' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T04:01:05.385 INFO:teuthology.orchestra.run.trial092.stdout:34359738395 2026-02-13T04:01:05.386 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph osd last-stat-seq osd.0 2026-02-13T04:01:05.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:05 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/2506385230' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T04:01:05.600 INFO:teuthology.orchestra.run.trial092.stdout:150323855379 2026-02-13T04:01:05.600 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph osd last-stat-seq osd.5 2026-02-13T04:01:05.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:05 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/2506385230' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2026-02-13T04:01:05.700 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:05.726 INFO:teuthology.orchestra.run.trial092.stdout:197568495632 2026-02-13T04:01:05.726 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph osd last-stat-seq osd.7 2026-02-13T04:01:05.728 INFO:teuthology.orchestra.run.trial092.stdout:133143986197 2026-02-13T04:01:05.728 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph osd last-stat-seq osd.4 2026-02-13T04:01:05.729 INFO:teuthology.orchestra.run.trial092.stdout:51539607578 2026-02-13T04:01:05.729 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-13T04:01:05.734 INFO:teuthology.orchestra.run.trial092.stdout:103079215126 2026-02-13T04:01:05.735 INFO:teuthology.orchestra.run.trial092.stdout:180388626449 2026-02-13T04:01:05.735 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph osd last-stat-seq osd.3 2026-02-13T04:01:05.736 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph osd last-stat-seq osd.6 2026-02-13T04:01:05.743 INFO:teuthology.orchestra.run.trial092.stdout:68719476761 2026-02-13T04:01:05.744 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph osd last-stat-seq osd.2 2026-02-13T04:01:05.753 INFO:teuthology.orchestra.run.trial092.stdout:257698037772 2026-02-13T04:01:05.753 INFO:teuthology.orchestra.run.trial092.stdout:274877906954 2026-02-13T04:01:05.754 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph osd last-stat-seq osd.9 2026-02-13T04:01:05.754 INFO:teuthology.orchestra.run.trial092.stdout:304942678026 2026-02-13T04:01:05.755 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph osd last-stat-seq osd.10 2026-02-13T04:01:05.756 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph osd last-stat-seq osd.11 2026-02-13T04:01:05.757 INFO:teuthology.orchestra.run.trial092.stdout:227633266702 2026-02-13T04:01:05.758 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph osd last-stat-seq osd.8 2026-02-13T04:01:05.874 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:05.965 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.962+0000 7f96e0fc66c0 1 -- 10.20.193.92:0/781373491 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f96dc116990 msgr2=0x7f96dc17a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.965 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.962+0000 7f96e0fc66c0 1 --2- 10.20.193.92:0/781373491 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f96dc116990 0x7f96dc17a5a0 secure :-1 s=READY pgs=211 gs=1 cs=0 l=1 c_cookie=17716333938945241854 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f96d0006fd0 tx=0x7f96d002fd70 comp rx=0 tx=0).stop 2026-02-13T04:01:05.967 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.964+0000 7f96e0fc66c0 1 -- 10.20.193.92:0/781373491 shutdown_connections 2026-02-13T04:01:05.968 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.964+0000 7f96e0fc66c0 1 --2- 10.20.193.92:0/781373491 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f96dc116990 0x7f96dc17a5a0 unknown :-1 s=CLOSED pgs=211 gs=1 cs=0 l=1 c_cookie=17716333938945241854 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.968 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.964+0000 7f96e0fc66c0 1 --2- 10.20.193.92:0/781373491 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f96dc1149f0 0x7f96dc1161e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.968 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.964+0000 7f96e0fc66c0 1 --2- 10.20.193.92:0/781373491 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f96dc114000 0x7f96dc1143d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.968 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.964+0000 7f96e0fc66c0 1 -- 10.20.193.92:0/781373491 >> 10.20.193.92:0/781373491 conn(0x7f96dc05aaa0 msgr2=0x7f96dc05b290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:05.968 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.964+0000 7f96e0fc66c0 1 -- 10.20.193.92:0/781373491 shutdown_connections 2026-02-13T04:01:05.968 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.964+0000 7f96e0fc66c0 1 -- 10.20.193.92:0/781373491 wait complete. 2026-02-13T04:01:05.972 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.966+0000 7f96e0fc66c0 1 Processor -- start 2026-02-13T04:01:05.972 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.966+0000 7f96e0fc66c0 1 -- start start 2026-02-13T04:01:05.972 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.966+0000 7f96e0fc66c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f96dc114000 0x7f96dc0f70a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.972 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.967+0000 7f96e0fc66c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f96dc116990 0x7f96dc17a510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.972 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.967+0000 7f96db7fe6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f96dc114000 0x7f96dc0f70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.972 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.967+0000 7f96db7fe6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f96dc114000 0x7f96dc0f70a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:45660/0 (socket says 10.20.193.92:45660) 2026-02-13T04:01:05.972 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.967+0000 7f96db7fe6c0 1 -- 10.20.193.92:0/3993246055 learned_addr learned my addr 10.20.193.92:0/3993246055 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:05.972 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.967+0000 7f96e0fc66c0 1 --2- 10.20.193.92:0/3993246055 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f96dc0f7790 0x7f96dc0fc9a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.972 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.967+0000 7f96e0fc66c0 1 -- 10.20.193.92:0/3993246055 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f96dc0fcee0 con 0x7f96dc116990 2026-02-13T04:01:05.972 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.967+0000 7f96e0fc66c0 1 -- 10.20.193.92:0/3993246055 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f96dc0fd050 con 0x7f96dc114000 2026-02-13T04:01:05.972 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.967+0000 7f96e0fc66c0 1 -- 10.20.193.92:0/3993246055 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f96dc0fd210 con 0x7f96dc0f7790 2026-02-13T04:01:05.973 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.968+0000 7f96dbfff6c0 1 --2- 10.20.193.92:0/3993246055 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f96dc0f7790 0x7f96dc0fc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.973 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.968+0000 7f96db7fe6c0 1 -- 10.20.193.92:0/3993246055 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f96dc0f7790 msgr2=0x7f96dc0fc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.973 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.968+0000 7f96db7fe6c0 1 --2- 10.20.193.92:0/3993246055 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f96dc0f7790 0x7f96dc0fc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.973 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.968+0000 7f96db7fe6c0 1 -- 10.20.193.92:0/3993246055 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f96dc116990 msgr2=0x7f96dc17a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:05.973 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.968+0000 7f96db7fe6c0 1 --2- 10.20.193.92:0/3993246055 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f96dc116990 0x7f96dc17a510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:05.973 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.968+0000 7f96db7fe6c0 1 -- 10.20.193.92:0/3993246055 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96d000a5b0 con 0x7f96dc114000 2026-02-13T04:01:05.973 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.968+0000 7f96db7fe6c0 1 --2- 10.20.193.92:0/3993246055 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f96dc114000 0x7f96dc0f70a0 secure :-1 s=READY pgs=98 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f96c800b800 tx=0x7f96c800bcd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:05.973 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.968+0000 7f96d8ff96c0 1 -- 10.20.193.92:0/3993246055 <== mon.2 v2:10.20.193.99:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f96c8004a80 con 0x7f96dc114000 2026-02-13T04:01:05.973 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.968+0000 7f96d8ff96c0 1 -- 10.20.193.92:0/3993246055 <== mon.2 v2:10.20.193.99:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f96c8009030 con 0x7f96dc114000 2026-02-13T04:01:05.974 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.969+0000 7f96d8ff96c0 1 -- 10.20.193.92:0/3993246055 <== mon.2 v2:10.20.193.99:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f96c8007440 con 0x7f96dc114000 2026-02-13T04:01:05.974 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.969+0000 7f96e0fc66c0 1 -- 10.20.193.92:0/3993246055 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96dc0fd4f0 con 0x7f96dc114000 2026-02-13T04:01:05.974 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.969+0000 7f96e0fc66c0 1 -- 10.20.193.92:0/3993246055 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96dc0fdb10 con 0x7f96dc114000 2026-02-13T04:01:05.974 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.970+0000 7f96e0fc66c0 1 -- 10.20.193.92:0/3993246055 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96dc1143d0 con 0x7f96dc114000 2026-02-13T04:01:05.976 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.972+0000 7f96d8ff96c0 1 -- 10.20.193.92:0/3993246055 <== mon.2 v2:10.20.193.99:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f96c8004060 con 0x7f96dc114000 2026-02-13T04:01:05.976 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.973+0000 7f96d8ff96c0 1 --2- 10.20.193.92:0/3993246055 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f96a80b5660 0x7f96a80d5b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:05.977 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.974+0000 7f96d8ff96c0 1 -- 10.20.193.92:0/3993246055 <== mon.2 v2:10.20.193.99:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7f96c80aa8c0 con 0x7f96dc114000 2026-02-13T04:01:05.978 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.974+0000 7f96daffd6c0 1 --2- 10.20.193.92:0/3993246055 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f96a80b5660 0x7f96a80d5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:05.978 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.974+0000 7f96d8ff96c0 1 -- 10.20.193.92:0/3993246055 <== mon.2 v2:10.20.193.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f96c80a66b0 con 0x7f96dc114000 2026-02-13T04:01:05.979 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:05.976+0000 7f96daffd6c0 1 --2- 10.20.193.92:0/3993246055 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f96a80b5660 0x7f96a80d5b10 secure :-1 s=READY pgs=167 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f96dc0fda30 tx=0x7f96cc0096a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:06.005 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:06.026 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:06.026 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:06.030 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:06.056 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:06.094 INFO:teuthology.orchestra.run.trial092.stdout:34359738395 2026-02-13T04:01:06.094 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.090+0000 7f96e0fc66c0 1 -- 10.20.193.92:0/3993246055 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f96dc0f8250 con 0x7f96dc114000 2026-02-13T04:01:06.095 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.091+0000 7f96d8ff96c0 1 -- 10.20.193.92:0/3993246055 <== mon.2 v2:10.20.193.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f96c80a6850 con 0x7f96dc114000 2026-02-13T04:01:06.098 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.095+0000 7f96e0fc66c0 1 -- 10.20.193.92:0/3993246055 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f96a80b5660 msgr2=0x7f96a80d5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.098 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.095+0000 7f96e0fc66c0 1 --2- 10.20.193.92:0/3993246055 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f96a80b5660 0x7f96a80d5b10 secure :-1 s=READY pgs=167 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f96dc0fda30 tx=0x7f96cc0096a0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.098 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.095+0000 7f96e0fc66c0 1 -- 10.20.193.92:0/3993246055 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f96dc114000 msgr2=0x7f96dc0f70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.099 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.095+0000 7f96e0fc66c0 1 --2- 10.20.193.92:0/3993246055 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f96dc114000 0x7f96dc0f70a0 secure :-1 s=READY pgs=98 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f96c800b800 tx=0x7f96c800bcd0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.100 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.096+0000 7f96e0fc66c0 1 -- 10.20.193.92:0/3993246055 shutdown_connections 2026-02-13T04:01:06.100 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.096+0000 7f96e0fc66c0 1 --2- 10.20.193.92:0/3993246055 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f96dc0f7790 0x7f96dc0fc9a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.100 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.096+0000 7f96e0fc66c0 1 --2- 10.20.193.92:0/3993246055 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f96dc116990 0x7f96dc17a510 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.100 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.096+0000 7f96e0fc66c0 1 --2- 10.20.193.92:0/3993246055 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f96a80b5660 0x7f96a80d5b10 unknown :-1 s=CLOSED pgs=167 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.100 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.096+0000 7f96e0fc66c0 1 --2- 10.20.193.92:0/3993246055 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f96dc114000 0x7f96dc0f70a0 unknown :-1 s=CLOSED pgs=98 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.100 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.096+0000 7f96e0fc66c0 1 -- 10.20.193.92:0/3993246055 >> 10.20.193.92:0/3993246055 conn(0x7f96dc05aaa0 msgr2=0x7f96dc05d410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:06.100 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.096+0000 7f96e0fc66c0 1 -- 10.20.193.92:0/3993246055 shutdown_connections 2026-02-13T04:01:06.100 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.096+0000 7f96e0fc66c0 1 -- 10.20.193.92:0/3993246055 wait complete. 2026-02-13T04:01:06.155 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:06.168 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:06.193 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:06.224 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.221+0000 7f2b7ae806c0 1 -- 10.20.193.92:0/2792715766 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2b7410fa40 msgr2=0x7f2b74114a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.225 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.221+0000 7f2b7ae806c0 1 --2- 10.20.193.92:0/2792715766 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2b7410fa40 0x7f2b74114a80 secure :-1 s=READY pgs=99 gs=2 cs=0 l=1 c_cookie=5253401517564600694 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b5c009970 tx=0x7f2b5c02ed70 comp rx=0 tx=0).stop 2026-02-13T04:01:06.226 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.223+0000 7f2b7ae806c0 1 -- 10.20.193.92:0/2792715766 shutdown_connections 2026-02-13T04:01:06.226 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.223+0000 7f2b7ae806c0 1 --2- 10.20.193.92:0/2792715766 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2b7410fa40 0x7f2b74114a80 unknown :-1 s=CLOSED pgs=99 gs=2 cs=0 l=1 c_cookie=5253401517564600694 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.226 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.223+0000 7f2b7ae806c0 1 --2- 10.20.193.92:0/2792715766 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2b74115260 0x7f2b74175c00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.226 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.223+0000 7f2b7ae806c0 1 --2- 10.20.193.92:0/2792715766 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2b7410f050 0x7f2b7410f420 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.226 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.223+0000 7f2b7ae806c0 1 -- 10.20.193.92:0/2792715766 >> 10.20.193.92:0/2792715766 conn(0x7f2b740ec950 msgr2=0x7f2b7410cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:06.226 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.223+0000 7f2b7ae806c0 1 -- 10.20.193.92:0/2792715766 shutdown_connections 2026-02-13T04:01:06.226 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.223+0000 7f2b7ae806c0 1 -- 10.20.193.92:0/2792715766 wait complete. 2026-02-13T04:01:06.227 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.224+0000 7f2b7ae806c0 1 Processor -- start 2026-02-13T04:01:06.227 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.224+0000 7f2b7ae806c0 1 -- start start 2026-02-13T04:01:06.227 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.224+0000 7f2b7ae806c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2b7410f050 0x7f2b740666e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.228 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.224+0000 7f2b7ae806c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2b74115260 0x7f2b74175b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.228 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.224+0000 7f2b7ae806c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2b74062990 0x7f2b74062e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.228 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.224+0000 7f2b7ae806c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2b740635c0 con 0x7f2b74115260 2026-02-13T04:01:06.228 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.224+0000 7f2b7ae806c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2b74063730 con 0x7f2b7410f050 2026-02-13T04:01:06.228 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.224+0000 7f2b7ae806c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f2b740f44a0 con 0x7f2b74062990 2026-02-13T04:01:06.228 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.224+0000 7f2b6bfff6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2b74115260 0x7f2b74175b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:06.228 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.224+0000 7f2b793f66c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2b74062990 0x7f2b74062e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:06.229 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.224+0000 7f2b6bfff6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2b74115260 0x7f2b74175b00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:53310/0 (socket says 10.20.193.92:53310) 2026-02-13T04:01:06.229 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.224+0000 7f2b6bfff6c0 1 -- 10.20.193.92:0/3508874662 learned_addr learned my addr 10.20.193.92:0/3508874662 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:06.229 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.225+0000 7f2b6bfff6c0 1 -- 10.20.193.92:0/3508874662 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2b74062990 msgr2=0x7f2b74062e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.229 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.225+0000 7f2b6bfff6c0 1 --2- 10.20.193.92:0/3508874662 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2b74062990 0x7f2b74062e30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.229 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.225+0000 7f2b6bfff6c0 1 -- 10.20.193.92:0/3508874662 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2b7410f050 msgr2=0x7f2b740666e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T04:01:06.229 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.225+0000 7f2b6bfff6c0 1 --2- 10.20.193.92:0/3508874662 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2b7410f050 0x7f2b740666e0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.229 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.225+0000 7f2b6bfff6c0 1 -- 10.20.193.92:0/3508874662 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b5c009590 con 0x7f2b74115260 2026-02-13T04:01:06.230 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.225+0000 7f2b6bfff6c0 1 --2- 10.20.193.92:0/3508874662 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2b74115260 0x7f2b74175b00 secure :-1 s=READY pgs=212 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b5c0092e0 tx=0x7f2b5c02f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:06.230 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.225+0000 7f2b69ffb6c0 1 -- 10.20.193.92:0/3508874662 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2b5c0028d0 con 0x7f2b74115260 2026-02-13T04:01:06.230 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.225+0000 7f2b69ffb6c0 1 -- 10.20.193.92:0/3508874662 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f2b5c0073f0 con 0x7f2b74115260 2026-02-13T04:01:06.230 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.225+0000 7f2b69ffb6c0 1 -- 10.20.193.92:0/3508874662 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2b5c038410 con 0x7f2b74115260 2026-02-13T04:01:06.230 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.225+0000 7f2b7ae806c0 1 -- 10.20.193.92:0/3508874662 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b740f4720 con 0x7f2b74115260 2026-02-13T04:01:06.230 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.225+0000 7f2b7ae806c0 1 -- 10.20.193.92:0/3508874662 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b740f4b50 con 0x7f2b74115260 2026-02-13T04:01:06.230 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.226+0000 7f2b7ae806c0 1 -- 10.20.193.92:0/3508874662 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b3c005310 con 0x7f2b74115260 2026-02-13T04:01:06.233 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.228+0000 7f2b69ffb6c0 1 -- 10.20.193.92:0/3508874662 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f2b5c002a30 con 0x7f2b74115260 2026-02-13T04:01:06.233 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.229+0000 7f2b69ffb6c0 1 --2- 10.20.193.92:0/3508874662 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f2b500b5830 0x7f2b500d5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.233 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.229+0000 7f2b69ffb6c0 1 -- 10.20.193.92:0/3508874662 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7f2b5c107bc0 con 0x7f2b74115260 2026-02-13T04:01:06.234 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.231+0000 7f2b78bf56c0 1 --2- 10.20.193.92:0/3508874662 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f2b500b5830 0x7f2b500d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:06.234 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.231+0000 7f2b69ffb6c0 1 -- 10.20.193.92:0/3508874662 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2b5c140620 con 0x7f2b74115260 2026-02-13T04:01:06.235 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.232+0000 7f2b78bf56c0 1 --2- 10.20.193.92:0/3508874662 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f2b500b5830 0x7f2b500d5ce0 secure :-1 s=READY pgs=168 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b64004750 tx=0x7f2b64009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:06.245 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:06.257 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:06.308 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:06 trial092 ceph-mon[23047]: pgmap v185: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 25 op/s 2026-02-13T04:01:06.308 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:06 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/3993246055' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-13T04:01:06.315 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.312+0000 7fa0981a76c0 1 -- 10.20.193.92:0/1291858682 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa090114000 msgr2=0x7fa0901143d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.316 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.312+0000 7fa094f166c0 1 -- 10.20.193.92:0/1291858682 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa08c030ac0 con 0x7fa090114000 2026-02-13T04:01:06.316 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.312+0000 7fa0981a76c0 1 --2- 10.20.193.92:0/1291858682 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa090114000 0x7fa0901143d0 secure :-1 s=READY pgs=213 gs=1 cs=0 l=1 c_cookie=16132514554457747110 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa08c00acd0 tx=0x7fa08c030040 comp rx=0 tx=0).stop 2026-02-13T04:01:06.318 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738395 got 34359738395 for osd.0 2026-02-13T04:01:06.318 DEBUG:teuthology.parallel:result is None 2026-02-13T04:01:06.326 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.323+0000 7fa0981a76c0 1 -- 10.20.193.92:0/1291858682 shutdown_connections 2026-02-13T04:01:06.326 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.323+0000 7fa0981a76c0 1 --2- 10.20.193.92:0/1291858682 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa090114910 0x7fa090116380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.326 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.323+0000 7fa0981a76c0 1 --2- 10.20.193.92:0/1291858682 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa0901168c0 0x7fa090116d60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.326 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.323+0000 7fa0981a76c0 1 --2- 10.20.193.92:0/1291858682 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa090114000 0x7fa0901143d0 unknown :-1 s=CLOSED pgs=213 gs=1 cs=0 l=1 c_cookie=16132514554457747110 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.326 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.323+0000 7fa0981a76c0 1 -- 10.20.193.92:0/1291858682 >> 10.20.193.92:0/1291858682 conn(0x7fa0900586e0 msgr2=0x7fa090058ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:06.327 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.323+0000 7fa0981a76c0 1 -- 10.20.193.92:0/1291858682 shutdown_connections 2026-02-13T04:01:06.327 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.323+0000 7fa0981a76c0 1 -- 10.20.193.92:0/1291858682 wait complete. 2026-02-13T04:01:06.330 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.327+0000 7f2c0b6f46c0 1 -- 10.20.193.92:0/2466153590 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2c04113dc0 msgr2=0x7f2c04114190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.330 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.327+0000 7f2c0b6f46c0 1 --2- 10.20.193.92:0/2466153590 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2c04113dc0 0x7f2c04114190 secure :-1 s=READY pgs=98 gs=1 cs=0 l=1 c_cookie=8397406204380169131 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c0000aa40 tx=0x7f2c0002fe00 comp rx=0 tx=0).stop 2026-02-13T04:01:06.331 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.324+0000 7fa0981a76c0 1 Processor -- start 2026-02-13T04:01:06.331 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.325+0000 7fa0981a76c0 1 -- start start 2026-02-13T04:01:06.331 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.325+0000 7fa0981a76c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa090114000 0x7fa0900f9f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.331 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.325+0000 7fa0981a76c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa090114910 0x7fa0900f6160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.331 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.325+0000 7fa0981a76c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa0901168c0 0x7fa0900f6810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.331 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.325+0000 7fa0981a76c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa0900f6fa0 con 0x7fa0901168c0 2026-02-13T04:01:06.331 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.325+0000 7fa0981a76c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa09017a760 con 0x7fa090114000 2026-02-13T04:01:06.331 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.325+0000 7fa0981a76c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fa09017a920 con 0x7fa090114910 2026-02-13T04:01:06.332 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.325+0000 7fa0957176c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa090114910 0x7fa0900f6160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:06.332 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.326+0000 7fa095f186c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa090114000 0x7fa0900f9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:06.332 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.326+0000 7fa095f186c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa090114000 0x7fa0900f9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:45682/0 (socket says 10.20.193.92:45682) 2026-02-13T04:01:06.332 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.326+0000 7fa0957176c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa090114910 0x7fa0900f6160 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:51926/0 (socket says 10.20.193.92:51926) 2026-02-13T04:01:06.332 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.326+0000 7fa095f186c0 1 -- 10.20.193.92:0/3602027367 learned_addr learned my addr 10.20.193.92:0/3602027367 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:06.332 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.326+0000 7fa0967196c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa0901168c0 0x7fa0900f6810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:06.332 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.326+0000 7fa0967196c0 1 -- 10.20.193.92:0/3602027367 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa090114910 msgr2=0x7fa0900f6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.332 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.326+0000 7fa0967196c0 1 --2- 10.20.193.92:0/3602027367 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa090114910 0x7fa0900f6160 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.332 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.326+0000 7fa0967196c0 1 -- 10.20.193.92:0/3602027367 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa090114000 msgr2=0x7fa0900f9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.332 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.326+0000 7fa0967196c0 1 --2- 10.20.193.92:0/3602027367 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa090114000 0x7fa0900f9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.332 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.326+0000 7fa0967196c0 1 -- 10.20.193.92:0/3602027367 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa08c00a660 con 0x7fa0901168c0 2026-02-13T04:01:06.332 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.326+0000 7fa0967196c0 1 --2- 10.20.193.92:0/3602027367 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa0901168c0 0x7fa0900f6810 secure :-1 s=READY pgs=214 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa08000b800 tx=0x7fa08000bcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:06.333 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.327+0000 7fa07effd6c0 1 -- 10.20.193.92:0/3602027367 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa080004350 con 0x7fa0901168c0 2026-02-13T04:01:06.333 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.327+0000 7fa0981a76c0 1 -- 10.20.193.92:0/3602027367 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa09017aba0 con 0x7fa0901168c0 2026-02-13T04:01:06.333 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.327+0000 7fa0981a76c0 1 -- 10.20.193.92:0/3602027367 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa09017b0d0 con 0x7fa0901168c0 2026-02-13T04:01:06.333 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.328+0000 7fa07effd6c0 1 -- 10.20.193.92:0/3602027367 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fa080009030 con 0x7fa0901168c0 2026-02-13T04:01:06.333 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.328+0000 7fa07effd6c0 1 -- 10.20.193.92:0/3602027367 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa080004350 con 0x7fa0901168c0 2026-02-13T04:01:06.333 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.329+0000 7fa07cff96c0 1 -- 10.20.193.92:0/3602027367 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa090114fe0 con 0x7fa0901168c0 2026-02-13T04:01:06.336 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.334+0000 7f2c0b6f46c0 1 -- 10.20.193.92:0/2466153590 shutdown_connections 2026-02-13T04:01:06.338 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.334+0000 7f2c0b6f46c0 1 --2- 10.20.193.92:0/2466153590 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2c041168c0 0x7f2c04116d10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.339 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.334+0000 7f2c0b6f46c0 1 --2- 10.20.193.92:0/2466153590 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2c041146d0 0x7f2c04116380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.339 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.334+0000 7f2c0b6f46c0 1 --2- 10.20.193.92:0/2466153590 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2c04113dc0 0x7f2c04114190 unknown :-1 s=CLOSED pgs=98 gs=1 cs=0 l=1 c_cookie=8397406204380169131 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.339 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.334+0000 7f2c0b6f46c0 1 -- 10.20.193.92:0/2466153590 >> 10.20.193.92:0/2466153590 conn(0x7f2c040586e0 msgr2=0x7f2c04058ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:06.339 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.334+0000 7f2c0b6f46c0 1 -- 10.20.193.92:0/2466153590 shutdown_connections 2026-02-13T04:01:06.339 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.334+0000 7f2c0b6f46c0 1 -- 10.20.193.92:0/2466153590 wait complete. 2026-02-13T04:01:06.339 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.335+0000 7f2c0b6f46c0 1 Processor -- start 2026-02-13T04:01:06.339 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.335+0000 7f2c0b6f46c0 1 -- start start 2026-02-13T04:01:06.340 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.336+0000 7f2c0b6f46c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2c04113dc0 0x7f2c04185b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.340 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.336+0000 7f2c0b6f46c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2c041146d0 0x7f2c04186080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.341 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.336+0000 7f2c0b6f46c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2c041168c0 0x7f2c041865c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.341 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.336+0000 7f2c094656c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2c04113dc0 0x7f2c04185b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:06.341 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.336+0000 7f2c094656c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2c04113dc0 0x7f2c04185b40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:45698/0 (socket says 10.20.193.92:45698) 2026-02-13T04:01:06.341 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.336+0000 7f2c094656c0 1 -- 10.20.193.92:0/2389867900 learned_addr learned my addr 10.20.193.92:0/2389867900 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:06.341 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.336+0000 7f2c0b6f46c0 1 -- 10.20.193.92:0/2389867900 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0415eac0 con 0x7f2c041168c0 2026-02-13T04:01:06.341 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.336+0000 7f2c0b6f46c0 1 -- 10.20.193.92:0/2389867900 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0415ec30 con 0x7f2c04113dc0 2026-02-13T04:01:06.341 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.336+0000 7f2c0b6f46c0 1 -- 10.20.193.92:0/2389867900 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0415edf0 con 0x7f2c041146d0 2026-02-13T04:01:06.341 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.336+0000 7f2c08c646c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2c041146d0 0x7f2c04186080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:06.341 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.337+0000 7f2c09c666c0 1 --2- 10.20.193.92:0/2389867900 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2c041168c0 0x7f2c041865c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:06.341 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.337+0000 7f2c08c646c0 1 -- 10.20.193.92:0/2389867900 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2c04113dc0 msgr2=0x7f2c04185b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.341 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.337+0000 7f2c08c646c0 1 --2- 10.20.193.92:0/2389867900 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2c04113dc0 0x7f2c04185b40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.342 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.337+0000 7f2c08c646c0 1 -- 10.20.193.92:0/2389867900 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2c041168c0 msgr2=0x7f2c041865c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.342 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.337+0000 7f2c08c646c0 1 --2- 10.20.193.92:0/2389867900 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2c041168c0 0x7f2c041865c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.342 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.337+0000 7f2c08c646c0 1 -- 10.20.193.92:0/2389867900 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c0000a660 con 0x7f2c041146d0 2026-02-13T04:01:06.342 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.337+0000 7f2c09c666c0 1 --2- 10.20.193.92:0/2389867900 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2c041168c0 0x7f2c041865c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T04:01:06.342 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.337+0000 7f2c08c646c0 1 --2- 10.20.193.92:0/2389867900 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2c041146d0 0x7f2c04186080 secure :-1 s=READY pgs=99 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2bf800b6c0 tx=0x7f2bf800bb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:06.342 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.338+0000 7f2bf27fc6c0 1 -- 10.20.193.92:0/2389867900 <== mon.1 v2:10.20.193.158:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2bf80044a0 con 0x7f2c041146d0 2026-02-13T04:01:06.346 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.342+0000 7fa07effd6c0 1 -- 10.20.193.92:0/3602027367 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fa08000cce0 con 0x7fa0901168c0 2026-02-13T04:01:06.349 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.338+0000 7f2bf27fc6c0 1 -- 10.20.193.92:0/2389867900 <== mon.1 v2:10.20.193.158:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f2bf8009030 con 0x7f2c041146d0 2026-02-13T04:01:06.349 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.340+0000 7f2bf27fc6c0 1 -- 10.20.193.92:0/2389867900 <== mon.1 v2:10.20.193.158:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2bf800ce60 con 0x7f2c041146d0 2026-02-13T04:01:06.349 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.340+0000 7f2c0b6f46c0 1 -- 10.20.193.92:0/2389867900 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c0415f0d0 con 0x7f2c041146d0 2026-02-13T04:01:06.349 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.340+0000 7f2c0b6f46c0 1 -- 10.20.193.92:0/2389867900 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c0415f5b0 con 0x7f2c041146d0 2026-02-13T04:01:06.349 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.346+0000 7f2c0b6f46c0 1 -- 10.20.193.92:0/2389867900 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bcc005310 con 0x7f2c041146d0 2026-02-13T04:01:06.350 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.347+0000 7fa07effd6c0 1 --2- 10.20.193.92:0/3602027367 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa0680b57c0 0x7fa0680d5c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.350 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.347+0000 7fa07effd6c0 1 -- 10.20.193.92:0/3602027367 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7fa0800e3780 con 0x7fa0901168c0 2026-02-13T04:01:06.351 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.347+0000 7fa095f186c0 1 --2- 10.20.193.92:0/3602027367 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa0680b57c0 0x7fa0680d5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:06.351 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.348+0000 7fa07effd6c0 1 -- 10.20.193.92:0/3602027367 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa0800a6110 con 0x7fa0901168c0 2026-02-13T04:01:06.352 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.349+0000 7fa095f186c0 1 --2- 10.20.193.92:0/3602027367 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa0680b57c0 0x7fa0680d5c70 secure :-1 s=READY pgs=169 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa08c030550 tx=0x7fa08c00a200 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:06.353 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.348+0000 7f2bf27fc6c0 1 -- 10.20.193.92:0/2389867900 <== mon.1 v2:10.20.193.158:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f2bf80026b0 con 0x7f2c041146d0 2026-02-13T04:01:06.353 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.349+0000 7f2bf27fc6c0 1 --2- 10.20.193.92:0/2389867900 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f2bd40b5820 0x7f2bd40d5cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.353 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.349+0000 7f2bf27fc6c0 1 -- 10.20.193.92:0/2389867900 <== mon.1 v2:10.20.193.158:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7f2bf80e3980 con 0x7f2c041146d0 2026-02-13T04:01:06.353 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.350+0000 7f2c094656c0 1 --2- 10.20.193.92:0/2389867900 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f2bd40b5820 0x7f2bd40d5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:06.353 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.350+0000 7f2c094656c0 1 --2- 10.20.193.92:0/2389867900 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f2bd40b5820 0x7f2bd40d5cd0 secure :-1 s=READY pgs=170 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c00006a60 tx=0x7f2c000069f0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:06.354 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.350+0000 7f2bf27fc6c0 1 -- 10.20.193.92:0/2389867900 <== mon.1 v2:10.20.193.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2bf80a62d0 con 0x7f2c041146d0 2026-02-13T04:01:06.357 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.355+0000 7f2b7ae806c0 1 -- 10.20.193.92:0/3508874662 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f2b3c005890 con 0x7f2b74115260 2026-02-13T04:01:06.362 INFO:teuthology.orchestra.run.trial092.stdout:150323855379 2026-02-13T04:01:06.362 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.355+0000 7f2b69ffb6c0 1 -- 10.20.193.92:0/3508874662 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f2b5c0ca510 con 0x7f2b74115260 2026-02-13T04:01:06.362 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.358+0000 7f2b7ae806c0 1 -- 10.20.193.92:0/3508874662 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f2b500b5830 msgr2=0x7f2b500d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.362 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.358+0000 7f2b7ae806c0 1 --2- 10.20.193.92:0/3508874662 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f2b500b5830 0x7f2b500d5ce0 secure :-1 s=READY pgs=168 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b64004750 tx=0x7f2b64009260 comp rx=0 tx=0).stop 2026-02-13T04:01:06.363 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.358+0000 7f2b7ae806c0 1 -- 10.20.193.92:0/3508874662 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2b74115260 msgr2=0x7f2b74175b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.363 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.358+0000 7f2b7ae806c0 1 --2- 10.20.193.92:0/3508874662 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2b74115260 0x7f2b74175b00 secure :-1 s=READY pgs=212 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b5c0092e0 tx=0x7f2b5c02f610 comp rx=0 tx=0).stop 2026-02-13T04:01:06.363 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.359+0000 7f2b7ae806c0 1 -- 10.20.193.92:0/3508874662 shutdown_connections 2026-02-13T04:01:06.363 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.359+0000 7f2b7ae806c0 1 --2- 10.20.193.92:0/3508874662 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2b74062990 0x7f2b74062e30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.363 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.359+0000 7f2b7ae806c0 1 --2- 10.20.193.92:0/3508874662 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2b74115260 0x7f2b74175b00 unknown :-1 s=CLOSED pgs=212 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.363 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.359+0000 7f2b7ae806c0 1 --2- 10.20.193.92:0/3508874662 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f2b500b5830 0x7f2b500d5ce0 unknown :-1 s=CLOSED pgs=168 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.363 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.359+0000 7f2b7ae806c0 1 --2- 10.20.193.92:0/3508874662 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2b7410f050 0x7f2b740666e0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.363 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.359+0000 7f2b7ae806c0 1 -- 10.20.193.92:0/3508874662 >> 10.20.193.92:0/3508874662 conn(0x7f2b740ec950 msgr2=0x7f2b7410d510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:06.364 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.360+0000 7f2b7ae806c0 1 -- 10.20.193.92:0/3508874662 shutdown_connections 2026-02-13T04:01:06.364 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.360+0000 7f2b7ae806c0 1 -- 10.20.193.92:0/3508874662 wait complete. 2026-02-13T04:01:06.385 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.380+0000 7fda808076c0 1 -- 10.20.193.92:0/906044881 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fda7c114000 msgr2=0x7fda7c1143d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.385 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.380+0000 7fda808076c0 1 --2- 10.20.193.92:0/906044881 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fda7c114000 0x7fda7c1143d0 secure :-1 s=READY pgs=215 gs=1 cs=0 l=1 c_cookie=18329707390679585572 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda7000aa40 tx=0x7fda7002fde0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.387 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.384+0000 7fda808076c0 1 -- 10.20.193.92:0/906044881 shutdown_connections 2026-02-13T04:01:06.388 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.384+0000 7fda808076c0 1 --2- 10.20.193.92:0/906044881 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fda7c1149f0 0x7fda7c1161e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.388 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.384+0000 7fda808076c0 1 --2- 10.20.193.92:0/906044881 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fda7c116990 0x7fda7c17a5a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.388 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.384+0000 7fda808076c0 1 --2- 10.20.193.92:0/906044881 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fda7c114000 0x7fda7c1143d0 unknown :-1 s=CLOSED pgs=215 gs=1 cs=0 l=1 c_cookie=18329707390679585572 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.388 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.384+0000 7fda808076c0 1 -- 10.20.193.92:0/906044881 >> 10.20.193.92:0/906044881 conn(0x7fda7c05aaa0 msgr2=0x7fda7c05b290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:06.388 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.385+0000 7fda808076c0 1 -- 10.20.193.92:0/906044881 shutdown_connections 2026-02-13T04:01:06.388 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.385+0000 7fda808076c0 1 -- 10.20.193.92:0/906044881 wait complete. 2026-02-13T04:01:06.391 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.387+0000 7fda808076c0 1 Processor -- start 2026-02-13T04:01:06.391 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.387+0000 7fda808076c0 1 -- start start 2026-02-13T04:01:06.391 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.387+0000 7fda808076c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fda7c114000 0x7fda7c125410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.391 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.387+0000 7fda808076c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fda7c116990 0x7fda7c121670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.391 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.387+0000 7fda808076c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fda7c121c50 0x7fda7c1220f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.391 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.388+0000 7fda808076c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fda7c1706b0 con 0x7fda7c121c50 2026-02-13T04:01:06.391 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.388+0000 7fda808076c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fda7c170820 con 0x7fda7c116990 2026-02-13T04:01:06.392 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.388+0000 7fda808076c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fda7c1709e0 con 0x7fda7c114000 2026-02-13T04:01:06.392 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.388+0000 7fda7affd6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fda7c116990 0x7fda7c121670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:06.392 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.388+0000 7fda7bfff6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fda7c121c50 0x7fda7c1220f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:06.392 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.388+0000 7fda7bfff6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fda7c121c50 0x7fda7c1220f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:53366/0 (socket says 10.20.193.92:53366) 2026-02-13T04:01:06.392 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.388+0000 7fda7bfff6c0 1 -- 10.20.193.92:0/3693575021 learned_addr learned my addr 10.20.193.92:0/3693575021 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:06.392 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.390+0000 7fda7bfff6c0 1 -- 10.20.193.92:0/3693575021 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fda7c114000 msgr2=0x7fda7c125410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.393 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.388+0000 7fda7b7fe6c0 1 --2- 10.20.193.92:0/3693575021 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fda7c114000 0x7fda7c125410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:06.393 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.390+0000 7fda7bfff6c0 1 --2- 10.20.193.92:0/3693575021 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fda7c114000 0x7fda7c125410 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.393 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.390+0000 7fda7bfff6c0 1 -- 10.20.193.92:0/3693575021 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fda7c116990 msgr2=0x7fda7c121670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.393 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.390+0000 7fda7bfff6c0 1 --2- 10.20.193.92:0/3693575021 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fda7c116990 0x7fda7c121670 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.393 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.390+0000 7fda7bfff6c0 1 -- 10.20.193.92:0/3693575021 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda6c0094c0 con 0x7fda7c121c50 2026-02-13T04:01:06.394 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.390+0000 7fda7b7fe6c0 1 --2- 10.20.193.92:0/3693575021 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fda7c114000 0x7fda7c125410 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T04:01:06.395 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.391+0000 7fda7bfff6c0 1 --2- 10.20.193.92:0/3693575021 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fda7c121c50 0x7fda7c1220f0 secure :-1 s=READY pgs=216 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda6800c9b0 tx=0x7fda6800ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:06.396 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.393+0000 7fda78ff96c0 1 -- 10.20.193.92:0/3693575021 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fda68009250 con 0x7fda7c121c50 2026-02-13T04:01:06.396 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.393+0000 7fda78ff96c0 1 -- 10.20.193.92:0/3693575021 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fda68002be0 con 0x7fda7c121c50 2026-02-13T04:01:06.396 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.393+0000 7fda78ff96c0 1 -- 10.20.193.92:0/3693575021 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fda680073f0 con 0x7fda7c121c50 2026-02-13T04:01:06.396 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.393+0000 7fda808076c0 1 -- 10.20.193.92:0/3693575021 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda680071c0 con 0x7fda7c121c50 2026-02-13T04:01:06.397 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.393+0000 7fda808076c0 1 -- 10.20.193.92:0/3693575021 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda7000a660 con 0x7fda7c121c50 2026-02-13T04:01:06.399 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.397+0000 7fda808076c0 1 -- 10.20.193.92:0/3693575021 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda4c005310 con 0x7fda7c121c50 2026-02-13T04:01:06.404 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.399+0000 7fda78ff96c0 1 -- 10.20.193.92:0/3693575021 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fda68004280 con 0x7fda7c121c50 2026-02-13T04:01:06.404 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.401+0000 7fda78ff96c0 1 --2- 10.20.193.92:0/3693575021 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fda5c0b58b0 0x7fda5c0d5d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.405 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.401+0000 7fda78ff96c0 1 -- 10.20.193.92:0/3693575021 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7fda680e3c20 con 0x7fda7c121c50 2026-02-13T04:01:06.405 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.402+0000 7fda7b7fe6c0 1 --2- 10.20.193.92:0/3693575021 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fda5c0b58b0 0x7fda5c0d5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:06.405 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.402+0000 7fda78ff96c0 1 -- 10.20.193.92:0/3693575021 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fda680a6570 con 0x7fda7c121c50 2026-02-13T04:01:06.405 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.402+0000 7fda7b7fe6c0 1 --2- 10.20.193.92:0/3693575021 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fda5c0b58b0 0x7fda5c0d5d60 secure :-1 s=READY pgs=171 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda7000a990 tx=0x7fda70002470 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:06.408 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.404+0000 7f041a2c26c0 1 -- 10.20.193.92:0/1722015631 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0414116990 msgr2=0x7f041417a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.408 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.404+0000 7f041a2c26c0 1 --2- 10.20.193.92:0/1722015631 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0414116990 0x7f041417a5a0 secure :-1 s=READY pgs=100 gs=2 cs=0 l=1 c_cookie=12230267695357414749 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f040c00aa40 tx=0x7f040c02fe30 comp rx=0 tx=0).stop 2026-02-13T04:01:06.408 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.405+0000 7f041a2c26c0 1 -- 10.20.193.92:0/1722015631 shutdown_connections 2026-02-13T04:01:06.408 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.405+0000 7f041a2c26c0 1 --2- 10.20.193.92:0/1722015631 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0414116990 0x7f041417a5a0 unknown :-1 s=CLOSED pgs=100 gs=2 cs=0 l=1 c_cookie=12230267695357414749 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.408 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.405+0000 7f041a2c26c0 1 --2- 10.20.193.92:0/1722015631 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f04141149f0 0x7f04141161e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.408 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.405+0000 7f041a2c26c0 1 --2- 10.20.193.92:0/1722015631 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0414114000 0x7f04141143d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.408 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.405+0000 7f041a2c26c0 1 -- 10.20.193.92:0/1722015631 >> 10.20.193.92:0/1722015631 conn(0x7f041405aaa0 msgr2=0x7f041405b290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:06.408 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.405+0000 7f041a2c26c0 1 -- 10.20.193.92:0/1722015631 shutdown_connections 2026-02-13T04:01:06.408 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.405+0000 7f041a2c26c0 1 -- 10.20.193.92:0/1722015631 wait complete. 2026-02-13T04:01:06.412 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.406+0000 7f041a2c26c0 1 Processor -- start 2026-02-13T04:01:06.412 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.406+0000 7f041a2c26c0 1 -- start start 2026-02-13T04:01:06.412 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.407+0000 7f041a2c26c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f0414114000 0x7f0414121790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.412 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.407+0000 7f041a2c26c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0414116990 0x7f0414121cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.412 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.407+0000 7f041a2c26c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0414127090 0x7f0414127530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.413 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.407+0000 7f04192c06c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f0414114000 0x7f0414121790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:06.413 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.407+0000 7f0418abf6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0414116990 0x7f0414121cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:06.413 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.407+0000 7f0418abf6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0414116990 0x7f0414121cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:45750/0 (socket says 10.20.193.92:45750) 2026-02-13T04:01:06.413 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.407+0000 7f04192c06c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f0414114000 0x7f0414121790 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:51982/0 (socket says 10.20.193.92:51982) 2026-02-13T04:01:06.413 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.407+0000 7f0419ac16c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0414127090 0x7f0414127530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:06.413 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.407+0000 7f0419ac16c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0414127090 0x7f0414127530 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:53388/0 (socket says 10.20.193.92:53388) 2026-02-13T04:01:06.413 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.407+0000 7f0418abf6c0 1 -- 10.20.193.92:0/2254218022 learned_addr learned my addr 10.20.193.92:0/2254218022 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:06.413 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.407+0000 7f041a2c26c0 1 -- 10.20.193.92:0/2254218022 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0414127aa0 con 0x7f0414127090 2026-02-13T04:01:06.413 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.407+0000 7f041a2c26c0 1 -- 10.20.193.92:0/2254218022 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0414127c10 con 0x7f0414116990 2026-02-13T04:01:06.413 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.408+0000 7f041a2c26c0 1 -- 10.20.193.92:0/2254218022 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f0414127dd0 con 0x7f0414114000 2026-02-13T04:01:06.413 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.408+0000 7f04192c06c0 1 -- 10.20.193.92:0/2254218022 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0414116990 msgr2=0x7f0414121cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.414 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.408+0000 7f04192c06c0 1 --2- 10.20.193.92:0/2254218022 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0414116990 0x7f0414121cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.414 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.408+0000 7f04192c06c0 1 -- 10.20.193.92:0/2254218022 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0414127090 msgr2=0x7f0414127530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.414 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.408+0000 7f04192c06c0 1 --2- 10.20.193.92:0/2254218022 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0414127090 0x7f0414127530 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.414 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.408+0000 7f04192c06c0 1 -- 10.20.193.92:0/2254218022 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04080094c0 con 0x7f0414114000 2026-02-13T04:01:06.414 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.408+0000 7f0419ac16c0 1 --2- 10.20.193.92:0/2254218022 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0414127090 0x7f0414127530 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T04:01:06.414 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.408+0000 7f04192c06c0 1 --2- 10.20.193.92:0/2254218022 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f0414114000 0x7f0414121790 secure :-1 s=READY pgs=100 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f040800ba30 tx=0x7f040800bf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:06.414 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.409+0000 7f04127fc6c0 1 -- 10.20.193.92:0/2254218022 <== mon.1 v2:10.20.193.158:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0408004460 con 0x7f0414114000 2026-02-13T04:01:06.415 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.409+0000 7f04127fc6c0 1 -- 10.20.193.92:0/2254218022 <== mon.1 v2:10.20.193.158:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f04080045c0 con 0x7f0414114000 2026-02-13T04:01:06.415 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.409+0000 7f04127fc6c0 1 -- 10.20.193.92:0/2254218022 <== mon.1 v2:10.20.193.158:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f04080071e0 con 0x7f0414114000 2026-02-13T04:01:06.415 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.409+0000 7f041a2c26c0 1 -- 10.20.193.92:0/2254218022 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03fc0094c0 con 0x7f0414114000 2026-02-13T04:01:06.415 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.409+0000 7f041a2c26c0 1 -- 10.20.193.92:0/2254218022 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f040c00a660 con 0x7f0414114000 2026-02-13T04:01:06.417 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.411+0000 7f04127fc6c0 1 -- 10.20.193.92:0/2254218022 <== mon.1 v2:10.20.193.158:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f040800c5d0 con 0x7f0414114000 2026-02-13T04:01:06.417 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.411+0000 7f041a2c26c0 1 -- 10.20.193.92:0/2254218022 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03dc005310 con 0x7f0414114000 2026-02-13T04:01:06.417 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.414+0000 7f04127fc6c0 1 --2- 10.20.193.92:0/2254218022 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f03e40b5760 0x7f03e40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.417 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.414+0000 7f04127fc6c0 1 -- 10.20.193.92:0/2254218022 <== mon.1 v2:10.20.193.158:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7f04080e3ca0 con 0x7f0414114000 2026-02-13T04:01:06.417 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.414+0000 7f0418abf6c0 1 --2- 10.20.193.92:0/2254218022 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f03e40b5760 0x7f03e40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:06.418 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.414+0000 7f04127fc6c0 1 -- 10.20.193.92:0/2254218022 <== mon.1 v2:10.20.193.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f04080a97a0 con 0x7f0414114000 2026-02-13T04:01:06.418 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.415+0000 7f0418abf6c0 1 --2- 10.20.193.92:0/2254218022 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f03e40b5760 0x7f03e40d5c10 secure :-1 s=READY pgs=172 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0414128120 tx=0x7f03fc009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:06.499 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.489+0000 7fdf3d7046c0 1 -- 10.20.193.92:0/3895643985 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdf381149f0 msgr2=0x7fdf38119070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.499 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.489+0000 7fdf3d7046c0 1 --2- 10.20.193.92:0/3895643985 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdf381149f0 0x7fdf38119070 secure :-1 s=READY pgs=217 gs=1 cs=0 l=1 c_cookie=11586819496217167563 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf20009970 tx=0x7fdf2002ed20 comp rx=0 tx=0).stop 2026-02-13T04:01:06.503 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.500+0000 7f2c0b6f46c0 1 -- 10.20.193.92:0/2389867900 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f2bcc0055c0 con 0x7f2c041146d0 2026-02-13T04:01:06.507 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.498+0000 7fdf3d7046c0 1 -- 10.20.193.92:0/3895643985 shutdown_connections 2026-02-13T04:01:06.507 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.498+0000 7fdf3d7046c0 1 --2- 10.20.193.92:0/3895643985 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fdf381197f0 0x7fdf3811a130 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.507 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.498+0000 7fdf3d7046c0 1 --2- 10.20.193.92:0/3895643985 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdf381149f0 0x7fdf38119070 unknown :-1 s=CLOSED pgs=217 gs=1 cs=0 l=1 c_cookie=11586819496217167563 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.507 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.498+0000 7fdf3d7046c0 1 --2- 10.20.193.92:0/3895643985 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fdf38114000 0x7fdf381143d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.507 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.498+0000 7fdf3d7046c0 1 -- 10.20.193.92:0/3895643985 >> 10.20.193.92:0/3895643985 conn(0x7fdf3805aaa0 msgr2=0x7fdf3805b290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:06.507 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.499+0000 7fdf3d7046c0 1 -- 10.20.193.92:0/3895643985 shutdown_connections 2026-02-13T04:01:06.507 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.499+0000 7fdf3d7046c0 1 -- 10.20.193.92:0/3895643985 wait complete. 2026-02-13T04:01:06.507 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.500+0000 7fdf3d7046c0 1 Processor -- start 2026-02-13T04:01:06.507 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.500+0000 7fdf3d7046c0 1 -- start start 2026-02-13T04:01:06.507 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.500+0000 7fdf3d7046c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fdf38114000 0x7fdf38126c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.508 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.501+0000 7fdf3d7046c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdf381197f0 0x7fdf381271d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.508 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.501+0000 7fdf3d7046c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fdf3812c590 0x7fdf3812ca30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.508 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.501+0000 7fdf3d7046c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdf3812cfa0 con 0x7fdf381197f0 2026-02-13T04:01:06.508 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.501+0000 7fdf3d7046c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fdf3812d110 con 0x7fdf3812c590 2026-02-13T04:01:06.508 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.501+0000 7fdf3d7046c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fdf3812d2d0 con 0x7fdf38114000 2026-02-13T04:01:06.508 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.501+0000 7fdf37fff6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fdf38114000 0x7fdf38126c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:06.508 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.501+0000 7fdf37fff6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fdf38114000 0x7fdf38126c90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:51996/0 (socket says 10.20.193.92:51996) 2026-02-13T04:01:06.508 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.501+0000 7fdf37fff6c0 1 -- 10.20.193.92:0/758884294 learned_addr learned my addr 10.20.193.92:0/758884294 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:06.508 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.501+0000 7fdf377fe6c0 1 --2- 10.20.193.92:0/758884294 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdf381197f0 0x7fdf381271d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:06.508 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.501+0000 7fdf3cf036c0 1 --2- 10.20.193.92:0/758884294 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fdf3812c590 0x7fdf3812ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:06.508 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.501+0000 7fdf37fff6c0 1 -- 10.20.193.92:0/758884294 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fdf3812c590 msgr2=0x7fdf3812ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.509 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.501+0000 7fdf37fff6c0 1 --2- 10.20.193.92:0/758884294 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fdf3812c590 0x7fdf3812ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.509 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.501+0000 7fdf37fff6c0 1 -- 10.20.193.92:0/758884294 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdf381197f0 msgr2=0x7fdf381271d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.509 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.501+0000 7fdf37fff6c0 1 --2- 10.20.193.92:0/758884294 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdf381197f0 0x7fdf381271d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.509 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.501+0000 7fdf37fff6c0 1 -- 10.20.193.92:0/758884294 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf20009590 con 0x7fdf38114000 2026-02-13T04:01:06.509 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.501+0000 7fdf377fe6c0 1 --2- 10.20.193.92:0/758884294 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdf381197f0 0x7fdf381271d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T04:01:06.509 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.502+0000 7fdf37fff6c0 1 --2- 10.20.193.92:0/758884294 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fdf38114000 0x7fdf38126c90 secure :-1 s=READY pgs=101 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf2c00b6c0 tx=0x7fdf2c00bb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:06.509 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.502+0000 7fdf357fa6c0 1 -- 10.20.193.92:0/758884294 <== mon.1 v2:10.20.193.158:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdf2c0044a0 con 0x7fdf38114000 2026-02-13T04:01:06.509 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.502+0000 7fdf3d7046c0 1 -- 10.20.193.92:0/758884294 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf3816d780 con 0x7fdf38114000 2026-02-13T04:01:06.509 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.502+0000 7fdf357fa6c0 1 -- 10.20.193.92:0/758884294 <== mon.1 v2:10.20.193.158:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fdf2c00be50 con 0x7fdf38114000 2026-02-13T04:01:06.509 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.502+0000 7fdf357fa6c0 1 -- 10.20.193.92:0/758884294 <== mon.1 v2:10.20.193.158:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdf2c00e070 con 0x7fdf38114000 2026-02-13T04:01:06.509 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.503+0000 7fdf3d7046c0 1 -- 10.20.193.92:0/758884294 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf3816dce0 con 0x7fdf38114000 2026-02-13T04:01:06.509 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.503+0000 7fdf3d7046c0 1 -- 10.20.193.92:0/758884294 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf3805bea0 con 0x7fdf38114000 2026-02-13T04:01:06.510 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.505+0000 7f2bf27fc6c0 1 -- 10.20.193.92:0/2389867900 <== mon.1 v2:10.20.193.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f2bf80a9480 con 0x7f2c041146d0 2026-02-13T04:01:06.510 INFO:teuthology.orchestra.run.trial092.stdout:274877906954 2026-02-13T04:01:06.511 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.505+0000 7fdf357fa6c0 1 -- 10.20.193.92:0/758884294 <== mon.1 v2:10.20.193.158:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fdf2c03a640 con 0x7fdf38114000 2026-02-13T04:01:06.511 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.507+0000 7fdf357fa6c0 1 --2- 10.20.193.92:0/758884294 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fdf080b5760 0x7fdf080d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.511 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.508+0000 7fdf357fa6c0 1 -- 10.20.193.92:0/758884294 <== mon.1 v2:10.20.193.158:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7fdf2c0e3ad0 con 0x7fdf38114000 2026-02-13T04:01:06.512 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.508+0000 7fdf377fe6c0 1 --2- 10.20.193.92:0/758884294 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fdf080b5760 0x7fdf080d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:06.512 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.508+0000 7f2c0b6f46c0 1 -- 10.20.193.92:0/2389867900 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f2bd40b5820 msgr2=0x7f2bd40d5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.512 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.508+0000 7f2c0b6f46c0 1 --2- 10.20.193.92:0/2389867900 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f2bd40b5820 0x7f2bd40d5cd0 secure :-1 s=READY pgs=170 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c00006a60 tx=0x7f2c000069f0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.512 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.508+0000 7f2c0b6f46c0 1 -- 10.20.193.92:0/2389867900 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2c041146d0 msgr2=0x7f2c04186080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.513 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.508+0000 7f2c0b6f46c0 1 --2- 10.20.193.92:0/2389867900 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2c041146d0 0x7f2c04186080 secure :-1 s=READY pgs=99 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2bf800b6c0 tx=0x7f2bf800bb90 comp rx=0 tx=0).stop 2026-02-13T04:01:06.513 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.509+0000 7f2c0b6f46c0 1 -- 10.20.193.92:0/2389867900 shutdown_connections 2026-02-13T04:01:06.513 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.509+0000 7f2c0b6f46c0 1 --2- 10.20.193.92:0/2389867900 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2c041168c0 0x7f2c041865c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.513 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.509+0000 7f2c0b6f46c0 1 --2- 10.20.193.92:0/2389867900 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2c041146d0 0x7f2c04186080 unknown :-1 s=CLOSED pgs=99 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.513 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.509+0000 7fdf357fa6c0 1 -- 10.20.193.92:0/758884294 <== mon.1 v2:10.20.193.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fdf2c0a9430 con 0x7fdf38114000 2026-02-13T04:01:06.514 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.509+0000 7f2c0b6f46c0 1 --2- 10.20.193.92:0/2389867900 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f2bd40b5820 0x7f2bd40d5cd0 unknown :-1 s=CLOSED pgs=170 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.514 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.509+0000 7f2c0b6f46c0 1 --2- 10.20.193.92:0/2389867900 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2c04113dc0 0x7f2c04185b40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.514 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.509+0000 7f2c0b6f46c0 1 -- 10.20.193.92:0/2389867900 >> 10.20.193.92:0/2389867900 conn(0x7f2c040586e0 msgr2=0x7f2c04119e30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:06.514 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.509+0000 7f2c0b6f46c0 1 -- 10.20.193.92:0/2389867900 shutdown_connections 2026-02-13T04:01:06.514 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.510+0000 7fdf377fe6c0 1 --2- 10.20.193.92:0/758884294 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fdf080b5760 0x7fdf080d5c10 secure :-1 s=READY pgs=173 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf200023e0 tx=0x7fdf20031cd0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:06.517 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.510+0000 7f2c0b6f46c0 1 -- 10.20.193.92:0/2389867900 wait complete. 2026-02-13T04:01:06.521 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.518+0000 7f42ca9e06c0 1 -- 10.20.193.92:0/2259734523 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f42c4114000 msgr2=0x7f42c41143d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.521 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.518+0000 7f42ca9e06c0 1 --2- 10.20.193.92:0/2259734523 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f42c4114000 0x7f42c41143d0 secure :-1 s=READY pgs=102 gs=1 cs=0 l=1 c_cookie=6776275122662267496 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f42a80085b0 tx=0x7f42a802ed40 comp rx=0 tx=0).stop 2026-02-13T04:01:06.522 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.520+0000 7f42ca9e06c0 1 -- 10.20.193.92:0/2259734523 shutdown_connections 2026-02-13T04:01:06.523 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.520+0000 7f42ca9e06c0 1 --2- 10.20.193.92:0/2259734523 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f42c4116b30 0x7f42c417a760 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.523 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.520+0000 7f42ca9e06c0 1 --2- 10.20.193.92:0/2259734523 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f42c41149f0 0x7f42c4116380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.524 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.520+0000 7f42ca9e06c0 1 --2- 10.20.193.92:0/2259734523 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f42c4114000 0x7f42c41143d0 unknown :-1 s=CLOSED pgs=102 gs=1 cs=0 l=1 c_cookie=6776275122662267496 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.524 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.520+0000 7f42ca9e06c0 1 -- 10.20.193.92:0/2259734523 >> 10.20.193.92:0/2259734523 conn(0x7f42c40586e0 msgr2=0x7f42c4058ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:06.524 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.520+0000 7f42ca9e06c0 1 -- 10.20.193.92:0/2259734523 shutdown_connections 2026-02-13T04:01:06.524 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.520+0000 7f42ca9e06c0 1 -- 10.20.193.92:0/2259734523 wait complete. 2026-02-13T04:01:06.524 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.521+0000 7f42ca9e06c0 1 Processor -- start 2026-02-13T04:01:06.525 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.521+0000 7f42ca9e06c0 1 -- start start 2026-02-13T04:01:06.525 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.522+0000 7f42ca9e06c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f42c4114000 0x7f42c4121950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.525 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.522+0000 7f42ca9e06c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f42c4116b30 0x7f42c4121e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.525 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.522+0000 7f42ca9e06c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f42c4127200 0x7f42c41276a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.527 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.523+0000 7f42c3fff6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f42c4114000 0x7f42c4121950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:06.527 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.523+0000 7f42c37fe6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f42c4116b30 0x7f42c4121e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:06.527 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.523+0000 7f42c3fff6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f42c4114000 0x7f42c4121950 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:53438/0 (socket says 10.20.193.92:53438) 2026-02-13T04:01:06.527 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.523+0000 7f42c3fff6c0 1 -- 10.20.193.92:0/3754188425 learned_addr learned my addr 10.20.193.92:0/3754188425 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:06.527 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.523+0000 7f42c8f566c0 1 --2- 10.20.193.92:0/3754188425 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f42c4127200 0x7f42c41276a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:06.527 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.523+0000 7f42ca9e06c0 1 -- 10.20.193.92:0/3754188425 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f42c4127c10 con 0x7f42c4114000 2026-02-13T04:01:06.527 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.523+0000 7f42ca9e06c0 1 -- 10.20.193.92:0/3754188425 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f42c4127d80 con 0x7f42c4127200 2026-02-13T04:01:06.528 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.523+0000 7f42ca9e06c0 1 -- 10.20.193.92:0/3754188425 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f42c4127f40 con 0x7f42c4116b30 2026-02-13T04:01:06.528 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.523+0000 7f42c8f566c0 1 -- 10.20.193.92:0/3754188425 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f42c4116b30 msgr2=0x7f42c4121e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.528 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.523+0000 7f42c8f566c0 1 --2- 10.20.193.92:0/3754188425 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f42c4116b30 0x7f42c4121e90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.528 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.523+0000 7f42c8f566c0 1 -- 10.20.193.92:0/3754188425 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f42c4114000 msgr2=0x7f42c4121950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.528 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.523+0000 7f42c8f566c0 1 --2- 10.20.193.92:0/3754188425 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f42c4114000 0x7f42c4121950 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.528 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.523+0000 7f42c8f566c0 1 -- 10.20.193.92:0/3754188425 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42b000f620 con 0x7f42c4127200 2026-02-13T04:01:06.528 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.523+0000 7f42c37fe6c0 1 --2- 10.20.193.92:0/3754188425 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f42c4116b30 0x7f42c4121e90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T04:01:06.528 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.524+0000 7f42c8f566c0 1 --2- 10.20.193.92:0/3754188425 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f42c4127200 0x7f42c41276a0 secure :-1 s=READY pgs=102 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f42b8006fd0 tx=0x7f42b800cc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:06.529 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.524+0000 7f42c17fa6c0 1 -- 10.20.193.92:0/3754188425 <== mon.2 v2:10.20.193.99:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f42b8003c40 con 0x7f42c4127200 2026-02-13T04:01:06.529 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.524+0000 7f42c17fa6c0 1 -- 10.20.193.92:0/3754188425 <== mon.2 v2:10.20.193.99:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f42b800a070 con 0x7f42c4127200 2026-02-13T04:01:06.530 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.527+0000 7fd7ac7db6c0 1 -- 10.20.193.92:0/3202932412 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fd7a41532d0 msgr2=0x7fd7a4173710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.530 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.527+0000 7fd7ac7db6c0 1 --2- 10.20.193.92:0/3202932412 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fd7a41532d0 0x7fd7a4173710 secure :-1 s=READY pgs=101 gs=2 cs=0 l=1 c_cookie=1634800287177163946 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd7a000aa40 tx=0x7fd7a002fde0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.530 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.527+0000 7f041a2c26c0 1 -- 10.20.193.92:0/2254218022 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f03dc0055c0 con 0x7f0414114000 2026-02-13T04:01:06.531 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.528+0000 7fd7ac7db6c0 1 -- 10.20.193.92:0/3202932412 shutdown_connections 2026-02-13T04:01:06.531 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.528+0000 7fd7ac7db6c0 1 --2- 10.20.193.92:0/3202932412 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fd7a41532d0 0x7fd7a4173710 unknown :-1 s=CLOSED pgs=101 gs=2 cs=0 l=1 c_cookie=1634800287177163946 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.531 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.528+0000 7fd7ac7db6c0 1 --2- 10.20.193.92:0/3202932412 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd7a410e710 0x7fd7a4152d00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.531 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.528+0000 7fd7ac7db6c0 1 --2- 10.20.193.92:0/3202932412 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd7a410dd20 0x7fd7a410e0f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.531 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.528+0000 7fd7ac7db6c0 1 -- 10.20.193.92:0/3202932412 >> 10.20.193.92:0/3202932412 conn(0x7fd7a40e9700 msgr2=0x7fd7a4109b10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:06.531 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.528+0000 7fd7ac7db6c0 1 -- 10.20.193.92:0/3202932412 shutdown_connections 2026-02-13T04:01:06.531 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.528+0000 7fd7ac7db6c0 1 -- 10.20.193.92:0/3202932412 wait complete. 2026-02-13T04:01:06.532 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.527+0000 7f04127fc6c0 1 -- 10.20.193.92:0/2254218022 <== mon.1 v2:10.20.193.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f04080a9980 con 0x7f0414114000 2026-02-13T04:01:06.532 INFO:teuthology.orchestra.run.trial092.stdout:180388626448 2026-02-13T04:01:06.532 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.528+0000 7fd7ac7db6c0 1 Processor -- start 2026-02-13T04:01:06.532 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.529+0000 7fd7ac7db6c0 1 -- start start 2026-02-13T04:01:06.533 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.525+0000 7f42c17fa6c0 1 -- 10.20.193.92:0/3754188425 <== mon.2 v2:10.20.193.99:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f42b80081c0 con 0x7f42c4127200 2026-02-13T04:01:06.533 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.525+0000 7f42ca9e06c0 1 -- 10.20.193.92:0/3754188425 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42a80081d0 con 0x7f42c4127200 2026-02-13T04:01:06.533 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.525+0000 7f42ca9e06c0 1 -- 10.20.193.92:0/3754188425 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42c41686c0 con 0x7f42c4127200 2026-02-13T04:01:06.533 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.526+0000 7f42ca9e06c0 1 -- 10.20.193.92:0/3754188425 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42c4114fe0 con 0x7f42c4127200 2026-02-13T04:01:06.533 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.529+0000 7fd7ac7db6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fd7a410dd20 0x7fd7a415eda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.533 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.529+0000 7fd7ac7db6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd7a410e710 0x7fd7a415f2e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.534 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.529+0000 7fd7aa54c6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fd7a410dd20 0x7fd7a415eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:06.534 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.529+0000 7fd7ac7db6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd7a41532d0 0x7fd7a41646a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.534 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.529+0000 7fd7a9d4b6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd7a410e710 0x7fd7a415f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:06.534 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.529+0000 7fd7a9d4b6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd7a410e710 0x7fd7a415f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:52020/0 (socket says 10.20.193.92:52020) 2026-02-13T04:01:06.534 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.529+0000 7fd7aa54c6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fd7a410dd20 0x7fd7a415eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:45800/0 (socket says 10.20.193.92:45800) 2026-02-13T04:01:06.534 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.529+0000 7fd7a9d4b6c0 1 -- 10.20.193.92:0/926560666 learned_addr learned my addr 10.20.193.92:0/926560666 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:06.534 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.529+0000 7fd7ac7db6c0 1 -- 10.20.193.92:0/926560666 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a4164cf0 con 0x7fd7a41532d0 2026-02-13T04:01:06.534 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.529+0000 7fd7ac7db6c0 1 -- 10.20.193.92:0/926560666 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a4164e60 con 0x7fd7a410dd20 2026-02-13T04:01:06.534 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.529+0000 7fd7ac7db6c0 1 -- 10.20.193.92:0/926560666 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fd7a4165020 con 0x7fd7a410e710 2026-02-13T04:01:06.534 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.530+0000 7fd7aad4d6c0 1 --2- 10.20.193.92:0/926560666 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd7a41532d0 0x7fd7a41646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:06.534 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.530+0000 7fd7aa54c6c0 1 -- 10.20.193.92:0/926560666 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd7a410e710 msgr2=0x7fd7a415f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.534 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.530+0000 7fd7aa54c6c0 1 --2- 10.20.193.92:0/926560666 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd7a410e710 0x7fd7a415f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.535 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.530+0000 7fd7aa54c6c0 1 -- 10.20.193.92:0/926560666 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd7a41532d0 msgr2=0x7fd7a41646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.535 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.531+0000 7f041a2c26c0 1 -- 10.20.193.92:0/2254218022 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f03e40b5760 msgr2=0x7f03e40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.535 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.531+0000 7f041a2c26c0 1 --2- 10.20.193.92:0/2254218022 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f03e40b5760 0x7f03e40d5c10 secure :-1 s=READY pgs=172 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0414128120 tx=0x7f03fc009260 comp rx=0 tx=0).stop 2026-02-13T04:01:06.535 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.531+0000 7f041a2c26c0 1 -- 10.20.193.92:0/2254218022 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f0414114000 msgr2=0x7f0414121790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.536 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.531+0000 7f041a2c26c0 1 --2- 10.20.193.92:0/2254218022 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f0414114000 0x7f0414121790 secure :-1 s=READY pgs=100 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f040800ba30 tx=0x7f040800bf00 comp rx=0 tx=0).stop 2026-02-13T04:01:06.536 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.531+0000 7f041a2c26c0 1 -- 10.20.193.92:0/2254218022 shutdown_connections 2026-02-13T04:01:06.536 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.531+0000 7f041a2c26c0 1 --2- 10.20.193.92:0/2254218022 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f03e40b5760 0x7f03e40d5c10 unknown :-1 s=CLOSED pgs=172 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.536 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.531+0000 7f041a2c26c0 1 --2- 10.20.193.92:0/2254218022 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0414116990 0x7f0414121cd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.536 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.531+0000 7f041a2c26c0 1 --2- 10.20.193.92:0/2254218022 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0414127090 0x7f0414127530 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.536 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.531+0000 7f041a2c26c0 1 --2- 10.20.193.92:0/2254218022 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f0414114000 0x7f0414121790 unknown :-1 s=CLOSED pgs=100 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.536 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.531+0000 7f041a2c26c0 1 -- 10.20.193.92:0/2254218022 >> 10.20.193.92:0/2254218022 conn(0x7f041405aaa0 msgr2=0x7f0414118a90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:06.536 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.531+0000 7f041a2c26c0 1 -- 10.20.193.92:0/2254218022 shutdown_connections 2026-02-13T04:01:06.536 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.531+0000 7f041a2c26c0 1 -- 10.20.193.92:0/2254218022 wait complete. 2026-02-13T04:01:06.537 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.530+0000 7fd7aa54c6c0 1 --2- 10.20.193.92:0/926560666 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd7a41532d0 0x7fd7a41646a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.537 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.530+0000 7f42c17fa6c0 1 -- 10.20.193.92:0/3754188425 <== mon.2 v2:10.20.193.99:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f42b800d4d0 con 0x7f42c4127200 2026-02-13T04:01:06.537 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.530+0000 7fd7aa54c6c0 1 -- 10.20.193.92:0/926560666 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7940094c0 con 0x7fd7a410dd20 2026-02-13T04:01:06.537 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.532+0000 7fd7aad4d6c0 1 --2- 10.20.193.92:0/926560666 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd7a41532d0 0x7fd7a41646a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T04:01:06.538 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.533+0000 7fd7aa54c6c0 1 --2- 10.20.193.92:0/926560666 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fd7a410dd20 0x7fd7a415eda0 secure :-1 s=READY pgs=103 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd79800b6e0 tx=0x7fd79800bbb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:06.539 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.536+0000 7fd7937fe6c0 1 -- 10.20.193.92:0/926560666 <== mon.2 v2:10.20.193.99:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd798004a80 con 0x7fd7a410dd20 2026-02-13T04:01:06.540 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.536+0000 7fd7ac7db6c0 1 -- 10.20.193.92:0/926560666 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7a000a660 con 0x7fd7a410dd20 2026-02-13T04:01:06.540 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.536+0000 7fd7ac7db6c0 1 -- 10.20.193.92:0/926560666 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7a414eca0 con 0x7fd7a410dd20 2026-02-13T04:01:06.540 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.537+0000 7fd7937fe6c0 1 -- 10.20.193.92:0/926560666 <== mon.2 v2:10.20.193.99:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fd798009030 con 0x7fd7a410dd20 2026-02-13T04:01:06.540 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.537+0000 7fd7937fe6c0 1 -- 10.20.193.92:0/926560666 <== mon.2 v2:10.20.193.99:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd798004a80 con 0x7fd7a410dd20 2026-02-13T04:01:06.542 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.539+0000 7fd7ac7db6c0 1 -- 10.20.193.92:0/926560666 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7a405fb90 con 0x7fd7a410dd20 2026-02-13T04:01:06.542 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.532+0000 7f42c17fa6c0 1 --2- 10.20.193.92:0/3754188425 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f42980b56e0 0x7f42980d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.542 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.532+0000 7f42c17fa6c0 1 -- 10.20.193.92:0/3754188425 <== mon.2 v2:10.20.193.99:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7f42b800d7b0 con 0x7f42c4127200 2026-02-13T04:01:06.542 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.532+0000 7f42c3fff6c0 1 --2- 10.20.193.92:0/3754188425 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f42980b56e0 0x7f42980d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:06.543 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.533+0000 7f42c3fff6c0 1 --2- 10.20.193.92:0/3754188425 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f42980b56e0 0x7f42980d5b90 secure :-1 s=READY pgs=174 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f42a80023e0 tx=0x7f42a8005910 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:06.543 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.537+0000 7f42c17fa6c0 1 -- 10.20.193.92:0/3754188425 <== mon.2 v2:10.20.193.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f42b80a75f0 con 0x7f42c4127200 2026-02-13T04:01:06.550 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.544+0000 7fd7937fe6c0 1 -- 10.20.193.92:0/926560666 <== mon.2 v2:10.20.193.99:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fd79800cbc0 con 0x7fd7a410dd20 2026-02-13T04:01:06.552 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.550+0000 7fda808076c0 1 -- 10.20.193.92:0/3693575021 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fda4c0055c0 con 0x7fda7c121c50 2026-02-13T04:01:06.554 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.552+0000 7fda78ff96c0 1 -- 10.20.193.92:0/3693575021 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fda680a9720 con 0x7fda7c121c50 2026-02-13T04:01:06.555 INFO:teuthology.orchestra.run.trial092.stdout:257698037771 2026-02-13T04:01:06.560 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855379 got 150323855379 for osd.5 2026-02-13T04:01:06.560 DEBUG:teuthology.parallel:result is None 2026-02-13T04:01:06.563 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.560+0000 7fda808076c0 1 -- 10.20.193.92:0/3693575021 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fda5c0b58b0 msgr2=0x7fda5c0d5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.564 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.560+0000 7fda808076c0 1 --2- 10.20.193.92:0/3693575021 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fda5c0b58b0 0x7fda5c0d5d60 secure :-1 s=READY pgs=171 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda7000a990 tx=0x7fda70002470 comp rx=0 tx=0).stop 2026-02-13T04:01:06.565 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.560+0000 7fda808076c0 1 -- 10.20.193.92:0/3693575021 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fda7c121c50 msgr2=0x7fda7c1220f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.565 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.560+0000 7fda808076c0 1 --2- 10.20.193.92:0/3693575021 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fda7c121c50 0x7fda7c1220f0 secure :-1 s=READY pgs=216 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda6800c9b0 tx=0x7fda6800ce80 comp rx=0 tx=0).stop 2026-02-13T04:01:06.565 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.560+0000 7fda808076c0 1 -- 10.20.193.92:0/3693575021 shutdown_connections 2026-02-13T04:01:06.565 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.560+0000 7fda808076c0 1 --2- 10.20.193.92:0/3693575021 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fda5c0b58b0 0x7fda5c0d5d60 unknown :-1 s=CLOSED pgs=171 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.565 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.560+0000 7fda808076c0 1 --2- 10.20.193.92:0/3693575021 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fda7c116990 0x7fda7c121670 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.565 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.560+0000 7fda808076c0 1 --2- 10.20.193.92:0/3693575021 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fda7c121c50 0x7fda7c1220f0 unknown :-1 s=CLOSED pgs=216 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.565 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.560+0000 7fda808076c0 1 --2- 10.20.193.92:0/3693575021 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fda7c114000 0x7fda7c125410 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.565 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.560+0000 7fda808076c0 1 -- 10.20.193.92:0/3693575021 >> 10.20.193.92:0/3693575021 conn(0x7fda7c05aaa0 msgr2=0x7fda7c119ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:06.565 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.561+0000 7fda808076c0 1 -- 10.20.193.92:0/3693575021 shutdown_connections 2026-02-13T04:01:06.565 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.561+0000 7fda808076c0 1 -- 10.20.193.92:0/3693575021 wait complete. 2026-02-13T04:01:06.566 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.563+0000 7ffbd8b2b6c0 1 -- 10.20.193.92:0/1615683875 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ffbcc0c4b80 msgr2=0x7ffbcc0c9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.573 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.563+0000 7ffbd8b2b6c0 1 --2- 10.20.193.92:0/1615683875 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ffbcc0c4b80 0x7ffbcc0c9bc0 secure :-1 s=READY pgs=218 gs=1 cs=0 l=1 c_cookie=8702577177182511191 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffbc0009c00 tx=0x7ffbc002efd0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.573 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.564+0000 7ffbd8b2b6c0 1 -- 10.20.193.92:0/1615683875 shutdown_connections 2026-02-13T04:01:06.573 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.564+0000 7ffbd8b2b6c0 1 --2- 10.20.193.92:0/1615683875 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ffbcc0ca3a0 0x7ffbcc12ad40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.573 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.564+0000 7ffbd8b2b6c0 1 --2- 10.20.193.92:0/1615683875 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ffbcc0c4b80 0x7ffbcc0c9bc0 unknown :-1 s=CLOSED pgs=218 gs=1 cs=0 l=1 c_cookie=8702577177182511191 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.573 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.564+0000 7ffbd8b2b6c0 1 --2- 10.20.193.92:0/1615683875 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ffbcc0c4190 0x7ffbcc0c4560 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.573 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.564+0000 7ffbd8b2b6c0 1 -- 10.20.193.92:0/1615683875 >> 10.20.193.92:0/1615683875 conn(0x7ffbcc01c5c0 msgr2=0x7ffbcc01cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:06.573 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.565+0000 7ffbd8b2b6c0 1 -- 10.20.193.92:0/1615683875 shutdown_connections 2026-02-13T04:01:06.574 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.565+0000 7ffbd8b2b6c0 1 -- 10.20.193.92:0/1615683875 wait complete. 2026-02-13T04:01:06.574 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.566+0000 7ffbd8b2b6c0 1 Processor -- start 2026-02-13T04:01:06.574 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.567+0000 7ffbd8b2b6c0 1 -- start start 2026-02-13T04:01:06.574 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.567+0000 7ffbd8b2b6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ffbcc0c4190 0x7ffbcc0d1f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.574 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.567+0000 7ffbd8b2b6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ffbcc0ca3a0 0x7ffbcc0d24a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.574 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.567+0000 7ffbd8b2b6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ffbcc0d7810 0x7ffbcc0d7cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.574 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.567+0000 7ffbd8b2b6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc0d8220 con 0x7ffbcc0ca3a0 2026-02-13T04:01:06.574 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.567+0000 7ffbd8b2b6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc0d8390 con 0x7ffbcc0d7810 2026-02-13T04:01:06.574 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.567+0000 7ffbd8b2b6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7ffbcc0d8550 con 0x7ffbcc0c4190 2026-02-13T04:01:06.574 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.568+0000 7ffbd1d746c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ffbcc0ca3a0 0x7ffbcc0d24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:06.574 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.568+0000 7ffbd1d746c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ffbcc0ca3a0 0x7ffbcc0d24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:53492/0 (socket says 10.20.193.92:53492) 2026-02-13T04:01:06.575 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.568+0000 7ffbd1d746c0 1 -- 10.20.193.92:0/3581742503 learned_addr learned my addr 10.20.193.92:0/3581742503 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:06.575 INFO:teuthology.orchestra.run.trial092.stdout:197568495631 2026-02-13T04:01:06.575 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.564+0000 7fa07cff96c0 1 -- 10.20.193.92:0/3602027367 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fa09017ea60 con 0x7fa0901168c0 2026-02-13T04:01:06.575 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.564+0000 7fa07effd6c0 1 -- 10.20.193.92:0/3602027367 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa0800a92c0 con 0x7fa0901168c0 2026-02-13T04:01:06.576 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.567+0000 7fa07cff96c0 1 -- 10.20.193.92:0/3602027367 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa0680b57c0 msgr2=0x7fa0680d5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.576 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.567+0000 7fa07cff96c0 1 --2- 10.20.193.92:0/3602027367 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa0680b57c0 0x7fa0680d5c70 secure :-1 s=READY pgs=169 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa08c030550 tx=0x7fa08c00a200 comp rx=0 tx=0).stop 2026-02-13T04:01:06.576 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.567+0000 7fa07cff96c0 1 -- 10.20.193.92:0/3602027367 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa0901168c0 msgr2=0x7fa0900f6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.576 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.567+0000 7fa07cff96c0 1 --2- 10.20.193.92:0/3602027367 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa0901168c0 0x7fa0900f6810 secure :-1 s=READY pgs=214 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa08000b800 tx=0x7fa08000bcd0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.576 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.567+0000 7fa07cff96c0 1 -- 10.20.193.92:0/3602027367 shutdown_connections 2026-02-13T04:01:06.576 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.567+0000 7fa07cff96c0 1 --2- 10.20.193.92:0/3602027367 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa0901168c0 0x7fa0900f6810 unknown :-1 s=CLOSED pgs=214 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.576 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.567+0000 7fa07cff96c0 1 --2- 10.20.193.92:0/3602027367 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa090114910 0x7fa0900f6160 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.576 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.567+0000 7fa07cff96c0 1 --2- 10.20.193.92:0/3602027367 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa0680b57c0 0x7fa0680d5c70 unknown :-1 s=CLOSED pgs=169 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.576 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.567+0000 7fa07cff96c0 1 --2- 10.20.193.92:0/3602027367 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa090114000 0x7fa0900f9f00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.576 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.567+0000 7fa07cff96c0 1 -- 10.20.193.92:0/3602027367 >> 10.20.193.92:0/3602027367 conn(0x7fa0900586e0 msgr2=0x7fa090117b30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:06.576 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.568+0000 7fa07cff96c0 1 -- 10.20.193.92:0/3602027367 shutdown_connections 2026-02-13T04:01:06.577 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.568+0000 7fa07cff96c0 1 -- 10.20.193.92:0/3602027367 wait complete. 2026-02-13T04:01:06.577 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.565+0000 7efe6b5776c0 1 -- 10.20.193.92:0/1853514572 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efe6c116990 msgr2=0x7efe6c17a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.577 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.565+0000 7efe6b5776c0 1 --2- 10.20.193.92:0/1853514572 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efe6c116990 0x7efe6c17a5a0 secure :-1 s=READY pgs=219 gs=1 cs=0 l=1 c_cookie=14843664862780101698 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe64006fd0 tx=0x7efe6402fd40 comp rx=0 tx=0).stop 2026-02-13T04:01:06.577 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.566+0000 7efe6b5776c0 1 -- 10.20.193.92:0/1853514572 shutdown_connections 2026-02-13T04:01:06.577 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.566+0000 7efe6b5776c0 1 --2- 10.20.193.92:0/1853514572 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efe6c116990 0x7efe6c17a5a0 unknown :-1 s=CLOSED pgs=219 gs=1 cs=0 l=1 c_cookie=14843664862780101698 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.577 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.566+0000 7efe6b5776c0 1 --2- 10.20.193.92:0/1853514572 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7efe6c1149f0 0x7efe6c1161e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.577 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.566+0000 7efe6b5776c0 1 --2- 10.20.193.92:0/1853514572 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7efe6c114000 0x7efe6c1143d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.577 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.566+0000 7efe6b5776c0 1 -- 10.20.193.92:0/1853514572 >> 10.20.193.92:0/1853514572 conn(0x7efe6c05aaa0 msgr2=0x7efe6c05b290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:06.577 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.566+0000 7efe6b5776c0 1 -- 10.20.193.92:0/1853514572 shutdown_connections 2026-02-13T04:01:06.578 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.566+0000 7efe6b5776c0 1 -- 10.20.193.92:0/1853514572 wait complete. 2026-02-13T04:01:06.578 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.566+0000 7efe6b5776c0 1 Processor -- start 2026-02-13T04:01:06.578 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.567+0000 7efe6b5776c0 1 -- start start 2026-02-13T04:01:06.578 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.567+0000 7efe6b5776c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efe6c114000 0x7efe6c121750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.578 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.567+0000 7efe6b5776c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7efe6c116990 0x7efe6c121c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.578 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.567+0000 7efe6b5776c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7efe6c127000 0x7efe6c1274a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.578 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.567+0000 7efe6b5776c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7efe6c127a10 con 0x7efe6c114000 2026-02-13T04:01:06.578 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.568+0000 7efe6b5776c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7efe6c127b80 con 0x7efe6c116990 2026-02-13T04:01:06.578 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.568+0000 7efe6b5776c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7efe6c127d40 con 0x7efe6c127000 2026-02-13T04:01:06.578 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.568+0000 7efe6a5756c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efe6c114000 0x7efe6c121750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:06.578 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.568+0000 7efe6a5756c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efe6c114000 0x7efe6c121750 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:53478/0 (socket says 10.20.193.92:53478) 2026-02-13T04:01:06.578 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.568+0000 7efe6a5756c0 1 -- 10.20.193.92:0/1698175533 learned_addr learned my addr 10.20.193.92:0/1698175533 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:06.578 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.568+0000 7efe6a5756c0 1 -- 10.20.193.92:0/1698175533 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7efe6c127000 msgr2=0x7efe6c1274a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T04:01:06.579 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.568+0000 7efe6a5756c0 1 --2- 10.20.193.92:0/1698175533 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7efe6c127000 0x7efe6c1274a0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.579 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.569+0000 7efe6a5756c0 1 -- 10.20.193.92:0/1698175533 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7efe6c116990 msgr2=0x7efe6c121c90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T04:01:06.579 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.569+0000 7efe6a5756c0 1 --2- 10.20.193.92:0/1698175533 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7efe6c116990 0x7efe6c121c90 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.579 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.569+0000 7efe6a5756c0 1 -- 10.20.193.92:0/1698175533 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe6400a5b0 con 0x7efe6c114000 2026-02-13T04:01:06.579 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.569+0000 7efe6a5756c0 1 --2- 10.20.193.92:0/1698175533 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efe6c114000 0x7efe6c121750 secure :-1 s=READY pgs=220 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe5400b6c0 tx=0x7efe5400bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:06.579 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.569+0000 7efe537fe6c0 1 -- 10.20.193.92:0/1698175533 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efe540044a0 con 0x7efe6c114000 2026-02-13T04:01:06.579 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.569+0000 7efe6b5776c0 1 -- 10.20.193.92:0/1698175533 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe6c1681f0 con 0x7efe6c114000 2026-02-13T04:01:06.579 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.569+0000 7efe537fe6c0 1 -- 10.20.193.92:0/1698175533 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7efe54009030 con 0x7efe6c114000 2026-02-13T04:01:06.579 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.569+0000 7efe537fe6c0 1 -- 10.20.193.92:0/1698175533 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efe5400ce30 con 0x7efe6c114000 2026-02-13T04:01:06.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:06 trial158 ceph-mon[27763]: pgmap v185: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 25 op/s 2026-02-13T04:01:06.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:06 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/3993246055' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-13T04:01:06.580 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.570+0000 7efe6b5776c0 1 -- 10.20.193.92:0/1698175533 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe6c1686d0 con 0x7efe6c114000 2026-02-13T04:01:06.581 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.574+0000 7ffbd1d746c0 1 -- 10.20.193.92:0/3581742503 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ffbcc0c4190 msgr2=0x7ffbcc0d1f60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T04:01:06.581 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.574+0000 7ffbd1d746c0 1 --2- 10.20.193.92:0/3581742503 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ffbcc0c4190 0x7ffbcc0d1f60 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.581 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.574+0000 7ffbd1d746c0 1 -- 10.20.193.92:0/3581742503 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ffbcc0d7810 msgr2=0x7ffbcc0d7cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T04:01:06.581 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.574+0000 7ffbd1d746c0 1 --2- 10.20.193.92:0/3581742503 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ffbcc0d7810 0x7ffbcc0d7cb0 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.581 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.574+0000 7ffbd1d746c0 1 -- 10.20.193.92:0/3581742503 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc0009590 con 0x7ffbcc0ca3a0 2026-02-13T04:01:06.581 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.557+0000 7fd7937fe6c0 1 --2- 10.20.193.92:0/926560666 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fd7800b57c0 0x7fd7800d5c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.582 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.559+0000 7fd7937fe6c0 1 -- 10.20.193.92:0/926560666 <== mon.2 v2:10.20.193.99:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7fd7980e3690 con 0x7fd7a410dd20 2026-02-13T04:01:06.582 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.559+0000 7fd7937fe6c0 1 -- 10.20.193.92:0/926560666 <== mon.2 v2:10.20.193.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd7980a8ff0 con 0x7fd7a410dd20 2026-02-13T04:01:06.582 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.577+0000 7ffbd1d746c0 1 --2- 10.20.193.92:0/3581742503 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ffbcc0ca3a0 0x7ffbcc0d24a0 secure :-1 s=READY pgs=221 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffbc0004460 tx=0x7ffbc0004490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:06.582 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.577+0000 7ffbcb7fe6c0 1 -- 10.20.193.92:0/3581742503 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffbc002fab0 con 0x7ffbcc0ca3a0 2026-02-13T04:01:06.582 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.577+0000 7ffbcb7fe6c0 1 -- 10.20.193.92:0/3581742503 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7ffbc002fc10 con 0x7ffbcc0ca3a0 2026-02-13T04:01:06.582 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.577+0000 7ffbcb7fe6c0 1 -- 10.20.193.92:0/3581742503 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ffbc00365c0 con 0x7ffbcc0ca3a0 2026-02-13T04:01:06.583 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.574+0000 7efe537fe6c0 1 -- 10.20.193.92:0/1698175533 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7efe5400c410 con 0x7efe6c114000 2026-02-13T04:01:06.583 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.578+0000 7efe6b5776c0 1 -- 10.20.193.92:0/1698175533 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe6c1143d0 con 0x7efe6c114000 2026-02-13T04:01:06.583 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.576+0000 7fd7a9d4b6c0 1 --2- 10.20.193.92:0/926560666 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fd7800b57c0 0x7fd7800d5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:06.583 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.580+0000 7fd7a9d4b6c0 1 --2- 10.20.193.92:0/926560666 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fd7800b57c0 0x7fd7800d5c70 secure :-1 s=READY pgs=175 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd7a4165730 tx=0x7fd794009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:06.588 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.578+0000 7ffbd8b2b6c0 1 -- 10.20.193.92:0/3581742503 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbcc1189a0 con 0x7ffbcc0ca3a0 2026-02-13T04:01:06.588 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.579+0000 7ffbd8b2b6c0 1 -- 10.20.193.92:0/3581742503 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbcc118dd0 con 0x7ffbcc0ca3a0 2026-02-13T04:01:06.589 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.581+0000 7efe537fe6c0 1 --2- 10.20.193.92:0/1698175533 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7efe4c0b5760 0x7efe4c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.589 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.581+0000 7efe537fe6c0 1 -- 10.20.193.92:0/1698175533 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7efe540e3b80 con 0x7efe6c114000 2026-02-13T04:01:06.589 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.582+0000 7efe69d746c0 1 --2- 10.20.193.92:0/1698175533 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7efe4c0b5760 0x7efe4c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:06.589 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.583+0000 7efe69d746c0 1 --2- 10.20.193.92:0/1698175533 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7efe4c0b5760 0x7efe4c0d5c10 secure :-1 s=READY pgs=176 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe60005b40 tx=0x7efe6000a540 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:06.590 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.581+0000 7ffbd8b2b6c0 1 -- 10.20.193.92:0/3581742503 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbcc0c5460 con 0x7ffbcc0ca3a0 2026-02-13T04:01:06.591 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.587+0000 7efe537fe6c0 1 -- 10.20.193.92:0/1698175533 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7efe540a6510 con 0x7efe6c114000 2026-02-13T04:01:06.596 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.590+0000 7ffbcb7fe6c0 1 -- 10.20.193.92:0/3581742503 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7ffbc0036750 con 0x7ffbcc0ca3a0 2026-02-13T04:01:06.596 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.591+0000 7ffbcb7fe6c0 1 --2- 10.20.193.92:0/3581742503 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ffba40b58b0 0x7ffba40d5d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.596 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.591+0000 7ffbcb7fe6c0 1 -- 10.20.193.92:0/3581742503 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7ffbc01085c0 con 0x7ffbcc0ca3a0 2026-02-13T04:01:06.596 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.591+0000 7ffbcb7fe6c0 1 -- 10.20.193.92:0/3581742503 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ffbc00cbb50 con 0x7ffbcc0ca3a0 2026-02-13T04:01:06.596 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.593+0000 7ffbd25756c0 1 --2- 10.20.193.92:0/3581742503 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ffba40b58b0 0x7ffba40d5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:06.597 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.594+0000 7ffbd25756c0 1 --2- 10.20.193.92:0/3581742503 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ffba40b58b0 0x7ffba40d5d60 secure :-1 s=READY pgs=177 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffbc4004750 tx=0x7ffbc4005c40 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:06.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:06 trial099 ceph-mon[27808]: pgmap v185: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 10 KiB/s rd, 11 KiB/s wr, 25 op/s 2026-02-13T04:01:06.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:06 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/3993246055' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2026-02-13T04:01:06.640 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.637+0000 7fc8f895b6c0 1 -- 10.20.193.92:0/2670886472 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fc8f4118f30 msgr2=0x7fc8f4119380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.640 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.638+0000 7fc8f895b6c0 1 --2- 10.20.193.92:0/2670886472 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fc8f4118f30 0x7fc8f4119380 secure :-1 s=READY pgs=103 gs=1 cs=0 l=1 c_cookie=9169001521597491024 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8dc009970 tx=0x7fc8dc02ed70 comp rx=0 tx=0).stop 2026-02-13T04:01:06.641 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.638+0000 7fc8f895b6c0 1 -- 10.20.193.92:0/2670886472 shutdown_connections 2026-02-13T04:01:06.641 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.638+0000 7fc8f895b6c0 1 --2- 10.20.193.92:0/2670886472 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fc8f41199a0 0x7fc8f4116df0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.641 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.638+0000 7fc8f895b6c0 1 --2- 10.20.193.92:0/2670886472 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fc8f4118f30 0x7fc8f4119380 unknown :-1 s=CLOSED pgs=103 gs=1 cs=0 l=1 c_cookie=9169001521597491024 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.641 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.638+0000 7fc8f895b6c0 1 --2- 10.20.193.92:0/2670886472 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc8f411b3f0 0x7fc8f411b7c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.641 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.638+0000 7fc8f895b6c0 1 -- 10.20.193.92:0/2670886472 >> 10.20.193.92:0/2670886472 conn(0x7fc8f405b290 msgr2=0x7fc8f405b690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:06.641 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.638+0000 7fc8f895b6c0 1 -- 10.20.193.92:0/2670886472 shutdown_connections 2026-02-13T04:01:06.642 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.638+0000 7fc8f895b6c0 1 -- 10.20.193.92:0/2670886472 wait complete. 2026-02-13T04:01:06.647 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.642+0000 7fc8f895b6c0 1 Processor -- start 2026-02-13T04:01:06.647 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.643+0000 7fc8f895b6c0 1 -- start start 2026-02-13T04:01:06.647 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.643+0000 7fc8f895b6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fc8f4118f30 0x7fc8f40fdbb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.648 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.643+0000 7fc8f895b6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc8f41199a0 0x7fc8f40fe0f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.648 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.643+0000 7fc8f895b6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fc8f411b3f0 0x7fc8f4103460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.648 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.643+0000 7fc8f895b6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f41039d0 con 0x7fc8f41199a0 2026-02-13T04:01:06.648 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.644+0000 7fc8f895b6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f4103b40 con 0x7fc8f4118f30 2026-02-13T04:01:06.648 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.644+0000 7fc8f895b6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f4103d00 con 0x7fc8f411b3f0 2026-02-13T04:01:06.648 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.643+0000 7fc8f2d766c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fc8f4118f30 0x7fc8f40fdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:06.648 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.644+0000 7fc8f2d766c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fc8f4118f30 0x7fc8f40fdbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:45860/0 (socket says 10.20.193.92:45860) 2026-02-13T04:01:06.648 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.644+0000 7fc8f2d766c0 1 -- 10.20.193.92:0/858143923 learned_addr learned my addr 10.20.193.92:0/858143923 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:06.648 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.644+0000 7fc8f25756c0 1 --2- 10.20.193.92:0/858143923 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc8f41199a0 0x7fc8f40fe0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:06.648 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.644+0000 7fc8f35776c0 1 --2- 10.20.193.92:0/858143923 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fc8f411b3f0 0x7fc8f4103460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:06.648 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.644+0000 7fc8f2d766c0 1 -- 10.20.193.92:0/858143923 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fc8f411b3f0 msgr2=0x7fc8f4103460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.648 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.644+0000 7fc8f2d766c0 1 --2- 10.20.193.92:0/858143923 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fc8f411b3f0 0x7fc8f4103460 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.649 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.644+0000 7fc8f2d766c0 1 -- 10.20.193.92:0/858143923 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc8f41199a0 msgr2=0x7fc8f40fe0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.649 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.644+0000 7fc8f2d766c0 1 --2- 10.20.193.92:0/858143923 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc8f41199a0 0x7fc8f40fe0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.649 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.644+0000 7fc8f2d766c0 1 -- 10.20.193.92:0/858143923 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8e80094c0 con 0x7fc8f4118f30 2026-02-13T04:01:06.649 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.644+0000 7fc8f25756c0 1 --2- 10.20.193.92:0/858143923 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc8f41199a0 0x7fc8f40fe0f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T04:01:06.649 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.645+0000 7fc8f2d766c0 1 --2- 10.20.193.92:0/858143923 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fc8f4118f30 0x7fc8f40fdbb0 secure :-1 s=READY pgs=104 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8e400c800 tx=0x7fc8e400ccd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:06.650 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.645+0000 7fc8d3fff6c0 1 -- 10.20.193.92:0/858143923 <== mon.2 v2:10.20.193.99:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc8e4003c40 con 0x7fc8f4118f30 2026-02-13T04:01:06.650 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.645+0000 7fc8d3fff6c0 1 -- 10.20.193.92:0/858143923 <== mon.2 v2:10.20.193.99:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fc8e400a0f0 con 0x7fc8f4118f30 2026-02-13T04:01:06.650 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.645+0000 7fc8d3fff6c0 1 -- 10.20.193.92:0/858143923 <== mon.2 v2:10.20.193.99:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc8e40081c0 con 0x7fc8f4118f30 2026-02-13T04:01:06.650 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.645+0000 7fc8f895b6c0 1 -- 10.20.193.92:0/858143923 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8dc009590 con 0x7fc8f4118f30 2026-02-13T04:01:06.650 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.646+0000 7fc8f895b6c0 1 -- 10.20.193.92:0/858143923 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8f41042b0 con 0x7fc8f4118f30 2026-02-13T04:01:06.650 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.648+0000 7fc8f895b6c0 1 -- 10.20.193.92:0/858143923 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8b8005310 con 0x7fc8f4118f30 2026-02-13T04:01:06.652 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.648+0000 7fc8d3fff6c0 1 -- 10.20.193.92:0/858143923 <== mon.2 v2:10.20.193.99:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fc8e400d560 con 0x7fc8f4118f30 2026-02-13T04:01:06.653 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.650+0000 7fc8d3fff6c0 1 --2- 10.20.193.92:0/858143923 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fc8c80b5760 0x7fc8c80d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:06.653 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.650+0000 7fc8d3fff6c0 1 -- 10.20.193.92:0/858143923 <== mon.2 v2:10.20.193.99:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7fc8e40e4c30 con 0x7fc8f4118f30 2026-02-13T04:01:06.653 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.650+0000 7fc8d3fff6c0 1 -- 10.20.193.92:0/858143923 <== mon.2 v2:10.20.193.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc8e40a7580 con 0x7fc8f4118f30 2026-02-13T04:01:06.654 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.651+0000 7fc8f25756c0 1 --2- 10.20.193.92:0/858143923 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fc8c80b5760 0x7fc8c80d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:06.657 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.652+0000 7fc8f25756c0 1 --2- 10.20.193.92:0/858143923 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fc8c80b5760 0x7fc8c80d5c10 secure :-1 s=READY pgs=178 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8dc005a00 tx=0x7fc8dc005910 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:06.661 INFO:tasks.cephadm.ceph_manager.ceph:need seq 274877906954 got 274877906954 for osd.10 2026-02-13T04:01:06.661 DEBUG:teuthology.parallel:result is None 2026-02-13T04:01:06.666 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.664+0000 7fdf3d7046c0 1 -- 10.20.193.92:0/758884294 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fdf38119090 con 0x7fdf38114000 2026-02-13T04:01:06.667 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.664+0000 7fdf357fa6c0 1 -- 10.20.193.92:0/758884294 <== mon.1 v2:10.20.193.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fdf2c0a9610 con 0x7fdf38114000 2026-02-13T04:01:06.671 INFO:teuthology.orchestra.run.trial092.stdout:103079215126 2026-02-13T04:01:06.671 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.667+0000 7fdf3d7046c0 1 -- 10.20.193.92:0/758884294 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fdf080b5760 msgr2=0x7fdf080d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.671 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.667+0000 7fdf3d7046c0 1 --2- 10.20.193.92:0/758884294 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fdf080b5760 0x7fdf080d5c10 secure :-1 s=READY pgs=173 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf200023e0 tx=0x7fdf20031cd0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.672 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.667+0000 7fdf3d7046c0 1 -- 10.20.193.92:0/758884294 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fdf38114000 msgr2=0x7fdf38126c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.672 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.667+0000 7fdf3d7046c0 1 --2- 10.20.193.92:0/758884294 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fdf38114000 0x7fdf38126c90 secure :-1 s=READY pgs=101 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf2c00b6c0 tx=0x7fdf2c00bb90 comp rx=0 tx=0).stop 2026-02-13T04:01:06.672 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.667+0000 7fdf3d7046c0 1 -- 10.20.193.92:0/758884294 shutdown_connections 2026-02-13T04:01:06.672 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.667+0000 7fdf3d7046c0 1 --2- 10.20.193.92:0/758884294 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fdf080b5760 0x7fdf080d5c10 unknown :-1 s=CLOSED pgs=173 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.672 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.667+0000 7fdf3d7046c0 1 --2- 10.20.193.92:0/758884294 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fdf3812c590 0x7fdf3812ca30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.672 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.667+0000 7fdf3d7046c0 1 --2- 10.20.193.92:0/758884294 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdf381197f0 0x7fdf381271d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.672 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.667+0000 7fdf3d7046c0 1 --2- 10.20.193.92:0/758884294 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fdf38114000 0x7fdf38126c90 unknown :-1 s=CLOSED pgs=101 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.672 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.667+0000 7fdf3d7046c0 1 -- 10.20.193.92:0/758884294 >> 10.20.193.92:0/758884294 conn(0x7fdf3805aaa0 msgr2=0x7fdf3805d690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:06.672 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.667+0000 7fdf3d7046c0 1 -- 10.20.193.92:0/758884294 shutdown_connections 2026-02-13T04:01:06.672 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.667+0000 7fdf3d7046c0 1 -- 10.20.193.92:0/758884294 wait complete. 2026-02-13T04:01:06.703 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495632 got 197568495631 for osd.7 2026-02-13T04:01:06.728 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.725+0000 7f42ca9e06c0 1 -- 10.20.193.92:0/3754188425 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f42c4114430 con 0x7f42c4127200 2026-02-13T04:01:06.730 INFO:teuthology.orchestra.run.trial092.stdout:304942678026 2026-02-13T04:01:06.730 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.727+0000 7f42c17fa6c0 1 -- 10.20.193.92:0/3754188425 <== mon.2 v2:10.20.193.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f42b80a7790 con 0x7f42c4127200 2026-02-13T04:01:06.731 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.728+0000 7f42ca9e06c0 1 -- 10.20.193.92:0/3754188425 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f42980b56e0 msgr2=0x7f42980d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.731 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.728+0000 7f42ca9e06c0 1 --2- 10.20.193.92:0/3754188425 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f42980b56e0 0x7f42980d5b90 secure :-1 s=READY pgs=174 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f42a80023e0 tx=0x7f42a8005910 comp rx=0 tx=0).stop 2026-02-13T04:01:06.731 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.728+0000 7f42ca9e06c0 1 -- 10.20.193.92:0/3754188425 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f42c4127200 msgr2=0x7f42c41276a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.731 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.728+0000 7f42ca9e06c0 1 --2- 10.20.193.92:0/3754188425 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f42c4127200 0x7f42c41276a0 secure :-1 s=READY pgs=102 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f42b8006fd0 tx=0x7f42b800cc00 comp rx=0 tx=0).stop 2026-02-13T04:01:06.732 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.729+0000 7f42ca9e06c0 1 -- 10.20.193.92:0/3754188425 shutdown_connections 2026-02-13T04:01:06.732 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.729+0000 7f42ca9e06c0 1 --2- 10.20.193.92:0/3754188425 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f42980b56e0 0x7f42980d5b90 unknown :-1 s=CLOSED pgs=174 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.732 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.729+0000 7f42ca9e06c0 1 --2- 10.20.193.92:0/3754188425 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f42c4127200 0x7f42c41276a0 unknown :-1 s=CLOSED pgs=102 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.733 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.729+0000 7f42ca9e06c0 1 --2- 10.20.193.92:0/3754188425 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f42c4116b30 0x7f42c4121e90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.733 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.729+0000 7f42ca9e06c0 1 --2- 10.20.193.92:0/3754188425 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f42c4114000 0x7f42c4121950 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.733 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.729+0000 7f42ca9e06c0 1 -- 10.20.193.92:0/3754188425 >> 10.20.193.92:0/3754188425 conn(0x7f42c40586e0 msgr2=0x7f42c40592a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:06.733 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.730+0000 7f42ca9e06c0 1 -- 10.20.193.92:0/3754188425 shutdown_connections 2026-02-13T04:01:06.733 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.730+0000 7f42ca9e06c0 1 -- 10.20.193.92:0/3754188425 wait complete. 2026-02-13T04:01:06.750 INFO:teuthology.orchestra.run.trial092.stdout:133143986196 2026-02-13T04:01:06.751 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.742+0000 7ffbd8b2b6c0 1 -- 10.20.193.92:0/3581742503 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7ffbcc0c4b80 con 0x7ffbcc0ca3a0 2026-02-13T04:01:06.751 INFO:teuthology.orchestra.run.trial092.stdout:227633266702 2026-02-13T04:01:06.751 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.738+0000 7fd7ac7db6c0 1 -- 10.20.193.92:0/926560666 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fd7a410e0f0 con 0x7fd7a410dd20 2026-02-13T04:01:06.751 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.739+0000 7fd7937fe6c0 1 -- 10.20.193.92:0/926560666 <== mon.2 v2:10.20.193.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd7980a91d0 con 0x7fd7a410dd20 2026-02-13T04:01:06.752 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.742+0000 7fd7ac7db6c0 1 -- 10.20.193.92:0/926560666 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fd7800b57c0 msgr2=0x7fd7800d5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.752 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.742+0000 7fd7ac7db6c0 1 --2- 10.20.193.92:0/926560666 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fd7800b57c0 0x7fd7800d5c70 secure :-1 s=READY pgs=175 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd7a4165730 tx=0x7fd794009260 comp rx=0 tx=0).stop 2026-02-13T04:01:06.752 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.742+0000 7fd7ac7db6c0 1 -- 10.20.193.92:0/926560666 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fd7a410dd20 msgr2=0x7fd7a415eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.752 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.742+0000 7fd7ac7db6c0 1 --2- 10.20.193.92:0/926560666 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fd7a410dd20 0x7fd7a415eda0 secure :-1 s=READY pgs=103 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd79800b6e0 tx=0x7fd79800bbb0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.752 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.742+0000 7fd7ac7db6c0 1 -- 10.20.193.92:0/926560666 shutdown_connections 2026-02-13T04:01:06.752 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.743+0000 7fd7ac7db6c0 1 --2- 10.20.193.92:0/926560666 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd7a41532d0 0x7fd7a41646a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.752 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.743+0000 7fd7ac7db6c0 1 --2- 10.20.193.92:0/926560666 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd7a410e710 0x7fd7a415f2e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.752 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.743+0000 7fd7ac7db6c0 1 --2- 10.20.193.92:0/926560666 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fd7800b57c0 0x7fd7800d5c70 unknown :-1 s=CLOSED pgs=175 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.752 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.743+0000 7fd7ac7db6c0 1 --2- 10.20.193.92:0/926560666 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fd7a410dd20 0x7fd7a415eda0 unknown :-1 s=CLOSED pgs=103 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.752 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.743+0000 7fd7ac7db6c0 1 -- 10.20.193.92:0/926560666 >> 10.20.193.92:0/926560666 conn(0x7fd7a40e9700 msgr2=0x7fd7a4109ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:06.752 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.743+0000 7fd7ac7db6c0 1 -- 10.20.193.92:0/926560666 shutdown_connections 2026-02-13T04:01:06.753 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.743+0000 7fd7ac7db6c0 1 -- 10.20.193.92:0/926560666 wait complete. 2026-02-13T04:01:06.753 INFO:teuthology.orchestra.run.trial092.stdout:51539607577 2026-02-13T04:01:06.753 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.736+0000 7efe6b5776c0 1 -- 10.20.193.92:0/1698175533 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7efe6c17d7c0 con 0x7efe6c114000 2026-02-13T04:01:06.753 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.738+0000 7efe537fe6c0 1 -- 10.20.193.92:0/1698175533 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efe540a96c0 con 0x7efe6c114000 2026-02-13T04:01:06.754 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.743+0000 7ffbcb7fe6c0 1 -- 10.20.193.92:0/3581742503 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ffbc0007b20 con 0x7ffbcc0ca3a0 2026-02-13T04:01:06.754 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.747+0000 7ffbd8b2b6c0 1 -- 10.20.193.92:0/3581742503 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ffba40b58b0 msgr2=0x7ffba40d5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.755 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.747+0000 7ffbd8b2b6c0 1 --2- 10.20.193.92:0/3581742503 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ffba40b58b0 0x7ffba40d5d60 secure :-1 s=READY pgs=177 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffbc4004750 tx=0x7ffbc4005c40 comp rx=0 tx=0).stop 2026-02-13T04:01:06.755 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.747+0000 7ffbd8b2b6c0 1 -- 10.20.193.92:0/3581742503 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ffbcc0ca3a0 msgr2=0x7ffbcc0d24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.755 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.750+0000 7ffbd8b2b6c0 1 --2- 10.20.193.92:0/3581742503 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ffbcc0ca3a0 0x7ffbcc0d24a0 secure :-1 s=READY pgs=221 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffbc0004460 tx=0x7ffbc0004490 comp rx=0 tx=0).stop 2026-02-13T04:01:06.764 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.761+0000 7ffbd8b2b6c0 1 -- 10.20.193.92:0/3581742503 shutdown_connections 2026-02-13T04:01:06.764 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.761+0000 7ffbd8b2b6c0 1 --2- 10.20.193.92:0/3581742503 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ffba40b58b0 0x7ffba40d5d60 unknown :-1 s=CLOSED pgs=177 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.764 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.761+0000 7ffbd8b2b6c0 1 --2- 10.20.193.92:0/3581742503 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ffbcc0d7810 0x7ffbcc0d7cb0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.764 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.761+0000 7ffbd8b2b6c0 1 --2- 10.20.193.92:0/3581742503 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ffbcc0ca3a0 0x7ffbcc0d24a0 unknown :-1 s=CLOSED pgs=221 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.764 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.761+0000 7ffbd8b2b6c0 1 --2- 10.20.193.92:0/3581742503 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ffbcc0c4190 0x7ffbcc0d1f60 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.764 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.761+0000 7ffbd8b2b6c0 1 -- 10.20.193.92:0/3581742503 >> 10.20.193.92:0/3581742503 conn(0x7ffbcc01c5c0 msgr2=0x7ffbcc0c8220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:06.768 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.764+0000 7efe6b5776c0 1 -- 10.20.193.92:0/1698175533 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7efe4c0b5760 msgr2=0x7efe4c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.768 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.764+0000 7efe6b5776c0 1 --2- 10.20.193.92:0/1698175533 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7efe4c0b5760 0x7efe4c0d5c10 secure :-1 s=READY pgs=176 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe60005b40 tx=0x7efe6000a540 comp rx=0 tx=0).stop 2026-02-13T04:01:06.768 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.764+0000 7efe6b5776c0 1 -- 10.20.193.92:0/1698175533 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efe6c114000 msgr2=0x7efe6c121750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.768 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.764+0000 7efe6b5776c0 1 --2- 10.20.193.92:0/1698175533 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efe6c114000 0x7efe6c121750 secure :-1 s=READY pgs=220 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe5400b6c0 tx=0x7efe5400bb90 comp rx=0 tx=0).stop 2026-02-13T04:01:06.771 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.768+0000 7efe6b5776c0 1 -- 10.20.193.92:0/1698175533 shutdown_connections 2026-02-13T04:01:06.771 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.768+0000 7ffbd8b2b6c0 1 -- 10.20.193.92:0/3581742503 shutdown_connections 2026-02-13T04:01:06.772 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.768+0000 7efe6b5776c0 1 --2- 10.20.193.92:0/1698175533 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7efe4c0b5760 0x7efe4c0d5c10 unknown :-1 s=CLOSED pgs=176 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.772 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.768+0000 7efe6b5776c0 1 --2- 10.20.193.92:0/1698175533 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7efe6c116990 0x7efe6c121c90 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.772 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.768+0000 7efe6b5776c0 1 --2- 10.20.193.92:0/1698175533 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7efe6c127000 0x7efe6c1274a0 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.772 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.768+0000 7efe6b5776c0 1 --2- 10.20.193.92:0/1698175533 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efe6c114000 0x7efe6c121750 unknown :-1 s=CLOSED pgs=220 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.772 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.768+0000 7efe6b5776c0 1 -- 10.20.193.92:0/1698175533 >> 10.20.193.92:0/1698175533 conn(0x7efe6c05aaa0 msgr2=0x7efe6c117980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:06.772 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.768+0000 7ffbd8b2b6c0 1 -- 10.20.193.92:0/3581742503 wait complete. 2026-02-13T04:01:06.773 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626449 got 180388626448 for osd.6 2026-02-13T04:01:06.778 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.775+0000 7efe6b5776c0 1 -- 10.20.193.92:0/1698175533 shutdown_connections 2026-02-13T04:01:06.779 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.775+0000 7efe6b5776c0 1 -- 10.20.193.92:0/1698175533 wait complete. 2026-02-13T04:01:06.801 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.798+0000 7fc8f895b6c0 1 -- 10.20.193.92:0/858143923 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fc8b80055c0 con 0x7fc8f4118f30 2026-02-13T04:01:06.801 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.798+0000 7fc8d3fff6c0 1 -- 10.20.193.92:0/858143923 <== mon.2 v2:10.20.193.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc8e40aa730 con 0x7fc8f4118f30 2026-02-13T04:01:06.803 INFO:teuthology.orchestra.run.trial092.stdout:68719476761 2026-02-13T04:01:06.804 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.800+0000 7fc8f895b6c0 1 -- 10.20.193.92:0/858143923 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fc8c80b5760 msgr2=0x7fc8c80d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.804 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.800+0000 7fc8f895b6c0 1 --2- 10.20.193.92:0/858143923 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fc8c80b5760 0x7fc8c80d5c10 secure :-1 s=READY pgs=178 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8dc005a00 tx=0x7fc8dc005910 comp rx=0 tx=0).stop 2026-02-13T04:01:06.804 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.800+0000 7fc8f895b6c0 1 -- 10.20.193.92:0/858143923 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fc8f4118f30 msgr2=0x7fc8f40fdbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:06.804 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.800+0000 7fc8f895b6c0 1 --2- 10.20.193.92:0/858143923 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fc8f4118f30 0x7fc8f40fdbb0 secure :-1 s=READY pgs=104 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8e400c800 tx=0x7fc8e400ccd0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.804 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.801+0000 7fc8f895b6c0 1 -- 10.20.193.92:0/858143923 shutdown_connections 2026-02-13T04:01:06.804 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.801+0000 7fc8f895b6c0 1 --2- 10.20.193.92:0/858143923 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fc8f411b3f0 0x7fc8f4103460 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.804 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.801+0000 7fc8f895b6c0 1 --2- 10.20.193.92:0/858143923 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc8f41199a0 0x7fc8f40fe0f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.804 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.801+0000 7fc8f895b6c0 1 --2- 10.20.193.92:0/858143923 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fc8c80b5760 0x7fc8c80d5c10 unknown :-1 s=CLOSED pgs=178 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.804 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.801+0000 7fc8f895b6c0 1 --2- 10.20.193.92:0/858143923 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fc8f4118f30 0x7fc8f40fdbb0 unknown :-1 s=CLOSED pgs=104 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:06.805 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.801+0000 7fc8f895b6c0 1 -- 10.20.193.92:0/858143923 >> 10.20.193.92:0/858143923 conn(0x7fc8f405b290 msgr2=0x7fc8f40f4220 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:06.805 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.801+0000 7fc8f895b6c0 1 -- 10.20.193.92:0/858143923 shutdown_connections 2026-02-13T04:01:06.805 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:06.801+0000 7fc8f895b6c0 1 -- 10.20.193.92:0/858143923 wait complete. 2026-02-13T04:01:06.872 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037772 got 257698037771 for osd.9 2026-02-13T04:01:06.923 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215126 got 103079215126 for osd.3 2026-02-13T04:01:06.924 DEBUG:teuthology.parallel:result is None 2026-02-13T04:01:07.092 INFO:tasks.cephadm.ceph_manager.ceph:need seq 304942678026 got 304942678026 for osd.11 2026-02-13T04:01:07.093 DEBUG:teuthology.parallel:result is None 2026-02-13T04:01:07.112 INFO:tasks.cephadm.ceph_manager.ceph:need seq 51539607578 got 51539607577 for osd.1 2026-02-13T04:01:07.113 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476761 got 68719476761 for osd.2 2026-02-13T04:01:07.113 DEBUG:teuthology.parallel:result is None 2026-02-13T04:01:07.114 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986197 got 133143986196 for osd.4 2026-02-13T04:01:07.115 INFO:tasks.cephadm.ceph_manager.ceph:need seq 227633266702 got 227633266702 for osd.8 2026-02-13T04:01:07.115 DEBUG:teuthology.parallel:result is None 2026-02-13T04:01:07.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:07 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/3508874662' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-13T04:01:07.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:07 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/2389867900' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-13T04:01:07.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:07 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/2254218022' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-13T04:01:07.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:07 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/3693575021' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-13T04:01:07.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:07 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/3602027367' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T04:01:07.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:07 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/758884294' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-13T04:01:07.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:07 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/3754188425' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-13T04:01:07.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:07 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1698175533' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-13T04:01:07.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:07 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/926560666' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-13T04:01:07.435 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:07 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/3581742503' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T04:01:07.435 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:07 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/858143923' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-13T04:01:07.480 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:07 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/3508874662' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-13T04:01:07.480 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:07 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/2389867900' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-13T04:01:07.480 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:07 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/2254218022' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-13T04:01:07.480 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:07 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/3693575021' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-13T04:01:07.480 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:07 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/3602027367' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T04:01:07.481 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:07 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/758884294' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-13T04:01:07.481 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:07 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/3754188425' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-13T04:01:07.481 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:07 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/1698175533' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-13T04:01:07.481 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:07 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/926560666' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-13T04:01:07.481 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:07 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/3581742503' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T04:01:07.481 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:07 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/858143923' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-13T04:01:07.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:07 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/3508874662' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2026-02-13T04:01:07.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:07 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/2389867900' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2026-02-13T04:01:07.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:07 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/2254218022' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-13T04:01:07.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:07 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/3693575021' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-13T04:01:07.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:07 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/3602027367' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T04:01:07.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:07 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/758884294' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2026-02-13T04:01:07.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:07 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/3754188425' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2026-02-13T04:01:07.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:07 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/1698175533' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-13T04:01:07.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:07 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/926560666' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2026-02-13T04:01:07.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:07 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/3581742503' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T04:01:07.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:07 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/858143923' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2026-02-13T04:01:07.704 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph osd last-stat-seq osd.7 2026-02-13T04:01:07.775 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph osd last-stat-seq osd.6 2026-02-13T04:01:07.874 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph osd last-stat-seq osd.9 2026-02-13T04:01:07.890 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:07.960 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:08.060 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:08.094 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.091+0000 7fa75bfff6c0 1 -- 10.20.193.92:0/3325621040 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa75c115270 msgr2=0x7fa75c175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:08.094 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.091+0000 7fa75bfff6c0 1 --2- 10.20.193.92:0/3325621040 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa75c115270 0x7fa75c175c10 secure :-1 s=READY pgs=222 gs=3 cs=0 l=1 c_cookie=3279028786396230608 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa74c00a9b0 tx=0x7fa74c02fd60 comp rx=0 tx=0).stop 2026-02-13T04:01:08.095 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.091+0000 7fa75bfff6c0 1 -- 10.20.193.92:0/3325621040 shutdown_connections 2026-02-13T04:01:08.095 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.091+0000 7fa75bfff6c0 1 --2- 10.20.193.92:0/3325621040 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa75c10fa50 0x7fa75c114a90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.095 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.091+0000 7fa75bfff6c0 1 --2- 10.20.193.92:0/3325621040 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa75c115270 0x7fa75c175c10 unknown :-1 s=CLOSED pgs=222 gs=3 cs=0 l=1 c_cookie=3279028786396230608 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.095 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.091+0000 7fa75bfff6c0 1 --2- 10.20.193.92:0/3325621040 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa75c10f060 0x7fa75c10f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.095 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.091+0000 7fa75bfff6c0 1 -- 10.20.193.92:0/3325621040 >> 10.20.193.92:0/3325621040 conn(0x7fa75c0ec980 msgr2=0x7fa75c10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:08.095 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.091+0000 7fa75bfff6c0 1 -- 10.20.193.92:0/3325621040 shutdown_connections 2026-02-13T04:01:08.095 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.091+0000 7fa75bfff6c0 1 -- 10.20.193.92:0/3325621040 wait complete. 2026-02-13T04:01:08.097 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.092+0000 7fa75bfff6c0 1 Processor -- start 2026-02-13T04:01:08.097 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.092+0000 7fa75bfff6c0 1 -- start start 2026-02-13T04:01:08.097 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.092+0000 7fa75bfff6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa75c10f060 0x7fa75c0f0240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:08.098 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.092+0000 7fa75bfff6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa75c115270 0x7fa75c175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:08.098 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.092+0000 7fa75bfff6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa75c0f0870 0x7fa75c0ef040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:08.098 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.092+0000 7fa75bfff6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa75c0f0f30 con 0x7fa75c0f0870 2026-02-13T04:01:08.098 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.092+0000 7fa75bfff6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa75c0ef580 con 0x7fa75c10f060 2026-02-13T04:01:08.098 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.092+0000 7fa75bfff6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fa75c0ef740 con 0x7fa75c115270 2026-02-13T04:01:08.098 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.093+0000 7fa75a7fc6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa75c115270 0x7fa75c175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:08.098 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.093+0000 7fa75a7fc6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa75c115270 0x7fa75c175b10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:52078/0 (socket says 10.20.193.92:52078) 2026-02-13T04:01:08.098 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.093+0000 7fa75a7fc6c0 1 -- 10.20.193.92:0/3017988040 learned_addr learned my addr 10.20.193.92:0/3017988040 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:08.098 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.093+0000 7fa75b7fe6c0 1 --2- 10.20.193.92:0/3017988040 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa75c0f0870 0x7fa75c0ef040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:08.098 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.093+0000 7fa75a7fc6c0 1 -- 10.20.193.92:0/3017988040 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa75c10f060 msgr2=0x7fa75c0f0240 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T04:01:08.098 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.093+0000 7fa75a7fc6c0 1 --2- 10.20.193.92:0/3017988040 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa75c10f060 0x7fa75c0f0240 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.099 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.093+0000 7fa75a7fc6c0 1 -- 10.20.193.92:0/3017988040 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa75c0f0870 msgr2=0x7fa75c0ef040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:08.099 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.093+0000 7fa75a7fc6c0 1 --2- 10.20.193.92:0/3017988040 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa75c0f0870 0x7fa75c0ef040 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.099 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.093+0000 7fa75a7fc6c0 1 -- 10.20.193.92:0/3017988040 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa74c00a5b0 con 0x7fa75c115270 2026-02-13T04:01:08.099 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.093+0000 7fa75a7fc6c0 1 --2- 10.20.193.92:0/3017988040 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa75c115270 0x7fa75c175b10 secure :-1 s=READY pgs=104 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa74400b800 tx=0x7fa74400bcd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:08.099 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.093+0000 7fa73bfff6c0 1 -- 10.20.193.92:0/3017988040 <== mon.1 v2:10.20.193.158:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa744004a80 con 0x7fa75c115270 2026-02-13T04:01:08.099 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.094+0000 7fa73bfff6c0 1 -- 10.20.193.92:0/3017988040 <== mon.1 v2:10.20.193.158:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fa744009070 con 0x7fa75c115270 2026-02-13T04:01:08.099 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.094+0000 7fa73bfff6c0 1 -- 10.20.193.92:0/3017988040 <== mon.1 v2:10.20.193.158:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa7440071c0 con 0x7fa75c115270 2026-02-13T04:01:08.099 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.094+0000 7fa75bfff6c0 1 -- 10.20.193.92:0/3017988040 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa75c0efa20 con 0x7fa75c115270 2026-02-13T04:01:08.099 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.094+0000 7fa75bfff6c0 1 -- 10.20.193.92:0/3017988040 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa75c0efeb0 con 0x7fa75c115270 2026-02-13T04:01:08.099 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.094+0000 7fa75bfff6c0 1 -- 10.20.193.92:0/3017988040 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa75c110330 con 0x7fa75c115270 2026-02-13T04:01:08.100 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.097+0000 7fa73bfff6c0 1 -- 10.20.193.92:0/3017988040 <== mon.1 v2:10.20.193.158:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fa744004060 con 0x7fa75c115270 2026-02-13T04:01:08.101 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.098+0000 7fa73bfff6c0 1 --2- 10.20.193.92:0/3017988040 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa7300b58b0 0x7fa7300d5d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:08.102 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.098+0000 7fa73bfff6c0 1 -- 10.20.193.92:0/3017988040 <== mon.1 v2:10.20.193.158:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7fa7440e3980 con 0x7fa75c115270 2026-02-13T04:01:08.102 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.098+0000 7fa73bfff6c0 1 -- 10.20.193.92:0/3017988040 <== mon.1 v2:10.20.193.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa7440e3d80 con 0x7fa75c115270 2026-02-13T04:01:08.102 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.099+0000 7fa75affd6c0 1 --2- 10.20.193.92:0/3017988040 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa7300b58b0 0x7fa7300d5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:08.102 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.099+0000 7fa75affd6c0 1 --2- 10.20.193.92:0/3017988040 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa7300b58b0 0x7fa7300d5d60 secure :-1 s=READY pgs=179 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa750005b40 tx=0x7fa750009310 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:08.114 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph osd last-stat-seq osd.1 2026-02-13T04:01:08.114 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph osd last-stat-seq osd.4 2026-02-13T04:01:08.177 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.173+0000 7f0903fff6c0 1 -- 10.20.193.92:0/2604977261 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f090410f060 msgr2=0x7f090410f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:08.178 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.173+0000 7f0903fff6c0 1 --2- 10.20.193.92:0/2604977261 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f090410f060 0x7f090410f430 secure :-1 s=READY pgs=223 gs=1 cs=0 l=1 c_cookie=5538487844201502159 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08ec0098d0 tx=0x7f08ec02ec60 comp rx=0 tx=0).stop 2026-02-13T04:01:08.178 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.174+0000 7f0903fff6c0 1 -- 10.20.193.92:0/2604977261 shutdown_connections 2026-02-13T04:01:08.178 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.174+0000 7f0903fff6c0 1 --2- 10.20.193.92:0/2604977261 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f090410fa50 0x7f0904114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.178 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.174+0000 7f0903fff6c0 1 --2- 10.20.193.92:0/2604977261 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f0904115270 0x7f0904175c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.178 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.174+0000 7f0903fff6c0 1 --2- 10.20.193.92:0/2604977261 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f090410f060 0x7f090410f430 unknown :-1 s=CLOSED pgs=223 gs=1 cs=0 l=1 c_cookie=5538487844201502159 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.178 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.174+0000 7f0903fff6c0 1 -- 10.20.193.92:0/2604977261 >> 10.20.193.92:0/2604977261 conn(0x7f09040ec980 msgr2=0x7f090410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:08.178 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.174+0000 7f0903fff6c0 1 -- 10.20.193.92:0/2604977261 shutdown_connections 2026-02-13T04:01:08.178 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.175+0000 7f0903fff6c0 1 -- 10.20.193.92:0/2604977261 wait complete. 2026-02-13T04:01:08.179 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.175+0000 7f0903fff6c0 1 Processor -- start 2026-02-13T04:01:08.179 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.175+0000 7f0903fff6c0 1 -- start start 2026-02-13T04:01:08.180 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.177+0000 7f0903fff6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f090410f060 0x7f090411ce70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:08.180 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.177+0000 7f0903fff6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0904115270 0x7f090411d3b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:08.180 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.177+0000 7f0903fff6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f0904122770 0x7f0904122c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:08.181 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.177+0000 7f0903fff6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0904123180 con 0x7f090410f060 2026-02-13T04:01:08.181 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.177+0000 7f0903fff6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f09041232f0 con 0x7f0904115270 2026-02-13T04:01:08.181 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.177+0000 7f0903fff6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f09041234b0 con 0x7f0904122770 2026-02-13T04:01:08.181 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.177+0000 7f09027fc6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0904115270 0x7f090411d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:08.181 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.177+0000 7f0902ffd6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f090410f060 0x7f090411ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:08.181 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.177+0000 7f09027fc6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0904115270 0x7f090411d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:45900/0 (socket says 10.20.193.92:45900) 2026-02-13T04:01:08.182 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.177+0000 7f09027fc6c0 1 -- 10.20.193.92:0/2356711950 learned_addr learned my addr 10.20.193.92:0/2356711950 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:08.182 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.177+0000 7f09037fe6c0 1 --2- 10.20.193.92:0/2356711950 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f0904122770 0x7f0904122c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:08.182 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.177+0000 7f0902ffd6c0 1 -- 10.20.193.92:0/2356711950 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f0904122770 msgr2=0x7f0904122c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:08.182 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.177+0000 7f0902ffd6c0 1 --2- 10.20.193.92:0/2356711950 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f0904122770 0x7f0904122c10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.182 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.177+0000 7f0902ffd6c0 1 -- 10.20.193.92:0/2356711950 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0904115270 msgr2=0x7f090411d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:08.182 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.177+0000 7f0902ffd6c0 1 --2- 10.20.193.92:0/2356711950 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0904115270 0x7f090411d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.182 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.177+0000 7f0902ffd6c0 1 -- 10.20.193.92:0/2356711950 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08ec0094c0 con 0x7f090410f060 2026-02-13T04:01:08.183 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.177+0000 7f09027fc6c0 1 --2- 10.20.193.92:0/2356711950 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0904115270 0x7f090411d3b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T04:01:08.183 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.178+0000 7f0902ffd6c0 1 --2- 10.20.193.92:0/2356711950 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f090410f060 0x7f090411ce70 secure :-1 s=READY pgs=224 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08ec0098a0 tx=0x7f08ec005540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:08.183 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.178+0000 7f09089b66c0 1 -- 10.20.193.92:0/2356711950 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f08ec02fc90 con 0x7f090410f060 2026-02-13T04:01:08.183 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.178+0000 7f09089b66c0 1 -- 10.20.193.92:0/2356711950 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f08ec02fdf0 con 0x7f090410f060 2026-02-13T04:01:08.183 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.178+0000 7f09089b66c0 1 -- 10.20.193.92:0/2356711950 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f08ec0072d0 con 0x7f090410f060 2026-02-13T04:01:08.183 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.178+0000 7f0903fff6c0 1 -- 10.20.193.92:0/2356711950 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0904062870 con 0x7f090410f060 2026-02-13T04:01:08.183 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.179+0000 7f0903fff6c0 1 -- 10.20.193.92:0/2356711950 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0904062ca0 con 0x7f090410f060 2026-02-13T04:01:08.184 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.180+0000 7f0903fff6c0 1 -- 10.20.193.92:0/2356711950 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0904110330 con 0x7f090410f060 2026-02-13T04:01:08.184 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.181+0000 7f09089b66c0 1 -- 10.20.193.92:0/2356711950 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f08ec0026b0 con 0x7f090410f060 2026-02-13T04:01:08.185 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.182+0000 7f09089b66c0 1 --2- 10.20.193.92:0/2356711950 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f08d80b5830 0x7f08d80d5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:08.185 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.182+0000 7f09027fc6c0 1 --2- 10.20.193.92:0/2356711950 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f08d80b5830 0x7f08d80d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:08.186 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.183+0000 7f09027fc6c0 1 --2- 10.20.193.92:0/2356711950 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f08d80b5830 0x7f08d80d5ce0 secure :-1 s=READY pgs=180 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0904123800 tx=0x7f08f8005f90 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:08.186 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.183+0000 7f09089b66c0 1 -- 10.20.193.92:0/2356711950 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7f08ec0ce950 con 0x7f090410f060 2026-02-13T04:01:08.186 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.183+0000 7f09089b66c0 1 -- 10.20.193.92:0/2356711950 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f08ec0ca5a0 con 0x7f090410f060 2026-02-13T04:01:08.204 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.202+0000 7fa75bfff6c0 1 -- 10.20.193.92:0/3017988040 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fa75c0efeb0 con 0x7fa75c115270 2026-02-13T04:01:08.205 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.202+0000 7fa73bfff6c0 1 -- 10.20.193.92:0/3017988040 <== mon.1 v2:10.20.193.158:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fa7440a6400 con 0x7fa75c115270 2026-02-13T04:01:08.205 INFO:teuthology.orchestra.run.trial092.stdout:197568495632 2026-02-13T04:01:08.207 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.204+0000 7fa75bfff6c0 1 -- 10.20.193.92:0/3017988040 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa7300b58b0 msgr2=0x7fa7300d5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:08.207 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.204+0000 7fa75bfff6c0 1 --2- 10.20.193.92:0/3017988040 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa7300b58b0 0x7fa7300d5d60 secure :-1 s=READY pgs=179 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa750005b40 tx=0x7fa750009310 comp rx=0 tx=0).stop 2026-02-13T04:01:08.207 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.204+0000 7fa75bfff6c0 1 -- 10.20.193.92:0/3017988040 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa75c115270 msgr2=0x7fa75c175b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:08.207 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.204+0000 7fa75bfff6c0 1 --2- 10.20.193.92:0/3017988040 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa75c115270 0x7fa75c175b10 secure :-1 s=READY pgs=104 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa74400b800 tx=0x7fa74400bcd0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.204+0000 7fa75bfff6c0 1 -- 10.20.193.92:0/3017988040 shutdown_connections 2026-02-13T04:01:08.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.204+0000 7fa75bfff6c0 1 --2- 10.20.193.92:0/3017988040 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa75c0f0870 0x7fa75c0ef040 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.204+0000 7fa75bfff6c0 1 --2- 10.20.193.92:0/3017988040 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa75c115270 0x7fa75c175b10 unknown :-1 s=CLOSED pgs=104 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.204+0000 7fa75bfff6c0 1 --2- 10.20.193.92:0/3017988040 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa7300b58b0 0x7fa7300d5d60 unknown :-1 s=CLOSED pgs=179 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.204+0000 7fa75bfff6c0 1 --2- 10.20.193.92:0/3017988040 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa75c10f060 0x7fa75c0f0240 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.204+0000 7fa75bfff6c0 1 -- 10.20.193.92:0/3017988040 >> 10.20.193.92:0/3017988040 conn(0x7fa75c0ec980 msgr2=0x7fa75c110a70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:08.209 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.205+0000 7fa75bfff6c0 1 -- 10.20.193.92:0/3017988040 shutdown_connections 2026-02-13T04:01:08.209 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.205+0000 7fa75bfff6c0 1 -- 10.20.193.92:0/3017988040 wait complete. 2026-02-13T04:01:08.224 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:08 trial092 ceph-mon[23047]: pgmap v186: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 25 op/s 2026-02-13T04:01:08.260 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.257+0000 7f1c997c36c0 1 -- 10.20.193.92:0/3587888453 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1c94114000 msgr2=0x7f1c941143d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:08.261 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.257+0000 7f1c997c36c0 1 --2- 10.20.193.92:0/3587888453 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1c94114000 0x7f1c941143d0 secure :-1 s=READY pgs=225 gs=1 cs=0 l=1 c_cookie=17426520572965902435 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c880075a0 tx=0x7f1c8802fdc0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.261 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.258+0000 7f1c997c36c0 1 -- 10.20.193.92:0/3587888453 shutdown_connections 2026-02-13T04:01:08.261 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.258+0000 7f1c997c36c0 1 --2- 10.20.193.92:0/3587888453 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1c94116b30 0x7f1c9417a740 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.261 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.258+0000 7f1c997c36c0 1 --2- 10.20.193.92:0/3587888453 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1c941149f0 0x7f1c94116380 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.262 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.258+0000 7f1c997c36c0 1 --2- 10.20.193.92:0/3587888453 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1c94114000 0x7f1c941143d0 unknown :-1 s=CLOSED pgs=225 gs=1 cs=0 l=1 c_cookie=17426520572965902435 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.262 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.258+0000 7f1c997c36c0 1 -- 10.20.193.92:0/3587888453 >> 10.20.193.92:0/3587888453 conn(0x7f1c94058a50 msgr2=0x7f1c94058e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:08.262 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.258+0000 7f1c997c36c0 1 -- 10.20.193.92:0/3587888453 shutdown_connections 2026-02-13T04:01:08.262 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.258+0000 7f1c997c36c0 1 -- 10.20.193.92:0/3587888453 wait complete. 2026-02-13T04:01:08.263 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.259+0000 7f1c997c36c0 1 Processor -- start 2026-02-13T04:01:08.263 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.259+0000 7f1c997c36c0 1 -- start start 2026-02-13T04:01:08.263 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.259+0000 7f1c997c36c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1c94114000 0x7f1c940ff630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:08.263 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.259+0000 7f1c997c36c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1c94116b30 0x7f1c9417a6b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:08.263 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.259+0000 7f1c997c36c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1c940ffd20 0x7f1c94104f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:08.264 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.259+0000 7f1c997c36c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1c94105470 con 0x7f1c94116b30 2026-02-13T04:01:08.264 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.259+0000 7f1c997c36c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1c941055e0 con 0x7f1c94114000 2026-02-13T04:01:08.264 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.259+0000 7f1c997c36c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f1c941057a0 con 0x7f1c940ffd20 2026-02-13T04:01:08.264 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.260+0000 7f1c927fc6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1c94116b30 0x7f1c9417a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:08.264 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.260+0000 7f1c927fc6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1c94116b30 0x7f1c9417a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:53562/0 (socket says 10.20.193.92:53562) 2026-02-13T04:01:08.264 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.260+0000 7f1c927fc6c0 1 -- 10.20.193.92:0/418382428 learned_addr learned my addr 10.20.193.92:0/418382428 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:08.265 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.260+0000 7f1c92ffd6c0 1 --2- 10.20.193.92:0/418382428 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1c94114000 0x7f1c940ff630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:08.265 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.260+0000 7f1c937fe6c0 1 --2- 10.20.193.92:0/418382428 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1c940ffd20 0x7f1c94104f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:08.265 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.260+0000 7f1c927fc6c0 1 -- 10.20.193.92:0/418382428 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1c940ffd20 msgr2=0x7f1c94104f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:08.265 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.260+0000 7f1c927fc6c0 1 --2- 10.20.193.92:0/418382428 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1c940ffd20 0x7f1c94104f30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.265 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.260+0000 7f1c927fc6c0 1 -- 10.20.193.92:0/418382428 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1c94114000 msgr2=0x7f1c940ff630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:08.265 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.260+0000 7f1c927fc6c0 1 --2- 10.20.193.92:0/418382428 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1c94114000 0x7f1c940ff630 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.265 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.260+0000 7f1c927fc6c0 1 -- 10.20.193.92:0/418382428 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c880071c0 con 0x7f1c94116b30 2026-02-13T04:01:08.265 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.260+0000 7f1c927fc6c0 1 --2- 10.20.193.92:0/418382428 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1c94116b30 0x7f1c9417a6b0 secure :-1 s=READY pgs=226 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c7c005910 tx=0x7f1c7c00bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:08.265 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.261+0000 7f1c73fff6c0 1 -- 10.20.193.92:0/418382428 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c7c004a80 con 0x7f1c94116b30 2026-02-13T04:01:08.265 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.261+0000 7f1c73fff6c0 1 -- 10.20.193.92:0/418382428 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f1c7c009030 con 0x7f1c94116b30 2026-02-13T04:01:08.265 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.261+0000 7f1c73fff6c0 1 -- 10.20.193.92:0/418382428 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1c7c0071c0 con 0x7f1c94116b30 2026-02-13T04:01:08.265 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.261+0000 7f1c997c36c0 1 -- 10.20.193.92:0/418382428 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c94105a80 con 0x7f1c94116b30 2026-02-13T04:01:08.266 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.261+0000 7f1c997c36c0 1 -- 10.20.193.92:0/418382428 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c941060a0 con 0x7f1c94116b30 2026-02-13T04:01:08.266 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.262+0000 7f1c71ffb6c0 1 -- 10.20.193.92:0/418382428 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c94114fe0 con 0x7f1c94116b30 2026-02-13T04:01:08.267 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.264+0000 7f1c73fff6c0 1 -- 10.20.193.92:0/418382428 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f1c7c004be0 con 0x7f1c94116b30 2026-02-13T04:01:08.268 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.265+0000 7f1c73fff6c0 1 --2- 10.20.193.92:0/418382428 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f1c680b5830 0x7f1c680d5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:08.268 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.265+0000 7f1c92ffd6c0 1 --2- 10.20.193.92:0/418382428 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f1c680b5830 0x7f1c680d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:08.268 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.265+0000 7f1c73fff6c0 1 -- 10.20.193.92:0/418382428 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7f1c7c0e39c0 con 0x7f1c94116b30 2026-02-13T04:01:08.269 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.266+0000 7f1c73fff6c0 1 -- 10.20.193.92:0/418382428 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1c7c0e3e40 con 0x7f1c94116b30 2026-02-13T04:01:08.269 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.266+0000 7f1c92ffd6c0 1 --2- 10.20.193.92:0/418382428 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f1c680b5830 0x7f1c680d5ce0 secure :-1 s=READY pgs=181 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c880074f0 tx=0x7f1c880023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:08.294 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.291+0000 7f0903fff6c0 1 -- 10.20.193.92:0/2356711950 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f090411dff0 con 0x7f090410f060 2026-02-13T04:01:08.300 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.297+0000 7f09089b66c0 1 -- 10.20.193.92:0/2356711950 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f08ec0310c0 con 0x7f090410f060 2026-02-13T04:01:08.301 INFO:teuthology.orchestra.run.trial092.stdout:180388626449 2026-02-13T04:01:08.302 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.299+0000 7f0903fff6c0 1 -- 10.20.193.92:0/2356711950 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f08d80b5830 msgr2=0x7f08d80d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:08.302 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.299+0000 7f0903fff6c0 1 --2- 10.20.193.92:0/2356711950 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f08d80b5830 0x7f08d80d5ce0 secure :-1 s=READY pgs=180 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0904123800 tx=0x7f08f8005f90 comp rx=0 tx=0).stop 2026-02-13T04:01:08.303 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.299+0000 7f0903fff6c0 1 -- 10.20.193.92:0/2356711950 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f090410f060 msgr2=0x7f090411ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:08.303 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.299+0000 7f0903fff6c0 1 --2- 10.20.193.92:0/2356711950 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f090410f060 0x7f090411ce70 secure :-1 s=READY pgs=224 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08ec0098a0 tx=0x7f08ec005540 comp rx=0 tx=0).stop 2026-02-13T04:01:08.303 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.300+0000 7f0903fff6c0 1 -- 10.20.193.92:0/2356711950 shutdown_connections 2026-02-13T04:01:08.303 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.300+0000 7f0903fff6c0 1 --2- 10.20.193.92:0/2356711950 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f08d80b5830 0x7f08d80d5ce0 unknown :-1 s=CLOSED pgs=180 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.303 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.300+0000 7f0903fff6c0 1 --2- 10.20.193.92:0/2356711950 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0904115270 0x7f090411d3b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.303 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.300+0000 7f0903fff6c0 1 --2- 10.20.193.92:0/2356711950 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f0904122770 0x7f0904122c10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.303 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.300+0000 7f0903fff6c0 1 --2- 10.20.193.92:0/2356711950 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f090410f060 0x7f090411ce70 unknown :-1 s=CLOSED pgs=224 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.304 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.300+0000 7f0903fff6c0 1 -- 10.20.193.92:0/2356711950 >> 10.20.193.92:0/2356711950 conn(0x7f09040ec980 msgr2=0x7f090410cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:08.304 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.300+0000 7f0903fff6c0 1 -- 10.20.193.92:0/2356711950 shutdown_connections 2026-02-13T04:01:08.304 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.301+0000 7f0903fff6c0 1 -- 10.20.193.92:0/2356711950 wait complete. 2026-02-13T04:01:08.328 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:08.328 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:08.366 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495632 got 197568495632 for osd.7 2026-02-13T04:01:08.366 DEBUG:teuthology.parallel:result is None 2026-02-13T04:01:08.371 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.369+0000 7f1c71ffb6c0 1 -- 10.20.193.92:0/418382428 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f1c94100780 con 0x7f1c94116b30 2026-02-13T04:01:08.373 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.370+0000 7f1c73fff6c0 1 -- 10.20.193.92:0/418382428 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f1c7c0a6310 con 0x7f1c94116b30 2026-02-13T04:01:08.373 INFO:teuthology.orchestra.run.trial092.stdout:257698037772 2026-02-13T04:01:08.375 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.372+0000 7f1c71ffb6c0 1 -- 10.20.193.92:0/418382428 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f1c680b5830 msgr2=0x7f1c680d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:08.375 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.372+0000 7f1c71ffb6c0 1 --2- 10.20.193.92:0/418382428 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f1c680b5830 0x7f1c680d5ce0 secure :-1 s=READY pgs=181 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c880074f0 tx=0x7f1c880023a0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.375 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.372+0000 7f1c71ffb6c0 1 -- 10.20.193.92:0/418382428 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1c94116b30 msgr2=0x7f1c9417a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:08.375 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.372+0000 7f1c71ffb6c0 1 --2- 10.20.193.92:0/418382428 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1c94116b30 0x7f1c9417a6b0 secure :-1 s=READY pgs=226 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c7c005910 tx=0x7f1c7c00bc50 comp rx=0 tx=0).stop 2026-02-13T04:01:08.376 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.372+0000 7f1c71ffb6c0 1 -- 10.20.193.92:0/418382428 shutdown_connections 2026-02-13T04:01:08.376 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.372+0000 7f1c71ffb6c0 1 --2- 10.20.193.92:0/418382428 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1c940ffd20 0x7f1c94104f30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.376 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.372+0000 7f1c71ffb6c0 1 --2- 10.20.193.92:0/418382428 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1c94116b30 0x7f1c9417a6b0 unknown :-1 s=CLOSED pgs=226 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.376 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.372+0000 7f1c71ffb6c0 1 --2- 10.20.193.92:0/418382428 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f1c680b5830 0x7f1c680d5ce0 unknown :-1 s=CLOSED pgs=181 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.376 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.372+0000 7f1c71ffb6c0 1 --2- 10.20.193.92:0/418382428 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1c94114000 0x7f1c940ff630 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.376 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.372+0000 7f1c71ffb6c0 1 -- 10.20.193.92:0/418382428 >> 10.20.193.92:0/418382428 conn(0x7f1c94058a50 msgr2=0x7f1c94059df0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:08.376 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.372+0000 7f1c71ffb6c0 1 -- 10.20.193.92:0/418382428 shutdown_connections 2026-02-13T04:01:08.376 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.372+0000 7f1c71ffb6c0 1 -- 10.20.193.92:0/418382428 wait complete. 2026-02-13T04:01:08.430 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626449 got 180388626449 for osd.6 2026-02-13T04:01:08.430 DEBUG:teuthology.parallel:result is None 2026-02-13T04:01:08.484 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037772 got 257698037772 for osd.9 2026-02-13T04:01:08.484 DEBUG:teuthology.parallel:result is None 2026-02-13T04:01:08.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:08 trial158 ceph-mon[27763]: pgmap v186: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 25 op/s 2026-02-13T04:01:08.585 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.582+0000 7fed6b5776c0 1 -- 10.20.193.92:0/2342258488 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fed6c1137a0 msgr2=0x7fed6c113b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:08.585 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.582+0000 7fed6b5776c0 1 --2- 10.20.193.92:0/2342258488 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fed6c1137a0 0x7fed6c113b70 secure :-1 s=READY pgs=105 gs=1 cs=0 l=1 c_cookie=11444402130254011294 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed60009970 tx=0x7fed6002ed50 comp rx=0 tx=0).stop 2026-02-13T04:01:08.585 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.583+0000 7fed6b5776c0 1 -- 10.20.193.92:0/2342258488 shutdown_connections 2026-02-13T04:01:08.586 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.583+0000 7fed6b5776c0 1 --2- 10.20.193.92:0/2342258488 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fed6c116520 0x7fed6c17a100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.586 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.583+0000 7fed6b5776c0 1 --2- 10.20.193.92:0/2342258488 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fed6c114190 0x7fed6c115d40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.586 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.583+0000 7fed6b5776c0 1 --2- 10.20.193.92:0/2342258488 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fed6c1137a0 0x7fed6c113b70 unknown :-1 s=CLOSED pgs=105 gs=1 cs=0 l=1 c_cookie=11444402130254011294 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.586 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.583+0000 7fed6b5776c0 1 -- 10.20.193.92:0/2342258488 >> 10.20.193.92:0/2342258488 conn(0x7fed6c061510 msgr2=0x7fed6c061910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:08.586 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.583+0000 7fed6b5776c0 1 -- 10.20.193.92:0/2342258488 shutdown_connections 2026-02-13T04:01:08.586 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.583+0000 7fed6b5776c0 1 -- 10.20.193.92:0/2342258488 wait complete. 2026-02-13T04:01:08.589 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.583+0000 7fed6b5776c0 1 Processor -- start 2026-02-13T04:01:08.589 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.584+0000 7fed6b5776c0 1 -- start start 2026-02-13T04:01:08.589 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.584+0000 7fed6b5776c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fed6c1137a0 0x7fed6c1213d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:08.589 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.584+0000 7fed6b5776c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fed6c116520 0x7fed6c121910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:08.589 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.584+0000 7fed6b5776c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fed6c126cd0 0x7fed6c127170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:08.589 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.584+0000 7fed6b5776c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fed6c1276e0 con 0x7fed6c126cd0 2026-02-13T04:01:08.589 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.584+0000 7fed6b5776c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fed6c127850 con 0x7fed6c1137a0 2026-02-13T04:01:08.590 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.584+0000 7fed6b5776c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fed6c127a10 con 0x7fed6c116520 2026-02-13T04:01:08.590 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.584+0000 7fed6a5756c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fed6c1137a0 0x7fed6c1213d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:08.590 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.584+0000 7fed6a5756c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fed6c1137a0 0x7fed6c1213d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:45932/0 (socket says 10.20.193.92:45932) 2026-02-13T04:01:08.590 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.584+0000 7fed6a5756c0 1 -- 10.20.193.92:0/2052263023 learned_addr learned my addr 10.20.193.92:0/2052263023 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:08.590 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.584+0000 7fed6ad766c0 1 --2- 10.20.193.92:0/2052263023 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fed6c126cd0 0x7fed6c127170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:08.590 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.584+0000 7fed6a5756c0 1 -- 10.20.193.92:0/2052263023 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fed6c116520 msgr2=0x7fed6c121910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:08.590 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.584+0000 7fed69d746c0 1 --2- 10.20.193.92:0/2052263023 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fed6c116520 0x7fed6c121910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:08.590 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.584+0000 7fed6a5756c0 1 --2- 10.20.193.92:0/2052263023 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fed6c116520 0x7fed6c121910 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.590 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.584+0000 7fed6a5756c0 1 -- 10.20.193.92:0/2052263023 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fed6c126cd0 msgr2=0x7fed6c127170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:08.590 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.584+0000 7fed6a5756c0 1 --2- 10.20.193.92:0/2052263023 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fed6c126cd0 0x7fed6c127170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.590 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.584+0000 7fed6a5756c0 1 -- 10.20.193.92:0/2052263023 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed60009590 con 0x7fed6c1137a0 2026-02-13T04:01:08.590 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.584+0000 7fed6ad766c0 1 --2- 10.20.193.92:0/2052263023 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fed6c126cd0 0x7fed6c127170 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T04:01:08.591 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.584+0000 7fed69d746c0 1 --2- 10.20.193.92:0/2052263023 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fed6c116520 0x7fed6c121910 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T04:01:08.591 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.585+0000 7fed6a5756c0 1 --2- 10.20.193.92:0/2052263023 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fed6c1137a0 0x7fed6c1213d0 secure :-1 s=READY pgs=106 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed600098c0 tx=0x7fed6002f8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:08.591 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.585+0000 7fed537fe6c0 1 -- 10.20.193.92:0/2052263023 <== mon.2 v2:10.20.193.99:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fed60002ae0 con 0x7fed6c1137a0 2026-02-13T04:01:08.591 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.585+0000 7fed537fe6c0 1 -- 10.20.193.92:0/2052263023 <== mon.2 v2:10.20.193.99:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fed600046b0 con 0x7fed6c1137a0 2026-02-13T04:01:08.591 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.585+0000 7fed6b5776c0 1 -- 10.20.193.92:0/2052263023 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed6c167e60 con 0x7fed6c1137a0 2026-02-13T04:01:08.591 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.585+0000 7fed537fe6c0 1 -- 10.20.193.92:0/2052263023 <== mon.2 v2:10.20.193.99:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fed60038290 con 0x7fed6c1137a0 2026-02-13T04:01:08.591 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.585+0000 7fed6b5776c0 1 -- 10.20.193.92:0/2052263023 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed6c168290 con 0x7fed6c1137a0 2026-02-13T04:01:08.591 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.586+0000 7fed517fa6c0 1 -- 10.20.193.92:0/2052263023 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed6c114840 con 0x7fed6c1137a0 2026-02-13T04:01:08.591 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.588+0000 7fed537fe6c0 1 -- 10.20.193.92:0/2052263023 <== mon.2 v2:10.20.193.99:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fed600073f0 con 0x7fed6c1137a0 2026-02-13T04:01:08.593 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.590+0000 7fed537fe6c0 1 --2- 10.20.193.92:0/2052263023 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fed440b56e0 0x7fed440d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:08.593 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.590+0000 7fed537fe6c0 1 -- 10.20.193.92:0/2052263023 <== mon.2 v2:10.20.193.99:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7fed60107de0 con 0x7fed6c1137a0 2026-02-13T04:01:08.593 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.590+0000 7fed69d746c0 1 --2- 10.20.193.92:0/2052263023 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fed440b56e0 0x7fed440d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:08.593 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.590+0000 7fed537fe6c0 1 -- 10.20.193.92:0/2052263023 <== mon.2 v2:10.20.193.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fed60108260 con 0x7fed6c1137a0 2026-02-13T04:01:08.593 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.590+0000 7fed69d746c0 1 --2- 10.20.193.92:0/2052263023 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fed440b56e0 0x7fed440d5b90 secure :-1 s=READY pgs=182 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed6c127d60 tx=0x7fed54009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:08.598 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.595+0000 7f7e0a7536c0 1 -- 10.20.193.92:0/1629628489 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7e0410fa50 msgr2=0x7f7e04114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:08.598 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.595+0000 7f7e0a7536c0 1 --2- 10.20.193.92:0/1629628489 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7e0410fa50 0x7f7e04114a90 secure :-1 s=READY pgs=227 gs=1 cs=0 l=1 c_cookie=13887313012008388091 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7df80099a0 tx=0x7f7df802ed00 comp rx=0 tx=0).stop 2026-02-13T04:01:08.598 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.595+0000 7f7e0a7536c0 1 -- 10.20.193.92:0/1629628489 shutdown_connections 2026-02-13T04:01:08.598 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.595+0000 7f7e0a7536c0 1 --2- 10.20.193.92:0/1629628489 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7e04115270 0x7f7e04175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.598 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.595+0000 7f7e0a7536c0 1 --2- 10.20.193.92:0/1629628489 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7e0410fa50 0x7f7e04114a90 unknown :-1 s=CLOSED pgs=227 gs=1 cs=0 l=1 c_cookie=13887313012008388091 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.598 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.595+0000 7f7e0a7536c0 1 --2- 10.20.193.92:0/1629628489 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7e0410f060 0x7f7e0410f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.598 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.595+0000 7f7e0a7536c0 1 -- 10.20.193.92:0/1629628489 >> 10.20.193.92:0/1629628489 conn(0x7f7e040ec980 msgr2=0x7f7e0410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:08.599 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.595+0000 7f7e0a7536c0 1 -- 10.20.193.92:0/1629628489 shutdown_connections 2026-02-13T04:01:08.600 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.595+0000 7f7e0a7536c0 1 -- 10.20.193.92:0/1629628489 wait complete. 2026-02-13T04:01:08.601 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.596+0000 7f7e0a7536c0 1 Processor -- start 2026-02-13T04:01:08.601 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.596+0000 7f7e0a7536c0 1 -- start start 2026-02-13T04:01:08.601 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.596+0000 7f7e0a7536c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7e0410f060 0x7f7e040f4860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:08.601 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.596+0000 7f7e0a7536c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7e04115270 0x7f7e04175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:08.601 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.596+0000 7f7e0a7536c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7e040f4e90 0x7f7e040fa160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:08.601 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.596+0000 7f7e0a7536c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7e040f5580 con 0x7f7e0410f060 2026-02-13T04:01:08.601 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.596+0000 7f7e0a7536c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7e040fa6a0 con 0x7f7e040f4e90 2026-02-13T04:01:08.601 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.596+0000 7f7e0a7536c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f7e040fa860 con 0x7f7e04115270 2026-02-13T04:01:08.601 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.597+0000 7f7e097516c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7e0410f060 0x7f7e040f4860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:08.601 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.597+0000 7f7e097516c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7e0410f060 0x7f7e040f4860 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:53612/0 (socket says 10.20.193.92:53612) 2026-02-13T04:01:08.602 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.597+0000 7f7e097516c0 1 -- 10.20.193.92:0/4199228671 learned_addr learned my addr 10.20.193.92:0/4199228671 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:08.602 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.597+0000 7f7e09f526c0 1 --2- 10.20.193.92:0/4199228671 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7e040f4e90 0x7f7e040fa160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:08.602 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.597+0000 7f7e08f506c0 1 --2- 10.20.193.92:0/4199228671 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7e04115270 0x7f7e04175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:08.602 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.597+0000 7f7e097516c0 1 -- 10.20.193.92:0/4199228671 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7e04115270 msgr2=0x7f7e04175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:08.602 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.597+0000 7f7e097516c0 1 --2- 10.20.193.92:0/4199228671 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7e04115270 0x7f7e04175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.602 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.597+0000 7f7e097516c0 1 -- 10.20.193.92:0/4199228671 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7e040f4e90 msgr2=0x7f7e040fa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:08.602 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.597+0000 7f7e097516c0 1 --2- 10.20.193.92:0/4199228671 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7e040f4e90 0x7f7e040fa160 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.602 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.597+0000 7f7e097516c0 1 -- 10.20.193.92:0/4199228671 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7df8009590 con 0x7f7e0410f060 2026-02-13T04:01:08.602 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.597+0000 7f7e097516c0 1 --2- 10.20.193.92:0/4199228671 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7e0410f060 0x7f7e040f4860 secure :-1 s=READY pgs=228 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7df4009490 tx=0x7f7df400bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:08.602 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.597+0000 7f7df27fc6c0 1 -- 10.20.193.92:0/4199228671 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7df4004a80 con 0x7f7e0410f060 2026-02-13T04:01:08.602 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.597+0000 7f7df27fc6c0 1 -- 10.20.193.92:0/4199228671 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f7df4009030 con 0x7f7e0410f060 2026-02-13T04:01:08.602 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.597+0000 7f7df27fc6c0 1 -- 10.20.193.92:0/4199228671 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7df4007440 con 0x7f7e0410f060 2026-02-13T04:01:08.603 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.597+0000 7f7e0a7536c0 1 -- 10.20.193.92:0/4199228671 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e040fab40 con 0x7f7e0410f060 2026-02-13T04:01:08.603 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.597+0000 7f7e0a7536c0 1 -- 10.20.193.92:0/4199228671 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e040fafd0 con 0x7f7e0410f060 2026-02-13T04:01:08.603 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.598+0000 7f7dd3fff6c0 1 -- 10.20.193.92:0/4199228671 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e04110330 con 0x7f7e0410f060 2026-02-13T04:01:08.603 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.600+0000 7f7df27fc6c0 1 -- 10.20.193.92:0/4199228671 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f7df4004be0 con 0x7f7e0410f060 2026-02-13T04:01:08.604 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.602+0000 7f7df27fc6c0 1 --2- 10.20.193.92:0/4199228671 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f7de00b5760 0x7f7de00d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:08.605 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.602+0000 7f7df27fc6c0 1 -- 10.20.193.92:0/4199228671 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7f7df40e3a90 con 0x7f7e0410f060 2026-02-13T04:01:08.605 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.602+0000 7f7df27fc6c0 1 -- 10.20.193.92:0/4199228671 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7df411c5e0 con 0x7f7e0410f060 2026-02-13T04:01:08.605 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.602+0000 7f7e08f506c0 1 --2- 10.20.193.92:0/4199228671 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f7de00b5760 0x7f7de00d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:08.605 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.602+0000 7f7e08f506c0 1 --2- 10.20.193.92:0/4199228671 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f7de00b5760 0x7f7de00d5c10 secure :-1 s=READY pgs=183 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7df80023e0 tx=0x7f7df8005c60 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:08.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:08 trial099 ceph-mon[27808]: pgmap v186: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 11 KiB/s wr, 25 op/s 2026-02-13T04:01:08.696 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.693+0000 7fed517fa6c0 1 -- 10.20.193.92:0/2052263023 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fed6c113b70 con 0x7fed6c1137a0 2026-02-13T04:01:08.697 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.694+0000 7fed537fe6c0 1 -- 10.20.193.92:0/2052263023 <== mon.2 v2:10.20.193.99:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fed600ca730 con 0x7fed6c1137a0 2026-02-13T04:01:08.697 INFO:teuthology.orchestra.run.trial092.stdout:133143986197 2026-02-13T04:01:08.698 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.695+0000 7fed517fa6c0 1 -- 10.20.193.92:0/2052263023 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fed440b56e0 msgr2=0x7fed440d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:08.698 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.695+0000 7fed517fa6c0 1 --2- 10.20.193.92:0/2052263023 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fed440b56e0 0x7fed440d5b90 secure :-1 s=READY pgs=182 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed6c127d60 tx=0x7fed54009260 comp rx=0 tx=0).stop 2026-02-13T04:01:08.698 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.695+0000 7fed517fa6c0 1 -- 10.20.193.92:0/2052263023 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fed6c1137a0 msgr2=0x7fed6c1213d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:08.698 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.695+0000 7fed517fa6c0 1 --2- 10.20.193.92:0/2052263023 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fed6c1137a0 0x7fed6c1213d0 secure :-1 s=READY pgs=106 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fed600098c0 tx=0x7fed6002f8a0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.699 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.695+0000 7fed517fa6c0 1 -- 10.20.193.92:0/2052263023 shutdown_connections 2026-02-13T04:01:08.699 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.695+0000 7fed517fa6c0 1 --2- 10.20.193.92:0/2052263023 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fed6c126cd0 0x7fed6c127170 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.699 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.695+0000 7fed517fa6c0 1 --2- 10.20.193.92:0/2052263023 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fed6c116520 0x7fed6c121910 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.699 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.695+0000 7fed517fa6c0 1 --2- 10.20.193.92:0/2052263023 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fed440b56e0 0x7fed440d5b90 unknown :-1 s=CLOSED pgs=182 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.699 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.695+0000 7fed517fa6c0 1 --2- 10.20.193.92:0/2052263023 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fed6c1137a0 0x7fed6c1213d0 unknown :-1 s=CLOSED pgs=106 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.699 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.695+0000 7fed517fa6c0 1 -- 10.20.193.92:0/2052263023 >> 10.20.193.92:0/2052263023 conn(0x7fed6c061510 msgr2=0x7fed6c116d50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:08.699 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.695+0000 7fed517fa6c0 1 -- 10.20.193.92:0/2052263023 shutdown_connections 2026-02-13T04:01:08.699 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.695+0000 7fed517fa6c0 1 -- 10.20.193.92:0/2052263023 wait complete. 2026-02-13T04:01:08.706 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.703+0000 7f7dd3fff6c0 1 -- 10.20.193.92:0/4199228671 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f7e040fafd0 con 0x7f7e0410f060 2026-02-13T04:01:08.706 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.703+0000 7f7df27fc6c0 1 -- 10.20.193.92:0/4199228671 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7e040fafd0 con 0x7f7e0410f060 2026-02-13T04:01:08.706 INFO:teuthology.orchestra.run.trial092.stdout:51539607578 2026-02-13T04:01:08.708 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.705+0000 7f7dd3fff6c0 1 -- 10.20.193.92:0/4199228671 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f7de00b5760 msgr2=0x7f7de00d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:08.708 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.705+0000 7f7dd3fff6c0 1 --2- 10.20.193.92:0/4199228671 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f7de00b5760 0x7f7de00d5c10 secure :-1 s=READY pgs=183 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7df80023e0 tx=0x7f7df8005c60 comp rx=0 tx=0).stop 2026-02-13T04:01:08.708 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.705+0000 7f7dd3fff6c0 1 -- 10.20.193.92:0/4199228671 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7e0410f060 msgr2=0x7f7e040f4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:08.709 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.705+0000 7f7dd3fff6c0 1 --2- 10.20.193.92:0/4199228671 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7e0410f060 0x7f7e040f4860 secure :-1 s=READY pgs=228 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7df4009490 tx=0x7f7df400bca0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.709 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.705+0000 7f7dd3fff6c0 1 -- 10.20.193.92:0/4199228671 shutdown_connections 2026-02-13T04:01:08.709 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.705+0000 7f7dd3fff6c0 1 --2- 10.20.193.92:0/4199228671 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f7de00b5760 0x7f7de00d5c10 unknown :-1 s=CLOSED pgs=183 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.709 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.705+0000 7f7dd3fff6c0 1 --2- 10.20.193.92:0/4199228671 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7e040f4e90 0x7f7e040fa160 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.709 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.705+0000 7f7dd3fff6c0 1 --2- 10.20.193.92:0/4199228671 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7e04115270 0x7f7e04175b10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.709 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.705+0000 7f7dd3fff6c0 1 --2- 10.20.193.92:0/4199228671 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7e0410f060 0x7f7e040f4860 unknown :-1 s=CLOSED pgs=228 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:08.709 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.705+0000 7f7dd3fff6c0 1 -- 10.20.193.92:0/4199228671 >> 10.20.193.92:0/4199228671 conn(0x7f7e040ec980 msgr2=0x7f7e0410d540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:08.709 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.705+0000 7f7dd3fff6c0 1 -- 10.20.193.92:0/4199228671 shutdown_connections 2026-02-13T04:01:08.709 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:08.705+0000 7f7dd3fff6c0 1 -- 10.20.193.92:0/4199228671 wait complete. 2026-02-13T04:01:08.845 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986197 got 133143986197 for osd.4 2026-02-13T04:01:08.845 DEBUG:teuthology.parallel:result is None 2026-02-13T04:01:08.851 INFO:tasks.cephadm.ceph_manager.ceph:need seq 51539607578 got 51539607578 for osd.1 2026-02-13T04:01:08.852 DEBUG:teuthology.parallel:result is None 2026-02-13T04:01:08.852 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2026-02-13T04:01:08.852 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph pg dump --format=json 2026-02-13T04:01:09.073 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:09.281 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.277+0000 7fc64b5776c0 1 -- 10.20.193.92:0/1000451725 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc64c10fa50 msgr2=0x7fc64c114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:09.281 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.277+0000 7fc64b5776c0 1 --2- 10.20.193.92:0/1000451725 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc64c10fa50 0x7fc64c114a90 secure :-1 s=READY pgs=229 gs=1 cs=0 l=1 c_cookie=13680198161888773065 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc6340099a0 tx=0x7fc63402ed00 comp rx=0 tx=0).stop 2026-02-13T04:01:09.281 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.278+0000 7fc64b5776c0 1 -- 10.20.193.92:0/1000451725 shutdown_connections 2026-02-13T04:01:09.281 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.278+0000 7fc64b5776c0 1 --2- 10.20.193.92:0/1000451725 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fc64c115270 0x7fc64c175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:09.281 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.278+0000 7fc64b5776c0 1 --2- 10.20.193.92:0/1000451725 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc64c10fa50 0x7fc64c114a90 unknown :-1 s=CLOSED pgs=229 gs=1 cs=0 l=1 c_cookie=13680198161888773065 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:09.282 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.278+0000 7fc64b5776c0 1 --2- 10.20.193.92:0/1000451725 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fc64c10f060 0x7fc64c10f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:09.282 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.278+0000 7fc64b5776c0 1 -- 10.20.193.92:0/1000451725 >> 10.20.193.92:0/1000451725 conn(0x7fc64c0ec980 msgr2=0x7fc64c10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:09.282 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.278+0000 7fc64b5776c0 1 -- 10.20.193.92:0/1000451725 shutdown_connections 2026-02-13T04:01:09.282 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.278+0000 7fc64b5776c0 1 -- 10.20.193.92:0/1000451725 wait complete. 2026-02-13T04:01:09.284 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.278+0000 7fc64b5776c0 1 Processor -- start 2026-02-13T04:01:09.284 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.279+0000 7fc64b5776c0 1 -- start start 2026-02-13T04:01:09.284 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.279+0000 7fc64b5776c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fc64c10f060 0x7fc64c066730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:09.284 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.279+0000 7fc64b5776c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc64c115270 0x7fc64c062990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:09.284 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.279+0000 7fc64b5776c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fc64c062f70 0x7fc64c063410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:09.284 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.279+0000 7fc64b5776c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc64c167890 con 0x7fc64c115270 2026-02-13T04:01:09.284 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.279+0000 7fc64b5776c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc64c167a00 con 0x7fc64c10f060 2026-02-13T04:01:09.285 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.279+0000 7fc64b5776c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fc64c167bc0 con 0x7fc64c062f70 2026-02-13T04:01:09.285 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.279+0000 7fc64ad766c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fc64c062f70 0x7fc64c063410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:09.285 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.279+0000 7fc649d746c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc64c115270 0x7fc64c062990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:09.285 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.279+0000 7fc649d746c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc64c115270 0x7fc64c062990 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:53626/0 (socket says 10.20.193.92:53626) 2026-02-13T04:01:09.285 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.279+0000 7fc649d746c0 1 -- 10.20.193.92:0/3120612773 learned_addr learned my addr 10.20.193.92:0/3120612773 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:09.285 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.279+0000 7fc64a5756c0 1 --2- 10.20.193.92:0/3120612773 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fc64c10f060 0x7fc64c066730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:09.285 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.279+0000 7fc649d746c0 1 -- 10.20.193.92:0/3120612773 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fc64c062f70 msgr2=0x7fc64c063410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:09.285 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.279+0000 7fc649d746c0 1 --2- 10.20.193.92:0/3120612773 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fc64c062f70 0x7fc64c063410 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:09.285 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.279+0000 7fc649d746c0 1 -- 10.20.193.92:0/3120612773 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fc64c10f060 msgr2=0x7fc64c066730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:09.285 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.279+0000 7fc649d746c0 1 --2- 10.20.193.92:0/3120612773 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fc64c10f060 0x7fc64c066730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:09.285 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.279+0000 7fc649d746c0 1 -- 10.20.193.92:0/3120612773 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc634009590 con 0x7fc64c115270 2026-02-13T04:01:09.285 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.280+0000 7fc649d746c0 1 --2- 10.20.193.92:0/3120612773 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc64c115270 0x7fc64c062990 secure :-1 s=READY pgs=230 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc6340072f0 tx=0x7fc63402f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:09.286 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.280+0000 7fc6337fe6c0 1 -- 10.20.193.92:0/3120612773 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc6340046b0 con 0x7fc64c115270 2026-02-13T04:01:09.286 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.280+0000 7fc6337fe6c0 1 -- 10.20.193.92:0/3120612773 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fc634002be0 con 0x7fc64c115270 2026-02-13T04:01:09.286 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.280+0000 7fc6337fe6c0 1 -- 10.20.193.92:0/3120612773 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc634037070 con 0x7fc64c115270 2026-02-13T04:01:09.286 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.280+0000 7fc64b5776c0 1 -- 10.20.193.92:0/3120612773 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc64c167e40 con 0x7fc64c115270 2026-02-13T04:01:09.286 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.280+0000 7fc64b5776c0 1 -- 10.20.193.92:0/3120612773 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc64c168270 con 0x7fc64c115270 2026-02-13T04:01:09.286 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.281+0000 7fc6317fa6c0 1 -- 10.20.193.92:0/3120612773 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc614005310 con 0x7fc64c115270 2026-02-13T04:01:09.286 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.283+0000 7fc6337fe6c0 1 -- 10.20.193.92:0/3120612773 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fc6340076a0 con 0x7fc64c115270 2026-02-13T04:01:09.287 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.284+0000 7fc6337fe6c0 1 --2- 10.20.193.92:0/3120612773 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fc6240b5760 0x7fc6240d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:09.287 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.284+0000 7fc6337fe6c0 1 -- 10.20.193.92:0/3120612773 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7fc634107cf0 con 0x7fc64c115270 2026-02-13T04:01:09.287 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.285+0000 7fc64a5756c0 1 --2- 10.20.193.92:0/3120612773 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fc6240b5760 0x7fc6240d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:09.288 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.285+0000 7fc64a5756c0 1 --2- 10.20.193.92:0/3120612773 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fc6240b5760 0x7fc6240d5c10 secure :-1 s=READY pgs=184 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc640004750 tx=0x7fc640009390 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:09.288 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.285+0000 7fc6337fe6c0 1 -- 10.20.193.92:0/3120612773 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc6340ca640 con 0x7fc64c115270 2026-02-13T04:01:09.385 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.383+0000 7fc6317fa6c0 1 -- 10.20.193.92:0/3120612773 --> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc614002bc0 con 0x7fc6240b5760 2026-02-13T04:01:09.386 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:09 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/3017988040' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T04:01:09.386 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:09 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/2356711950' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-13T04:01:09.386 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:09 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/418382428' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-13T04:01:09.386 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:09 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/2052263023' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T04:01:09.386 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:09 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/4199228671' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-13T04:01:09.388 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.386+0000 7fc6337fe6c0 1 -- 10.20.193.92:0/3120612773 <== mgr.14187 v2:10.20.193.92:6800/4191527999 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259042 (secure 0 0 0) 0x7fc614002bc0 con 0x7fc6240b5760 2026-02-13T04:01:09.389 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:01:09.390 INFO:teuthology.orchestra.run.trial092.stderr:dumped all 2026-02-13T04:01:09.391 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.388+0000 7fc6317fa6c0 1 -- 10.20.193.92:0/3120612773 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fc6240b5760 msgr2=0x7fc6240d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:09.391 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.388+0000 7fc6317fa6c0 1 --2- 10.20.193.92:0/3120612773 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fc6240b5760 0x7fc6240d5c10 secure :-1 s=READY pgs=184 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc640004750 tx=0x7fc640009390 comp rx=0 tx=0).stop 2026-02-13T04:01:09.391 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.388+0000 7fc6317fa6c0 1 -- 10.20.193.92:0/3120612773 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc64c115270 msgr2=0x7fc64c062990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:09.391 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.388+0000 7fc6317fa6c0 1 --2- 10.20.193.92:0/3120612773 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc64c115270 0x7fc64c062990 secure :-1 s=READY pgs=230 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc6340072f0 tx=0x7fc63402f810 comp rx=0 tx=0).stop 2026-02-13T04:01:09.391 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.388+0000 7fc6317fa6c0 1 -- 10.20.193.92:0/3120612773 shutdown_connections 2026-02-13T04:01:09.391 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.388+0000 7fc6317fa6c0 1 --2- 10.20.193.92:0/3120612773 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fc64c062f70 0x7fc64c063410 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:09.391 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.388+0000 7fc6317fa6c0 1 --2- 10.20.193.92:0/3120612773 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc64c115270 0x7fc64c062990 unknown :-1 s=CLOSED pgs=230 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:09.391 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.388+0000 7fc6317fa6c0 1 --2- 10.20.193.92:0/3120612773 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fc6240b5760 0x7fc6240d5c10 unknown :-1 s=CLOSED pgs=184 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:09.391 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.388+0000 7fc6317fa6c0 1 --2- 10.20.193.92:0/3120612773 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fc64c10f060 0x7fc64c066730 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:09.391 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.388+0000 7fc6317fa6c0 1 -- 10.20.193.92:0/3120612773 >> 10.20.193.92:0/3120612773 conn(0x7fc64c0ec980 msgr2=0x7fc64c10cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:09.391 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.389+0000 7fc6317fa6c0 1 -- 10.20.193.92:0/3120612773 shutdown_connections 2026-02-13T04:01:09.391 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.389+0000 7fc6317fa6c0 1 -- 10.20.193.92:0/3120612773 wait complete. 2026-02-13T04:01:09.493 INFO:teuthology.orchestra.run.trial092.stdout:{"pg_ready":true,"pg_map":{"version":187,"stamp":"2026-02-13T04:01:09.090384+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":664819,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":252,"num_read_kb":249,"num_write":427,"num_write_kb":3863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":359,"ondisk_log_size":359,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":333900,"kb_used_data":10332,"kb_used_omap":458,"kb_used_meta":322869,"kb_avail":8807704500,"statfs":{"total":9019431321600,"available":9019089408000,"internally_reserved":0,"allocated":10579968,"data_stored":6744813,"data_compressed":120318,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":469837,"internal_metadata":330618035},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":60592,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":138,"num_read_kb":150,"num_write":88,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002205"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722515+0000","last_change":"2026-02-13T04:00:49.479956+0000","last_active":"2026-02-13T04:00:50.722515+0000","last_peered":"2026-02-13T04:00:50.722515+0000","last_clean":"2026-02-13T04:00:50.722515+0000","last_became_active":"2026-02-13T04:00:49.479727+0000","last_became_peered":"2026-02-13T04:00:49.479727+0000","last_unstale":"2026-02-13T04:00:50.722515+0000","last_undegraded":"2026-02-13T04:00:50.722515+0000","last_fullsized":"2026-02-13T04:00:50.722515+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:47:26.793095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469620+0000","last_change":"2026-02-13T04:00:49.482313+0000","last_active":"2026-02-13T04:00:50.469620+0000","last_peered":"2026-02-13T04:00:50.469620+0000","last_clean":"2026-02-13T04:00:50.469620+0000","last_became_active":"2026-02-13T04:00:49.482220+0000","last_became_peered":"2026-02-13T04:00:49.482220+0000","last_unstale":"2026-02-13T04:00:50.469620+0000","last_undegraded":"2026-02-13T04:00:50.469620+0000","last_fullsized":"2026-02-13T04:00:50.469620+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:31:30.541675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469513+0000","last_change":"2026-02-13T04:00:49.475309+0000","last_active":"2026-02-13T04:00:50.469513+0000","last_peered":"2026-02-13T04:00:50.469513+0000","last_clean":"2026-02-13T04:00:50.469513+0000","last_became_active":"2026-02-13T04:00:49.474397+0000","last_became_peered":"2026-02-13T04:00:49.474397+0000","last_unstale":"2026-02-13T04:00:50.469513+0000","last_undegraded":"2026-02-13T04:00:50.469513+0000","last_fullsized":"2026-02-13T04:00:50.469513+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:12:33.930204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.468755+0000","last_change":"2026-02-13T04:00:49.478672+0000","last_active":"2026-02-13T04:00:50.468755+0000","last_peered":"2026-02-13T04:00:50.468755+0000","last_clean":"2026-02-13T04:00:50.468755+0000","last_became_active":"2026-02-13T04:00:49.477706+0000","last_became_peered":"2026-02-13T04:00:49.477706+0000","last_unstale":"2026-02-13T04:00:50.468755+0000","last_undegraded":"2026-02-13T04:00:50.468755+0000","last_fullsized":"2026-02-13T04:00:50.468755+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:18:15.978107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722339+0000","last_change":"2026-02-13T04:00:49.479066+0000","last_active":"2026-02-13T04:00:50.722339+0000","last_peered":"2026-02-13T04:00:50.722339+0000","last_clean":"2026-02-13T04:00:50.722339+0000","last_became_active":"2026-02-13T04:00:49.478908+0000","last_became_peered":"2026-02-13T04:00:49.478908+0000","last_unstale":"2026-02-13T04:00:50.722339+0000","last_undegraded":"2026-02-13T04:00:50.722339+0000","last_fullsized":"2026-02-13T04:00:50.722339+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:23:17.185580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.468647+0000","last_change":"2026-02-13T04:00:49.473377+0000","last_active":"2026-02-13T04:00:50.468647+0000","last_peered":"2026-02-13T04:00:50.468647+0000","last_clean":"2026-02-13T04:00:50.468647+0000","last_became_active":"2026-02-13T04:00:49.473101+0000","last_became_peered":"2026-02-13T04:00:49.473101+0000","last_unstale":"2026-02-13T04:00:50.468647+0000","last_undegraded":"2026-02-13T04:00:50.468647+0000","last_fullsized":"2026-02-13T04:00:50.468647+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:13:24.278254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.909973+0000","last_change":"2026-02-13T04:00:49.474399+0000","last_active":"2026-02-13T04:00:50.909973+0000","last_peered":"2026-02-13T04:00:50.909973+0000","last_clean":"2026-02-13T04:00:50.909973+0000","last_became_active":"2026-02-13T04:00:49.474190+0000","last_became_peered":"2026-02-13T04:00:49.474190+0000","last_unstale":"2026-02-13T04:00:50.909973+0000","last_undegraded":"2026-02-13T04:00:50.909973+0000","last_fullsized":"2026-02-13T04:00:50.909973+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:58:56.035600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.468618+0000","last_change":"2026-02-13T04:00:49.479881+0000","last_active":"2026-02-13T04:00:50.468618+0000","last_peered":"2026-02-13T04:00:50.468618+0000","last_clean":"2026-02-13T04:00:50.468618+0000","last_became_active":"2026-02-13T04:00:49.477264+0000","last_became_peered":"2026-02-13T04:00:49.477264+0000","last_unstale":"2026-02-13T04:00:50.468618+0000","last_undegraded":"2026-02-13T04:00:50.468618+0000","last_fullsized":"2026-02-13T04:00:50.468618+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:44:11.954643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.720863+0000","last_change":"2026-02-13T04:00:49.474129+0000","last_active":"2026-02-13T04:00:50.720863+0000","last_peered":"2026-02-13T04:00:50.720863+0000","last_clean":"2026-02-13T04:00:50.720863+0000","last_became_active":"2026-02-13T04:00:49.473954+0000","last_became_peered":"2026-02-13T04:00:49.473954+0000","last_unstale":"2026-02-13T04:00:50.720863+0000","last_undegraded":"2026-02-13T04:00:50.720863+0000","last_fullsized":"2026-02-13T04:00:50.720863+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:57:22.870845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469105+0000","last_change":"2026-02-13T04:00:49.473093+0000","last_active":"2026-02-13T04:00:50.469105+0000","last_peered":"2026-02-13T04:00:50.469105+0000","last_clean":"2026-02-13T04:00:50.469105+0000","last_became_active":"2026-02-13T04:00:49.472808+0000","last_became_peered":"2026-02-13T04:00:49.472808+0000","last_unstale":"2026-02-13T04:00:50.469105+0000","last_undegraded":"2026-02-13T04:00:50.469105+0000","last_fullsized":"2026-02-13T04:00:50.469105+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:43:54.901711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.910473+0000","last_change":"2026-02-13T04:00:49.474383+0000","last_active":"2026-02-13T04:00:50.910473+0000","last_peered":"2026-02-13T04:00:50.910473+0000","last_clean":"2026-02-13T04:00:50.910473+0000","last_became_active":"2026-02-13T04:00:49.473948+0000","last_became_peered":"2026-02-13T04:00:49.473948+0000","last_unstale":"2026-02-13T04:00:50.910473+0000","last_undegraded":"2026-02-13T04:00:50.910473+0000","last_fullsized":"2026-02-13T04:00:50.910473+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:55:08.451894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.468849+0000","last_change":"2026-02-13T04:00:49.477579+0000","last_active":"2026-02-13T04:00:50.468849+0000","last_peered":"2026-02-13T04:00:50.468849+0000","last_clean":"2026-02-13T04:00:50.468849+0000","last_became_active":"2026-02-13T04:00:49.473854+0000","last_became_peered":"2026-02-13T04:00:49.473854+0000","last_unstale":"2026-02-13T04:00:50.468849+0000","last_undegraded":"2026-02-13T04:00:50.468849+0000","last_fullsized":"2026-02-13T04:00:50.468849+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:12:19.444223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.721290+0000","last_change":"2026-02-13T04:00:49.476339+0000","last_active":"2026-02-13T04:00:50.721290+0000","last_peered":"2026-02-13T04:00:50.721290+0000","last_clean":"2026-02-13T04:00:50.721290+0000","last_became_active":"2026-02-13T04:00:49.476269+0000","last_became_peered":"2026-02-13T04:00:49.476269+0000","last_unstale":"2026-02-13T04:00:50.721290+0000","last_undegraded":"2026-02-13T04:00:50.721290+0000","last_fullsized":"2026-02-13T04:00:50.721290+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:51:34.159138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.470257+0000","last_change":"2026-02-13T04:00:49.475689+0000","last_active":"2026-02-13T04:00:50.470257+0000","last_peered":"2026-02-13T04:00:50.470257+0000","last_clean":"2026-02-13T04:00:50.470257+0000","last_became_active":"2026-02-13T04:00:49.475254+0000","last_became_peered":"2026-02-13T04:00:49.475254+0000","last_unstale":"2026-02-13T04:00:50.470257+0000","last_undegraded":"2026-02-13T04:00:50.470257+0000","last_fullsized":"2026-02-13T04:00:50.470257+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:44:04.115649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469299+0000","last_change":"2026-02-13T04:00:49.478457+0000","last_active":"2026-02-13T04:00:50.469299+0000","last_peered":"2026-02-13T04:00:50.469299+0000","last_clean":"2026-02-13T04:00:50.469299+0000","last_became_active":"2026-02-13T04:00:49.478351+0000","last_became_peered":"2026-02-13T04:00:49.478351+0000","last_unstale":"2026-02-13T04:00:50.469299+0000","last_undegraded":"2026-02-13T04:00:50.469299+0000","last_fullsized":"2026-02-13T04:00:50.469299+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:03:26.642290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.720495+0000","last_change":"2026-02-13T04:00:49.476182+0000","last_active":"2026-02-13T04:00:50.720495+0000","last_peered":"2026-02-13T04:00:50.720495+0000","last_clean":"2026-02-13T04:00:50.720495+0000","last_became_active":"2026-02-13T04:00:49.476070+0000","last_became_peered":"2026-02-13T04:00:49.476070+0000","last_unstale":"2026-02-13T04:00:50.720495+0000","last_undegraded":"2026-02-13T04:00:50.720495+0000","last_fullsized":"2026-02-13T04:00:50.720495+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:04:29.238236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722540+0000","last_change":"2026-02-13T04:00:49.482695+0000","last_active":"2026-02-13T04:00:50.722540+0000","last_peered":"2026-02-13T04:00:50.722540+0000","last_clean":"2026-02-13T04:00:50.722540+0000","last_became_active":"2026-02-13T04:00:49.482487+0000","last_became_peered":"2026-02-13T04:00:49.482487+0000","last_unstale":"2026-02-13T04:00:50.722540+0000","last_undegraded":"2026-02-13T04:00:50.722540+0000","last_fullsized":"2026-02-13T04:00:50.722540+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:17:10.991068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469800+0000","last_change":"2026-02-13T04:00:49.473784+0000","last_active":"2026-02-13T04:00:50.469800+0000","last_peered":"2026-02-13T04:00:50.469800+0000","last_clean":"2026-02-13T04:00:50.469800+0000","last_became_active":"2026-02-13T04:00:49.473653+0000","last_became_peered":"2026-02-13T04:00:49.473653+0000","last_unstale":"2026-02-13T04:00:50.469800+0000","last_undegraded":"2026-02-13T04:00:50.469800+0000","last_fullsized":"2026-02-13T04:00:50.469800+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:47:48.283470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722687+0000","last_change":"2026-02-13T04:00:49.476692+0000","last_active":"2026-02-13T04:00:50.722687+0000","last_peered":"2026-02-13T04:00:50.722687+0000","last_clean":"2026-02-13T04:00:50.722687+0000","last_became_active":"2026-02-13T04:00:49.476507+0000","last_became_peered":"2026-02-13T04:00:49.476507+0000","last_unstale":"2026-02-13T04:00:50.722687+0000","last_undegraded":"2026-02-13T04:00:50.722687+0000","last_fullsized":"2026-02-13T04:00:50.722687+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:48:00.193446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722223+0000","last_change":"2026-02-13T04:00:49.480680+0000","last_active":"2026-02-13T04:00:50.722223+0000","last_peered":"2026-02-13T04:00:50.722223+0000","last_clean":"2026-02-13T04:00:50.722223+0000","last_became_active":"2026-02-13T04:00:49.480429+0000","last_became_peered":"2026-02-13T04:00:49.480429+0000","last_unstale":"2026-02-13T04:00:50.722223+0000","last_undegraded":"2026-02-13T04:00:50.722223+0000","last_fullsized":"2026-02-13T04:00:50.722223+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:59:07.789528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.721354+0000","last_change":"2026-02-13T04:00:49.478790+0000","last_active":"2026-02-13T04:00:50.721354+0000","last_peered":"2026-02-13T04:00:50.721354+0000","last_clean":"2026-02-13T04:00:50.721354+0000","last_became_active":"2026-02-13T04:00:49.478542+0000","last_became_peered":"2026-02-13T04:00:49.478542+0000","last_unstale":"2026-02-13T04:00:50.721354+0000","last_undegraded":"2026-02-13T04:00:50.721354+0000","last_fullsized":"2026-02-13T04:00:50.721354+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:20:02.089377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.720635+0000","last_change":"2026-02-13T04:00:49.480725+0000","last_active":"2026-02-13T04:00:50.720635+0000","last_peered":"2026-02-13T04:00:50.720635+0000","last_clean":"2026-02-13T04:00:50.720635+0000","last_became_active":"2026-02-13T04:00:49.480629+0000","last_became_peered":"2026-02-13T04:00:49.480629+0000","last_unstale":"2026-02-13T04:00:50.720635+0000","last_undegraded":"2026-02-13T04:00:50.720635+0000","last_fullsized":"2026-02-13T04:00:50.720635+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:58:01.268671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.468709+0000","last_change":"2026-02-13T04:00:49.477665+0000","last_active":"2026-02-13T04:00:50.468709+0000","last_peered":"2026-02-13T04:00:50.468709+0000","last_clean":"2026-02-13T04:00:50.468709+0000","last_became_active":"2026-02-13T04:00:49.477495+0000","last_became_peered":"2026-02-13T04:00:49.477495+0000","last_unstale":"2026-02-13T04:00:50.468709+0000","last_undegraded":"2026-02-13T04:00:50.468709+0000","last_fullsized":"2026-02-13T04:00:50.468709+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:59:53.668023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469843+0000","last_change":"2026-02-13T04:00:49.482438+0000","last_active":"2026-02-13T04:00:50.469843+0000","last_peered":"2026-02-13T04:00:50.469843+0000","last_clean":"2026-02-13T04:00:50.469843+0000","last_became_active":"2026-02-13T04:00:49.482330+0000","last_became_peered":"2026-02-13T04:00:49.482330+0000","last_unstale":"2026-02-13T04:00:50.469843+0000","last_undegraded":"2026-02-13T04:00:50.469843+0000","last_fullsized":"2026-02-13T04:00:50.469843+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:22:36.817612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469056+0000","last_change":"2026-02-13T04:00:49.477434+0000","last_active":"2026-02-13T04:00:50.469056+0000","last_peered":"2026-02-13T04:00:50.469056+0000","last_clean":"2026-02-13T04:00:50.469056+0000","last_became_active":"2026-02-13T04:00:49.477191+0000","last_became_peered":"2026-02-13T04:00:49.477191+0000","last_unstale":"2026-02-13T04:00:50.469056+0000","last_undegraded":"2026-02-13T04:00:50.469056+0000","last_fullsized":"2026-02-13T04:00:50.469056+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:37:48.389471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722779+0000","last_change":"2026-02-13T04:00:49.474549+0000","last_active":"2026-02-13T04:00:50.722779+0000","last_peered":"2026-02-13T04:00:50.722779+0000","last_clean":"2026-02-13T04:00:50.722779+0000","last_became_active":"2026-02-13T04:00:49.474357+0000","last_became_peered":"2026-02-13T04:00:49.474357+0000","last_unstale":"2026-02-13T04:00:50.722779+0000","last_undegraded":"2026-02-13T04:00:50.722779+0000","last_fullsized":"2026-02-13T04:00:50.722779+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:29:00.130538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722309+0000","last_change":"2026-02-13T04:00:49.476543+0000","last_active":"2026-02-13T04:00:50.722309+0000","last_peered":"2026-02-13T04:00:50.722309+0000","last_clean":"2026-02-13T04:00:50.722309+0000","last_became_active":"2026-02-13T04:00:49.476269+0000","last_became_peered":"2026-02-13T04:00:49.476269+0000","last_unstale":"2026-02-13T04:00:50.722309+0000","last_undegraded":"2026-02-13T04:00:50.722309+0000","last_fullsized":"2026-02-13T04:00:50.722309+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:51:34.541577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.721455+0000","last_change":"2026-02-13T04:00:49.480227+0000","last_active":"2026-02-13T04:00:50.721455+0000","last_peered":"2026-02-13T04:00:50.721455+0000","last_clean":"2026-02-13T04:00:50.721455+0000","last_became_active":"2026-02-13T04:00:49.480117+0000","last_became_peered":"2026-02-13T04:00:49.480117+0000","last_unstale":"2026-02-13T04:00:50.721455+0000","last_undegraded":"2026-02-13T04:00:50.721455+0000","last_fullsized":"2026-02-13T04:00:50.721455+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:57:45.182937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469454+0000","last_change":"2026-02-13T04:00:49.479873+0000","last_active":"2026-02-13T04:00:50.469454+0000","last_peered":"2026-02-13T04:00:50.469454+0000","last_clean":"2026-02-13T04:00:50.469454+0000","last_became_active":"2026-02-13T04:00:49.479764+0000","last_became_peered":"2026-02-13T04:00:49.479764+0000","last_unstale":"2026-02-13T04:00:50.469454+0000","last_undegraded":"2026-02-13T04:00:50.469454+0000","last_fullsized":"2026-02-13T04:00:50.469454+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:59:09.259456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722421+0000","last_change":"2026-02-13T04:00:49.478971+0000","last_active":"2026-02-13T04:00:50.722421+0000","last_peered":"2026-02-13T04:00:50.722421+0000","last_clean":"2026-02-13T04:00:50.722421+0000","last_became_active":"2026-02-13T04:00:49.478770+0000","last_became_peered":"2026-02-13T04:00:49.478770+0000","last_unstale":"2026-02-13T04:00:50.722421+0000","last_undegraded":"2026-02-13T04:00:50.722421+0000","last_fullsized":"2026-02-13T04:00:50.722421+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:41:03.291420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722355+0000","last_change":"2026-02-13T04:00:49.475701+0000","last_active":"2026-02-13T04:00:50.722355+0000","last_peered":"2026-02-13T04:00:50.722355+0000","last_clean":"2026-02-13T04:00:50.722355+0000","last_became_active":"2026-02-13T04:00:49.475238+0000","last_became_peered":"2026-02-13T04:00:49.475238+0000","last_unstale":"2026-02-13T04:00:50.722355+0000","last_undegraded":"2026-02-13T04:00:50.722355+0000","last_fullsized":"2026-02-13T04:00:50.722355+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:53:42.399821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722110+0000","last_change":"2026-02-13T04:00:49.476461+0000","last_active":"2026-02-13T04:00:50.722110+0000","last_peered":"2026-02-13T04:00:50.722110+0000","last_clean":"2026-02-13T04:00:50.722110+0000","last_became_active":"2026-02-13T04:00:49.476249+0000","last_became_peered":"2026-02-13T04:00:49.476249+0000","last_unstale":"2026-02-13T04:00:50.722110+0000","last_undegraded":"2026-02-13T04:00:50.722110+0000","last_fullsized":"2026-02-13T04:00:50.722110+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:54:58.933497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722340+0000","last_change":"2026-02-13T04:00:49.475811+0000","last_active":"2026-02-13T04:00:50.722340+0000","last_peered":"2026-02-13T04:00:50.722340+0000","last_clean":"2026-02-13T04:00:50.722340+0000","last_became_active":"2026-02-13T04:00:49.475618+0000","last_became_peered":"2026-02-13T04:00:49.475618+0000","last_unstale":"2026-02-13T04:00:50.722340+0000","last_undegraded":"2026-02-13T04:00:50.722340+0000","last_fullsized":"2026-02-13T04:00:50.722340+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:22:47.756470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"76'6","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:01:04.094634+0000","last_change":"2026-02-13T04:00:48.693027+0000","last_active":"2026-02-13T04:01:04.094634+0000","last_peered":"2026-02-13T04:01:04.094634+0000","last_clean":"2026-02-13T04:01:04.094634+0000","last_became_active":"2026-02-13T04:00:48.692784+0000","last_became_peered":"2026-02-13T04:00:48.692784+0000","last_unstale":"2026-02-13T04:01:04.094634+0000","last_undegraded":"2026-02-13T04:01:04.094634+0000","last_fullsized":"2026-02-13T04:01:04.094634+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:12:41.834516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1032,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469782+0000","last_change":"2026-02-13T04:00:49.482026+0000","last_active":"2026-02-13T04:00:50.469782+0000","last_peered":"2026-02-13T04:00:50.469782+0000","last_clean":"2026-02-13T04:00:50.469782+0000","last_became_active":"2026-02-13T04:00:49.481905+0000","last_became_peered":"2026-02-13T04:00:49.481905+0000","last_unstale":"2026-02-13T04:00:50.469782+0000","last_undegraded":"2026-02-13T04:00:50.469782+0000","last_fullsized":"2026-02-13T04:00:50.469782+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:05:21.043555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"76'7","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:55.067925+0000","last_change":"2026-02-13T04:00:48.691792+0000","last_active":"2026-02-13T04:00:55.067925+0000","last_peered":"2026-02-13T04:00:55.067925+0000","last_clean":"2026-02-13T04:00:55.067925+0000","last_became_active":"2026-02-13T04:00:48.691630+0000","last_became_peered":"2026-02-13T04:00:48.691630+0000","last_unstale":"2026-02-13T04:00:55.067925+0000","last_undegraded":"2026-02-13T04:00:55.067925+0000","last_fullsized":"2026-02-13T04:00:55.067925+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:32:00.435154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"76'3","reported_seq":19,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:54.062781+0000","last_change":"2026-02-13T04:00:48.695910+0000","last_active":"2026-02-13T04:00:54.062781+0000","last_peered":"2026-02-13T04:00:54.062781+0000","last_clean":"2026-02-13T04:00:54.062781+0000","last_became_active":"2026-02-13T04:00:48.695729+0000","last_became_peered":"2026-02-13T04:00:48.695729+0000","last_unstale":"2026-02-13T04:00:54.062781+0000","last_undegraded":"2026-02-13T04:00:54.062781+0000","last_fullsized":"2026-02-13T04:00:54.062781+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:31:27.918317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.468699+0000","last_change":"2026-02-13T04:00:49.481361+0000","last_active":"2026-02-13T04:00:50.468699+0000","last_peered":"2026-02-13T04:00:50.468699+0000","last_clean":"2026-02-13T04:00:50.468699+0000","last_became_active":"2026-02-13T04:00:49.481073+0000","last_became_peered":"2026-02-13T04:00:49.481073+0000","last_unstale":"2026-02-13T04:00:50.468699+0000","last_undegraded":"2026-02-13T04:00:50.468699+0000","last_fullsized":"2026-02-13T04:00:50.468699+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:55:00.151374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"76'3","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:56.075748+0000","last_change":"2026-02-13T04:00:48.692833+0000","last_active":"2026-02-13T04:00:56.075748+0000","last_peered":"2026-02-13T04:00:56.075748+0000","last_clean":"2026-02-13T04:00:56.075748+0000","last_became_active":"2026-02-13T04:00:48.692566+0000","last_became_peered":"2026-02-13T04:00:48.692566+0000","last_unstale":"2026-02-13T04:00:56.075748+0000","last_undegraded":"2026-02-13T04:00:56.075748+0000","last_fullsized":"2026-02-13T04:00:56.075748+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:01:30.821370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469695+0000","last_change":"2026-02-13T04:00:49.479585+0000","last_active":"2026-02-13T04:00:50.469695+0000","last_peered":"2026-02-13T04:00:50.469695+0000","last_clean":"2026-02-13T04:00:50.469695+0000","last_became_active":"2026-02-13T04:00:49.479155+0000","last_became_peered":"2026-02-13T04:00:49.479155+0000","last_unstale":"2026-02-13T04:00:50.469695+0000","last_undegraded":"2026-02-13T04:00:50.469695+0000","last_fullsized":"2026-02-13T04:00:50.469695+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:04:32.865189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"76'4","reported_seq":40,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:01:06.085856+0000","last_change":"2026-02-13T04:00:48.697295+0000","last_active":"2026-02-13T04:01:06.085856+0000","last_peered":"2026-02-13T04:01:06.085856+0000","last_clean":"2026-02-13T04:01:06.085856+0000","last_became_active":"2026-02-13T04:00:48.697115+0000","last_became_peered":"2026-02-13T04:00:48.697115+0000","last_unstale":"2026-02-13T04:01:06.085856+0000","last_undegraded":"2026-02-13T04:01:06.085856+0000","last_fullsized":"2026-02-13T04:01:06.085856+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:41:11.697570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.720845+0000","last_change":"2026-02-13T04:00:49.474447+0000","last_active":"2026-02-13T04:00:50.720845+0000","last_peered":"2026-02-13T04:00:50.720845+0000","last_clean":"2026-02-13T04:00:50.720845+0000","last_became_active":"2026-02-13T04:00:49.473707+0000","last_became_peered":"2026-02-13T04:00:49.473707+0000","last_unstale":"2026-02-13T04:00:50.720845+0000","last_undegraded":"2026-02-13T04:00:50.720845+0000","last_fullsized":"2026-02-13T04:00:50.720845+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:33:16.764134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"76'4","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:56.074475+0000","last_change":"2026-02-13T04:00:48.691107+0000","last_active":"2026-02-13T04:00:56.074475+0000","last_peered":"2026-02-13T04:00:56.074475+0000","last_clean":"2026-02-13T04:00:56.074475+0000","last_became_active":"2026-02-13T04:00:48.690883+0000","last_became_peered":"2026-02-13T04:00:48.690883+0000","last_unstale":"2026-02-13T04:00:56.074475+0000","last_undegraded":"2026-02-13T04:00:56.074475+0000","last_fullsized":"2026-02-13T04:00:56.074475+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:42:12.911922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469851+0000","last_change":"2026-02-13T04:00:49.479316+0000","last_active":"2026-02-13T04:00:50.469851+0000","last_peered":"2026-02-13T04:00:50.469851+0000","last_clean":"2026-02-13T04:00:50.469851+0000","last_became_active":"2026-02-13T04:00:49.479237+0000","last_became_peered":"2026-02-13T04:00:49.479237+0000","last_unstale":"2026-02-13T04:00:50.469851+0000","last_undegraded":"2026-02-13T04:00:50.469851+0000","last_fullsized":"2026-02-13T04:00:50.469851+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:42:22.094924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"76'5","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:55.069328+0000","last_change":"2026-02-13T04:00:48.694972+0000","last_active":"2026-02-13T04:00:55.069328+0000","last_peered":"2026-02-13T04:00:55.069328+0000","last_clean":"2026-02-13T04:00:55.069328+0000","last_became_active":"2026-02-13T04:00:48.694866+0000","last_became_peered":"2026-02-13T04:00:48.694866+0000","last_unstale":"2026-02-13T04:00:55.069328+0000","last_undegraded":"2026-02-13T04:00:55.069328+0000","last_fullsized":"2026-02-13T04:00:55.069328+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:21:39.815574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.720774+0000","last_change":"2026-02-13T04:00:49.473770+0000","last_active":"2026-02-13T04:00:50.720774+0000","last_peered":"2026-02-13T04:00:50.720774+0000","last_clean":"2026-02-13T04:00:50.720774+0000","last_became_active":"2026-02-13T04:00:49.473571+0000","last_became_peered":"2026-02-13T04:00:49.473571+0000","last_unstale":"2026-02-13T04:00:50.720774+0000","last_undegraded":"2026-02-13T04:00:50.720774+0000","last_fullsized":"2026-02-13T04:00:50.720774+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:20:31.775093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"76'28","reported_seq":69,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:01:06.087790+0000","last_change":"2026-02-13T04:00:48.691199+0000","last_active":"2026-02-13T04:01:06.087790+0000","last_peered":"2026-02-13T04:01:06.087790+0000","last_clean":"2026-02-13T04:01:06.087790+0000","last_became_active":"2026-02-13T04:00:48.690955+0000","last_became_peered":"2026-02-13T04:00:48.690955+0000","last_unstale":"2026-02-13T04:01:06.087790+0000","last_undegraded":"2026-02-13T04:01:06.087790+0000","last_fullsized":"2026-02-13T04:01:06.087790+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:41:58.570616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66455,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":25,"num_read_kb":77,"num_write":30,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722495+0000","last_change":"2026-02-13T04:00:49.474461+0000","last_active":"2026-02-13T04:00:50.722495+0000","last_peered":"2026-02-13T04:00:50.722495+0000","last_clean":"2026-02-13T04:00:50.722495+0000","last_became_active":"2026-02-13T04:00:49.474220+0000","last_became_peered":"2026-02-13T04:00:49.474220+0000","last_unstale":"2026-02-13T04:00:50.722495+0000","last_undegraded":"2026-02-13T04:00:50.722495+0000","last_fullsized":"2026-02-13T04:00:50.722495+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:04:21.521507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:57.079077+0000","last_change":"2026-02-13T04:00:48.698134+0000","last_active":"2026-02-13T04:00:57.079077+0000","last_peered":"2026-02-13T04:00:57.079077+0000","last_clean":"2026-02-13T04:00:57.079077+0000","last_became_active":"2026-02-13T04:00:48.697958+0000","last_became_peered":"2026-02-13T04:00:48.697958+0000","last_unstale":"2026-02-13T04:00:57.079077+0000","last_undegraded":"2026-02-13T04:00:57.079077+0000","last_fullsized":"2026-02-13T04:00:57.079077+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:55:21.688751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.721213+0000","last_change":"2026-02-13T04:00:49.481860+0000","last_active":"2026-02-13T04:00:50.721213+0000","last_peered":"2026-02-13T04:00:50.721213+0000","last_clean":"2026-02-13T04:00:50.721213+0000","last_became_active":"2026-02-13T04:00:49.481735+0000","last_became_peered":"2026-02-13T04:00:49.481735+0000","last_unstale":"2026-02-13T04:00:50.721213+0000","last_undegraded":"2026-02-13T04:00:50.721213+0000","last_fullsized":"2026-02-13T04:00:50.721213+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:13:15.403655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"76'5","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:56.077283+0000","last_change":"2026-02-13T04:00:48.700556+0000","last_active":"2026-02-13T04:00:56.077283+0000","last_peered":"2026-02-13T04:00:56.077283+0000","last_clean":"2026-02-13T04:00:56.077283+0000","last_became_active":"2026-02-13T04:00:48.700417+0000","last_became_peered":"2026-02-13T04:00:48.700417+0000","last_unstale":"2026-02-13T04:00:56.077283+0000","last_undegraded":"2026-02-13T04:00:56.077283+0000","last_fullsized":"2026-02-13T04:00:56.077283+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:53:13.088594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.910386+0000","last_change":"2026-02-13T04:00:49.477823+0000","last_active":"2026-02-13T04:00:50.910386+0000","last_peered":"2026-02-13T04:00:50.910386+0000","last_clean":"2026-02-13T04:00:50.910386+0000","last_became_active":"2026-02-13T04:00:49.477688+0000","last_became_peered":"2026-02-13T04:00:49.477688+0000","last_unstale":"2026-02-13T04:00:50.910386+0000","last_undegraded":"2026-02-13T04:00:50.910386+0000","last_fullsized":"2026-02-13T04:00:50.910386+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:38:51.114912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"76'6","reported_seq":36,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:01:07.096447+0000","last_change":"2026-02-13T04:00:48.689958+0000","last_active":"2026-02-13T04:01:07.096447+0000","last_peered":"2026-02-13T04:01:07.096447+0000","last_clean":"2026-02-13T04:01:07.096447+0000","last_became_active":"2026-02-13T04:00:48.689800+0000","last_became_peered":"2026-02-13T04:00:48.689800+0000","last_unstale":"2026-02-13T04:01:07.096447+0000","last_undegraded":"2026-02-13T04:01:07.096447+0000","last_fullsized":"2026-02-13T04:01:07.096447+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:57:29.593581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":998,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.909974+0000","last_change":"2026-02-13T04:00:49.474922+0000","last_active":"2026-02-13T04:00:50.909974+0000","last_peered":"2026-02-13T04:00:50.909974+0000","last_clean":"2026-02-13T04:00:50.909974+0000","last_became_active":"2026-02-13T04:00:49.474798+0000","last_became_peered":"2026-02-13T04:00:49.474798+0000","last_unstale":"2026-02-13T04:00:50.909974+0000","last_undegraded":"2026-02-13T04:00:50.909974+0000","last_fullsized":"2026-02-13T04:00:50.909974+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:24:58.395490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"76'17","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:56.076531+0000","last_change":"2026-02-13T04:00:48.697186+0000","last_active":"2026-02-13T04:00:56.076531+0000","last_peered":"2026-02-13T04:00:56.076531+0000","last_clean":"2026-02-13T04:00:56.076531+0000","last_became_active":"2026-02-13T04:00:48.696965+0000","last_became_peered":"2026-02-13T04:00:48.696965+0000","last_unstale":"2026-02-13T04:00:56.076531+0000","last_undegraded":"2026-02-13T04:00:56.076531+0000","last_fullsized":"2026-02-13T04:00:56.076531+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:56:20.600423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469600+0000","last_change":"2026-02-13T04:00:49.478825+0000","last_active":"2026-02-13T04:00:50.469600+0000","last_peered":"2026-02-13T04:00:50.469600+0000","last_clean":"2026-02-13T04:00:50.469600+0000","last_became_active":"2026-02-13T04:00:49.478665+0000","last_became_peered":"2026-02-13T04:00:49.478665+0000","last_unstale":"2026-02-13T04:00:50.469600+0000","last_undegraded":"2026-02-13T04:00:50.469600+0000","last_fullsized":"2026-02-13T04:00:50.469600+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:30:36.733228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"76'2","reported_seq":19,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:56.060673+0000","last_change":"2026-02-13T04:00:48.691503+0000","last_active":"2026-02-13T04:00:56.060673+0000","last_peered":"2026-02-13T04:00:56.060673+0000","last_clean":"2026-02-13T04:00:56.060673+0000","last_became_active":"2026-02-13T04:00:48.691259+0000","last_became_peered":"2026-02-13T04:00:48.691259+0000","last_unstale":"2026-02-13T04:00:56.060673+0000","last_undegraded":"2026-02-13T04:00:56.060673+0000","last_fullsized":"2026-02-13T04:00:56.060673+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:34:28.622800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722403+0000","last_change":"2026-02-13T04:00:49.480630+0000","last_active":"2026-02-13T04:00:50.722403+0000","last_peered":"2026-02-13T04:00:50.722403+0000","last_clean":"2026-02-13T04:00:50.722403+0000","last_became_active":"2026-02-13T04:00:49.480389+0000","last_became_peered":"2026-02-13T04:00:49.480389+0000","last_unstale":"2026-02-13T04:00:50.722403+0000","last_undegraded":"2026-02-13T04:00:50.722403+0000","last_fullsized":"2026-02-13T04:00:50.722403+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:57:06.972169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"76'5","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:56.077127+0000","last_change":"2026-02-13T04:00:48.699907+0000","last_active":"2026-02-13T04:00:56.077127+0000","last_peered":"2026-02-13T04:00:56.077127+0000","last_clean":"2026-02-13T04:00:56.077127+0000","last_became_active":"2026-02-13T04:00:48.699680+0000","last_became_peered":"2026-02-13T04:00:48.699680+0000","last_unstale":"2026-02-13T04:00:56.077127+0000","last_undegraded":"2026-02-13T04:00:56.077127+0000","last_fullsized":"2026-02-13T04:00:56.077127+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:59:04.468050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.910539+0000","last_change":"2026-02-13T04:00:49.474061+0000","last_active":"2026-02-13T04:00:50.910539+0000","last_peered":"2026-02-13T04:00:50.910539+0000","last_clean":"2026-02-13T04:00:50.910539+0000","last_became_active":"2026-02-13T04:00:49.473775+0000","last_became_peered":"2026-02-13T04:00:49.473775+0000","last_unstale":"2026-02-13T04:00:50.910539+0000","last_undegraded":"2026-02-13T04:00:50.910539+0000","last_fullsized":"2026-02-13T04:00:50.910539+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:17:55.919908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"76'3","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:56.077318+0000","last_change":"2026-02-13T04:00:48.700390+0000","last_active":"2026-02-13T04:00:56.077318+0000","last_peered":"2026-02-13T04:00:56.077318+0000","last_clean":"2026-02-13T04:00:56.077318+0000","last_became_active":"2026-02-13T04:00:48.700274+0000","last_became_peered":"2026-02-13T04:00:48.700274+0000","last_unstale":"2026-02-13T04:00:56.077318+0000","last_undegraded":"2026-02-13T04:00:56.077318+0000","last_fullsized":"2026-02-13T04:00:56.077318+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:42:57.951202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"76'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.910469+0000","last_change":"2026-02-13T04:00:49.473385+0000","last_active":"2026-02-13T04:00:50.910469+0000","last_peered":"2026-02-13T04:00:50.910469+0000","last_clean":"2026-02-13T04:00:50.910469+0000","last_became_active":"2026-02-13T04:00:49.473169+0000","last_became_peered":"2026-02-13T04:00:49.473169+0000","last_unstale":"2026-02-13T04:00:50.910469+0000","last_undegraded":"2026-02-13T04:00:50.910469+0000","last_fullsized":"2026-02-13T04:00:50.910469+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:39:38.736962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"76'6","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:01:05.086578+0000","last_change":"2026-02-13T04:00:48.697672+0000","last_active":"2026-02-13T04:01:05.086578+0000","last_peered":"2026-02-13T04:01:05.086578+0000","last_clean":"2026-02-13T04:01:05.086578+0000","last_became_active":"2026-02-13T04:00:48.697508+0000","last_became_peered":"2026-02-13T04:00:48.697508+0000","last_unstale":"2026-02-13T04:01:05.086578+0000","last_undegraded":"2026-02-13T04:01:05.086578+0000","last_fullsized":"2026-02-13T04:01:05.086578+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:06:23.149951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1602,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.910511+0000","last_change":"2026-02-13T04:00:49.474120+0000","last_active":"2026-02-13T04:00:50.910511+0000","last_peered":"2026-02-13T04:00:50.910511+0000","last_clean":"2026-02-13T04:00:50.910511+0000","last_became_active":"2026-02-13T04:00:49.473810+0000","last_became_peered":"2026-02-13T04:00:49.473810+0000","last_unstale":"2026-02-13T04:00:50.910511+0000","last_undegraded":"2026-02-13T04:00:50.910511+0000","last_fullsized":"2026-02-13T04:00:50.910511+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:19:59.822379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'152","reported_seq":345,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.910012+0000","last_change":"2026-02-13T04:00:24.257474+0000","last_active":"2026-02-13T04:00:50.910012+0000","last_peered":"2026-02-13T04:00:50.910012+0000","last_clean":"2026-02-13T04:00:50.910012+0000","last_became_active":"2026-02-13T04:00:24.257034+0000","last_became_peered":"2026-02-13T04:00:24.257034+0000","last_unstale":"2026-02-13T04:00:50.910012+0000","last_undegraded":"2026-02-13T04:00:50.910012+0000","last_fullsized":"2026-02-13T04:00:50.910012+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:59:12.660085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:59:12.660085+0000","last_clean_scrub_stamp":"2026-02-13T03:59:12.660085+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:39:33.745502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"76'6","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:57.079518+0000","last_change":"2026-02-13T04:00:48.692792+0000","last_active":"2026-02-13T04:00:57.079518+0000","last_peered":"2026-02-13T04:00:57.079518+0000","last_clean":"2026-02-13T04:00:57.079518+0000","last_became_active":"2026-02-13T04:00:48.692666+0000","last_became_peered":"2026-02-13T04:00:48.692666+0000","last_unstale":"2026-02-13T04:00:57.079518+0000","last_undegraded":"2026-02-13T04:00:57.079518+0000","last_fullsized":"2026-02-13T04:00:57.079518+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:32:34.713449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469917+0000","last_change":"2026-02-13T04:00:49.480086+0000","last_active":"2026-02-13T04:00:50.469917+0000","last_peered":"2026-02-13T04:00:50.469917+0000","last_clean":"2026-02-13T04:00:50.469917+0000","last_became_active":"2026-02-13T04:00:49.477323+0000","last_became_peered":"2026-02-13T04:00:49.477323+0000","last_unstale":"2026-02-13T04:00:50.469917+0000","last_undegraded":"2026-02-13T04:00:50.469917+0000","last_fullsized":"2026-02-13T04:00:50.469917+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:59:23.446340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"76'4","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:54.060635+0000","last_change":"2026-02-13T04:00:48.691498+0000","last_active":"2026-02-13T04:00:54.060635+0000","last_peered":"2026-02-13T04:00:54.060635+0000","last_clean":"2026-02-13T04:00:54.060635+0000","last_became_active":"2026-02-13T04:00:48.691356+0000","last_became_peered":"2026-02-13T04:00:48.691356+0000","last_unstale":"2026-02-13T04:00:54.060635+0000","last_undegraded":"2026-02-13T04:00:54.060635+0000","last_fullsized":"2026-02-13T04:00:54.060635+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:52:50.006515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.721111+0000","last_change":"2026-02-13T04:00:49.479452+0000","last_active":"2026-02-13T04:00:50.721111+0000","last_peered":"2026-02-13T04:00:50.721111+0000","last_clean":"2026-02-13T04:00:50.721111+0000","last_became_active":"2026-02-13T04:00:49.479354+0000","last_became_peered":"2026-02-13T04:00:49.479354+0000","last_unstale":"2026-02-13T04:00:50.721111+0000","last_undegraded":"2026-02-13T04:00:50.721111+0000","last_fullsized":"2026-02-13T04:00:50.721111+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:46:41.444877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"76'5","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:01:06.095373+0000","last_change":"2026-02-13T04:00:48.696889+0000","last_active":"2026-02-13T04:01:06.095373+0000","last_peered":"2026-02-13T04:01:06.095373+0000","last_clean":"2026-02-13T04:01:06.095373+0000","last_became_active":"2026-02-13T04:00:48.696722+0000","last_became_peered":"2026-02-13T04:00:48.696722+0000","last_unstale":"2026-02-13T04:01:06.095373+0000","last_undegraded":"2026-02-13T04:01:06.095373+0000","last_fullsized":"2026-02-13T04:01:06.095373+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:14:45.512084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469888+0000","last_change":"2026-02-13T04:00:49.478833+0000","last_active":"2026-02-13T04:00:50.469888+0000","last_peered":"2026-02-13T04:00:50.469888+0000","last_clean":"2026-02-13T04:00:50.469888+0000","last_became_active":"2026-02-13T04:00:49.478661+0000","last_became_peered":"2026-02-13T04:00:49.478661+0000","last_unstale":"2026-02-13T04:00:50.469888+0000","last_undegraded":"2026-02-13T04:00:50.469888+0000","last_fullsized":"2026-02-13T04:00:50.469888+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:19:27.081820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"76'5","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:01:04.093300+0000","last_change":"2026-02-13T04:00:48.691941+0000","last_active":"2026-02-13T04:01:04.093300+0000","last_peered":"2026-02-13T04:01:04.093300+0000","last_clean":"2026-02-13T04:01:04.093300+0000","last_became_active":"2026-02-13T04:00:48.691773+0000","last_became_peered":"2026-02-13T04:00:48.691773+0000","last_unstale":"2026-02-13T04:01:04.093300+0000","last_undegraded":"2026-02-13T04:01:04.093300+0000","last_fullsized":"2026-02-13T04:01:04.093300+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:42:13.810742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.468946+0000","last_change":"2026-02-13T04:00:49.477705+0000","last_active":"2026-02-13T04:00:50.468946+0000","last_peered":"2026-02-13T04:00:50.468946+0000","last_clean":"2026-02-13T04:00:50.468946+0000","last_became_active":"2026-02-13T04:00:49.477600+0000","last_became_peered":"2026-02-13T04:00:49.477600+0000","last_unstale":"2026-02-13T04:00:50.468946+0000","last_undegraded":"2026-02-13T04:00:50.468946+0000","last_fullsized":"2026-02-13T04:00:50.468946+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:38:17.010092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"76'1","reported_seq":17,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469620+0000","last_change":"2026-02-13T04:00:48.698484+0000","last_active":"2026-02-13T04:00:50.469620+0000","last_peered":"2026-02-13T04:00:50.469620+0000","last_clean":"2026-02-13T04:00:50.469620+0000","last_became_active":"2026-02-13T04:00:48.698054+0000","last_became_peered":"2026-02-13T04:00:48.698054+0000","last_unstale":"2026-02-13T04:00:50.469620+0000","last_undegraded":"2026-02-13T04:00:50.469620+0000","last_fullsized":"2026-02-13T04:00:50.469620+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:44:12.728961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"76'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:51.278727+0000","last_change":"2026-02-13T04:00:49.475436+0000","last_active":"2026-02-13T04:00:51.278727+0000","last_peered":"2026-02-13T04:00:51.278727+0000","last_clean":"2026-02-13T04:00:51.278727+0000","last_became_active":"2026-02-13T04:00:49.475301+0000","last_became_peered":"2026-02-13T04:00:49.475301+0000","last_unstale":"2026-02-13T04:00:51.278727+0000","last_undegraded":"2026-02-13T04:00:51.278727+0000","last_fullsized":"2026-02-13T04:00:51.278727+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:01:52.755952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"76'4","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:56.077951+0000","last_change":"2026-02-13T04:00:48.697244+0000","last_active":"2026-02-13T04:00:56.077951+0000","last_peered":"2026-02-13T04:00:56.077951+0000","last_clean":"2026-02-13T04:00:56.077951+0000","last_became_active":"2026-02-13T04:00:48.697000+0000","last_became_peered":"2026-02-13T04:00:48.697000+0000","last_unstale":"2026-02-13T04:00:56.077951+0000","last_undegraded":"2026-02-13T04:00:56.077951+0000","last_fullsized":"2026-02-13T04:00:56.077951+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:01:34.413201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.721388+0000","last_change":"2026-02-13T04:00:49.479594+0000","last_active":"2026-02-13T04:00:50.721388+0000","last_peered":"2026-02-13T04:00:50.721388+0000","last_clean":"2026-02-13T04:00:50.721388+0000","last_became_active":"2026-02-13T04:00:49.479339+0000","last_became_peered":"2026-02-13T04:00:49.479339+0000","last_unstale":"2026-02-13T04:00:50.721388+0000","last_undegraded":"2026-02-13T04:00:50.721388+0000","last_fullsized":"2026-02-13T04:00:50.721388+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:53:38.743418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"76'12","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:01:03.038434+0000","last_change":"2026-02-13T04:00:48.700184+0000","last_active":"2026-02-13T04:01:03.038434+0000","last_peered":"2026-02-13T04:01:03.038434+0000","last_clean":"2026-02-13T04:01:03.038434+0000","last_became_active":"2026-02-13T04:00:48.699830+0000","last_became_peered":"2026-02-13T04:00:48.699830+0000","last_unstale":"2026-02-13T04:01:03.038434+0000","last_undegraded":"2026-02-13T04:01:03.038434+0000","last_fullsized":"2026-02-13T04:01:03.038434+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:33:36.683841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469071+0000","last_change":"2026-02-13T04:00:49.479398+0000","last_active":"2026-02-13T04:00:50.469071+0000","last_peered":"2026-02-13T04:00:50.469071+0000","last_clean":"2026-02-13T04:00:50.469071+0000","last_became_active":"2026-02-13T04:00:49.478123+0000","last_became_peered":"2026-02-13T04:00:49.478123+0000","last_unstale":"2026-02-13T04:00:50.469071+0000","last_undegraded":"2026-02-13T04:00:50.469071+0000","last_fullsized":"2026-02-13T04:00:50.469071+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:27:11.747352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"76'7","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:56.076080+0000","last_change":"2026-02-13T04:00:48.693990+0000","last_active":"2026-02-13T04:00:56.076080+0000","last_peered":"2026-02-13T04:00:56.076080+0000","last_clean":"2026-02-13T04:00:56.076080+0000","last_became_active":"2026-02-13T04:00:48.693900+0000","last_became_peered":"2026-02-13T04:00:48.693900+0000","last_unstale":"2026-02-13T04:00:56.076080+0000","last_undegraded":"2026-02-13T04:00:56.076080+0000","last_fullsized":"2026-02-13T04:00:56.076080+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:30:06.422983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469681+0000","last_change":"2026-02-13T04:00:49.482955+0000","last_active":"2026-02-13T04:00:50.469681+0000","last_peered":"2026-02-13T04:00:50.469681+0000","last_clean":"2026-02-13T04:00:50.469681+0000","last_became_active":"2026-02-13T04:00:49.482763+0000","last_became_peered":"2026-02-13T04:00:49.482763+0000","last_unstale":"2026-02-13T04:00:50.469681+0000","last_undegraded":"2026-02-13T04:00:50.469681+0000","last_fullsized":"2026-02-13T04:00:50.469681+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:57:57.634076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"76'2","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:53.057146+0000","last_change":"2026-02-13T04:00:48.691700+0000","last_active":"2026-02-13T04:00:53.057146+0000","last_peered":"2026-02-13T04:00:53.057146+0000","last_clean":"2026-02-13T04:00:53.057146+0000","last_became_active":"2026-02-13T04:00:48.691589+0000","last_became_peered":"2026-02-13T04:00:48.691589+0000","last_unstale":"2026-02-13T04:00:53.057146+0000","last_undegraded":"2026-02-13T04:00:53.057146+0000","last_fullsized":"2026-02-13T04:00:53.057146+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:11:12.096183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722064+0000","last_change":"2026-02-13T04:00:49.474149+0000","last_active":"2026-02-13T04:00:50.722064+0000","last_peered":"2026-02-13T04:00:50.722064+0000","last_clean":"2026-02-13T04:00:50.722064+0000","last_became_active":"2026-02-13T04:00:49.473736+0000","last_became_peered":"2026-02-13T04:00:49.473736+0000","last_unstale":"2026-02-13T04:00:50.722064+0000","last_undegraded":"2026-02-13T04:00:50.722064+0000","last_fullsized":"2026-02-13T04:00:50.722064+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:25:56.827117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"76'7","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:56.076853+0000","last_change":"2026-02-13T04:00:48.697874+0000","last_active":"2026-02-13T04:00:56.076853+0000","last_peered":"2026-02-13T04:00:56.076853+0000","last_clean":"2026-02-13T04:00:56.076853+0000","last_became_active":"2026-02-13T04:00:48.697771+0000","last_became_peered":"2026-02-13T04:00:48.697771+0000","last_unstale":"2026-02-13T04:00:56.076853+0000","last_undegraded":"2026-02-13T04:00:56.076853+0000","last_fullsized":"2026-02-13T04:00:56.076853+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:08:04.185025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722259+0000","last_change":"2026-02-13T04:00:49.482790+0000","last_active":"2026-02-13T04:00:50.722259+0000","last_peered":"2026-02-13T04:00:50.722259+0000","last_clean":"2026-02-13T04:00:50.722259+0000","last_became_active":"2026-02-13T04:00:49.482576+0000","last_became_peered":"2026-02-13T04:00:49.482576+0000","last_unstale":"2026-02-13T04:00:50.722259+0000","last_undegraded":"2026-02-13T04:00:50.722259+0000","last_fullsized":"2026-02-13T04:00:50.722259+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:32:27.345836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"76'3","reported_seq":19,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:55.070981+0000","last_change":"2026-02-13T04:00:48.700697+0000","last_active":"2026-02-13T04:00:55.070981+0000","last_peered":"2026-02-13T04:00:55.070981+0000","last_clean":"2026-02-13T04:00:55.070981+0000","last_became_active":"2026-02-13T04:00:48.700486+0000","last_became_peered":"2026-02-13T04:00:48.700486+0000","last_unstale":"2026-02-13T04:00:55.070981+0000","last_undegraded":"2026-02-13T04:00:55.070981+0000","last_fullsized":"2026-02-13T04:00:55.070981+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:12:01.767319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469076+0000","last_change":"2026-02-13T04:00:49.479587+0000","last_active":"2026-02-13T04:00:50.469076+0000","last_peered":"2026-02-13T04:00:50.469076+0000","last_clean":"2026-02-13T04:00:50.469076+0000","last_became_active":"2026-02-13T04:00:49.478914+0000","last_became_peered":"2026-02-13T04:00:49.478914+0000","last_unstale":"2026-02-13T04:00:50.469076+0000","last_undegraded":"2026-02-13T04:00:50.469076+0000","last_fullsized":"2026-02-13T04:00:50.469076+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:17:27.267886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"76'4","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:53.057328+0000","last_change":"2026-02-13T04:00:48.693343+0000","last_active":"2026-02-13T04:00:53.057328+0000","last_peered":"2026-02-13T04:00:53.057328+0000","last_clean":"2026-02-13T04:00:53.057328+0000","last_became_active":"2026-02-13T04:00:48.692911+0000","last_became_peered":"2026-02-13T04:00:48.692911+0000","last_unstale":"2026-02-13T04:00:53.057328+0000","last_undegraded":"2026-02-13T04:00:53.057328+0000","last_fullsized":"2026-02-13T04:00:53.057328+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:54:45.498989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.910234+0000","last_change":"2026-02-13T04:00:49.475224+0000","last_active":"2026-02-13T04:00:50.910234+0000","last_peered":"2026-02-13T04:00:50.910234+0000","last_clean":"2026-02-13T04:00:50.910234+0000","last_became_active":"2026-02-13T04:00:49.475101+0000","last_became_peered":"2026-02-13T04:00:49.475101+0000","last_unstale":"2026-02-13T04:00:50.910234+0000","last_undegraded":"2026-02-13T04:00:50.910234+0000","last_fullsized":"2026-02-13T04:00:50.910234+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:14:50.281702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469957+0000","last_change":"2026-02-13T04:00:49.478859+0000","last_active":"2026-02-13T04:00:50.469957+0000","last_peered":"2026-02-13T04:00:50.469957+0000","last_clean":"2026-02-13T04:00:50.469957+0000","last_became_active":"2026-02-13T04:00:49.478702+0000","last_became_peered":"2026-02-13T04:00:49.478702+0000","last_unstale":"2026-02-13T04:00:50.469957+0000","last_undegraded":"2026-02-13T04:00:50.469957+0000","last_fullsized":"2026-02-13T04:00:50.469957+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:37:22.794457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"76'5","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:56.076369+0000","last_change":"2026-02-13T04:00:48.693367+0000","last_active":"2026-02-13T04:00:56.076369+0000","last_peered":"2026-02-13T04:00:56.076369+0000","last_clean":"2026-02-13T04:00:56.076369+0000","last_became_active":"2026-02-13T04:00:48.692994+0000","last_became_peered":"2026-02-13T04:00:48.692994+0000","last_unstale":"2026-02-13T04:00:56.076369+0000","last_undegraded":"2026-02-13T04:00:56.076369+0000","last_fullsized":"2026-02-13T04:00:56.076369+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:39:31.460593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.720749+0000","last_change":"2026-02-13T04:00:49.478041+0000","last_active":"2026-02-13T04:00:50.720749+0000","last_peered":"2026-02-13T04:00:50.720749+0000","last_clean":"2026-02-13T04:00:50.720749+0000","last_became_active":"2026-02-13T04:00:49.477881+0000","last_became_peered":"2026-02-13T04:00:49.477881+0000","last_unstale":"2026-02-13T04:00:50.720749+0000","last_undegraded":"2026-02-13T04:00:50.720749+0000","last_fullsized":"2026-02-13T04:00:50.720749+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:18:39.952084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"76'12","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:57.078960+0000","last_change":"2026-02-13T04:00:48.693403+0000","last_active":"2026-02-13T04:00:57.078960+0000","last_peered":"2026-02-13T04:00:57.078960+0000","last_clean":"2026-02-13T04:00:57.078960+0000","last_became_active":"2026-02-13T04:00:48.693036+0000","last_became_peered":"2026-02-13T04:00:48.693036+0000","last_unstale":"2026-02-13T04:00:57.078960+0000","last_undegraded":"2026-02-13T04:00:57.078960+0000","last_fullsized":"2026-02-13T04:00:57.078960+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:11:26.056818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469797+0000","last_change":"2026-02-13T04:00:49.477916+0000","last_active":"2026-02-13T04:00:50.469797+0000","last_peered":"2026-02-13T04:00:50.469797+0000","last_clean":"2026-02-13T04:00:50.469797+0000","last_became_active":"2026-02-13T04:00:49.477821+0000","last_became_peered":"2026-02-13T04:00:49.477821+0000","last_unstale":"2026-02-13T04:00:50.469797+0000","last_undegraded":"2026-02-13T04:00:50.469797+0000","last_fullsized":"2026-02-13T04:00:50.469797+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:28:08.763696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"76'2","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.697310+0000","last_change":"2026-02-13T04:00:48.696707+0000","last_active":"2026-02-13T04:00:50.697310+0000","last_peered":"2026-02-13T04:00:50.697310+0000","last_clean":"2026-02-13T04:00:50.697310+0000","last_became_active":"2026-02-13T04:00:48.696565+0000","last_became_peered":"2026-02-13T04:00:48.696565+0000","last_unstale":"2026-02-13T04:00:50.697310+0000","last_undegraded":"2026-02-13T04:00:50.697310+0000","last_fullsized":"2026-02-13T04:00:50.697310+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:22:58.352215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469060+0000","last_change":"2026-02-13T04:00:49.476851+0000","last_active":"2026-02-13T04:00:50.469060+0000","last_peered":"2026-02-13T04:00:50.469060+0000","last_clean":"2026-02-13T04:00:50.469060+0000","last_became_active":"2026-02-13T04:00:49.476687+0000","last_became_peered":"2026-02-13T04:00:49.476687+0000","last_unstale":"2026-02-13T04:00:50.469060+0000","last_undegraded":"2026-02-13T04:00:50.469060+0000","last_fullsized":"2026-02-13T04:00:50.469060+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:33:58.923183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"76'13","reported_seq":42,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:01:07.097195+0000","last_change":"2026-02-13T04:00:48.695808+0000","last_active":"2026-02-13T04:01:07.097195+0000","last_peered":"2026-02-13T04:01:07.097195+0000","last_clean":"2026-02-13T04:01:07.097195+0000","last_became_active":"2026-02-13T04:00:48.695558+0000","last_became_peered":"2026-02-13T04:00:48.695558+0000","last_unstale":"2026-02-13T04:01:07.097195+0000","last_undegraded":"2026-02-13T04:01:07.097195+0000","last_fullsized":"2026-02-13T04:01:07.097195+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:50:53.268602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74217,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":138,"num_read_kb":150,"num_write":236,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":222651,"data_compressed":5013,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":199101,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":3542208,"data_compressed":228962,"data_compressed_allocated":270336,"data_compressed_original":3522560,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678026,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":397487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9466,"internal_metadata":27581190},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906955,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27932,"kb_used_data":968,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":733975268,"statfs":{"total":751619276800,"available":751590674432,"internally_reserved":0,"allocated":991232,"data_stored":1054971,"data_compressed":40106,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":29687,"internal_metadata":27560969},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037773,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27800,"kb_used_data":836,"kb_used_omap":32,"kb_used_meta":26911,"kb_avail":733975400,"statfs":{"total":751619276800,"available":751590809600,"internally_reserved":0,"allocated":856064,"data_stored":397007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33305,"internal_metadata":27557351},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266703,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27796,"kb_used_data":832,"kb_used_omap":35,"kb_used_meta":26908,"kb_avail":733975404,"statfs":{"total":751619276800,"available":751590813696,"internally_reserved":0,"allocated":851968,"data_stored":397407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36098,"internal_metadata":27554558},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495632,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27848,"kb_used_data":884,"kb_used_omap":34,"kb_used_meta":26909,"kb_avail":733975352,"statfs":{"total":751619276800,"available":751590760448,"internally_reserved":0,"allocated":905216,"data_stored":990354,"data_compressed":38435,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":35816,"internal_metadata":27554840},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626450,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27784,"kb_used_data":820,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975416,"statfs":{"total":751619276800,"available":751590825984,"internally_reserved":0,"allocated":839680,"data_stored":396702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34098,"internal_metadata":27556558},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855380,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27860,"kb_used_data":896,"kb_used_omap":36,"kb_used_meta":26907,"kb_avail":733975340,"statfs":{"total":751619276800,"available":751590748160,"internally_reserved":0,"allocated":917504,"data_stored":989644,"data_compressed":38435,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":37792,"internal_metadata":27552864},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986198,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27784,"kb_used_data":820,"kb_used_omap":44,"kb_used_meta":26899,"kb_avail":733975416,"statfs":{"total":751619276800,"available":751590825984,"internally_reserved":0,"allocated":839680,"data_stored":396973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45151,"internal_metadata":27545505},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215127,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27800,"kb_used_data":836,"kb_used_omap":49,"kb_used_meta":26894,"kb_avail":733975400,"statfs":{"total":751619276800,"available":751590809600,"internally_reserved":0,"allocated":856064,"data_stored":396527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":50679,"internal_metadata":27539977},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476762,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27868,"kb_used_data":904,"kb_used_omap":60,"kb_used_meta":26883,"kb_avail":733975332,"statfs":{"total":751619276800,"available":751590739968,"internally_reserved":0,"allocated":925696,"data_stored":465132,"data_compressed":1671,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":61511,"internal_metadata":27529145},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607579,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27848,"kb_used_data":884,"kb_used_omap":45,"kb_used_meta":26898,"kb_avail":733975352,"statfs":{"total":751619276800,"available":751590760448,"internally_reserved":0,"allocated":905216,"data_stored":464114,"data_compressed":1671,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":46360,"internal_metadata":27544296},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738396,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27804,"kb_used_data":840,"kb_used_omap":48,"kb_used_meta":26895,"kb_avail":733975396,"statfs":{"total":751619276800,"available":751590805504,"internally_reserved":0,"allocated":860160,"data_stored":398495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49874,"internal_metadata":27540782},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36787,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38435,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38435,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38435,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38435,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38435,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10042,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":68251,"data_compressed":1671,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":3361,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":69269,"data_compressed":1671,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":58168,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4479,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31677,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7190,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13465,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6309,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25201,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24776,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":68623,"data_compressed":1671,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":11283,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3150,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T04:01:09.495 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph pg dump --format=json 2026-02-13T04:01:09.578 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:09 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/3017988040' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T04:01:09.578 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:09 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/2356711950' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-13T04:01:09.578 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:09 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/418382428' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-13T04:01:09.578 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:09 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/2052263023' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T04:01:09.578 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:09 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/4199228671' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-13T04:01:09.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:09 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/3017988040' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2026-02-13T04:01:09.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:09 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/2356711950' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2026-02-13T04:01:09.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:09 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/418382428' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2026-02-13T04:01:09.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:09 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/2052263023' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2026-02-13T04:01:09.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:09 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/4199228671' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2026-02-13T04:01:09.716 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:09.904 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.901+0000 7f63b2e7b6c0 1 -- 10.20.193.92:0/2362264057 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f63ac115410 msgr2=0x7f63ac175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:09.905 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.901+0000 7f63b2e7b6c0 1 --2- 10.20.193.92:0/2362264057 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f63ac115410 0x7f63ac175db0 secure :-1 s=READY pgs=231 gs=1 cs=0 l=1 c_cookie=1862853421334838843 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63a800aa70 tx=0x7f63a802fde0 comp rx=0 tx=0).stop 2026-02-13T04:01:09.905 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.901+0000 7f63b2e7b6c0 1 -- 10.20.193.92:0/2362264057 shutdown_connections 2026-02-13T04:01:09.905 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.901+0000 7f63b2e7b6c0 1 --2- 10.20.193.92:0/2362264057 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f63ac115410 0x7f63ac175db0 unknown :-1 s=CLOSED pgs=231 gs=1 cs=0 l=1 c_cookie=1862853421334838843 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:09.905 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.901+0000 7f63b2e7b6c0 1 --2- 10.20.193.92:0/2362264057 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f63ac10fbf0 0x7f63ac114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:09.905 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.901+0000 7f63b2e7b6c0 1 --2- 10.20.193.92:0/2362264057 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f63ac10f200 0x7f63ac10f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:09.905 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.901+0000 7f63b2e7b6c0 1 -- 10.20.193.92:0/2362264057 >> 10.20.193.92:0/2362264057 conn(0x7f63ac0ecb00 msgr2=0x7f63ac10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:09.905 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.901+0000 7f63b2e7b6c0 1 -- 10.20.193.92:0/2362264057 shutdown_connections 2026-02-13T04:01:09.905 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.901+0000 7f63b2e7b6c0 1 -- 10.20.193.92:0/2362264057 wait complete. 2026-02-13T04:01:09.907 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.902+0000 7f63b2e7b6c0 1 Processor -- start 2026-02-13T04:01:09.907 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.902+0000 7f63b2e7b6c0 1 -- start start 2026-02-13T04:01:09.907 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.902+0000 7f63b2e7b6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f63ac10f200 0x7f63ac115e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:09.908 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.902+0000 7f63b2e7b6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f63ac115410 0x7f63ac116370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:09.908 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.902+0000 7f63b2e7b6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f63ac118440 0x7f63ac1188e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:09.908 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.902+0000 7f63b2e7b6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f63ac118e50 con 0x7f63ac115410 2026-02-13T04:01:09.908 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.902+0000 7f63b2e7b6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f63ac118fc0 con 0x7f63ac10f200 2026-02-13T04:01:09.908 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.902+0000 7f63b2e7b6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f63ac119180 con 0x7f63ac118440 2026-02-13T04:01:09.908 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.902+0000 7f63a3fff6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f63ac115410 0x7f63ac116370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:09.908 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.902+0000 7f63a3fff6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f63ac115410 0x7f63ac116370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:53646/0 (socket says 10.20.193.92:53646) 2026-02-13T04:01:09.908 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.902+0000 7f63a3fff6c0 1 -- 10.20.193.92:0/2884453043 learned_addr learned my addr 10.20.193.92:0/2884453043 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:09.908 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.902+0000 7f63b0bec6c0 1 --2- 10.20.193.92:0/2884453043 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f63ac10f200 0x7f63ac115e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:09.908 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.903+0000 7f63b13ed6c0 1 --2- 10.20.193.92:0/2884453043 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f63ac118440 0x7f63ac1188e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:09.908 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.903+0000 7f63a3fff6c0 1 -- 10.20.193.92:0/2884453043 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f63ac118440 msgr2=0x7f63ac1188e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:09.909 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.903+0000 7f63a3fff6c0 1 --2- 10.20.193.92:0/2884453043 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f63ac118440 0x7f63ac1188e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:09.909 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.903+0000 7f63a3fff6c0 1 -- 10.20.193.92:0/2884453043 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f63ac10f200 msgr2=0x7f63ac115e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:09.909 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.903+0000 7f63a3fff6c0 1 --2- 10.20.193.92:0/2884453043 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f63ac10f200 0x7f63ac115e30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:09.909 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.903+0000 7f63a3fff6c0 1 -- 10.20.193.92:0/2884453043 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63a800a660 con 0x7f63ac115410 2026-02-13T04:01:09.909 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.903+0000 7f63b13ed6c0 1 --2- 10.20.193.92:0/2884453043 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f63ac118440 0x7f63ac1188e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T04:01:09.909 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.903+0000 7f63a3fff6c0 1 --2- 10.20.193.92:0/2884453043 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f63ac115410 0x7f63ac116370 secure :-1 s=READY pgs=232 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f639400b6c0 tx=0x7f639400bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:09.909 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.903+0000 7f63a1ffb6c0 1 -- 10.20.193.92:0/2884453043 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6394004250 con 0x7f63ac115410 2026-02-13T04:01:09.909 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.903+0000 7f63a1ffb6c0 1 -- 10.20.193.92:0/2884453043 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f6394009070 con 0x7f63ac115410 2026-02-13T04:01:09.909 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.903+0000 7f63a1ffb6c0 1 -- 10.20.193.92:0/2884453043 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f63940071c0 con 0x7f63ac115410 2026-02-13T04:01:09.909 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.903+0000 7f63b2e7b6c0 1 -- 10.20.193.92:0/2884453043 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63ac15c870 con 0x7f63ac115410 2026-02-13T04:01:09.909 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.903+0000 7f63b2e7b6c0 1 -- 10.20.193.92:0/2884453043 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63ac15cd00 con 0x7f63ac115410 2026-02-13T04:01:09.909 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.904+0000 7f63b2e7b6c0 1 -- 10.20.193.92:0/2884453043 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63ac1104d0 con 0x7f63ac115410 2026-02-13T04:01:09.910 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.906+0000 7f63a1ffb6c0 1 -- 10.20.193.92:0/2884453043 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f63940043b0 con 0x7f63ac115410 2026-02-13T04:01:09.911 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.908+0000 7f63a1ffb6c0 1 --2- 10.20.193.92:0/2884453043 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f63880b5760 0x7f63880d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:09.911 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.908+0000 7f63a1ffb6c0 1 -- 10.20.193.92:0/2884453043 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7f63940e3bd0 con 0x7f63ac115410 2026-02-13T04:01:09.911 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.908+0000 7f63a1ffb6c0 1 -- 10.20.193.92:0/2884453043 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f639411c660 con 0x7f63ac115410 2026-02-13T04:01:09.911 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.908+0000 7f63b0bec6c0 1 --2- 10.20.193.92:0/2884453043 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f63880b5760 0x7f63880d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:09.912 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:09.909+0000 7f63b0bec6c0 1 --2- 10.20.193.92:0/2884453043 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f63880b5760 0x7f63880d5c10 secure :-1 s=READY pgs=185 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f639c004750 tx=0x7f639c009390 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:10.009 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.007+0000 7f63b2e7b6c0 1 -- 10.20.193.92:0/2884453043 --> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f63ac10fbf0 con 0x7f63880b5760 2026-02-13T04:01:10.012 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.009+0000 7f63a1ffb6c0 1 -- 10.20.193.92:0/2884453043 <== mgr.14187 v2:10.20.193.92:6800/4191527999 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259042 (secure 0 0 0) 0x7f63ac10fbf0 con 0x7f63880b5760 2026-02-13T04:01:10.016 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:01:10.017 INFO:teuthology.orchestra.run.trial092.stderr:dumped all 2026-02-13T04:01:10.019 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.012+0000 7f63b2e7b6c0 1 -- 10.20.193.92:0/2884453043 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f63880b5760 msgr2=0x7f63880d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:10.019 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.012+0000 7f63b2e7b6c0 1 --2- 10.20.193.92:0/2884453043 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f63880b5760 0x7f63880d5c10 secure :-1 s=READY pgs=185 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f639c004750 tx=0x7f639c009390 comp rx=0 tx=0).stop 2026-02-13T04:01:10.019 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.012+0000 7f63b2e7b6c0 1 -- 10.20.193.92:0/2884453043 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f63ac115410 msgr2=0x7f63ac116370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:10.019 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.012+0000 7f63b2e7b6c0 1 --2- 10.20.193.92:0/2884453043 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f63ac115410 0x7f63ac116370 secure :-1 s=READY pgs=232 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f639400b6c0 tx=0x7f639400bb90 comp rx=0 tx=0).stop 2026-02-13T04:01:10.019 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.012+0000 7f63b2e7b6c0 1 -- 10.20.193.92:0/2884453043 shutdown_connections 2026-02-13T04:01:10.019 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.012+0000 7f63b2e7b6c0 1 --2- 10.20.193.92:0/2884453043 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f63ac118440 0x7f63ac1188e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:10.020 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.012+0000 7f63b2e7b6c0 1 --2- 10.20.193.92:0/2884453043 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f63ac115410 0x7f63ac116370 unknown :-1 s=CLOSED pgs=232 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:10.020 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.012+0000 7f63b2e7b6c0 1 --2- 10.20.193.92:0/2884453043 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f63880b5760 0x7f63880d5c10 unknown :-1 s=CLOSED pgs=185 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:10.020 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.012+0000 7f63b2e7b6c0 1 --2- 10.20.193.92:0/2884453043 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f63ac10f200 0x7f63ac115e30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:10.020 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.012+0000 7f63b2e7b6c0 1 -- 10.20.193.92:0/2884453043 >> 10.20.193.92:0/2884453043 conn(0x7f63ac0ecb00 msgr2=0x7f63ac10cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:10.020 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.012+0000 7f63b2e7b6c0 1 -- 10.20.193.92:0/2884453043 shutdown_connections 2026-02-13T04:01:10.020 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.012+0000 7f63b2e7b6c0 1 -- 10.20.193.92:0/2884453043 wait complete. 2026-02-13T04:01:10.116 INFO:teuthology.orchestra.run.trial092.stdout:{"pg_ready":true,"pg_map":{"version":187,"stamp":"2026-02-13T04:01:09.090384+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":664819,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":252,"num_read_kb":249,"num_write":427,"num_write_kb":3863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":359,"ondisk_log_size":359,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":8808038400,"kb_used":333900,"kb_used_data":10332,"kb_used_omap":458,"kb_used_meta":322869,"kb_avail":8807704500,"statfs":{"total":9019431321600,"available":9019089408000,"internally_reserved":0,"allocated":10579968,"data_stored":6744813,"data_compressed":120318,"data_compressed_allocated":147456,"data_compressed_original":1794048,"omap_allocated":469837,"internal_metadata":330618035},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":60592,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":138,"num_read_kb":150,"num_write":88,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002205"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722515+0000","last_change":"2026-02-13T04:00:49.479956+0000","last_active":"2026-02-13T04:00:50.722515+0000","last_peered":"2026-02-13T04:00:50.722515+0000","last_clean":"2026-02-13T04:00:50.722515+0000","last_became_active":"2026-02-13T04:00:49.479727+0000","last_became_peered":"2026-02-13T04:00:49.479727+0000","last_unstale":"2026-02-13T04:00:50.722515+0000","last_undegraded":"2026-02-13T04:00:50.722515+0000","last_fullsized":"2026-02-13T04:00:50.722515+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:47:26.793095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469620+0000","last_change":"2026-02-13T04:00:49.482313+0000","last_active":"2026-02-13T04:00:50.469620+0000","last_peered":"2026-02-13T04:00:50.469620+0000","last_clean":"2026-02-13T04:00:50.469620+0000","last_became_active":"2026-02-13T04:00:49.482220+0000","last_became_peered":"2026-02-13T04:00:49.482220+0000","last_unstale":"2026-02-13T04:00:50.469620+0000","last_undegraded":"2026-02-13T04:00:50.469620+0000","last_fullsized":"2026-02-13T04:00:50.469620+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:31:30.541675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469513+0000","last_change":"2026-02-13T04:00:49.475309+0000","last_active":"2026-02-13T04:00:50.469513+0000","last_peered":"2026-02-13T04:00:50.469513+0000","last_clean":"2026-02-13T04:00:50.469513+0000","last_became_active":"2026-02-13T04:00:49.474397+0000","last_became_peered":"2026-02-13T04:00:49.474397+0000","last_unstale":"2026-02-13T04:00:50.469513+0000","last_undegraded":"2026-02-13T04:00:50.469513+0000","last_fullsized":"2026-02-13T04:00:50.469513+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:12:33.930204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.468755+0000","last_change":"2026-02-13T04:00:49.478672+0000","last_active":"2026-02-13T04:00:50.468755+0000","last_peered":"2026-02-13T04:00:50.468755+0000","last_clean":"2026-02-13T04:00:50.468755+0000","last_became_active":"2026-02-13T04:00:49.477706+0000","last_became_peered":"2026-02-13T04:00:49.477706+0000","last_unstale":"2026-02-13T04:00:50.468755+0000","last_undegraded":"2026-02-13T04:00:50.468755+0000","last_fullsized":"2026-02-13T04:00:50.468755+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:18:15.978107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722339+0000","last_change":"2026-02-13T04:00:49.479066+0000","last_active":"2026-02-13T04:00:50.722339+0000","last_peered":"2026-02-13T04:00:50.722339+0000","last_clean":"2026-02-13T04:00:50.722339+0000","last_became_active":"2026-02-13T04:00:49.478908+0000","last_became_peered":"2026-02-13T04:00:49.478908+0000","last_unstale":"2026-02-13T04:00:50.722339+0000","last_undegraded":"2026-02-13T04:00:50.722339+0000","last_fullsized":"2026-02-13T04:00:50.722339+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:23:17.185580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.468647+0000","last_change":"2026-02-13T04:00:49.473377+0000","last_active":"2026-02-13T04:00:50.468647+0000","last_peered":"2026-02-13T04:00:50.468647+0000","last_clean":"2026-02-13T04:00:50.468647+0000","last_became_active":"2026-02-13T04:00:49.473101+0000","last_became_peered":"2026-02-13T04:00:49.473101+0000","last_unstale":"2026-02-13T04:00:50.468647+0000","last_undegraded":"2026-02-13T04:00:50.468647+0000","last_fullsized":"2026-02-13T04:00:50.468647+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:13:24.278254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.909973+0000","last_change":"2026-02-13T04:00:49.474399+0000","last_active":"2026-02-13T04:00:50.909973+0000","last_peered":"2026-02-13T04:00:50.909973+0000","last_clean":"2026-02-13T04:00:50.909973+0000","last_became_active":"2026-02-13T04:00:49.474190+0000","last_became_peered":"2026-02-13T04:00:49.474190+0000","last_unstale":"2026-02-13T04:00:50.909973+0000","last_undegraded":"2026-02-13T04:00:50.909973+0000","last_fullsized":"2026-02-13T04:00:50.909973+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:58:56.035600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.468618+0000","last_change":"2026-02-13T04:00:49.479881+0000","last_active":"2026-02-13T04:00:50.468618+0000","last_peered":"2026-02-13T04:00:50.468618+0000","last_clean":"2026-02-13T04:00:50.468618+0000","last_became_active":"2026-02-13T04:00:49.477264+0000","last_became_peered":"2026-02-13T04:00:49.477264+0000","last_unstale":"2026-02-13T04:00:50.468618+0000","last_undegraded":"2026-02-13T04:00:50.468618+0000","last_fullsized":"2026-02-13T04:00:50.468618+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:44:11.954643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.720863+0000","last_change":"2026-02-13T04:00:49.474129+0000","last_active":"2026-02-13T04:00:50.720863+0000","last_peered":"2026-02-13T04:00:50.720863+0000","last_clean":"2026-02-13T04:00:50.720863+0000","last_became_active":"2026-02-13T04:00:49.473954+0000","last_became_peered":"2026-02-13T04:00:49.473954+0000","last_unstale":"2026-02-13T04:00:50.720863+0000","last_undegraded":"2026-02-13T04:00:50.720863+0000","last_fullsized":"2026-02-13T04:00:50.720863+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:57:22.870845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469105+0000","last_change":"2026-02-13T04:00:49.473093+0000","last_active":"2026-02-13T04:00:50.469105+0000","last_peered":"2026-02-13T04:00:50.469105+0000","last_clean":"2026-02-13T04:00:50.469105+0000","last_became_active":"2026-02-13T04:00:49.472808+0000","last_became_peered":"2026-02-13T04:00:49.472808+0000","last_unstale":"2026-02-13T04:00:50.469105+0000","last_undegraded":"2026-02-13T04:00:50.469105+0000","last_fullsized":"2026-02-13T04:00:50.469105+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:43:54.901711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.910473+0000","last_change":"2026-02-13T04:00:49.474383+0000","last_active":"2026-02-13T04:00:50.910473+0000","last_peered":"2026-02-13T04:00:50.910473+0000","last_clean":"2026-02-13T04:00:50.910473+0000","last_became_active":"2026-02-13T04:00:49.473948+0000","last_became_peered":"2026-02-13T04:00:49.473948+0000","last_unstale":"2026-02-13T04:00:50.910473+0000","last_undegraded":"2026-02-13T04:00:50.910473+0000","last_fullsized":"2026-02-13T04:00:50.910473+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:55:08.451894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.468849+0000","last_change":"2026-02-13T04:00:49.477579+0000","last_active":"2026-02-13T04:00:50.468849+0000","last_peered":"2026-02-13T04:00:50.468849+0000","last_clean":"2026-02-13T04:00:50.468849+0000","last_became_active":"2026-02-13T04:00:49.473854+0000","last_became_peered":"2026-02-13T04:00:49.473854+0000","last_unstale":"2026-02-13T04:00:50.468849+0000","last_undegraded":"2026-02-13T04:00:50.468849+0000","last_fullsized":"2026-02-13T04:00:50.468849+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:12:19.444223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.721290+0000","last_change":"2026-02-13T04:00:49.476339+0000","last_active":"2026-02-13T04:00:50.721290+0000","last_peered":"2026-02-13T04:00:50.721290+0000","last_clean":"2026-02-13T04:00:50.721290+0000","last_became_active":"2026-02-13T04:00:49.476269+0000","last_became_peered":"2026-02-13T04:00:49.476269+0000","last_unstale":"2026-02-13T04:00:50.721290+0000","last_undegraded":"2026-02-13T04:00:50.721290+0000","last_fullsized":"2026-02-13T04:00:50.721290+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:51:34.159138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.470257+0000","last_change":"2026-02-13T04:00:49.475689+0000","last_active":"2026-02-13T04:00:50.470257+0000","last_peered":"2026-02-13T04:00:50.470257+0000","last_clean":"2026-02-13T04:00:50.470257+0000","last_became_active":"2026-02-13T04:00:49.475254+0000","last_became_peered":"2026-02-13T04:00:49.475254+0000","last_unstale":"2026-02-13T04:00:50.470257+0000","last_undegraded":"2026-02-13T04:00:50.470257+0000","last_fullsized":"2026-02-13T04:00:50.470257+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:44:04.115649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469299+0000","last_change":"2026-02-13T04:00:49.478457+0000","last_active":"2026-02-13T04:00:50.469299+0000","last_peered":"2026-02-13T04:00:50.469299+0000","last_clean":"2026-02-13T04:00:50.469299+0000","last_became_active":"2026-02-13T04:00:49.478351+0000","last_became_peered":"2026-02-13T04:00:49.478351+0000","last_unstale":"2026-02-13T04:00:50.469299+0000","last_undegraded":"2026-02-13T04:00:50.469299+0000","last_fullsized":"2026-02-13T04:00:50.469299+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:03:26.642290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.720495+0000","last_change":"2026-02-13T04:00:49.476182+0000","last_active":"2026-02-13T04:00:50.720495+0000","last_peered":"2026-02-13T04:00:50.720495+0000","last_clean":"2026-02-13T04:00:50.720495+0000","last_became_active":"2026-02-13T04:00:49.476070+0000","last_became_peered":"2026-02-13T04:00:49.476070+0000","last_unstale":"2026-02-13T04:00:50.720495+0000","last_undegraded":"2026-02-13T04:00:50.720495+0000","last_fullsized":"2026-02-13T04:00:50.720495+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:04:29.238236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722540+0000","last_change":"2026-02-13T04:00:49.482695+0000","last_active":"2026-02-13T04:00:50.722540+0000","last_peered":"2026-02-13T04:00:50.722540+0000","last_clean":"2026-02-13T04:00:50.722540+0000","last_became_active":"2026-02-13T04:00:49.482487+0000","last_became_peered":"2026-02-13T04:00:49.482487+0000","last_unstale":"2026-02-13T04:00:50.722540+0000","last_undegraded":"2026-02-13T04:00:50.722540+0000","last_fullsized":"2026-02-13T04:00:50.722540+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:17:10.991068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469800+0000","last_change":"2026-02-13T04:00:49.473784+0000","last_active":"2026-02-13T04:00:50.469800+0000","last_peered":"2026-02-13T04:00:50.469800+0000","last_clean":"2026-02-13T04:00:50.469800+0000","last_became_active":"2026-02-13T04:00:49.473653+0000","last_became_peered":"2026-02-13T04:00:49.473653+0000","last_unstale":"2026-02-13T04:00:50.469800+0000","last_undegraded":"2026-02-13T04:00:50.469800+0000","last_fullsized":"2026-02-13T04:00:50.469800+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:47:48.283470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722687+0000","last_change":"2026-02-13T04:00:49.476692+0000","last_active":"2026-02-13T04:00:50.722687+0000","last_peered":"2026-02-13T04:00:50.722687+0000","last_clean":"2026-02-13T04:00:50.722687+0000","last_became_active":"2026-02-13T04:00:49.476507+0000","last_became_peered":"2026-02-13T04:00:49.476507+0000","last_unstale":"2026-02-13T04:00:50.722687+0000","last_undegraded":"2026-02-13T04:00:50.722687+0000","last_fullsized":"2026-02-13T04:00:50.722687+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:48:00.193446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722223+0000","last_change":"2026-02-13T04:00:49.480680+0000","last_active":"2026-02-13T04:00:50.722223+0000","last_peered":"2026-02-13T04:00:50.722223+0000","last_clean":"2026-02-13T04:00:50.722223+0000","last_became_active":"2026-02-13T04:00:49.480429+0000","last_became_peered":"2026-02-13T04:00:49.480429+0000","last_unstale":"2026-02-13T04:00:50.722223+0000","last_undegraded":"2026-02-13T04:00:50.722223+0000","last_fullsized":"2026-02-13T04:00:50.722223+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:59:07.789528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.721354+0000","last_change":"2026-02-13T04:00:49.478790+0000","last_active":"2026-02-13T04:00:50.721354+0000","last_peered":"2026-02-13T04:00:50.721354+0000","last_clean":"2026-02-13T04:00:50.721354+0000","last_became_active":"2026-02-13T04:00:49.478542+0000","last_became_peered":"2026-02-13T04:00:49.478542+0000","last_unstale":"2026-02-13T04:00:50.721354+0000","last_undegraded":"2026-02-13T04:00:50.721354+0000","last_fullsized":"2026-02-13T04:00:50.721354+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:20:02.089377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.720635+0000","last_change":"2026-02-13T04:00:49.480725+0000","last_active":"2026-02-13T04:00:50.720635+0000","last_peered":"2026-02-13T04:00:50.720635+0000","last_clean":"2026-02-13T04:00:50.720635+0000","last_became_active":"2026-02-13T04:00:49.480629+0000","last_became_peered":"2026-02-13T04:00:49.480629+0000","last_unstale":"2026-02-13T04:00:50.720635+0000","last_undegraded":"2026-02-13T04:00:50.720635+0000","last_fullsized":"2026-02-13T04:00:50.720635+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:58:01.268671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.468709+0000","last_change":"2026-02-13T04:00:49.477665+0000","last_active":"2026-02-13T04:00:50.468709+0000","last_peered":"2026-02-13T04:00:50.468709+0000","last_clean":"2026-02-13T04:00:50.468709+0000","last_became_active":"2026-02-13T04:00:49.477495+0000","last_became_peered":"2026-02-13T04:00:49.477495+0000","last_unstale":"2026-02-13T04:00:50.468709+0000","last_undegraded":"2026-02-13T04:00:50.468709+0000","last_fullsized":"2026-02-13T04:00:50.468709+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:59:53.668023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469843+0000","last_change":"2026-02-13T04:00:49.482438+0000","last_active":"2026-02-13T04:00:50.469843+0000","last_peered":"2026-02-13T04:00:50.469843+0000","last_clean":"2026-02-13T04:00:50.469843+0000","last_became_active":"2026-02-13T04:00:49.482330+0000","last_became_peered":"2026-02-13T04:00:49.482330+0000","last_unstale":"2026-02-13T04:00:50.469843+0000","last_undegraded":"2026-02-13T04:00:50.469843+0000","last_fullsized":"2026-02-13T04:00:50.469843+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:22:36.817612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469056+0000","last_change":"2026-02-13T04:00:49.477434+0000","last_active":"2026-02-13T04:00:50.469056+0000","last_peered":"2026-02-13T04:00:50.469056+0000","last_clean":"2026-02-13T04:00:50.469056+0000","last_became_active":"2026-02-13T04:00:49.477191+0000","last_became_peered":"2026-02-13T04:00:49.477191+0000","last_unstale":"2026-02-13T04:00:50.469056+0000","last_undegraded":"2026-02-13T04:00:50.469056+0000","last_fullsized":"2026-02-13T04:00:50.469056+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:37:48.389471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722779+0000","last_change":"2026-02-13T04:00:49.474549+0000","last_active":"2026-02-13T04:00:50.722779+0000","last_peered":"2026-02-13T04:00:50.722779+0000","last_clean":"2026-02-13T04:00:50.722779+0000","last_became_active":"2026-02-13T04:00:49.474357+0000","last_became_peered":"2026-02-13T04:00:49.474357+0000","last_unstale":"2026-02-13T04:00:50.722779+0000","last_undegraded":"2026-02-13T04:00:50.722779+0000","last_fullsized":"2026-02-13T04:00:50.722779+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:29:00.130538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722309+0000","last_change":"2026-02-13T04:00:49.476543+0000","last_active":"2026-02-13T04:00:50.722309+0000","last_peered":"2026-02-13T04:00:50.722309+0000","last_clean":"2026-02-13T04:00:50.722309+0000","last_became_active":"2026-02-13T04:00:49.476269+0000","last_became_peered":"2026-02-13T04:00:49.476269+0000","last_unstale":"2026-02-13T04:00:50.722309+0000","last_undegraded":"2026-02-13T04:00:50.722309+0000","last_fullsized":"2026-02-13T04:00:50.722309+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:51:34.541577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.721455+0000","last_change":"2026-02-13T04:00:49.480227+0000","last_active":"2026-02-13T04:00:50.721455+0000","last_peered":"2026-02-13T04:00:50.721455+0000","last_clean":"2026-02-13T04:00:50.721455+0000","last_became_active":"2026-02-13T04:00:49.480117+0000","last_became_peered":"2026-02-13T04:00:49.480117+0000","last_unstale":"2026-02-13T04:00:50.721455+0000","last_undegraded":"2026-02-13T04:00:50.721455+0000","last_fullsized":"2026-02-13T04:00:50.721455+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:57:45.182937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469454+0000","last_change":"2026-02-13T04:00:49.479873+0000","last_active":"2026-02-13T04:00:50.469454+0000","last_peered":"2026-02-13T04:00:50.469454+0000","last_clean":"2026-02-13T04:00:50.469454+0000","last_became_active":"2026-02-13T04:00:49.479764+0000","last_became_peered":"2026-02-13T04:00:49.479764+0000","last_unstale":"2026-02-13T04:00:50.469454+0000","last_undegraded":"2026-02-13T04:00:50.469454+0000","last_fullsized":"2026-02-13T04:00:50.469454+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:59:09.259456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722421+0000","last_change":"2026-02-13T04:00:49.478971+0000","last_active":"2026-02-13T04:00:50.722421+0000","last_peered":"2026-02-13T04:00:50.722421+0000","last_clean":"2026-02-13T04:00:50.722421+0000","last_became_active":"2026-02-13T04:00:49.478770+0000","last_became_peered":"2026-02-13T04:00:49.478770+0000","last_unstale":"2026-02-13T04:00:50.722421+0000","last_undegraded":"2026-02-13T04:00:50.722421+0000","last_fullsized":"2026-02-13T04:00:50.722421+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:41:03.291420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722355+0000","last_change":"2026-02-13T04:00:49.475701+0000","last_active":"2026-02-13T04:00:50.722355+0000","last_peered":"2026-02-13T04:00:50.722355+0000","last_clean":"2026-02-13T04:00:50.722355+0000","last_became_active":"2026-02-13T04:00:49.475238+0000","last_became_peered":"2026-02-13T04:00:49.475238+0000","last_unstale":"2026-02-13T04:00:50.722355+0000","last_undegraded":"2026-02-13T04:00:50.722355+0000","last_fullsized":"2026-02-13T04:00:50.722355+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:53:42.399821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722110+0000","last_change":"2026-02-13T04:00:49.476461+0000","last_active":"2026-02-13T04:00:50.722110+0000","last_peered":"2026-02-13T04:00:50.722110+0000","last_clean":"2026-02-13T04:00:50.722110+0000","last_became_active":"2026-02-13T04:00:49.476249+0000","last_became_peered":"2026-02-13T04:00:49.476249+0000","last_unstale":"2026-02-13T04:00:50.722110+0000","last_undegraded":"2026-02-13T04:00:50.722110+0000","last_fullsized":"2026-02-13T04:00:50.722110+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:54:58.933497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722340+0000","last_change":"2026-02-13T04:00:49.475811+0000","last_active":"2026-02-13T04:00:50.722340+0000","last_peered":"2026-02-13T04:00:50.722340+0000","last_clean":"2026-02-13T04:00:50.722340+0000","last_became_active":"2026-02-13T04:00:49.475618+0000","last_became_peered":"2026-02-13T04:00:49.475618+0000","last_unstale":"2026-02-13T04:00:50.722340+0000","last_undegraded":"2026-02-13T04:00:50.722340+0000","last_fullsized":"2026-02-13T04:00:50.722340+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:22:47.756470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"76'6","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:01:04.094634+0000","last_change":"2026-02-13T04:00:48.693027+0000","last_active":"2026-02-13T04:01:04.094634+0000","last_peered":"2026-02-13T04:01:04.094634+0000","last_clean":"2026-02-13T04:01:04.094634+0000","last_became_active":"2026-02-13T04:00:48.692784+0000","last_became_peered":"2026-02-13T04:00:48.692784+0000","last_unstale":"2026-02-13T04:01:04.094634+0000","last_undegraded":"2026-02-13T04:01:04.094634+0000","last_fullsized":"2026-02-13T04:01:04.094634+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:12:41.834516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1032,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469782+0000","last_change":"2026-02-13T04:00:49.482026+0000","last_active":"2026-02-13T04:00:50.469782+0000","last_peered":"2026-02-13T04:00:50.469782+0000","last_clean":"2026-02-13T04:00:50.469782+0000","last_became_active":"2026-02-13T04:00:49.481905+0000","last_became_peered":"2026-02-13T04:00:49.481905+0000","last_unstale":"2026-02-13T04:00:50.469782+0000","last_undegraded":"2026-02-13T04:00:50.469782+0000","last_fullsized":"2026-02-13T04:00:50.469782+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:05:21.043555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"76'7","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:55.067925+0000","last_change":"2026-02-13T04:00:48.691792+0000","last_active":"2026-02-13T04:00:55.067925+0000","last_peered":"2026-02-13T04:00:55.067925+0000","last_clean":"2026-02-13T04:00:55.067925+0000","last_became_active":"2026-02-13T04:00:48.691630+0000","last_became_peered":"2026-02-13T04:00:48.691630+0000","last_unstale":"2026-02-13T04:00:55.067925+0000","last_undegraded":"2026-02-13T04:00:55.067925+0000","last_fullsized":"2026-02-13T04:00:55.067925+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:32:00.435154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"76'3","reported_seq":19,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:54.062781+0000","last_change":"2026-02-13T04:00:48.695910+0000","last_active":"2026-02-13T04:00:54.062781+0000","last_peered":"2026-02-13T04:00:54.062781+0000","last_clean":"2026-02-13T04:00:54.062781+0000","last_became_active":"2026-02-13T04:00:48.695729+0000","last_became_peered":"2026-02-13T04:00:48.695729+0000","last_unstale":"2026-02-13T04:00:54.062781+0000","last_undegraded":"2026-02-13T04:00:54.062781+0000","last_fullsized":"2026-02-13T04:00:54.062781+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:31:27.918317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.468699+0000","last_change":"2026-02-13T04:00:49.481361+0000","last_active":"2026-02-13T04:00:50.468699+0000","last_peered":"2026-02-13T04:00:50.468699+0000","last_clean":"2026-02-13T04:00:50.468699+0000","last_became_active":"2026-02-13T04:00:49.481073+0000","last_became_peered":"2026-02-13T04:00:49.481073+0000","last_unstale":"2026-02-13T04:00:50.468699+0000","last_undegraded":"2026-02-13T04:00:50.468699+0000","last_fullsized":"2026-02-13T04:00:50.468699+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:55:00.151374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"76'3","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:56.075748+0000","last_change":"2026-02-13T04:00:48.692833+0000","last_active":"2026-02-13T04:00:56.075748+0000","last_peered":"2026-02-13T04:00:56.075748+0000","last_clean":"2026-02-13T04:00:56.075748+0000","last_became_active":"2026-02-13T04:00:48.692566+0000","last_became_peered":"2026-02-13T04:00:48.692566+0000","last_unstale":"2026-02-13T04:00:56.075748+0000","last_undegraded":"2026-02-13T04:00:56.075748+0000","last_fullsized":"2026-02-13T04:00:56.075748+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:01:30.821370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469695+0000","last_change":"2026-02-13T04:00:49.479585+0000","last_active":"2026-02-13T04:00:50.469695+0000","last_peered":"2026-02-13T04:00:50.469695+0000","last_clean":"2026-02-13T04:00:50.469695+0000","last_became_active":"2026-02-13T04:00:49.479155+0000","last_became_peered":"2026-02-13T04:00:49.479155+0000","last_unstale":"2026-02-13T04:00:50.469695+0000","last_undegraded":"2026-02-13T04:00:50.469695+0000","last_fullsized":"2026-02-13T04:00:50.469695+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:04:32.865189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"76'4","reported_seq":40,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:01:06.085856+0000","last_change":"2026-02-13T04:00:48.697295+0000","last_active":"2026-02-13T04:01:06.085856+0000","last_peered":"2026-02-13T04:01:06.085856+0000","last_clean":"2026-02-13T04:01:06.085856+0000","last_became_active":"2026-02-13T04:00:48.697115+0000","last_became_peered":"2026-02-13T04:00:48.697115+0000","last_unstale":"2026-02-13T04:01:06.085856+0000","last_undegraded":"2026-02-13T04:01:06.085856+0000","last_fullsized":"2026-02-13T04:01:06.085856+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:41:11.697570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.720845+0000","last_change":"2026-02-13T04:00:49.474447+0000","last_active":"2026-02-13T04:00:50.720845+0000","last_peered":"2026-02-13T04:00:50.720845+0000","last_clean":"2026-02-13T04:00:50.720845+0000","last_became_active":"2026-02-13T04:00:49.473707+0000","last_became_peered":"2026-02-13T04:00:49.473707+0000","last_unstale":"2026-02-13T04:00:50.720845+0000","last_undegraded":"2026-02-13T04:00:50.720845+0000","last_fullsized":"2026-02-13T04:00:50.720845+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:33:16.764134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"76'4","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:56.074475+0000","last_change":"2026-02-13T04:00:48.691107+0000","last_active":"2026-02-13T04:00:56.074475+0000","last_peered":"2026-02-13T04:00:56.074475+0000","last_clean":"2026-02-13T04:00:56.074475+0000","last_became_active":"2026-02-13T04:00:48.690883+0000","last_became_peered":"2026-02-13T04:00:48.690883+0000","last_unstale":"2026-02-13T04:00:56.074475+0000","last_undegraded":"2026-02-13T04:00:56.074475+0000","last_fullsized":"2026-02-13T04:00:56.074475+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:42:12.911922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469851+0000","last_change":"2026-02-13T04:00:49.479316+0000","last_active":"2026-02-13T04:00:50.469851+0000","last_peered":"2026-02-13T04:00:50.469851+0000","last_clean":"2026-02-13T04:00:50.469851+0000","last_became_active":"2026-02-13T04:00:49.479237+0000","last_became_peered":"2026-02-13T04:00:49.479237+0000","last_unstale":"2026-02-13T04:00:50.469851+0000","last_undegraded":"2026-02-13T04:00:50.469851+0000","last_fullsized":"2026-02-13T04:00:50.469851+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:42:22.094924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"76'5","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:55.069328+0000","last_change":"2026-02-13T04:00:48.694972+0000","last_active":"2026-02-13T04:00:55.069328+0000","last_peered":"2026-02-13T04:00:55.069328+0000","last_clean":"2026-02-13T04:00:55.069328+0000","last_became_active":"2026-02-13T04:00:48.694866+0000","last_became_peered":"2026-02-13T04:00:48.694866+0000","last_unstale":"2026-02-13T04:00:55.069328+0000","last_undegraded":"2026-02-13T04:00:55.069328+0000","last_fullsized":"2026-02-13T04:00:55.069328+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:21:39.815574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.720774+0000","last_change":"2026-02-13T04:00:49.473770+0000","last_active":"2026-02-13T04:00:50.720774+0000","last_peered":"2026-02-13T04:00:50.720774+0000","last_clean":"2026-02-13T04:00:50.720774+0000","last_became_active":"2026-02-13T04:00:49.473571+0000","last_became_peered":"2026-02-13T04:00:49.473571+0000","last_unstale":"2026-02-13T04:00:50.720774+0000","last_undegraded":"2026-02-13T04:00:50.720774+0000","last_fullsized":"2026-02-13T04:00:50.720774+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:20:31.775093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"76'28","reported_seq":69,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:01:06.087790+0000","last_change":"2026-02-13T04:00:48.691199+0000","last_active":"2026-02-13T04:01:06.087790+0000","last_peered":"2026-02-13T04:01:06.087790+0000","last_clean":"2026-02-13T04:01:06.087790+0000","last_became_active":"2026-02-13T04:00:48.690955+0000","last_became_peered":"2026-02-13T04:00:48.690955+0000","last_unstale":"2026-02-13T04:01:06.087790+0000","last_undegraded":"2026-02-13T04:01:06.087790+0000","last_fullsized":"2026-02-13T04:01:06.087790+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:41:58.570616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66455,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":25,"num_read_kb":77,"num_write":30,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722495+0000","last_change":"2026-02-13T04:00:49.474461+0000","last_active":"2026-02-13T04:00:50.722495+0000","last_peered":"2026-02-13T04:00:50.722495+0000","last_clean":"2026-02-13T04:00:50.722495+0000","last_became_active":"2026-02-13T04:00:49.474220+0000","last_became_peered":"2026-02-13T04:00:49.474220+0000","last_unstale":"2026-02-13T04:00:50.722495+0000","last_undegraded":"2026-02-13T04:00:50.722495+0000","last_fullsized":"2026-02-13T04:00:50.722495+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:04:21.521507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"76'9","reported_seq":27,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:57.079077+0000","last_change":"2026-02-13T04:00:48.698134+0000","last_active":"2026-02-13T04:00:57.079077+0000","last_peered":"2026-02-13T04:00:57.079077+0000","last_clean":"2026-02-13T04:00:57.079077+0000","last_became_active":"2026-02-13T04:00:48.697958+0000","last_became_peered":"2026-02-13T04:00:48.697958+0000","last_unstale":"2026-02-13T04:00:57.079077+0000","last_undegraded":"2026-02-13T04:00:57.079077+0000","last_fullsized":"2026-02-13T04:00:57.079077+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:55:21.688751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.721213+0000","last_change":"2026-02-13T04:00:49.481860+0000","last_active":"2026-02-13T04:00:50.721213+0000","last_peered":"2026-02-13T04:00:50.721213+0000","last_clean":"2026-02-13T04:00:50.721213+0000","last_became_active":"2026-02-13T04:00:49.481735+0000","last_became_peered":"2026-02-13T04:00:49.481735+0000","last_unstale":"2026-02-13T04:00:50.721213+0000","last_undegraded":"2026-02-13T04:00:50.721213+0000","last_fullsized":"2026-02-13T04:00:50.721213+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:13:15.403655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"76'5","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:56.077283+0000","last_change":"2026-02-13T04:00:48.700556+0000","last_active":"2026-02-13T04:00:56.077283+0000","last_peered":"2026-02-13T04:00:56.077283+0000","last_clean":"2026-02-13T04:00:56.077283+0000","last_became_active":"2026-02-13T04:00:48.700417+0000","last_became_peered":"2026-02-13T04:00:48.700417+0000","last_unstale":"2026-02-13T04:00:56.077283+0000","last_undegraded":"2026-02-13T04:00:56.077283+0000","last_fullsized":"2026-02-13T04:00:56.077283+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:53:13.088594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.910386+0000","last_change":"2026-02-13T04:00:49.477823+0000","last_active":"2026-02-13T04:00:50.910386+0000","last_peered":"2026-02-13T04:00:50.910386+0000","last_clean":"2026-02-13T04:00:50.910386+0000","last_became_active":"2026-02-13T04:00:49.477688+0000","last_became_peered":"2026-02-13T04:00:49.477688+0000","last_unstale":"2026-02-13T04:00:50.910386+0000","last_undegraded":"2026-02-13T04:00:50.910386+0000","last_fullsized":"2026-02-13T04:00:50.910386+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:38:51.114912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"76'6","reported_seq":36,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:01:07.096447+0000","last_change":"2026-02-13T04:00:48.689958+0000","last_active":"2026-02-13T04:01:07.096447+0000","last_peered":"2026-02-13T04:01:07.096447+0000","last_clean":"2026-02-13T04:01:07.096447+0000","last_became_active":"2026-02-13T04:00:48.689800+0000","last_became_peered":"2026-02-13T04:00:48.689800+0000","last_unstale":"2026-02-13T04:01:07.096447+0000","last_undegraded":"2026-02-13T04:01:07.096447+0000","last_fullsized":"2026-02-13T04:01:07.096447+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:57:29.593581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":998,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.909974+0000","last_change":"2026-02-13T04:00:49.474922+0000","last_active":"2026-02-13T04:00:50.909974+0000","last_peered":"2026-02-13T04:00:50.909974+0000","last_clean":"2026-02-13T04:00:50.909974+0000","last_became_active":"2026-02-13T04:00:49.474798+0000","last_became_peered":"2026-02-13T04:00:49.474798+0000","last_unstale":"2026-02-13T04:00:50.909974+0000","last_undegraded":"2026-02-13T04:00:50.909974+0000","last_fullsized":"2026-02-13T04:00:50.909974+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:24:58.395490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"76'17","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:56.076531+0000","last_change":"2026-02-13T04:00:48.697186+0000","last_active":"2026-02-13T04:00:56.076531+0000","last_peered":"2026-02-13T04:00:56.076531+0000","last_clean":"2026-02-13T04:00:56.076531+0000","last_became_active":"2026-02-13T04:00:48.696965+0000","last_became_peered":"2026-02-13T04:00:48.696965+0000","last_unstale":"2026-02-13T04:00:56.076531+0000","last_undegraded":"2026-02-13T04:00:56.076531+0000","last_fullsized":"2026-02-13T04:00:56.076531+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:56:20.600423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469600+0000","last_change":"2026-02-13T04:00:49.478825+0000","last_active":"2026-02-13T04:00:50.469600+0000","last_peered":"2026-02-13T04:00:50.469600+0000","last_clean":"2026-02-13T04:00:50.469600+0000","last_became_active":"2026-02-13T04:00:49.478665+0000","last_became_peered":"2026-02-13T04:00:49.478665+0000","last_unstale":"2026-02-13T04:00:50.469600+0000","last_undegraded":"2026-02-13T04:00:50.469600+0000","last_fullsized":"2026-02-13T04:00:50.469600+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:30:36.733228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"76'2","reported_seq":19,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:56.060673+0000","last_change":"2026-02-13T04:00:48.691503+0000","last_active":"2026-02-13T04:00:56.060673+0000","last_peered":"2026-02-13T04:00:56.060673+0000","last_clean":"2026-02-13T04:00:56.060673+0000","last_became_active":"2026-02-13T04:00:48.691259+0000","last_became_peered":"2026-02-13T04:00:48.691259+0000","last_unstale":"2026-02-13T04:00:56.060673+0000","last_undegraded":"2026-02-13T04:00:56.060673+0000","last_fullsized":"2026-02-13T04:00:56.060673+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:34:28.622800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722403+0000","last_change":"2026-02-13T04:00:49.480630+0000","last_active":"2026-02-13T04:00:50.722403+0000","last_peered":"2026-02-13T04:00:50.722403+0000","last_clean":"2026-02-13T04:00:50.722403+0000","last_became_active":"2026-02-13T04:00:49.480389+0000","last_became_peered":"2026-02-13T04:00:49.480389+0000","last_unstale":"2026-02-13T04:00:50.722403+0000","last_undegraded":"2026-02-13T04:00:50.722403+0000","last_fullsized":"2026-02-13T04:00:50.722403+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:57:06.972169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"76'5","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:56.077127+0000","last_change":"2026-02-13T04:00:48.699907+0000","last_active":"2026-02-13T04:00:56.077127+0000","last_peered":"2026-02-13T04:00:56.077127+0000","last_clean":"2026-02-13T04:00:56.077127+0000","last_became_active":"2026-02-13T04:00:48.699680+0000","last_became_peered":"2026-02-13T04:00:48.699680+0000","last_unstale":"2026-02-13T04:00:56.077127+0000","last_undegraded":"2026-02-13T04:00:56.077127+0000","last_fullsized":"2026-02-13T04:00:56.077127+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:59:04.468050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.910539+0000","last_change":"2026-02-13T04:00:49.474061+0000","last_active":"2026-02-13T04:00:50.910539+0000","last_peered":"2026-02-13T04:00:50.910539+0000","last_clean":"2026-02-13T04:00:50.910539+0000","last_became_active":"2026-02-13T04:00:49.473775+0000","last_became_peered":"2026-02-13T04:00:49.473775+0000","last_unstale":"2026-02-13T04:00:50.910539+0000","last_undegraded":"2026-02-13T04:00:50.910539+0000","last_fullsized":"2026-02-13T04:00:50.910539+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:17:55.919908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"76'3","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:56.077318+0000","last_change":"2026-02-13T04:00:48.700390+0000","last_active":"2026-02-13T04:00:56.077318+0000","last_peered":"2026-02-13T04:00:56.077318+0000","last_clean":"2026-02-13T04:00:56.077318+0000","last_became_active":"2026-02-13T04:00:48.700274+0000","last_became_peered":"2026-02-13T04:00:48.700274+0000","last_unstale":"2026-02-13T04:00:56.077318+0000","last_undegraded":"2026-02-13T04:00:56.077318+0000","last_fullsized":"2026-02-13T04:00:56.077318+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:42:57.951202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"76'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.910469+0000","last_change":"2026-02-13T04:00:49.473385+0000","last_active":"2026-02-13T04:00:50.910469+0000","last_peered":"2026-02-13T04:00:50.910469+0000","last_clean":"2026-02-13T04:00:50.910469+0000","last_became_active":"2026-02-13T04:00:49.473169+0000","last_became_peered":"2026-02-13T04:00:49.473169+0000","last_unstale":"2026-02-13T04:00:50.910469+0000","last_undegraded":"2026-02-13T04:00:50.910469+0000","last_fullsized":"2026-02-13T04:00:50.910469+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:39:38.736962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"76'6","reported_seq":34,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:01:05.086578+0000","last_change":"2026-02-13T04:00:48.697672+0000","last_active":"2026-02-13T04:01:05.086578+0000","last_peered":"2026-02-13T04:01:05.086578+0000","last_clean":"2026-02-13T04:01:05.086578+0000","last_became_active":"2026-02-13T04:00:48.697508+0000","last_became_peered":"2026-02-13T04:00:48.697508+0000","last_unstale":"2026-02-13T04:01:05.086578+0000","last_undegraded":"2026-02-13T04:01:05.086578+0000","last_fullsized":"2026-02-13T04:01:05.086578+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:06:23.149951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1602,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":2,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.910511+0000","last_change":"2026-02-13T04:00:49.474120+0000","last_active":"2026-02-13T04:00:50.910511+0000","last_peered":"2026-02-13T04:00:50.910511+0000","last_clean":"2026-02-13T04:00:50.910511+0000","last_became_active":"2026-02-13T04:00:49.473810+0000","last_became_peered":"2026-02-13T04:00:49.473810+0000","last_unstale":"2026-02-13T04:00:50.910511+0000","last_undegraded":"2026-02-13T04:00:50.910511+0000","last_fullsized":"2026-02-13T04:00:50.910511+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:19:59.822379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'152","reported_seq":345,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.910012+0000","last_change":"2026-02-13T04:00:24.257474+0000","last_active":"2026-02-13T04:00:50.910012+0000","last_peered":"2026-02-13T04:00:50.910012+0000","last_clean":"2026-02-13T04:00:50.910012+0000","last_became_active":"2026-02-13T04:00:24.257034+0000","last_became_peered":"2026-02-13T04:00:24.257034+0000","last_unstale":"2026-02-13T04:00:50.910012+0000","last_undegraded":"2026-02-13T04:00:50.910012+0000","last_fullsized":"2026-02-13T04:00:50.910012+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T03:59:12.660085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T03:59:12.660085+0000","last_clean_scrub_stamp":"2026-02-13T03:59:12.660085+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:39:33.745502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"76'6","reported_seq":25,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:57.079518+0000","last_change":"2026-02-13T04:00:48.692792+0000","last_active":"2026-02-13T04:00:57.079518+0000","last_peered":"2026-02-13T04:00:57.079518+0000","last_clean":"2026-02-13T04:00:57.079518+0000","last_became_active":"2026-02-13T04:00:48.692666+0000","last_became_peered":"2026-02-13T04:00:48.692666+0000","last_unstale":"2026-02-13T04:00:57.079518+0000","last_undegraded":"2026-02-13T04:00:57.079518+0000","last_fullsized":"2026-02-13T04:00:57.079518+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:32:34.713449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469917+0000","last_change":"2026-02-13T04:00:49.480086+0000","last_active":"2026-02-13T04:00:50.469917+0000","last_peered":"2026-02-13T04:00:50.469917+0000","last_clean":"2026-02-13T04:00:50.469917+0000","last_became_active":"2026-02-13T04:00:49.477323+0000","last_became_peered":"2026-02-13T04:00:49.477323+0000","last_unstale":"2026-02-13T04:00:50.469917+0000","last_undegraded":"2026-02-13T04:00:50.469917+0000","last_fullsized":"2026-02-13T04:00:50.469917+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T12:59:23.446340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"76'4","reported_seq":20,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:54.060635+0000","last_change":"2026-02-13T04:00:48.691498+0000","last_active":"2026-02-13T04:00:54.060635+0000","last_peered":"2026-02-13T04:00:54.060635+0000","last_clean":"2026-02-13T04:00:54.060635+0000","last_became_active":"2026-02-13T04:00:48.691356+0000","last_became_peered":"2026-02-13T04:00:48.691356+0000","last_unstale":"2026-02-13T04:00:54.060635+0000","last_undegraded":"2026-02-13T04:00:54.060635+0000","last_fullsized":"2026-02-13T04:00:54.060635+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:52:50.006515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.721111+0000","last_change":"2026-02-13T04:00:49.479452+0000","last_active":"2026-02-13T04:00:50.721111+0000","last_peered":"2026-02-13T04:00:50.721111+0000","last_clean":"2026-02-13T04:00:50.721111+0000","last_became_active":"2026-02-13T04:00:49.479354+0000","last_became_peered":"2026-02-13T04:00:49.479354+0000","last_unstale":"2026-02-13T04:00:50.721111+0000","last_undegraded":"2026-02-13T04:00:50.721111+0000","last_fullsized":"2026-02-13T04:00:50.721111+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:46:41.444877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"76'5","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:01:06.095373+0000","last_change":"2026-02-13T04:00:48.696889+0000","last_active":"2026-02-13T04:01:06.095373+0000","last_peered":"2026-02-13T04:01:06.095373+0000","last_clean":"2026-02-13T04:01:06.095373+0000","last_became_active":"2026-02-13T04:00:48.696722+0000","last_became_peered":"2026-02-13T04:00:48.696722+0000","last_unstale":"2026-02-13T04:01:06.095373+0000","last_undegraded":"2026-02-13T04:01:06.095373+0000","last_fullsized":"2026-02-13T04:01:06.095373+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:14:45.512084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469888+0000","last_change":"2026-02-13T04:00:49.478833+0000","last_active":"2026-02-13T04:00:50.469888+0000","last_peered":"2026-02-13T04:00:50.469888+0000","last_clean":"2026-02-13T04:00:50.469888+0000","last_became_active":"2026-02-13T04:00:49.478661+0000","last_became_peered":"2026-02-13T04:00:49.478661+0000","last_unstale":"2026-02-13T04:00:50.469888+0000","last_undegraded":"2026-02-13T04:00:50.469888+0000","last_fullsized":"2026-02-13T04:00:50.469888+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:19:27.081820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"76'5","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:01:04.093300+0000","last_change":"2026-02-13T04:00:48.691941+0000","last_active":"2026-02-13T04:01:04.093300+0000","last_peered":"2026-02-13T04:01:04.093300+0000","last_clean":"2026-02-13T04:01:04.093300+0000","last_became_active":"2026-02-13T04:00:48.691773+0000","last_became_peered":"2026-02-13T04:00:48.691773+0000","last_unstale":"2026-02-13T04:01:04.093300+0000","last_undegraded":"2026-02-13T04:01:04.093300+0000","last_fullsized":"2026-02-13T04:01:04.093300+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:42:13.810742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.468946+0000","last_change":"2026-02-13T04:00:49.477705+0000","last_active":"2026-02-13T04:00:50.468946+0000","last_peered":"2026-02-13T04:00:50.468946+0000","last_clean":"2026-02-13T04:00:50.468946+0000","last_became_active":"2026-02-13T04:00:49.477600+0000","last_became_peered":"2026-02-13T04:00:49.477600+0000","last_unstale":"2026-02-13T04:00:50.468946+0000","last_undegraded":"2026-02-13T04:00:50.468946+0000","last_fullsized":"2026-02-13T04:00:50.468946+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:38:17.010092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"76'1","reported_seq":17,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469620+0000","last_change":"2026-02-13T04:00:48.698484+0000","last_active":"2026-02-13T04:00:50.469620+0000","last_peered":"2026-02-13T04:00:50.469620+0000","last_clean":"2026-02-13T04:00:50.469620+0000","last_became_active":"2026-02-13T04:00:48.698054+0000","last_became_peered":"2026-02-13T04:00:48.698054+0000","last_unstale":"2026-02-13T04:00:50.469620+0000","last_undegraded":"2026-02-13T04:00:50.469620+0000","last_fullsized":"2026-02-13T04:00:50.469620+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T07:44:12.728961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"76'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:51.278727+0000","last_change":"2026-02-13T04:00:49.475436+0000","last_active":"2026-02-13T04:00:51.278727+0000","last_peered":"2026-02-13T04:00:51.278727+0000","last_clean":"2026-02-13T04:00:51.278727+0000","last_became_active":"2026-02-13T04:00:49.475301+0000","last_became_peered":"2026-02-13T04:00:49.475301+0000","last_unstale":"2026-02-13T04:00:51.278727+0000","last_undegraded":"2026-02-13T04:00:51.278727+0000","last_fullsized":"2026-02-13T04:00:51.278727+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:01:52.755952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"76'4","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:56.077951+0000","last_change":"2026-02-13T04:00:48.697244+0000","last_active":"2026-02-13T04:00:56.077951+0000","last_peered":"2026-02-13T04:00:56.077951+0000","last_clean":"2026-02-13T04:00:56.077951+0000","last_became_active":"2026-02-13T04:00:48.697000+0000","last_became_peered":"2026-02-13T04:00:48.697000+0000","last_unstale":"2026-02-13T04:00:56.077951+0000","last_undegraded":"2026-02-13T04:00:56.077951+0000","last_fullsized":"2026-02-13T04:00:56.077951+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:01:34.413201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.721388+0000","last_change":"2026-02-13T04:00:49.479594+0000","last_active":"2026-02-13T04:00:50.721388+0000","last_peered":"2026-02-13T04:00:50.721388+0000","last_clean":"2026-02-13T04:00:50.721388+0000","last_became_active":"2026-02-13T04:00:49.479339+0000","last_became_peered":"2026-02-13T04:00:49.479339+0000","last_unstale":"2026-02-13T04:00:50.721388+0000","last_undegraded":"2026-02-13T04:00:50.721388+0000","last_fullsized":"2026-02-13T04:00:50.721388+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:53:38.743418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"76'12","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:01:03.038434+0000","last_change":"2026-02-13T04:00:48.700184+0000","last_active":"2026-02-13T04:01:03.038434+0000","last_peered":"2026-02-13T04:01:03.038434+0000","last_clean":"2026-02-13T04:01:03.038434+0000","last_became_active":"2026-02-13T04:00:48.699830+0000","last_became_peered":"2026-02-13T04:00:48.699830+0000","last_unstale":"2026-02-13T04:01:03.038434+0000","last_undegraded":"2026-02-13T04:01:03.038434+0000","last_fullsized":"2026-02-13T04:01:03.038434+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:33:36.683841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469071+0000","last_change":"2026-02-13T04:00:49.479398+0000","last_active":"2026-02-13T04:00:50.469071+0000","last_peered":"2026-02-13T04:00:50.469071+0000","last_clean":"2026-02-13T04:00:50.469071+0000","last_became_active":"2026-02-13T04:00:49.478123+0000","last_became_peered":"2026-02-13T04:00:49.478123+0000","last_unstale":"2026-02-13T04:00:50.469071+0000","last_undegraded":"2026-02-13T04:00:50.469071+0000","last_fullsized":"2026-02-13T04:00:50.469071+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:27:11.747352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"76'7","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:56.076080+0000","last_change":"2026-02-13T04:00:48.693990+0000","last_active":"2026-02-13T04:00:56.076080+0000","last_peered":"2026-02-13T04:00:56.076080+0000","last_clean":"2026-02-13T04:00:56.076080+0000","last_became_active":"2026-02-13T04:00:48.693900+0000","last_became_peered":"2026-02-13T04:00:48.693900+0000","last_unstale":"2026-02-13T04:00:56.076080+0000","last_undegraded":"2026-02-13T04:00:56.076080+0000","last_fullsized":"2026-02-13T04:00:56.076080+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:30:06.422983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469681+0000","last_change":"2026-02-13T04:00:49.482955+0000","last_active":"2026-02-13T04:00:50.469681+0000","last_peered":"2026-02-13T04:00:50.469681+0000","last_clean":"2026-02-13T04:00:50.469681+0000","last_became_active":"2026-02-13T04:00:49.482763+0000","last_became_peered":"2026-02-13T04:00:49.482763+0000","last_unstale":"2026-02-13T04:00:50.469681+0000","last_undegraded":"2026-02-13T04:00:50.469681+0000","last_fullsized":"2026-02-13T04:00:50.469681+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:57:57.634076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"76'2","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:53.057146+0000","last_change":"2026-02-13T04:00:48.691700+0000","last_active":"2026-02-13T04:00:53.057146+0000","last_peered":"2026-02-13T04:00:53.057146+0000","last_clean":"2026-02-13T04:00:53.057146+0000","last_became_active":"2026-02-13T04:00:48.691589+0000","last_became_peered":"2026-02-13T04:00:48.691589+0000","last_unstale":"2026-02-13T04:00:53.057146+0000","last_undegraded":"2026-02-13T04:00:53.057146+0000","last_fullsized":"2026-02-13T04:00:53.057146+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:11:12.096183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722064+0000","last_change":"2026-02-13T04:00:49.474149+0000","last_active":"2026-02-13T04:00:50.722064+0000","last_peered":"2026-02-13T04:00:50.722064+0000","last_clean":"2026-02-13T04:00:50.722064+0000","last_became_active":"2026-02-13T04:00:49.473736+0000","last_became_peered":"2026-02-13T04:00:49.473736+0000","last_unstale":"2026-02-13T04:00:50.722064+0000","last_undegraded":"2026-02-13T04:00:50.722064+0000","last_fullsized":"2026-02-13T04:00:50.722064+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:25:56.827117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"76'7","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:56.076853+0000","last_change":"2026-02-13T04:00:48.697874+0000","last_active":"2026-02-13T04:00:56.076853+0000","last_peered":"2026-02-13T04:00:56.076853+0000","last_clean":"2026-02-13T04:00:56.076853+0000","last_became_active":"2026-02-13T04:00:48.697771+0000","last_became_peered":"2026-02-13T04:00:48.697771+0000","last_unstale":"2026-02-13T04:00:56.076853+0000","last_undegraded":"2026-02-13T04:00:56.076853+0000","last_fullsized":"2026-02-13T04:00:56.076853+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:08:04.185025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.722259+0000","last_change":"2026-02-13T04:00:49.482790+0000","last_active":"2026-02-13T04:00:50.722259+0000","last_peered":"2026-02-13T04:00:50.722259+0000","last_clean":"2026-02-13T04:00:50.722259+0000","last_became_active":"2026-02-13T04:00:49.482576+0000","last_became_peered":"2026-02-13T04:00:49.482576+0000","last_unstale":"2026-02-13T04:00:50.722259+0000","last_undegraded":"2026-02-13T04:00:50.722259+0000","last_fullsized":"2026-02-13T04:00:50.722259+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:32:27.345836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"76'3","reported_seq":19,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:55.070981+0000","last_change":"2026-02-13T04:00:48.700697+0000","last_active":"2026-02-13T04:00:55.070981+0000","last_peered":"2026-02-13T04:00:55.070981+0000","last_clean":"2026-02-13T04:00:55.070981+0000","last_became_active":"2026-02-13T04:00:48.700486+0000","last_became_peered":"2026-02-13T04:00:48.700486+0000","last_unstale":"2026-02-13T04:00:55.070981+0000","last_undegraded":"2026-02-13T04:00:55.070981+0000","last_fullsized":"2026-02-13T04:00:55.070981+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:12:01.767319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469076+0000","last_change":"2026-02-13T04:00:49.479587+0000","last_active":"2026-02-13T04:00:50.469076+0000","last_peered":"2026-02-13T04:00:50.469076+0000","last_clean":"2026-02-13T04:00:50.469076+0000","last_became_active":"2026-02-13T04:00:49.478914+0000","last_became_peered":"2026-02-13T04:00:49.478914+0000","last_unstale":"2026-02-13T04:00:50.469076+0000","last_undegraded":"2026-02-13T04:00:50.469076+0000","last_fullsized":"2026-02-13T04:00:50.469076+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:17:27.267886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"76'4","reported_seq":21,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:53.057328+0000","last_change":"2026-02-13T04:00:48.693343+0000","last_active":"2026-02-13T04:00:53.057328+0000","last_peered":"2026-02-13T04:00:53.057328+0000","last_clean":"2026-02-13T04:00:53.057328+0000","last_became_active":"2026-02-13T04:00:48.692911+0000","last_became_peered":"2026-02-13T04:00:48.692911+0000","last_unstale":"2026-02-13T04:00:53.057328+0000","last_undegraded":"2026-02-13T04:00:53.057328+0000","last_fullsized":"2026-02-13T04:00:53.057328+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T11:54:45.498989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.910234+0000","last_change":"2026-02-13T04:00:49.475224+0000","last_active":"2026-02-13T04:00:50.910234+0000","last_peered":"2026-02-13T04:00:50.910234+0000","last_clean":"2026-02-13T04:00:50.910234+0000","last_became_active":"2026-02-13T04:00:49.475101+0000","last_became_peered":"2026-02-13T04:00:49.475101+0000","last_unstale":"2026-02-13T04:00:50.910234+0000","last_undegraded":"2026-02-13T04:00:50.910234+0000","last_fullsized":"2026-02-13T04:00:50.910234+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T10:14:50.281702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469957+0000","last_change":"2026-02-13T04:00:49.478859+0000","last_active":"2026-02-13T04:00:50.469957+0000","last_peered":"2026-02-13T04:00:50.469957+0000","last_clean":"2026-02-13T04:00:50.469957+0000","last_became_active":"2026-02-13T04:00:49.478702+0000","last_became_peered":"2026-02-13T04:00:49.478702+0000","last_unstale":"2026-02-13T04:00:50.469957+0000","last_undegraded":"2026-02-13T04:00:50.469957+0000","last_fullsized":"2026-02-13T04:00:50.469957+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:37:22.794457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"76'5","reported_seq":22,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:56.076369+0000","last_change":"2026-02-13T04:00:48.693367+0000","last_active":"2026-02-13T04:00:56.076369+0000","last_peered":"2026-02-13T04:00:56.076369+0000","last_clean":"2026-02-13T04:00:56.076369+0000","last_became_active":"2026-02-13T04:00:48.692994+0000","last_became_peered":"2026-02-13T04:00:48.692994+0000","last_unstale":"2026-02-13T04:00:56.076369+0000","last_undegraded":"2026-02-13T04:00:56.076369+0000","last_fullsized":"2026-02-13T04:00:56.076369+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T06:39:31.460593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":604,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.720749+0000","last_change":"2026-02-13T04:00:49.478041+0000","last_active":"2026-02-13T04:00:50.720749+0000","last_peered":"2026-02-13T04:00:50.720749+0000","last_clean":"2026-02-13T04:00:50.720749+0000","last_became_active":"2026-02-13T04:00:49.477881+0000","last_became_peered":"2026-02-13T04:00:49.477881+0000","last_unstale":"2026-02-13T04:00:50.720749+0000","last_undegraded":"2026-02-13T04:00:50.720749+0000","last_fullsized":"2026-02-13T04:00:50.720749+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T09:18:39.952084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"76'12","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:57.078960+0000","last_change":"2026-02-13T04:00:48.693403+0000","last_active":"2026-02-13T04:00:57.078960+0000","last_peered":"2026-02-13T04:00:57.078960+0000","last_clean":"2026-02-13T04:00:57.078960+0000","last_became_active":"2026-02-13T04:00:48.693036+0000","last_became_peered":"2026-02-13T04:00:48.693036+0000","last_unstale":"2026-02-13T04:00:57.078960+0000","last_undegraded":"2026-02-13T04:00:57.078960+0000","last_fullsized":"2026-02-13T04:00:57.078960+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:11:26.056818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469797+0000","last_change":"2026-02-13T04:00:49.477916+0000","last_active":"2026-02-13T04:00:50.469797+0000","last_peered":"2026-02-13T04:00:50.469797+0000","last_clean":"2026-02-13T04:00:50.469797+0000","last_became_active":"2026-02-13T04:00:49.477821+0000","last_became_peered":"2026-02-13T04:00:49.477821+0000","last_unstale":"2026-02-13T04:00:50.469797+0000","last_undegraded":"2026-02-13T04:00:50.469797+0000","last_fullsized":"2026-02-13T04:00:50.469797+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T08:28:08.763696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"76'2","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.697310+0000","last_change":"2026-02-13T04:00:48.696707+0000","last_active":"2026-02-13T04:00:50.697310+0000","last_peered":"2026-02-13T04:00:50.697310+0000","last_clean":"2026-02-13T04:00:50.697310+0000","last_became_active":"2026-02-13T04:00:48.696565+0000","last_became_peered":"2026-02-13T04:00:48.696565+0000","last_unstale":"2026-02-13T04:00:50.697310+0000","last_undegraded":"2026-02-13T04:00:50.697310+0000","last_fullsized":"2026-02-13T04:00:50.697310+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T15:22:58.352215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:00:50.469060+0000","last_change":"2026-02-13T04:00:49.476851+0000","last_active":"2026-02-13T04:00:50.469060+0000","last_peered":"2026-02-13T04:00:50.469060+0000","last_clean":"2026-02-13T04:00:50.469060+0000","last_became_active":"2026-02-13T04:00:49.476687+0000","last_became_peered":"2026-02-13T04:00:49.476687+0000","last_unstale":"2026-02-13T04:00:50.469060+0000","last_undegraded":"2026-02-13T04:00:50.469060+0000","last_fullsized":"2026-02-13T04:00:50.469060+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:48.684688+0000","last_clean_scrub_stamp":"2026-02-13T04:00:48.684688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T14:33:58.923183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"76'13","reported_seq":42,"reported_epoch":76,"state":"active+clean","last_fresh":"2026-02-13T04:01:07.097195+0000","last_change":"2026-02-13T04:00:48.695808+0000","last_active":"2026-02-13T04:01:07.097195+0000","last_peered":"2026-02-13T04:01:07.097195+0000","last_clean":"2026-02-13T04:01:07.097195+0000","last_became_active":"2026-02-13T04:00:48.695558+0000","last_became_peered":"2026-02-13T04:00:48.695558+0000","last_unstale":"2026-02-13T04:01:07.097195+0000","last_undegraded":"2026-02-13T04:01:07.097195+0000","last_fullsized":"2026-02-13T04:01:07.097195+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-13T04:00:47.681810+0000","last_clean_scrub_stamp":"2026-02-13T04:00:47.681810+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T13:50:53.268602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":694,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74217,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":138,"num_read_kb":150,"num_write":236,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":222651,"data_compressed":5013,"data_compressed_allocated":12288,"data_compressed_original":24576,"omap_allocated":199101,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":114,"num_read_kb":99,"num_write":189,"num_write_kb":3716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":3542208,"data_compressed":228962,"data_compressed_allocated":270336,"data_compressed_original":3522560,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":71,"seq":304942678026,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27776,"kb_used_data":812,"kb_used_omap":9,"kb_used_meta":26934,"kb_avail":733975424,"statfs":{"total":751619276800,"available":751590834176,"internally_reserved":0,"allocated":831488,"data_stored":397487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9466,"internal_metadata":27581190},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":64,"seq":274877906955,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27932,"kb_used_data":968,"kb_used_omap":28,"kb_used_meta":26915,"kb_avail":733975268,"statfs":{"total":751619276800,"available":751590674432,"internally_reserved":0,"allocated":991232,"data_stored":1054971,"data_compressed":40106,"data_compressed_allocated":49152,"data_compressed_original":598016,"omap_allocated":29687,"internal_metadata":27560969},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037773,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27800,"kb_used_data":836,"kb_used_omap":32,"kb_used_meta":26911,"kb_avail":733975400,"statfs":{"total":751619276800,"available":751590809600,"internally_reserved":0,"allocated":856064,"data_stored":397007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33305,"internal_metadata":27557351},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":53,"seq":227633266703,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27796,"kb_used_data":832,"kb_used_omap":35,"kb_used_meta":26908,"kb_avail":733975404,"statfs":{"total":751619276800,"available":751590813696,"internally_reserved":0,"allocated":851968,"data_stored":397407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":36098,"internal_metadata":27554558},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":46,"seq":197568495632,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27848,"kb_used_data":884,"kb_used_omap":34,"kb_used_meta":26909,"kb_avail":733975352,"statfs":{"total":751619276800,"available":751590760448,"internally_reserved":0,"allocated":905216,"data_stored":990354,"data_compressed":38435,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":35816,"internal_metadata":27554840},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":42,"seq":180388626450,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27784,"kb_used_data":820,"kb_used_omap":33,"kb_used_meta":26910,"kb_avail":733975416,"statfs":{"total":751619276800,"available":751590825984,"internally_reserved":0,"allocated":839680,"data_stored":396702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":34098,"internal_metadata":27556558},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":35,"seq":150323855380,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27860,"kb_used_data":896,"kb_used_omap":36,"kb_used_meta":26907,"kb_avail":733975340,"statfs":{"total":751619276800,"available":751590748160,"internally_reserved":0,"allocated":917504,"data_stored":989644,"data_compressed":38435,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":37792,"internal_metadata":27552864},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986198,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27784,"kb_used_data":820,"kb_used_omap":44,"kb_used_meta":26899,"kb_avail":733975416,"statfs":{"total":751619276800,"available":751590825984,"internally_reserved":0,"allocated":839680,"data_stored":396973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":45151,"internal_metadata":27545505},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215127,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27800,"kb_used_data":836,"kb_used_omap":49,"kb_used_meta":26894,"kb_avail":733975400,"statfs":{"total":751619276800,"available":751590809600,"internally_reserved":0,"allocated":856064,"data_stored":396527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":50679,"internal_metadata":27539977},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476762,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27868,"kb_used_data":904,"kb_used_omap":60,"kb_used_meta":26883,"kb_avail":733975332,"statfs":{"total":751619276800,"available":751590739968,"internally_reserved":0,"allocated":925696,"data_stored":465132,"data_compressed":1671,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":61511,"internal_metadata":27529145},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":12,"seq":51539607579,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27848,"kb_used_data":884,"kb_used_omap":45,"kb_used_meta":26898,"kb_avail":733975352,"statfs":{"total":751619276800,"available":751590760448,"internally_reserved":0,"allocated":905216,"data_stored":464114,"data_compressed":1671,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":46360,"internal_metadata":27544296},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738396,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":734003200,"kb_used":27804,"kb_used_data":840,"kb_used_omap":48,"kb_used_meta":26895,"kb_avail":733975396,"statfs":{"total":751619276800,"available":751590805504,"internally_reserved":0,"allocated":860160,"data_stored":398495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":49874,"internal_metadata":27540782},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":36787,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38435,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38435,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38435,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38435,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":38435,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10042,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":68251,"data_compressed":1671,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":3361,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":69269,"data_compressed":1671,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":58168,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4479,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":31677,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7190,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13465,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6309,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":25201,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":24776,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":68623,"data_compressed":1671,"data_compressed_allocated":4096,"data_compressed_original":8192,"omap_allocated":11283,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3150,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-13T04:01:10.123 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2026-02-13T04:01:10.123 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-13T04:01:10.123 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2026-02-13T04:01:10.123 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:01:10.307 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:10.348 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:10 trial092 ceph-mon[23047]: pgmap v187: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 7.4 KiB/s wr, 18 op/s 2026-02-13T04:01:10.348 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:10 trial092 ceph-mon[23047]: from='client.14991 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T04:01:10.493 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.490+0000 7ff0104a56c0 1 -- 10.20.193.92:0/2800234077 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff008115410 msgr2=0x7ff008175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:10.494 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.490+0000 7ff0104a56c0 1 --2- 10.20.193.92:0/2800234077 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff008115410 0x7ff008175db0 secure :-1 s=READY pgs=233 gs=1 cs=0 l=1 c_cookie=11856699402210441234 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff00400aa70 tx=0x7ff00402fdd0 comp rx=0 tx=0).stop 2026-02-13T04:01:10.494 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.490+0000 7ff0104a56c0 1 -- 10.20.193.92:0/2800234077 shutdown_connections 2026-02-13T04:01:10.494 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.490+0000 7ff0104a56c0 1 --2- 10.20.193.92:0/2800234077 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff008115410 0x7ff008175db0 unknown :-1 s=CLOSED pgs=233 gs=1 cs=0 l=1 c_cookie=11856699402210441234 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:10.494 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.490+0000 7ff0104a56c0 1 --2- 10.20.193.92:0/2800234077 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff00810fbf0 0x7ff008114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:10.494 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.490+0000 7ff0104a56c0 1 --2- 10.20.193.92:0/2800234077 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff00810f200 0x7ff00810f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:10.494 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.490+0000 7ff0104a56c0 1 -- 10.20.193.92:0/2800234077 >> 10.20.193.92:0/2800234077 conn(0x7ff0080ecb00 msgr2=0x7ff00810cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:10.494 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.490+0000 7ff0104a56c0 1 -- 10.20.193.92:0/2800234077 shutdown_connections 2026-02-13T04:01:10.494 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.490+0000 7ff0104a56c0 1 -- 10.20.193.92:0/2800234077 wait complete. 2026-02-13T04:01:10.496 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.491+0000 7ff0104a56c0 1 Processor -- start 2026-02-13T04:01:10.496 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.491+0000 7ff0104a56c0 1 -- start start 2026-02-13T04:01:10.496 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.491+0000 7ff0104a56c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff00810f200 0x7ff00811cf00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:10.496 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.491+0000 7ff0104a56c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff008115410 0x7ff00811d440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:10.496 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.492+0000 7ff0104a56c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff008122800 0x7ff008122ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:10.496 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.492+0000 7ff0104a56c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff008123210 con 0x7ff00810f200 2026-02-13T04:01:10.496 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.492+0000 7ff0104a56c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff008123380 con 0x7ff008122800 2026-02-13T04:01:10.496 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.492+0000 7ff0104a56c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7ff008123540 con 0x7ff008115410 2026-02-13T04:01:10.496 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.492+0000 7ff00da156c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff008115410 0x7ff00811d440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:10.497 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.492+0000 7ff00da156c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff008115410 0x7ff00811d440 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:52218/0 (socket says 10.20.193.92:52218) 2026-02-13T04:01:10.497 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.492+0000 7ff00ea176c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff008122800 0x7ff008122ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:10.497 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.492+0000 7ff00da156c0 1 -- 10.20.193.92:0/1468576514 learned_addr learned my addr 10.20.193.92:0/1468576514 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:10.497 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.492+0000 7ff00e2166c0 1 --2- 10.20.193.92:0/1468576514 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff00810f200 0x7ff00811cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:10.497 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.492+0000 7ff00da156c0 1 -- 10.20.193.92:0/1468576514 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff008122800 msgr2=0x7ff008122ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:10.497 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.492+0000 7ff00da156c0 1 --2- 10.20.193.92:0/1468576514 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff008122800 0x7ff008122ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:10.497 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.492+0000 7ff00da156c0 1 -- 10.20.193.92:0/1468576514 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff00810f200 msgr2=0x7ff00811cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:10.497 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.492+0000 7ff00da156c0 1 --2- 10.20.193.92:0/1468576514 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff00810f200 0x7ff00811cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:10.497 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.492+0000 7ff00da156c0 1 -- 10.20.193.92:0/1468576514 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff00400a660 con 0x7ff008115410 2026-02-13T04:01:10.497 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.492+0000 7ff00da156c0 1 --2- 10.20.193.92:0/1468576514 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff008115410 0x7ff00811d440 secure :-1 s=READY pgs=105 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feffc00b6c0 tx=0x7feffc00bb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:10.497 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.492+0000 7fefef7fe6c0 1 -- 10.20.193.92:0/1468576514 <== mon.1 v2:10.20.193.158:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feffc004250 con 0x7ff008115410 2026-02-13T04:01:10.497 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.492+0000 7fefef7fe6c0 1 -- 10.20.193.92:0/1468576514 <== mon.1 v2:10.20.193.158:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7feffc009070 con 0x7ff008115410 2026-02-13T04:01:10.498 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.492+0000 7fefef7fe6c0 1 -- 10.20.193.92:0/1468576514 <== mon.1 v2:10.20.193.158:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feffc0071c0 con 0x7ff008115410 2026-02-13T04:01:10.498 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.492+0000 7ff0104a56c0 1 -- 10.20.193.92:0/1468576514 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0081639f0 con 0x7ff008115410 2026-02-13T04:01:10.498 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.493+0000 7ff0104a56c0 1 -- 10.20.193.92:0/1468576514 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff008163e80 con 0x7ff008115410 2026-02-13T04:01:10.498 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.493+0000 7ff0104a56c0 1 -- 10.20.193.92:0/1468576514 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0081104d0 con 0x7ff008115410 2026-02-13T04:01:10.498 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.495+0000 7fefef7fe6c0 1 -- 10.20.193.92:0/1468576514 <== mon.1 v2:10.20.193.158:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7feffc0043b0 con 0x7ff008115410 2026-02-13T04:01:10.500 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.497+0000 7fefef7fe6c0 1 --2- 10.20.193.92:0/1468576514 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fefe40b5760 0x7fefe40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:10.500 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.497+0000 7fefef7fe6c0 1 -- 10.20.193.92:0/1468576514 <== mon.1 v2:10.20.193.158:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7feffc0e3b00 con 0x7ff008115410 2026-02-13T04:01:10.500 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.497+0000 7ff00e2166c0 1 --2- 10.20.193.92:0/1468576514 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fefe40b5760 0x7fefe40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:10.500 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.497+0000 7fefef7fe6c0 1 -- 10.20.193.92:0/1468576514 <== mon.1 v2:10.20.193.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7feffc11c5e0 con 0x7ff008115410 2026-02-13T04:01:10.500 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.497+0000 7ff00e2166c0 1 --2- 10.20.193.92:0/1468576514 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fefe40b5760 0x7fefe40d5c10 secure :-1 s=READY pgs=186 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feff8004750 tx=0x7feff8009390 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:10.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:10 trial158 ceph-mon[27763]: pgmap v187: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 7.4 KiB/s wr, 18 op/s 2026-02-13T04:01:10.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:10 trial158 ceph-mon[27763]: from='client.14991 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T04:01:10.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:10 trial099 ceph-mon[27808]: pgmap v187: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 7.4 KiB/s wr, 18 op/s 2026-02-13T04:01:10.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:10 trial099 ceph-mon[27808]: from='client.14991 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T04:01:10.625 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.622+0000 7ff0104a56c0 1 -- 10.20.193.92:0/1468576514 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff00810f5d0 con 0x7ff008115410 2026-02-13T04:01:10.625 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.622+0000 7fefef7fe6c0 1 -- 10.20.193.92:0/1468576514 <== mon.1 v2:10.20.193.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7feffc0a6450 con 0x7ff008115410 2026-02-13T04:01:10.626 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:01:10.626 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:01:10.627 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.623+0000 7ff0104a56c0 1 -- 10.20.193.92:0/1468576514 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fefe40b5760 msgr2=0x7fefe40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:10.627 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.623+0000 7ff0104a56c0 1 --2- 10.20.193.92:0/1468576514 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fefe40b5760 0x7fefe40d5c10 secure :-1 s=READY pgs=186 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feff8004750 tx=0x7feff8009390 comp rx=0 tx=0).stop 2026-02-13T04:01:10.627 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.623+0000 7ff0104a56c0 1 -- 10.20.193.92:0/1468576514 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff008115410 msgr2=0x7ff00811d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:10.627 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.623+0000 7ff0104a56c0 1 --2- 10.20.193.92:0/1468576514 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff008115410 0x7ff00811d440 secure :-1 s=READY pgs=105 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feffc00b6c0 tx=0x7feffc00bb90 comp rx=0 tx=0).stop 2026-02-13T04:01:10.627 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.623+0000 7ff0104a56c0 1 -- 10.20.193.92:0/1468576514 shutdown_connections 2026-02-13T04:01:10.627 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.623+0000 7ff0104a56c0 1 --2- 10.20.193.92:0/1468576514 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fefe40b5760 0x7fefe40d5c10 unknown :-1 s=CLOSED pgs=186 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:10.627 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.623+0000 7ff0104a56c0 1 --2- 10.20.193.92:0/1468576514 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff008122800 0x7ff008122ca0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:10.627 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.623+0000 7ff0104a56c0 1 --2- 10.20.193.92:0/1468576514 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff008115410 0x7ff00811d440 unknown :-1 s=CLOSED pgs=105 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:10.627 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.623+0000 7ff0104a56c0 1 --2- 10.20.193.92:0/1468576514 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff00810f200 0x7ff00811cf00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:10.627 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.623+0000 7ff0104a56c0 1 -- 10.20.193.92:0/1468576514 >> 10.20.193.92:0/1468576514 conn(0x7ff0080ecb00 msgr2=0x7ff00810cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:10.628 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.623+0000 7ff0104a56c0 1 -- 10.20.193.92:0/1468576514 shutdown_connections 2026-02-13T04:01:10.628 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:10.624+0000 7ff0104a56c0 1 -- 10.20.193.92:0/1468576514 wait complete. 2026-02-13T04:01:11.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:11 trial092 ceph-mon[23047]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T04:01:11.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:11 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1468576514' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:01:11.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:11 trial158 ceph-mon[27763]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T04:01:11.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:11 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/1468576514' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:01:11.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:11 trial099 ceph-mon[27808]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2026-02-13T04:01:11.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:11 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/1468576514' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:01:12.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:12 trial092 ceph-mon[23047]: pgmap v188: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 6.1 KiB/s wr, 14 op/s 2026-02-13T04:01:12.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:12 trial158 ceph-mon[27763]: pgmap v188: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 6.1 KiB/s wr, 14 op/s 2026-02-13T04:01:12.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:12 trial099 ceph-mon[27808]: pgmap v188: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 11 KiB/s rd, 6.1 KiB/s wr, 14 op/s 2026-02-13T04:01:13.730 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:01:13.913 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:14.108 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.104+0000 7faa91aac6c0 1 -- 10.20.193.92:0/3587396752 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7faa8c1137a0 msgr2=0x7faa8c113b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:14.108 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.104+0000 7faa91aac6c0 1 --2- 10.20.193.92:0/3587396752 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7faa8c1137a0 0x7faa8c113b70 secure :-1 s=READY pgs=234 gs=2 cs=0 l=1 c_cookie=4227236248141938894 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa78009970 tx=0x7faa7802ed10 comp rx=0 tx=0).stop 2026-02-13T04:01:14.108 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.104+0000 7faa91aac6c0 1 -- 10.20.193.92:0/3587396752 shutdown_connections 2026-02-13T04:01:14.108 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.104+0000 7faa91aac6c0 1 --2- 10.20.193.92:0/3587396752 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7faa8c114190 0x7faa8c119140 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:14.109 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.104+0000 7faa91aac6c0 1 --2- 10.20.193.92:0/3587396752 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7faa8c1198f0 0x7faa8c17a2c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:14.109 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.104+0000 7faa91aac6c0 1 --2- 10.20.193.92:0/3587396752 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7faa8c1137a0 0x7faa8c113b70 unknown :-1 s=CLOSED pgs=234 gs=2 cs=0 l=1 c_cookie=4227236248141938894 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:14.109 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.104+0000 7faa91aac6c0 1 -- 10.20.193.92:0/3587396752 >> 10.20.193.92:0/3587396752 conn(0x7faa8c060760 msgr2=0x7faa8c060d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:14.109 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.104+0000 7faa91aac6c0 1 -- 10.20.193.92:0/3587396752 shutdown_connections 2026-02-13T04:01:14.109 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.104+0000 7faa91aac6c0 1 -- 10.20.193.92:0/3587396752 wait complete. 2026-02-13T04:01:14.109 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.105+0000 7faa91aac6c0 1 Processor -- start 2026-02-13T04:01:14.109 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.105+0000 7faa91aac6c0 1 -- start start 2026-02-13T04:01:14.111 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.105+0000 7faa91aac6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7faa8c1137a0 0x7faa8c1214c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:14.111 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.105+0000 7faa91aac6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7faa8c1198f0 0x7faa8c121a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:14.111 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.106+0000 7faa91aac6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7faa8c126dc0 0x7faa8c127260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:14.111 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.106+0000 7faa91aac6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7faa8c1277d0 con 0x7faa8c1137a0 2026-02-13T04:01:14.111 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.106+0000 7faa91aac6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7faa8c127940 con 0x7faa8c1198f0 2026-02-13T04:01:14.111 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.106+0000 7faa91aac6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7faa8c127b00 con 0x7faa8c126dc0 2026-02-13T04:01:14.111 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.106+0000 7faa8b7fe6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7faa8c1137a0 0x7faa8c1214c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:14.112 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.106+0000 7faa8affd6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7faa8c1198f0 0x7faa8c121a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:14.112 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.106+0000 7faa8b7fe6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7faa8c1137a0 0x7faa8c1214c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:53680/0 (socket says 10.20.193.92:53680) 2026-02-13T04:01:14.112 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.106+0000 7faa8b7fe6c0 1 -- 10.20.193.92:0/1722906482 learned_addr learned my addr 10.20.193.92:0/1722906482 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:14.112 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.106+0000 7faa8bfff6c0 1 --2- 10.20.193.92:0/1722906482 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7faa8c126dc0 0x7faa8c127260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:14.112 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.106+0000 7faa8affd6c0 1 -- 10.20.193.92:0/1722906482 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7faa8c126dc0 msgr2=0x7faa8c127260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:14.112 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.106+0000 7faa8affd6c0 1 --2- 10.20.193.92:0/1722906482 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7faa8c126dc0 0x7faa8c127260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:14.112 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.106+0000 7faa8affd6c0 1 -- 10.20.193.92:0/1722906482 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7faa8c1137a0 msgr2=0x7faa8c1214c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:14.112 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.106+0000 7faa8affd6c0 1 --2- 10.20.193.92:0/1722906482 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7faa8c1137a0 0x7faa8c1214c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:14.112 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.106+0000 7faa8affd6c0 1 -- 10.20.193.92:0/1722906482 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa7c0094c0 con 0x7faa8c1198f0 2026-02-13T04:01:14.112 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.106+0000 7faa8b7fe6c0 1 --2- 10.20.193.92:0/1722906482 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7faa8c1137a0 0x7faa8c1214c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T04:01:14.112 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.106+0000 7faa8affd6c0 1 --2- 10.20.193.92:0/1722906482 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7faa8c1198f0 0x7faa8c121a00 secure :-1 s=READY pgs=107 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa7c00ba30 tx=0x7faa7c00bf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:14.113 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.106+0000 7faa88ff96c0 1 -- 10.20.193.92:0/1722906482 <== mon.2 v2:10.20.193.99:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faa7c004460 con 0x7faa8c1198f0 2026-02-13T04:01:14.113 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.106+0000 7faa88ff96c0 1 -- 10.20.193.92:0/1722906482 <== mon.2 v2:10.20.193.99:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7faa7c0045c0 con 0x7faa8c1198f0 2026-02-13T04:01:14.113 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.106+0000 7faa91aac6c0 1 -- 10.20.193.92:0/1722906482 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa78009590 con 0x7faa8c1198f0 2026-02-13T04:01:14.113 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.106+0000 7faa88ff96c0 1 -- 10.20.193.92:0/1722906482 <== mon.2 v2:10.20.193.99:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faa7c0071c0 con 0x7faa8c1198f0 2026-02-13T04:01:14.113 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.107+0000 7faa91aac6c0 1 -- 10.20.193.92:0/1722906482 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa8c168300 con 0x7faa8c1198f0 2026-02-13T04:01:14.113 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.107+0000 7faa91aac6c0 1 -- 10.20.193.92:0/1722906482 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa8c1149e0 con 0x7faa8c1198f0 2026-02-13T04:01:14.114 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.109+0000 7faa88ff96c0 1 -- 10.20.193.92:0/1722906482 <== mon.2 v2:10.20.193.99:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7faa7c00c510 con 0x7faa8c1198f0 2026-02-13T04:01:14.114 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.111+0000 7faa88ff96c0 1 --2- 10.20.193.92:0/1722906482 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7faa600b5760 0x7faa600d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:14.114 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.111+0000 7faa88ff96c0 1 -- 10.20.193.92:0/1722906482 <== mon.2 v2:10.20.193.99:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7faa7c0e3c60 con 0x7faa8c1198f0 2026-02-13T04:01:14.114 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.111+0000 7faa88ff96c0 1 -- 10.20.193.92:0/1722906482 <== mon.2 v2:10.20.193.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7faa7c0e40e0 con 0x7faa8c1198f0 2026-02-13T04:01:14.114 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.111+0000 7faa8b7fe6c0 1 --2- 10.20.193.92:0/1722906482 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7faa600b5760 0x7faa600d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:14.115 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.111+0000 7faa8b7fe6c0 1 --2- 10.20.193.92:0/1722906482 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7faa600b5760 0x7faa600d5c10 secure :-1 s=READY pgs=187 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa780023e0 tx=0x7faa78005910 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:14.238 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.235+0000 7faa91aac6c0 1 -- 10.20.193.92:0/1722906482 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7faa8c122610 con 0x7faa8c1198f0 2026-02-13T04:01:14.238 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.235+0000 7faa88ff96c0 1 -- 10.20.193.92:0/1722906482 <== mon.2 v2:10.20.193.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7faa7c0a65b0 con 0x7faa8c1198f0 2026-02-13T04:01:14.238 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:01:14.238 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:01:14.239 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.236+0000 7faa91aac6c0 1 -- 10.20.193.92:0/1722906482 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7faa600b5760 msgr2=0x7faa600d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:14.239 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.236+0000 7faa91aac6c0 1 --2- 10.20.193.92:0/1722906482 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7faa600b5760 0x7faa600d5c10 secure :-1 s=READY pgs=187 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa780023e0 tx=0x7faa78005910 comp rx=0 tx=0).stop 2026-02-13T04:01:14.240 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.236+0000 7faa91aac6c0 1 -- 10.20.193.92:0/1722906482 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7faa8c1198f0 msgr2=0x7faa8c121a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:14.240 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.236+0000 7faa91aac6c0 1 --2- 10.20.193.92:0/1722906482 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7faa8c1198f0 0x7faa8c121a00 secure :-1 s=READY pgs=107 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faa7c00ba30 tx=0x7faa7c00bf00 comp rx=0 tx=0).stop 2026-02-13T04:01:14.240 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.236+0000 7faa91aac6c0 1 -- 10.20.193.92:0/1722906482 shutdown_connections 2026-02-13T04:01:14.240 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.236+0000 7faa91aac6c0 1 --2- 10.20.193.92:0/1722906482 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7faa600b5760 0x7faa600d5c10 unknown :-1 s=CLOSED pgs=187 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:14.240 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.236+0000 7faa91aac6c0 1 --2- 10.20.193.92:0/1722906482 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7faa8c1198f0 0x7faa8c121a00 unknown :-1 s=CLOSED pgs=107 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:14.240 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.236+0000 7faa91aac6c0 1 --2- 10.20.193.92:0/1722906482 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7faa8c126dc0 0x7faa8c127260 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:14.240 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.236+0000 7faa91aac6c0 1 --2- 10.20.193.92:0/1722906482 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7faa8c1137a0 0x7faa8c1214c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:14.240 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.236+0000 7faa91aac6c0 1 -- 10.20.193.92:0/1722906482 >> 10.20.193.92:0/1722906482 conn(0x7faa8c060760 msgr2=0x7faa8c115a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:14.240 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.236+0000 7faa91aac6c0 1 -- 10.20.193.92:0/1722906482 shutdown_connections 2026-02-13T04:01:14.240 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:14.236+0000 7faa91aac6c0 1 -- 10.20.193.92:0/1722906482 wait complete. 2026-02-13T04:01:14.300 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:14 trial092 ceph-mon[23047]: pgmap v189: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 5.8 KiB/s wr, 14 op/s 2026-02-13T04:01:14.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:14 trial158 ceph-mon[27763]: pgmap v189: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 5.8 KiB/s wr, 14 op/s 2026-02-13T04:01:14.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:14 trial099 ceph-mon[27808]: pgmap v189: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 12 KiB/s rd, 5.8 KiB/s wr, 14 op/s 2026-02-13T04:01:15.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:15 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1722906482' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:01:15.578 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:15 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/1722906482' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:01:15.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:15 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/1722906482' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:01:16.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:16 trial158 ceph-mon[27763]: pgmap v190: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2026-02-13T04:01:16.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:16 trial099 ceph-mon[27808]: pgmap v190: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2026-02-13T04:01:16.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:16 trial092 ceph-mon[23047]: pgmap v190: 97 pgs: 97 active+clean; 649 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2026-02-13T04:01:17.344 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:01:17.531 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:17.729 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.725+0000 7f9d1d8036c0 1 -- 10.20.193.92:0/1783491746 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9d18159910 msgr2=0x7f9d18179cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:17.729 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.725+0000 7f9d1d8036c0 1 --2- 10.20.193.92:0/1783491746 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9d18159910 0x7f9d18179cf0 secure :-1 s=READY pgs=235 gs=2 cs=0 l=1 c_cookie=12570251417897893990 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d1400aa40 tx=0x7f9d1402fde0 comp rx=0 tx=0).stop 2026-02-13T04:01:17.729 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.725+0000 7f9d1d8036c0 1 -- 10.20.193.92:0/1783491746 shutdown_connections 2026-02-13T04:01:17.729 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.725+0000 7f9d1d8036c0 1 --2- 10.20.193.92:0/1783491746 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9d18060ce0 0x7f9d18061110 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:17.730 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.725+0000 7f9d1d8036c0 1 --2- 10.20.193.92:0/1783491746 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9d18159910 0x7f9d18179cf0 unknown :-1 s=CLOSED pgs=235 gs=2 cs=0 l=1 c_cookie=12570251417897893990 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:17.730 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.725+0000 7f9d1d8036c0 1 --2- 10.20.193.92:0/1783491746 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f9d180622d0 0x7f9d180607a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:17.730 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.725+0000 7f9d1d8036c0 1 -- 10.20.193.92:0/1783491746 >> 10.20.193.92:0/1783491746 conn(0x7f9d180ea6d0 msgr2=0x7f9d1810aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:17.730 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.725+0000 7f9d1d8036c0 1 -- 10.20.193.92:0/1783491746 shutdown_connections 2026-02-13T04:01:17.730 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.726+0000 7f9d1d8036c0 1 -- 10.20.193.92:0/1783491746 wait complete. 2026-02-13T04:01:17.730 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.726+0000 7f9d1d8036c0 1 Processor -- start 2026-02-13T04:01:17.730 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.726+0000 7f9d1d8036c0 1 -- start start 2026-02-13T04:01:17.732 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.726+0000 7f9d1d8036c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f9d18060ce0 0x7f9d18161000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:17.732 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.726+0000 7f9d1d8036c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9d180622d0 0x7f9d18161540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:17.732 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.726+0000 7f9d1d8036c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9d18159910 0x7f9d18166900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:17.732 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.726+0000 7f9d1d8036c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9d18166f50 con 0x7f9d180622d0 2026-02-13T04:01:17.732 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.726+0000 7f9d1d8036c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9d181670c0 con 0x7f9d18159910 2026-02-13T04:01:17.732 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.726+0000 7f9d1d8036c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f9d18167280 con 0x7f9d18060ce0 2026-02-13T04:01:17.732 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.727+0000 7f9d0ffff6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9d180622d0 0x7f9d18161540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:17.732 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.727+0000 7f9d0ffff6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9d180622d0 0x7f9d18161540 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:46770/0 (socket says 10.20.193.92:46770) 2026-02-13T04:01:17.732 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.727+0000 7f9d0ffff6c0 1 -- 10.20.193.92:0/2969887117 learned_addr learned my addr 10.20.193.92:0/2969887117 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:17.732 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.727+0000 7f9d1c8016c0 1 --2- 10.20.193.92:0/2969887117 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f9d18060ce0 0x7f9d18161000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:17.732 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.727+0000 7f9d1d0026c0 1 --2- 10.20.193.92:0/2969887117 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9d18159910 0x7f9d18166900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:17.733 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.727+0000 7f9d0ffff6c0 1 -- 10.20.193.92:0/2969887117 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f9d18060ce0 msgr2=0x7f9d18161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:17.733 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.727+0000 7f9d0ffff6c0 1 --2- 10.20.193.92:0/2969887117 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f9d18060ce0 0x7f9d18161000 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:17.733 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.727+0000 7f9d0ffff6c0 1 -- 10.20.193.92:0/2969887117 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9d18159910 msgr2=0x7f9d18166900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:17.733 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.727+0000 7f9d0ffff6c0 1 --2- 10.20.193.92:0/2969887117 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9d18159910 0x7f9d18166900 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:17.733 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.727+0000 7f9d0ffff6c0 1 -- 10.20.193.92:0/2969887117 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d1400a660 con 0x7f9d180622d0 2026-02-13T04:01:17.733 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.727+0000 7f9d0ffff6c0 1 --2- 10.20.193.92:0/2969887117 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9d180622d0 0x7f9d18161540 secure :-1 s=READY pgs=236 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d000092e0 tx=0x7f9d0000bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:17.733 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.727+0000 7f9d0dffb6c0 1 -- 10.20.193.92:0/2969887117 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9d00004250 con 0x7f9d180622d0 2026-02-13T04:01:17.733 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.727+0000 7f9d1d8036c0 1 -- 10.20.193.92:0/2969887117 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d18167560 con 0x7f9d180622d0 2026-02-13T04:01:17.733 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.727+0000 7f9d0dffb6c0 1 -- 10.20.193.92:0/2969887117 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f9d000043b0 con 0x7f9d180622d0 2026-02-13T04:01:17.733 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.727+0000 7f9d1d8036c0 1 -- 10.20.193.92:0/2969887117 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d18167c20 con 0x7f9d180622d0 2026-02-13T04:01:17.733 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.727+0000 7f9d0dffb6c0 1 -- 10.20.193.92:0/2969887117 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9d000072a0 con 0x7f9d180622d0 2026-02-13T04:01:17.733 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.728+0000 7f9d1d8036c0 1 -- 10.20.193.92:0/2969887117 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d18061cb0 con 0x7f9d180622d0 2026-02-13T04:01:17.734 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.730+0000 7f9d0dffb6c0 1 -- 10.20.193.92:0/2969887117 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f9d0000c560 con 0x7f9d180622d0 2026-02-13T04:01:17.735 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.731+0000 7f9d0dffb6c0 1 --2- 10.20.193.92:0/2969887117 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f9cf40b5760 0x7f9cf40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:17.735 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.732+0000 7f9d0dffb6c0 1 -- 10.20.193.92:0/2969887117 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7f9d000e3a80 con 0x7f9d180622d0 2026-02-13T04:01:17.735 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.732+0000 7f9d1c8016c0 1 --2- 10.20.193.92:0/2969887117 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f9cf40b5760 0x7f9cf40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:17.735 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.732+0000 7f9d0dffb6c0 1 -- 10.20.193.92:0/2969887117 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f9d000a63d0 con 0x7f9d180622d0 2026-02-13T04:01:17.735 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.732+0000 7f9d1c8016c0 1 --2- 10.20.193.92:0/2969887117 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f9cf40b5760 0x7f9cf40d5c10 secure :-1 s=READY pgs=188 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d08004750 tx=0x7f9d08009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:17.859 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.856+0000 7f9d1d8036c0 1 -- 10.20.193.92:0/2969887117 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9d18061110 con 0x7f9d180622d0 2026-02-13T04:01:17.860 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.857+0000 7f9d0dffb6c0 1 -- 10.20.193.92:0/2969887117 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f9d000a9580 con 0x7f9d180622d0 2026-02-13T04:01:17.860 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:01:17.860 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:01:17.861 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.858+0000 7f9d1d8036c0 1 -- 10.20.193.92:0/2969887117 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f9cf40b5760 msgr2=0x7f9cf40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:17.861 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.858+0000 7f9d1d8036c0 1 --2- 10.20.193.92:0/2969887117 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f9cf40b5760 0x7f9cf40d5c10 secure :-1 s=READY pgs=188 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d08004750 tx=0x7f9d08009260 comp rx=0 tx=0).stop 2026-02-13T04:01:17.861 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.858+0000 7f9d1d8036c0 1 -- 10.20.193.92:0/2969887117 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9d180622d0 msgr2=0x7f9d18161540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:17.861 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.858+0000 7f9d1d8036c0 1 --2- 10.20.193.92:0/2969887117 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9d180622d0 0x7f9d18161540 secure :-1 s=READY pgs=236 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d000092e0 tx=0x7f9d0000bc50 comp rx=0 tx=0).stop 2026-02-13T04:01:17.862 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.858+0000 7f9d1d8036c0 1 -- 10.20.193.92:0/2969887117 shutdown_connections 2026-02-13T04:01:17.862 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.858+0000 7f9d1d8036c0 1 --2- 10.20.193.92:0/2969887117 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f9cf40b5760 0x7f9cf40d5c10 unknown :-1 s=CLOSED pgs=188 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:17.862 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.858+0000 7f9d1d8036c0 1 --2- 10.20.193.92:0/2969887117 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9d18159910 0x7f9d18166900 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:17.862 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.858+0000 7f9d1d8036c0 1 --2- 10.20.193.92:0/2969887117 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9d180622d0 0x7f9d18161540 unknown :-1 s=CLOSED pgs=236 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:17.862 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.858+0000 7f9d1d8036c0 1 --2- 10.20.193.92:0/2969887117 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f9d18060ce0 0x7f9d18161000 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:17.862 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.858+0000 7f9d1d8036c0 1 -- 10.20.193.92:0/2969887117 >> 10.20.193.92:0/2969887117 conn(0x7f9d180ea6d0 msgr2=0x7f9d1810aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:17.862 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.858+0000 7f9d1d8036c0 1 -- 10.20.193.92:0/2969887117 shutdown_connections 2026-02-13T04:01:17.862 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:17.858+0000 7f9d1d8036c0 1 -- 10.20.193.92:0/2969887117 wait complete. 2026-02-13T04:01:18.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:18 trial158 ceph-mon[27763]: pgmap v191: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.1 KiB/s rd, 426 B/s wr, 9 op/s 2026-02-13T04:01:18.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:18 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/2969887117' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:01:18.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:18 trial099 ceph-mon[27808]: pgmap v191: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.1 KiB/s rd, 426 B/s wr, 9 op/s 2026-02-13T04:01:18.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:18 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/2969887117' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:01:18.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:18 trial092 ceph-mon[23047]: pgmap v191: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.1 KiB/s rd, 426 B/s wr, 9 op/s 2026-02-13T04:01:18.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:18 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/2969887117' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:01:20.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:20 trial158 ceph-mon[27763]: pgmap v192: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 426 B/s wr, 9 op/s 2026-02-13T04:01:20.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:20 trial099 ceph-mon[27808]: pgmap v192: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 426 B/s wr, 9 op/s 2026-02-13T04:01:20.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:20 trial092 ceph-mon[23047]: pgmap v192: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 426 B/s wr, 9 op/s 2026-02-13T04:01:20.967 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:01:21.153 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:21.342 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.339+0000 7fd6c35776c0 1 -- 10.20.193.92:0/261457399 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd6c41157f0 msgr2=0x7fd6c4115bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:21.342 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.339+0000 7fd6c35776c0 1 --2- 10.20.193.92:0/261457399 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd6c41157f0 0x7fd6c4115bc0 secure :-1 s=READY pgs=106 gs=3 cs=0 l=1 c_cookie=17363648086234548399 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6b80099a0 tx=0x7fd6b802ed00 comp rx=0 tx=0).stop 2026-02-13T04:01:21.342 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.339+0000 7fd6c35776c0 1 -- 10.20.193.92:0/261457399 shutdown_connections 2026-02-13T04:01:21.343 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.339+0000 7fd6c35776c0 1 --2- 10.20.193.92:0/261457399 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fd6c41161e0 0x7fd6c411b220 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:21.343 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.339+0000 7fd6c35776c0 1 --2- 10.20.193.92:0/261457399 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd6c411ba00 0x7fd6c417c3a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:21.343 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.339+0000 7fd6c35776c0 1 --2- 10.20.193.92:0/261457399 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd6c41157f0 0x7fd6c4115bc0 unknown :-1 s=CLOSED pgs=106 gs=3 cs=0 l=1 c_cookie=17363648086234548399 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:21.343 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.339+0000 7fd6c35776c0 1 -- 10.20.193.92:0/261457399 >> 10.20.193.92:0/261457399 conn(0x7fd6c405dc80 msgr2=0x7fd6c405e080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:21.343 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.339+0000 7fd6c35776c0 1 -- 10.20.193.92:0/261457399 shutdown_connections 2026-02-13T04:01:21.343 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.339+0000 7fd6c35776c0 1 -- 10.20.193.92:0/261457399 wait complete. 2026-02-13T04:01:21.344 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.340+0000 7fd6c35776c0 1 Processor -- start 2026-02-13T04:01:21.345 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.340+0000 7fd6c35776c0 1 -- start start 2026-02-13T04:01:21.345 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.340+0000 7fd6c35776c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd6c41157f0 0x7fd6c40fe3c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:21.345 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.340+0000 7fd6c35776c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fd6c411ba00 0x7fd6c417c2a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:21.345 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.340+0000 7fd6c35776c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd6c40fe9f0 0x7fd6c4103cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:21.345 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.340+0000 7fd6c35776c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c40ff0e0 con 0x7fd6c41157f0 2026-02-13T04:01:21.345 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.340+0000 7fd6c35776c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c4104200 con 0x7fd6c411ba00 2026-02-13T04:01:21.345 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.340+0000 7fd6c35776c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fd6c41043c0 con 0x7fd6c40fe9f0 2026-02-13T04:01:21.345 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.340+0000 7fd6c25756c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd6c41157f0 0x7fd6c40fe3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:21.345 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.341+0000 7fd6c2d766c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd6c40fe9f0 0x7fd6c4103cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:21.345 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.341+0000 7fd6c25756c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd6c41157f0 0x7fd6c40fe3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:46788/0 (socket says 10.20.193.92:46788) 2026-02-13T04:01:21.345 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.341+0000 7fd6c25756c0 1 -- 10.20.193.92:0/3603560085 learned_addr learned my addr 10.20.193.92:0/3603560085 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:21.346 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.341+0000 7fd6c1d746c0 1 --2- 10.20.193.92:0/3603560085 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fd6c411ba00 0x7fd6c417c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:21.346 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.341+0000 7fd6c25756c0 1 -- 10.20.193.92:0/3603560085 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd6c40fe9f0 msgr2=0x7fd6c4103cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:21.346 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.341+0000 7fd6c25756c0 1 --2- 10.20.193.92:0/3603560085 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd6c40fe9f0 0x7fd6c4103cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:21.346 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.341+0000 7fd6c25756c0 1 -- 10.20.193.92:0/3603560085 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fd6c411ba00 msgr2=0x7fd6c417c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:21.346 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.341+0000 7fd6c25756c0 1 --2- 10.20.193.92:0/3603560085 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fd6c411ba00 0x7fd6c417c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:21.346 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.341+0000 7fd6c25756c0 1 -- 10.20.193.92:0/3603560085 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6b8009590 con 0x7fd6c41157f0 2026-02-13T04:01:21.346 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.341+0000 7fd6c2d766c0 1 --2- 10.20.193.92:0/3603560085 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd6c40fe9f0 0x7fd6c4103cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T04:01:21.346 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.341+0000 7fd6c25756c0 1 --2- 10.20.193.92:0/3603560085 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd6c41157f0 0x7fd6c40fe3c0 secure :-1 s=READY pgs=237 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6b802f210 tx=0x7fd6b802f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:21.346 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.341+0000 7fd6ab7fe6c0 1 -- 10.20.193.92:0/3603560085 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6b8005e90 con 0x7fd6c41157f0 2026-02-13T04:01:21.346 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.341+0000 7fd6c35776c0 1 -- 10.20.193.92:0/3603560085 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6c4104640 con 0x7fd6c41157f0 2026-02-13T04:01:21.346 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.341+0000 7fd6c35776c0 1 -- 10.20.193.92:0/3603560085 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6c4104b10 con 0x7fd6c41157f0 2026-02-13T04:01:21.347 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.341+0000 7fd6ab7fe6c0 1 -- 10.20.193.92:0/3603560085 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fd6b80046b0 con 0x7fd6c41157f0 2026-02-13T04:01:21.347 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.341+0000 7fd6ab7fe6c0 1 -- 10.20.193.92:0/3603560085 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd6b80073f0 con 0x7fd6c41157f0 2026-02-13T04:01:21.347 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.342+0000 7fd6c35776c0 1 -- 10.20.193.92:0/3603560085 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6c4116ac0 con 0x7fd6c41157f0 2026-02-13T04:01:21.347 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.344+0000 7fd6ab7fe6c0 1 -- 10.20.193.92:0/3603560085 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fd6b80310c0 con 0x7fd6c41157f0 2026-02-13T04:01:21.349 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.346+0000 7fd6ab7fe6c0 1 --2- 10.20.193.92:0/3603560085 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fd69c0b5760 0x7fd69c0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:21.349 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.346+0000 7fd6ab7fe6c0 1 -- 10.20.193.92:0/3603560085 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7fd6b8107c10 con 0x7fd6c41157f0 2026-02-13T04:01:21.349 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.346+0000 7fd6c1d746c0 1 --2- 10.20.193.92:0/3603560085 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fd69c0b5760 0x7fd69c0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:21.349 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.346+0000 7fd6ab7fe6c0 1 -- 10.20.193.92:0/3603560085 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd6b8108090 con 0x7fd6c41157f0 2026-02-13T04:01:21.349 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.346+0000 7fd6c1d746c0 1 --2- 10.20.193.92:0/3603560085 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fd69c0b5760 0x7fd69c0d5c10 secure :-1 s=READY pgs=189 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6c4104d50 tx=0x7fd6ac009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:21.472 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.469+0000 7fd6c35776c0 1 -- 10.20.193.92:0/3603560085 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd6c41161e0 con 0x7fd6c41157f0 2026-02-13T04:01:21.473 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.470+0000 7fd6ab7fe6c0 1 -- 10.20.193.92:0/3603560085 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fd6b80ca560 con 0x7fd6c41157f0 2026-02-13T04:01:21.473 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:01:21.473 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:01:21.474 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.471+0000 7fd6c35776c0 1 -- 10.20.193.92:0/3603560085 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fd69c0b5760 msgr2=0x7fd69c0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:21.474 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.471+0000 7fd6c35776c0 1 --2- 10.20.193.92:0/3603560085 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fd69c0b5760 0x7fd69c0d5c10 secure :-1 s=READY pgs=189 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6c4104d50 tx=0x7fd6ac009260 comp rx=0 tx=0).stop 2026-02-13T04:01:21.474 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.471+0000 7fd6c35776c0 1 -- 10.20.193.92:0/3603560085 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd6c41157f0 msgr2=0x7fd6c40fe3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:21.474 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.471+0000 7fd6c35776c0 1 --2- 10.20.193.92:0/3603560085 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd6c41157f0 0x7fd6c40fe3c0 secure :-1 s=READY pgs=237 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6b802f210 tx=0x7fd6b802f810 comp rx=0 tx=0).stop 2026-02-13T04:01:21.475 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.471+0000 7fd6c35776c0 1 -- 10.20.193.92:0/3603560085 shutdown_connections 2026-02-13T04:01:21.475 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.471+0000 7fd6c35776c0 1 --2- 10.20.193.92:0/3603560085 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fd69c0b5760 0x7fd69c0d5c10 unknown :-1 s=CLOSED pgs=189 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:21.475 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.471+0000 7fd6c35776c0 1 --2- 10.20.193.92:0/3603560085 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fd6c411ba00 0x7fd6c417c2a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:21.475 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.471+0000 7fd6c35776c0 1 --2- 10.20.193.92:0/3603560085 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd6c40fe9f0 0x7fd6c4103cc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:21.475 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.471+0000 7fd6c35776c0 1 --2- 10.20.193.92:0/3603560085 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd6c41157f0 0x7fd6c40fe3c0 unknown :-1 s=CLOSED pgs=237 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:21.475 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.471+0000 7fd6c35776c0 1 -- 10.20.193.92:0/3603560085 >> 10.20.193.92:0/3603560085 conn(0x7fd6c405dc80 msgr2=0x7fd6c41177a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:21.475 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.471+0000 7fd6c35776c0 1 -- 10.20.193.92:0/3603560085 shutdown_connections 2026-02-13T04:01:21.475 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:21.471+0000 7fd6c35776c0 1 -- 10.20.193.92:0/3603560085 wait complete. 2026-02-13T04:01:22.493 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:22 trial092 ceph-mon[23047]: pgmap v193: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 9 op/s 2026-02-13T04:01:22.493 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:22 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/3603560085' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:01:22.578 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:22 trial158 ceph-mon[27763]: pgmap v193: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 9 op/s 2026-02-13T04:01:22.578 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:22 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/3603560085' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:01:22.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:22 trial099 ceph-mon[27808]: pgmap v193: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 426 B/s wr, 9 op/s 2026-02-13T04:01:22.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:22 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/3603560085' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:01:24.577 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:01:24.578 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:24 trial158 ceph-mon[27763]: pgmap v194: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 11 op/s 2026-02-13T04:01:24.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:24 trial099 ceph-mon[27808]: pgmap v194: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 11 op/s 2026-02-13T04:01:24.629 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:24 trial092 ceph-mon[23047]: pgmap v194: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 11 op/s 2026-02-13T04:01:24.765 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:24.960 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:24.957+0000 7f722c85f6c0 1 -- 10.20.193.92:0/616161395 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7228115270 msgr2=0x7f7228175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:24.960 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:24.957+0000 7f722c85f6c0 1 --2- 10.20.193.92:0/616161395 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7228115270 0x7f7228175c10 secure :-1 s=READY pgs=238 gs=1 cs=0 l=1 c_cookie=3553977841439124657 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f721800aa70 tx=0x7f721802fde0 comp rx=0 tx=0).stop 2026-02-13T04:01:24.960 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:24.957+0000 7f722c85f6c0 1 -- 10.20.193.92:0/616161395 shutdown_connections 2026-02-13T04:01:24.960 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:24.957+0000 7f722c85f6c0 1 --2- 10.20.193.92:0/616161395 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7228115270 0x7f7228175c10 unknown :-1 s=CLOSED pgs=238 gs=1 cs=0 l=1 c_cookie=3553977841439124657 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:24.960 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:24.957+0000 7f722c85f6c0 1 --2- 10.20.193.92:0/616161395 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f722810fa50 0x7f7228114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:24.960 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:24.957+0000 7f722c85f6c0 1 --2- 10.20.193.92:0/616161395 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f722810f060 0x7f722810f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:24.960 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:24.957+0000 7f722c85f6c0 1 -- 10.20.193.92:0/616161395 >> 10.20.193.92:0/616161395 conn(0x7f72280ec980 msgr2=0x7f722810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:24.960 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:24.957+0000 7f722c85f6c0 1 -- 10.20.193.92:0/616161395 shutdown_connections 2026-02-13T04:01:24.960 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:24.957+0000 7f722c85f6c0 1 -- 10.20.193.92:0/616161395 wait complete. 2026-02-13T04:01:24.960 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:24.958+0000 7f722c85f6c0 1 Processor -- start 2026-02-13T04:01:24.961 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:24.958+0000 7f722c85f6c0 1 -- start start 2026-02-13T04:01:24.961 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:24.958+0000 7f722c85f6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f722810f060 0x7f722811cd90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:24.961 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:24.958+0000 7f722c85f6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7228115270 0x7f722811d2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:24.961 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:24.958+0000 7f722c85f6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7228122690 0x7f7228122b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:24.961 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:24.958+0000 7f722c85f6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f72281230a0 con 0x7f722810f060 2026-02-13T04:01:24.961 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:24.958+0000 7f722c85f6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7228123210 con 0x7f7228115270 2026-02-13T04:01:24.961 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:24.958+0000 7f722c85f6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f72281233d0 con 0x7f7228122690 2026-02-13T04:01:24.961 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:24.959+0000 7f7226d766c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f722810f060 0x7f722811cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:24.961 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:24.959+0000 7f7226d766c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f722810f060 0x7f722811cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:38208/0 (socket says 10.20.193.92:38208) 2026-02-13T04:01:24.961 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:24.959+0000 7f7226d766c0 1 -- 10.20.193.92:0/2322412502 learned_addr learned my addr 10.20.193.92:0/2322412502 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:24.961 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:24.959+0000 7f72275776c0 1 --2- 10.20.193.92:0/2322412502 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7228122690 0x7f7228122b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:24.961 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:24.959+0000 7f7226d766c0 1 -- 10.20.193.92:0/2322412502 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7228122690 msgr2=0x7f7228122b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:24.961 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:24.959+0000 7f7226d766c0 1 --2- 10.20.193.92:0/2322412502 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7228122690 0x7f7228122b30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:24.961 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:24.959+0000 7f7226d766c0 1 -- 10.20.193.92:0/2322412502 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7228115270 msgr2=0x7f722811d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:24.962 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:24.959+0000 7f72265756c0 1 --2- 10.20.193.92:0/2322412502 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7228115270 0x7f722811d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:24.962 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:24.959+0000 7f7226d766c0 1 --2- 10.20.193.92:0/2322412502 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7228115270 0x7f722811d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:24.962 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:24.959+0000 7f7226d766c0 1 -- 10.20.193.92:0/2322412502 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f721800a660 con 0x7f722810f060 2026-02-13T04:01:24.962 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:24.959+0000 7f72265756c0 1 --2- 10.20.193.92:0/2322412502 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7228115270 0x7f722811d2d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T04:01:24.962 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:24.959+0000 7f7226d766c0 1 --2- 10.20.193.92:0/2322412502 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f722810f060 0x7f722811cd90 secure :-1 s=READY pgs=239 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f721c009490 tx=0x7f721c00bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:24.962 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:24.959+0000 7f7207fff6c0 1 -- 10.20.193.92:0/2322412502 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f721c004a80 con 0x7f722810f060 2026-02-13T04:01:24.962 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:24.959+0000 7f7207fff6c0 1 -- 10.20.193.92:0/2322412502 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f721c009030 con 0x7f722810f060 2026-02-13T04:01:24.962 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:24.959+0000 7f7207fff6c0 1 -- 10.20.193.92:0/2322412502 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f721c007440 con 0x7f722810f060 2026-02-13T04:01:24.962 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:24.959+0000 7f722c85f6c0 1 -- 10.20.193.92:0/2322412502 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7228163880 con 0x7f722810f060 2026-02-13T04:01:24.962 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:24.959+0000 7f722c85f6c0 1 -- 10.20.193.92:0/2322412502 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7228163d10 con 0x7f722810f060 2026-02-13T04:01:24.962 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:24.960+0000 7f722c85f6c0 1 -- 10.20.193.92:0/2322412502 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7228110330 con 0x7f722810f060 2026-02-13T04:01:24.965 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:24.962+0000 7f7207fff6c0 1 -- 10.20.193.92:0/2322412502 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f721c004060 con 0x7f722810f060 2026-02-13T04:01:24.966 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:24.964+0000 7f7207fff6c0 1 --2- 10.20.193.92:0/2322412502 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f71fc0b5760 0x7f71fc0d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:24.967 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:24.964+0000 7f7207fff6c0 1 -- 10.20.193.92:0/2322412502 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7f721c0e3cc0 con 0x7f722810f060 2026-02-13T04:01:24.967 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:24.964+0000 7f7207fff6c0 1 -- 10.20.193.92:0/2322412502 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f721c0e4140 con 0x7f722810f060 2026-02-13T04:01:24.967 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:24.964+0000 7f72265756c0 1 --2- 10.20.193.92:0/2322412502 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f71fc0b5760 0x7f71fc0d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:24.967 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:24.965+0000 7f72265756c0 1 --2- 10.20.193.92:0/2322412502 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f71fc0b5760 0x7f71fc0d5c10 secure :-1 s=READY pgs=190 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7228123720 tx=0x7f7210009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:25.091 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:25.088+0000 7f722c85f6c0 1 -- 10.20.193.92:0/2322412502 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f722810f430 con 0x7f722810f060 2026-02-13T04:01:25.091 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:25.088+0000 7f7207fff6c0 1 -- 10.20.193.92:0/2322412502 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f721c0a6610 con 0x7f722810f060 2026-02-13T04:01:25.092 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:01:25.092 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:01:25.093 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:25.090+0000 7f722c85f6c0 1 -- 10.20.193.92:0/2322412502 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f71fc0b5760 msgr2=0x7f71fc0d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:25.093 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:25.090+0000 7f722c85f6c0 1 --2- 10.20.193.92:0/2322412502 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f71fc0b5760 0x7f71fc0d5c10 secure :-1 s=READY pgs=190 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7228123720 tx=0x7f7210009260 comp rx=0 tx=0).stop 2026-02-13T04:01:25.093 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:25.090+0000 7f722c85f6c0 1 -- 10.20.193.92:0/2322412502 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f722810f060 msgr2=0x7f722811cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:25.093 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:25.090+0000 7f722c85f6c0 1 --2- 10.20.193.92:0/2322412502 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f722810f060 0x7f722811cd90 secure :-1 s=READY pgs=239 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f721c009490 tx=0x7f721c00bca0 comp rx=0 tx=0).stop 2026-02-13T04:01:25.093 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:25.090+0000 7f722c85f6c0 1 -- 10.20.193.92:0/2322412502 shutdown_connections 2026-02-13T04:01:25.094 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:25.090+0000 7f722c85f6c0 1 --2- 10.20.193.92:0/2322412502 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f71fc0b5760 0x7f71fc0d5c10 unknown :-1 s=CLOSED pgs=190 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:25.094 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:25.090+0000 7f722c85f6c0 1 --2- 10.20.193.92:0/2322412502 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7228115270 0x7f722811d2d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:25.094 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:25.090+0000 7f722c85f6c0 1 --2- 10.20.193.92:0/2322412502 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7228122690 0x7f7228122b30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:25.094 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:25.090+0000 7f722c85f6c0 1 --2- 10.20.193.92:0/2322412502 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f722810f060 0x7f722811cd90 unknown :-1 s=CLOSED pgs=239 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:25.094 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:25.090+0000 7f722c85f6c0 1 -- 10.20.193.92:0/2322412502 >> 10.20.193.92:0/2322412502 conn(0x7f72280ec980 msgr2=0x7f722810cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:25.094 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:25.090+0000 7f722c85f6c0 1 -- 10.20.193.92:0/2322412502 shutdown_connections 2026-02-13T04:01:25.094 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:25.090+0000 7f722c85f6c0 1 -- 10.20.193.92:0/2322412502 wait complete. 2026-02-13T04:01:25.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:25 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/2322412502' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:01:25.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:25 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/2322412502' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:01:25.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:25 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/2322412502' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:01:26.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:26 trial158 ceph-mon[27763]: pgmap v195: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 426 B/s wr, 9 op/s 2026-02-13T04:01:26.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:26 trial099 ceph-mon[27808]: pgmap v195: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 426 B/s wr, 9 op/s 2026-02-13T04:01:26.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:26 trial092 ceph-mon[23047]: pgmap v195: 97 pgs: 97 active+clean; 653 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 426 B/s wr, 9 op/s 2026-02-13T04:01:28.234 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:01:28.419 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:28.461 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:28 trial092 ceph-mon[23047]: pgmap v196: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.9 KiB/s rd, 597 B/s wr, 11 op/s 2026-02-13T04:01:28.578 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:28 trial158 ceph-mon[27763]: pgmap v196: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.9 KiB/s rd, 597 B/s wr, 11 op/s 2026-02-13T04:01:28.607 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.605+0000 7fd338ea36c0 1 -- 10.20.193.92:0/313534599 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd33410fa50 msgr2=0x7fd334114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:28.607 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.605+0000 7fd338ea36c0 1 --2- 10.20.193.92:0/313534599 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd33410fa50 0x7fd334114a90 secure :-1 s=READY pgs=107 gs=1 cs=0 l=1 c_cookie=4007821859762100789 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3240099a0 tx=0x7fd32402ed00 comp rx=0 tx=0).stop 2026-02-13T04:01:28.608 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.605+0000 7fd338ea36c0 1 -- 10.20.193.92:0/313534599 shutdown_connections 2026-02-13T04:01:28.608 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.605+0000 7fd338ea36c0 1 --2- 10.20.193.92:0/313534599 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd334115270 0x7fd334175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:28.608 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.605+0000 7fd338ea36c0 1 --2- 10.20.193.92:0/313534599 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd33410fa50 0x7fd334114a90 unknown :-1 s=CLOSED pgs=107 gs=1 cs=0 l=1 c_cookie=4007821859762100789 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:28.608 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.605+0000 7fd338ea36c0 1 --2- 10.20.193.92:0/313534599 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fd33410f060 0x7fd33410f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:28.608 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.605+0000 7fd338ea36c0 1 -- 10.20.193.92:0/313534599 >> 10.20.193.92:0/313534599 conn(0x7fd3340ec980 msgr2=0x7fd33410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:28.608 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.605+0000 7fd338ea36c0 1 -- 10.20.193.92:0/313534599 shutdown_connections 2026-02-13T04:01:28.608 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.605+0000 7fd338ea36c0 1 -- 10.20.193.92:0/313534599 wait complete. 2026-02-13T04:01:28.608 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.605+0000 7fd338ea36c0 1 Processor -- start 2026-02-13T04:01:28.608 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.606+0000 7fd338ea36c0 1 -- start start 2026-02-13T04:01:28.608 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.606+0000 7fd338ea36c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd33410f060 0x7fd3340f4800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:28.608 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.606+0000 7fd338ea36c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fd334115270 0x7fd334175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:28.608 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.606+0000 7fd338ea36c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd3340f4e30 0x7fd3340fa100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:28.608 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.606+0000 7fd338ea36c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd3340f5520 con 0x7fd3340f4e30 2026-02-13T04:01:28.608 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.606+0000 7fd338ea36c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fd3340fa640 con 0x7fd334115270 2026-02-13T04:01:28.608 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.606+0000 7fd338ea36c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fd3340fa800 con 0x7fd33410f060 2026-02-13T04:01:28.609 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.606+0000 7fd333fff6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd3340f4e30 0x7fd3340fa100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:28.609 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.606+0000 7fd3337fe6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd33410f060 0x7fd3340f4800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:28.609 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.606+0000 7fd3337fe6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd33410f060 0x7fd3340f4800 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:59834/0 (socket says 10.20.193.92:59834) 2026-02-13T04:01:28.609 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.606+0000 7fd3337fe6c0 1 -- 10.20.193.92:0/4023989993 learned_addr learned my addr 10.20.193.92:0/4023989993 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:28.609 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.606+0000 7fd333fff6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd3340f4e30 0x7fd3340fa100 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:38224/0 (socket says 10.20.193.92:38224) 2026-02-13T04:01:28.609 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.606+0000 7fd332ffd6c0 1 --2- 10.20.193.92:0/4023989993 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fd334115270 0x7fd334175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:28.609 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.606+0000 7fd3337fe6c0 1 -- 10.20.193.92:0/4023989993 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fd334115270 msgr2=0x7fd334175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:28.609 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.606+0000 7fd3337fe6c0 1 --2- 10.20.193.92:0/4023989993 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fd334115270 0x7fd334175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:28.609 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.606+0000 7fd3337fe6c0 1 -- 10.20.193.92:0/4023989993 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd3340f4e30 msgr2=0x7fd3340fa100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:28.609 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.606+0000 7fd3337fe6c0 1 --2- 10.20.193.92:0/4023989993 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd3340f4e30 0x7fd3340fa100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:28.609 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.606+0000 7fd3337fe6c0 1 -- 10.20.193.92:0/4023989993 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd324009590 con 0x7fd33410f060 2026-02-13T04:01:28.609 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.606+0000 7fd333fff6c0 1 --2- 10.20.193.92:0/4023989993 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd3340f4e30 0x7fd3340fa100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T04:01:28.609 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.607+0000 7fd3337fe6c0 1 --2- 10.20.193.92:0/4023989993 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd33410f060 0x7fd3340f4800 secure :-1 s=READY pgs=108 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd32000b740 tx=0x7fd32000bc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:28.609 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.607+0000 7fd330ff96c0 1 -- 10.20.193.92:0/4023989993 <== mon.1 v2:10.20.193.158:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd320004250 con 0x7fd33410f060 2026-02-13T04:01:28.609 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.607+0000 7fd330ff96c0 1 -- 10.20.193.92:0/4023989993 <== mon.1 v2:10.20.193.158:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fd320009070 con 0x7fd33410f060 2026-02-13T04:01:28.609 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.607+0000 7fd338ea36c0 1 -- 10.20.193.92:0/4023989993 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3340faae0 con 0x7fd33410f060 2026-02-13T04:01:28.609 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.607+0000 7fd330ff96c0 1 -- 10.20.193.92:0/4023989993 <== mon.1 v2:10.20.193.158:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fd3200071c0 con 0x7fd33410f060 2026-02-13T04:01:28.609 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.607+0000 7fd338ea36c0 1 -- 10.20.193.92:0/4023989993 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3340fb270 con 0x7fd33410f060 2026-02-13T04:01:28.610 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.608+0000 7fd338ea36c0 1 -- 10.20.193.92:0/4023989993 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd334110330 con 0x7fd33410f060 2026-02-13T04:01:28.612 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.609+0000 7fd330ff96c0 1 -- 10.20.193.92:0/4023989993 <== mon.1 v2:10.20.193.158:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fd3200043b0 con 0x7fd33410f060 2026-02-13T04:01:28.613 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.611+0000 7fd330ff96c0 1 --2- 10.20.193.92:0/4023989993 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fd3080b5760 0x7fd3080d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:28.613 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.611+0000 7fd330ff96c0 1 -- 10.20.193.92:0/4023989993 <== mon.1 v2:10.20.193.158:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7fd3200e3bf0 con 0x7fd33410f060 2026-02-13T04:01:28.614 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.611+0000 7fd332ffd6c0 1 --2- 10.20.193.92:0/4023989993 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fd3080b5760 0x7fd3080d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:28.614 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.612+0000 7fd330ff96c0 1 -- 10.20.193.92:0/4023989993 <== mon.1 v2:10.20.193.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fd3200a6540 con 0x7fd33410f060 2026-02-13T04:01:28.614 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.612+0000 7fd332ffd6c0 1 --2- 10.20.193.92:0/4023989993 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fd3080b5760 0x7fd3080d5c10 secure :-1 s=READY pgs=191 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd324005d10 tx=0x7fd324005c80 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:28.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:28 trial099 ceph-mon[27808]: pgmap v196: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.9 KiB/s rd, 597 B/s wr, 11 op/s 2026-02-13T04:01:28.738 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.735+0000 7fd338ea36c0 1 -- 10.20.193.92:0/4023989993 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd3340f5950 con 0x7fd33410f060 2026-02-13T04:01:28.743 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.736+0000 7fd330ff96c0 1 -- 10.20.193.92:0/4023989993 <== mon.1 v2:10.20.193.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fd32000c560 con 0x7fd33410f060 2026-02-13T04:01:28.743 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:01:28.743 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:01:28.743 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.737+0000 7fd338ea36c0 1 -- 10.20.193.92:0/4023989993 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fd3080b5760 msgr2=0x7fd3080d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:28.743 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.737+0000 7fd338ea36c0 1 --2- 10.20.193.92:0/4023989993 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fd3080b5760 0x7fd3080d5c10 secure :-1 s=READY pgs=191 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd324005d10 tx=0x7fd324005c80 comp rx=0 tx=0).stop 2026-02-13T04:01:28.743 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.737+0000 7fd338ea36c0 1 -- 10.20.193.92:0/4023989993 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd33410f060 msgr2=0x7fd3340f4800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:28.743 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.737+0000 7fd338ea36c0 1 --2- 10.20.193.92:0/4023989993 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd33410f060 0x7fd3340f4800 secure :-1 s=READY pgs=108 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd32000b740 tx=0x7fd32000bc10 comp rx=0 tx=0).stop 2026-02-13T04:01:28.743 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.737+0000 7fd338ea36c0 1 -- 10.20.193.92:0/4023989993 shutdown_connections 2026-02-13T04:01:28.743 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.737+0000 7fd338ea36c0 1 --2- 10.20.193.92:0/4023989993 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fd3080b5760 0x7fd3080d5c10 unknown :-1 s=CLOSED pgs=191 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:28.743 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.737+0000 7fd338ea36c0 1 --2- 10.20.193.92:0/4023989993 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fd334115270 0x7fd334175b10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:28.743 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.737+0000 7fd338ea36c0 1 --2- 10.20.193.92:0/4023989993 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fd3340f4e30 0x7fd3340fa100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:28.743 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.737+0000 7fd338ea36c0 1 --2- 10.20.193.92:0/4023989993 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fd33410f060 0x7fd3340f4800 unknown :-1 s=CLOSED pgs=108 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:28.743 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.737+0000 7fd338ea36c0 1 -- 10.20.193.92:0/4023989993 >> 10.20.193.92:0/4023989993 conn(0x7fd3340ec980 msgr2=0x7fd3341138f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:28.743 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.738+0000 7fd338ea36c0 1 -- 10.20.193.92:0/4023989993 shutdown_connections 2026-02-13T04:01:28.743 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:28.738+0000 7fd338ea36c0 1 -- 10.20.193.92:0/4023989993 wait complete. 2026-02-13T04:01:29.578 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:29 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/4023989993' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:01:29.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:29 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/4023989993' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:01:29.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:29 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/4023989993' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:01:30.578 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:30 trial158 ceph-mon[27763]: pgmap v197: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 9 op/s 2026-02-13T04:01:30.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:30 trial099 ceph-mon[27808]: pgmap v197: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 9 op/s 2026-02-13T04:01:30.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:30 trial092 ceph-mon[23047]: pgmap v197: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 9 op/s 2026-02-13T04:01:31.848 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:01:32.035 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:32.233 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.230+0000 7f0ab1fb76c0 1 -- 10.20.193.92:0/2906197704 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0aac115270 msgr2=0x7f0aac175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:32.233 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.230+0000 7f0ab1fb76c0 1 --2- 10.20.193.92:0/2906197704 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0aac115270 0x7f0aac175c10 secure :-1 s=READY pgs=240 gs=1 cs=0 l=1 c_cookie=15291058131194451319 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0aa800aa70 tx=0x7f0aa802fdd0 comp rx=0 tx=0).stop 2026-02-13T04:01:32.233 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.230+0000 7f0ab1fb76c0 1 -- 10.20.193.92:0/2906197704 shutdown_connections 2026-02-13T04:01:32.233 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.230+0000 7f0ab1fb76c0 1 --2- 10.20.193.92:0/2906197704 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0aac115270 0x7f0aac175c10 unknown :-1 s=CLOSED pgs=240 gs=1 cs=0 l=1 c_cookie=15291058131194451319 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:32.233 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.230+0000 7f0ab1fb76c0 1 --2- 10.20.193.92:0/2906197704 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f0aac10fa50 0x7f0aac114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:32.234 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.230+0000 7f0ab1fb76c0 1 --2- 10.20.193.92:0/2906197704 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0aac10f060 0x7f0aac10f430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:32.234 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.230+0000 7f0ab1fb76c0 1 -- 10.20.193.92:0/2906197704 >> 10.20.193.92:0/2906197704 conn(0x7f0aac0ec980 msgr2=0x7f0aac10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:32.234 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.230+0000 7f0ab1fb76c0 1 -- 10.20.193.92:0/2906197704 shutdown_connections 2026-02-13T04:01:32.234 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.230+0000 7f0ab1fb76c0 1 -- 10.20.193.92:0/2906197704 wait complete. 2026-02-13T04:01:32.236 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.231+0000 7f0ab1fb76c0 1 Processor -- start 2026-02-13T04:01:32.236 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.231+0000 7f0ab1fb76c0 1 -- start start 2026-02-13T04:01:32.236 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.231+0000 7f0ab1fb76c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f0aac10f060 0x7f0aac11cd90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:32.236 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.231+0000 7f0ab1fb76c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0aac115270 0x7f0aac11d2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:32.236 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.231+0000 7f0ab1fb76c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0aac122690 0x7f0aac122b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:32.236 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.231+0000 7f0ab1fb76c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0aac1230a0 con 0x7f0aac122690 2026-02-13T04:01:32.236 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.231+0000 7f0ab1fb76c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0aac123210 con 0x7f0aac115270 2026-02-13T04:01:32.236 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.231+0000 7f0ab1fb76c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f0aac1233d0 con 0x7f0aac10f060 2026-02-13T04:01:32.237 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.232+0000 7f0aa3fff6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0aac115270 0x7f0aac11d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:32.237 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.232+0000 7f0ab0fb56c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f0aac10f060 0x7f0aac11cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:32.237 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.232+0000 7f0aa3fff6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0aac115270 0x7f0aac11d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:47808/0 (socket says 10.20.193.92:47808) 2026-02-13T04:01:32.237 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.232+0000 7f0aa3fff6c0 1 -- 10.20.193.92:0/4256688759 learned_addr learned my addr 10.20.193.92:0/4256688759 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:32.237 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.232+0000 7f0ab17b66c0 1 --2- 10.20.193.92:0/4256688759 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0aac122690 0x7f0aac122b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:32.237 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.232+0000 7f0aa3fff6c0 1 -- 10.20.193.92:0/4256688759 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f0aac10f060 msgr2=0x7f0aac11cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:32.237 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.232+0000 7f0aa3fff6c0 1 --2- 10.20.193.92:0/4256688759 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f0aac10f060 0x7f0aac11cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:32.237 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.232+0000 7f0aa3fff6c0 1 -- 10.20.193.92:0/4256688759 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0aac122690 msgr2=0x7f0aac122b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:32.237 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.232+0000 7f0aa3fff6c0 1 --2- 10.20.193.92:0/4256688759 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0aac122690 0x7f0aac122b30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:32.237 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.232+0000 7f0aa3fff6c0 1 -- 10.20.193.92:0/4256688759 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aa800a660 con 0x7f0aac115270 2026-02-13T04:01:32.237 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.232+0000 7f0aa3fff6c0 1 --2- 10.20.193.92:0/4256688759 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0aac115270 0x7f0aac11d2d0 secure :-1 s=READY pgs=108 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a9400b750 tx=0x7f0a9400bc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:32.238 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.232+0000 7f0aa1ffb6c0 1 -- 10.20.193.92:0/4256688759 <== mon.2 v2:10.20.193.99:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0a94004a80 con 0x7f0aac115270 2026-02-13T04:01:32.238 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.232+0000 7f0aa1ffb6c0 1 -- 10.20.193.92:0/4256688759 <== mon.2 v2:10.20.193.99:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f0a94009030 con 0x7f0aac115270 2026-02-13T04:01:32.238 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.232+0000 7f0ab1fb76c0 1 -- 10.20.193.92:0/4256688759 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0aac163880 con 0x7f0aac115270 2026-02-13T04:01:32.238 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.232+0000 7f0ab1fb76c0 1 -- 10.20.193.92:0/4256688759 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aac163d10 con 0x7f0aac115270 2026-02-13T04:01:32.238 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.232+0000 7f0aa1ffb6c0 1 -- 10.20.193.92:0/4256688759 <== mon.2 v2:10.20.193.99:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0a940071c0 con 0x7f0aac115270 2026-02-13T04:01:32.238 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.233+0000 7f0ab1fb76c0 1 -- 10.20.193.92:0/4256688759 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0aac110330 con 0x7f0aac115270 2026-02-13T04:01:32.238 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.235+0000 7f0aa1ffb6c0 1 -- 10.20.193.92:0/4256688759 <== mon.2 v2:10.20.193.99:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f0a94005020 con 0x7f0aac115270 2026-02-13T04:01:32.240 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.237+0000 7f0aa1ffb6c0 1 --2- 10.20.193.92:0/4256688759 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f0a880b5760 0x7f0a880d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:32.240 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.237+0000 7f0aa1ffb6c0 1 -- 10.20.193.92:0/4256688759 <== mon.2 v2:10.20.193.99:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7977+0+0 (secure 0 0 0) 0x7f0a940e3b70 con 0x7f0aac115270 2026-02-13T04:01:32.240 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.237+0000 7f0ab0fb56c0 1 --2- 10.20.193.92:0/4256688759 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f0a880b5760 0x7f0a880d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:32.240 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.237+0000 7f0aa1ffb6c0 1 -- 10.20.193.92:0/4256688759 <== mon.2 v2:10.20.193.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f0a9411c5e0 con 0x7f0aac115270 2026-02-13T04:01:32.241 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.238+0000 7f0ab0fb56c0 1 --2- 10.20.193.92:0/4256688759 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f0a880b5760 0x7f0a880d5c10 secure :-1 s=READY pgs=192 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a9c004750 tx=0x7f0a9c009390 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:32.369 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.366+0000 7f0ab1fb76c0 1 -- 10.20.193.92:0/4256688759 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0aac10f430 con 0x7f0aac115270 2026-02-13T04:01:32.370 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.366+0000 7f0aa1ffb6c0 1 -- 10.20.193.92:0/4256688759 <== mon.2 v2:10.20.193.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f0a940a64c0 con 0x7f0aac115270 2026-02-13T04:01:32.370 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:01:32.370 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:01:32.371 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.367+0000 7f0ab1fb76c0 1 -- 10.20.193.92:0/4256688759 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f0a880b5760 msgr2=0x7f0a880d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:32.371 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.367+0000 7f0ab1fb76c0 1 --2- 10.20.193.92:0/4256688759 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f0a880b5760 0x7f0a880d5c10 secure :-1 s=READY pgs=192 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a9c004750 tx=0x7f0a9c009390 comp rx=0 tx=0).stop 2026-02-13T04:01:32.371 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.368+0000 7f0ab1fb76c0 1 -- 10.20.193.92:0/4256688759 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0aac115270 msgr2=0x7f0aac11d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:32.371 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.368+0000 7f0ab1fb76c0 1 --2- 10.20.193.92:0/4256688759 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0aac115270 0x7f0aac11d2d0 secure :-1 s=READY pgs=108 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0a9400b750 tx=0x7f0a9400bc20 comp rx=0 tx=0).stop 2026-02-13T04:01:32.371 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.368+0000 7f0ab1fb76c0 1 -- 10.20.193.92:0/4256688759 shutdown_connections 2026-02-13T04:01:32.372 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.368+0000 7f0ab1fb76c0 1 --2- 10.20.193.92:0/4256688759 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f0a880b5760 0x7f0a880d5c10 unknown :-1 s=CLOSED pgs=192 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:32.372 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.368+0000 7f0ab1fb76c0 1 --2- 10.20.193.92:0/4256688759 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0aac115270 0x7f0aac11d2d0 unknown :-1 s=CLOSED pgs=108 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:32.372 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.368+0000 7f0ab1fb76c0 1 --2- 10.20.193.92:0/4256688759 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0aac122690 0x7f0aac122b30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:32.372 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.368+0000 7f0ab1fb76c0 1 --2- 10.20.193.92:0/4256688759 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f0aac10f060 0x7f0aac11cd90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:32.372 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.368+0000 7f0ab1fb76c0 1 -- 10.20.193.92:0/4256688759 >> 10.20.193.92:0/4256688759 conn(0x7f0aac0ec980 msgr2=0x7f0aac10cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:32.372 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.368+0000 7f0ab1fb76c0 1 -- 10.20.193.92:0/4256688759 shutdown_connections 2026-02-13T04:01:32.372 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:32.368+0000 7f0ab1fb76c0 1 -- 10.20.193.92:0/4256688759 wait complete. 2026-02-13T04:01:32.430 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:32 trial092 ceph-mon[23047]: pgmap v198: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2026-02-13T04:01:32.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:32 trial158 ceph-mon[27763]: pgmap v198: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2026-02-13T04:01:32.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:32 trial099 ceph-mon[27808]: pgmap v198: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2026-02-13T04:01:33.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:33 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/4256688759' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:01:33.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:33 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/4256688759' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:01:33.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:33 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/4256688759' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:01:34.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:34 trial158 ceph-mon[27763]: pgmap v199: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 10 op/s 2026-02-13T04:01:34.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:34 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]} : dispatch 2026-02-13T04:01:34.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:34 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]} : dispatch 2026-02-13T04:01:34.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:34 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]} : dispatch 2026-02-13T04:01:34.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:34 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]} : dispatch 2026-02-13T04:01:34.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:34 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]} : dispatch 2026-02-13T04:01:34.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:34 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]} : dispatch 2026-02-13T04:01:34.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:34 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]} : dispatch 2026-02-13T04:01:34.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:34 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]} : dispatch 2026-02-13T04:01:34.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:34 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]} : dispatch 2026-02-13T04:01:34.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:34 trial099 ceph-mon[27808]: pgmap v199: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 10 op/s 2026-02-13T04:01:34.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:34 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]} : dispatch 2026-02-13T04:01:34.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:34 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]} : dispatch 2026-02-13T04:01:34.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:34 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]} : dispatch 2026-02-13T04:01:34.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:34 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]} : dispatch 2026-02-13T04:01:34.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:34 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]} : dispatch 2026-02-13T04:01:34.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:34 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]} : dispatch 2026-02-13T04:01:34.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:34 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]} : dispatch 2026-02-13T04:01:34.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:34 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]} : dispatch 2026-02-13T04:01:34.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:34 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]} : dispatch 2026-02-13T04:01:34.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:34 trial092 ceph-mon[23047]: pgmap v199: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.0 KiB/s rd, 170 B/s wr, 10 op/s 2026-02-13T04:01:34.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:34 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]} : dispatch 2026-02-13T04:01:34.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:34 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]} : dispatch 2026-02-13T04:01:34.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:34 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]} : dispatch 2026-02-13T04:01:34.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:34 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]} : dispatch 2026-02-13T04:01:34.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:34 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]} : dispatch 2026-02-13T04:01:34.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:34 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]} : dispatch 2026-02-13T04:01:34.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:34 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]} : dispatch 2026-02-13T04:01:34.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:34 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]} : dispatch 2026-02-13T04:01:34.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:34 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]} : dispatch 2026-02-13T04:01:35.473 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:01:35.523 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:35 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2026-02-13T04:01:35.523 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:35 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2026-02-13T04:01:35.523 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:35 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2026-02-13T04:01:35.523 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:35 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2026-02-13T04:01:35.523 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:35 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2026-02-13T04:01:35.523 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:35 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2026-02-13T04:01:35.524 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:35 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2026-02-13T04:01:35.524 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:35 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2026-02-13T04:01:35.524 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:35 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2026-02-13T04:01:35.524 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:35 trial092 ceph-mon[23047]: osdmap e77: 12 total, 12 up, 12 in 2026-02-13T04:01:35.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:35 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2026-02-13T04:01:35.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:35 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2026-02-13T04:01:35.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:35 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2026-02-13T04:01:35.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:35 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2026-02-13T04:01:35.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:35 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2026-02-13T04:01:35.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:35 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2026-02-13T04:01:35.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:35 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2026-02-13T04:01:35.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:35 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2026-02-13T04:01:35.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:35 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2026-02-13T04:01:35.580 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:35 trial158 ceph-mon[27763]: osdmap e77: 12 total, 12 up, 12 in 2026-02-13T04:01:35.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:35 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2026-02-13T04:01:35.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:35 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.c", "id": [2, 4]}]': finished 2026-02-13T04:01:35.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:35 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2026-02-13T04:01:35.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:35 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [8, 11]}]': finished 2026-02-13T04:01:35.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:35 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [4, 6]}]': finished 2026-02-13T04:01:35.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:35 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [4, 8]}]': finished 2026-02-13T04:01:35.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:35 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2026-02-13T04:01:35.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:35 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2026-02-13T04:01:35.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:35 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2026-02-13T04:01:35.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:35 trial099 ceph-mon[27808]: osdmap e77: 12 total, 12 up, 12 in 2026-02-13T04:01:35.656 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:35.850 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.846+0000 7f70fe3666c0 1 -- 10.20.193.92:0/1635242604 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f70f810b8e0 msgr2=0x7f70f810bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:35.850 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.846+0000 7f70fe3666c0 1 --2- 10.20.193.92:0/1635242604 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f70f810b8e0 0x7f70f810bcb0 secure :-1 s=READY pgs=241 gs=1 cs=0 l=1 c_cookie=15325984644769086175 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f70e8009970 tx=0x7f70e802ed20 comp rx=0 tx=0).stop 2026-02-13T04:01:35.850 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.846+0000 7f70fe3666c0 1 -- 10.20.193.92:0/1635242604 shutdown_connections 2026-02-13T04:01:35.850 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.846+0000 7f70fe3666c0 1 --2- 10.20.193.92:0/1635242604 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f70f810c2d0 0x7f70f81108a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:35.850 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.846+0000 7f70fe3666c0 1 --2- 10.20.193.92:0/1635242604 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f70f8110ef0 0x7f70f8111370 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:35.850 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.846+0000 7f70fe3666c0 1 --2- 10.20.193.92:0/1635242604 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f70f810b8e0 0x7f70f810bcb0 unknown :-1 s=CLOSED pgs=241 gs=1 cs=0 l=1 c_cookie=15325984644769086175 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:35.850 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.846+0000 7f70fe3666c0 1 -- 10.20.193.92:0/1635242604 >> 10.20.193.92:0/1635242604 conn(0x7f70f80e9570 msgr2=0x7f70f8109980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:35.851 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.846+0000 7f70fe3666c0 1 -- 10.20.193.92:0/1635242604 shutdown_connections 2026-02-13T04:01:35.851 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.846+0000 7f70fe3666c0 1 -- 10.20.193.92:0/1635242604 wait complete. 2026-02-13T04:01:35.851 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.847+0000 7f70fe3666c0 1 Processor -- start 2026-02-13T04:01:35.852 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.847+0000 7f70fe3666c0 1 -- start start 2026-02-13T04:01:35.852 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.848+0000 7f70fe3666c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f70f810b8e0 0x7f70f8121690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:35.852 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.848+0000 7f70fe3666c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f70f810c2d0 0x7f70f8121bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:35.853 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.848+0000 7f70fe3666c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f70f8110ef0 0x7f70f8126f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:35.853 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.848+0000 7f70fe3666c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f70f81275e0 con 0x7f70f8110ef0 2026-02-13T04:01:35.853 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.848+0000 7f70fe3666c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f70f8127750 con 0x7f70f810c2d0 2026-02-13T04:01:35.853 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.848+0000 7f70fe3666c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f70f8127910 con 0x7f70f810b8e0 2026-02-13T04:01:35.853 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.848+0000 7f70fcb636c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f70f810c2d0 0x7f70f8121bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:35.853 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.848+0000 7f70fd3646c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f70f810b8e0 0x7f70f8121690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:35.853 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.848+0000 7f70fcb636c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f70f810c2d0 0x7f70f8121bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:58610/0 (socket says 10.20.193.92:58610) 2026-02-13T04:01:35.853 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.848+0000 7f70fcb636c0 1 -- 10.20.193.92:0/642860766 learned_addr learned my addr 10.20.193.92:0/642860766 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:35.853 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.848+0000 7f70fdb656c0 1 --2- 10.20.193.92:0/642860766 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f70f8110ef0 0x7f70f8126f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:35.853 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.848+0000 7f70fdb656c0 1 -- 10.20.193.92:0/642860766 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f70f810b8e0 msgr2=0x7f70f8121690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:35.854 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.848+0000 7f70fdb656c0 1 --2- 10.20.193.92:0/642860766 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f70f810b8e0 0x7f70f8121690 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:35.854 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.848+0000 7f70fdb656c0 1 -- 10.20.193.92:0/642860766 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f70f810c2d0 msgr2=0x7f70f8121bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:35.854 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.848+0000 7f70fdb656c0 1 --2- 10.20.193.92:0/642860766 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f70f810c2d0 0x7f70f8121bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:35.854 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.848+0000 7f70fdb656c0 1 -- 10.20.193.92:0/642860766 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70e8009590 con 0x7f70f8110ef0 2026-02-13T04:01:35.854 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.848+0000 7f70fcb636c0 1 --2- 10.20.193.92:0/642860766 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f70f810c2d0 0x7f70f8121bd0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T04:01:35.854 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.848+0000 7f70fdb656c0 1 --2- 10.20.193.92:0/642860766 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f70f8110ef0 0x7f70f8126f90 secure :-1 s=READY pgs=242 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f70f400c6c0 tx=0x7f70f400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:35.854 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.848+0000 7f70e67fc6c0 1 -- 10.20.193.92:0/642860766 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f70f4005340 con 0x7f70f8110ef0 2026-02-13T04:01:35.854 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.849+0000 7f70e67fc6c0 1 -- 10.20.193.92:0/642860766 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f70f4003d40 con 0x7f70f8110ef0 2026-02-13T04:01:35.854 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.849+0000 7f70e67fc6c0 1 -- 10.20.193.92:0/642860766 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f70f400de30 con 0x7f70f8110ef0 2026-02-13T04:01:35.854 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.849+0000 7f70fe3666c0 1 -- 10.20.193.92:0/642860766 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70f8127bf0 con 0x7f70f8110ef0 2026-02-13T04:01:35.855 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.849+0000 7f70fe3666c0 1 -- 10.20.193.92:0/642860766 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70f81682d0 con 0x7f70f8110ef0 2026-02-13T04:01:35.855 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.850+0000 7f70fe3666c0 1 -- 10.20.193.92:0/642860766 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70f8127e10 con 0x7f70f8110ef0 2026-02-13T04:01:35.855 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.851+0000 7f70e67fc6c0 1 -- 10.20.193.92:0/642860766 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f70f400d410 con 0x7f70f8110ef0 2026-02-13T04:01:35.856 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.853+0000 7f70e67fc6c0 1 --2- 10.20.193.92:0/642860766 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f70d40b5760 0x7f70d40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:35.856 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.853+0000 7f70e67fc6c0 1 -- 10.20.193.92:0/642860766 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f70f40e4b20 con 0x7f70f8110ef0 2026-02-13T04:01:35.856 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.853+0000 7f70fd3646c0 1 --2- 10.20.193.92:0/642860766 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f70d40b5760 0x7f70d40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:35.857 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.854+0000 7f70fd3646c0 1 --2- 10.20.193.92:0/642860766 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f70d40b5760 0x7f70d40d5c10 secure :-1 s=READY pgs=193 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f70e80098c0 tx=0x7f70e80023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:35.857 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.854+0000 7f70e67fc6c0 1 -- 10.20.193.92:0/642860766 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f70f40a7360 con 0x7f70f8110ef0 2026-02-13T04:01:35.980 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.977+0000 7f70fe3666c0 1 -- 10.20.193.92:0/642860766 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f70f805fb90 con 0x7f70f8110ef0 2026-02-13T04:01:35.981 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.977+0000 7f70e67fc6c0 1 -- 10.20.193.92:0/642860766 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f70f40aa510 con 0x7f70f8110ef0 2026-02-13T04:01:35.981 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:01:35.981 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:01:35.982 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.979+0000 7f70fe3666c0 1 -- 10.20.193.92:0/642860766 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f70d40b5760 msgr2=0x7f70d40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:35.982 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.979+0000 7f70fe3666c0 1 --2- 10.20.193.92:0/642860766 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f70d40b5760 0x7f70d40d5c10 secure :-1 s=READY pgs=193 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f70e80098c0 tx=0x7f70e80023a0 comp rx=0 tx=0).stop 2026-02-13T04:01:35.982 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.979+0000 7f70fe3666c0 1 -- 10.20.193.92:0/642860766 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f70f8110ef0 msgr2=0x7f70f8126f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:35.982 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.979+0000 7f70fe3666c0 1 --2- 10.20.193.92:0/642860766 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f70f8110ef0 0x7f70f8126f90 secure :-1 s=READY pgs=242 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f70f400c6c0 tx=0x7f70f400cb90 comp rx=0 tx=0).stop 2026-02-13T04:01:35.982 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.979+0000 7f70fe3666c0 1 -- 10.20.193.92:0/642860766 shutdown_connections 2026-02-13T04:01:35.982 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.979+0000 7f70fe3666c0 1 --2- 10.20.193.92:0/642860766 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f70d40b5760 0x7f70d40d5c10 unknown :-1 s=CLOSED pgs=193 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:35.983 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.979+0000 7f70fe3666c0 1 --2- 10.20.193.92:0/642860766 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f70f810c2d0 0x7f70f8121bd0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:35.983 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.979+0000 7f70fe3666c0 1 --2- 10.20.193.92:0/642860766 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f70f8110ef0 0x7f70f8126f90 unknown :-1 s=CLOSED pgs=242 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:35.983 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.979+0000 7f70fe3666c0 1 --2- 10.20.193.92:0/642860766 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f70f810b8e0 0x7f70f8121690 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:35.983 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.979+0000 7f70fe3666c0 1 -- 10.20.193.92:0/642860766 >> 10.20.193.92:0/642860766 conn(0x7f70f80e9570 msgr2=0x7f70f8109950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:35.983 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.979+0000 7f70fe3666c0 1 -- 10.20.193.92:0/642860766 shutdown_connections 2026-02-13T04:01:35.983 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:35.979+0000 7f70fe3666c0 1 -- 10.20.193.92:0/642860766 wait complete. 2026-02-13T04:01:36.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:36 trial092 ceph-mon[23047]: pgmap v201: 97 pgs: 4 peering, 93 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2026-02-13T04:01:36.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:36 trial092 ceph-mon[23047]: osdmap e78: 12 total, 12 up, 12 in 2026-02-13T04:01:36.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:36 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/642860766' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:01:36.578 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:36 trial158 ceph-mon[27763]: pgmap v201: 97 pgs: 4 peering, 93 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2026-02-13T04:01:36.578 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:36 trial158 ceph-mon[27763]: osdmap e78: 12 total, 12 up, 12 in 2026-02-13T04:01:36.578 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:36 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/642860766' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:01:36.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:36 trial099 ceph-mon[27808]: pgmap v201: 97 pgs: 4 peering, 93 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 204 B/s wr, 9 op/s 2026-02-13T04:01:36.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:36 trial099 ceph-mon[27808]: osdmap e78: 12 total, 12 up, 12 in 2026-02-13T04:01:36.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:36 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/642860766' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:01:38.578 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:38 trial158 ceph-mon[27763]: pgmap v203: 97 pgs: 4 peering, 93 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 9 op/s 2026-02-13T04:01:38.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:38 trial099 ceph-mon[27808]: pgmap v203: 97 pgs: 4 peering, 93 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 9 op/s 2026-02-13T04:01:38.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:38 trial092 ceph-mon[23047]: pgmap v203: 97 pgs: 4 peering, 93 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 9 op/s 2026-02-13T04:01:39.118 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:01:39.303 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:39.497 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.493+0000 7f248f0036c0 1 -- 10.20.193.92:0/1455743191 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2488060200 msgr2=0x7f2488112800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:39.497 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.493+0000 7f248f0036c0 1 --2- 10.20.193.92:0/1455743191 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2488060200 0x7f2488112800 secure :-1 s=READY pgs=109 gs=1 cs=0 l=1 c_cookie=10205191170662846483 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f247c009970 tx=0x7f247c02ed10 comp rx=0 tx=0).stop 2026-02-13T04:01:39.497 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.494+0000 7f248f0036c0 1 -- 10.20.193.92:0/1455743191 shutdown_connections 2026-02-13T04:01:39.497 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.494+0000 7f248f0036c0 1 --2- 10.20.193.92:0/1455743191 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2488060200 0x7f2488112800 unknown :-1 s=CLOSED pgs=109 gs=1 cs=0 l=1 c_cookie=10205191170662846483 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:39.498 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.494+0000 7f248f0036c0 1 --2- 10.20.193.92:0/1455743191 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2488112fe0 0x7f2488173980 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:39.498 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.494+0000 7f248f0036c0 1 --2- 10.20.193.92:0/1455743191 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f248805f810 0x7f248805fbe0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:39.498 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.494+0000 7f248f0036c0 1 -- 10.20.193.92:0/1455743191 >> 10.20.193.92:0/1455743191 conn(0x7f24880e9590 msgr2=0x7f24881099a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:39.498 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.494+0000 7f248f0036c0 1 -- 10.20.193.92:0/1455743191 shutdown_connections 2026-02-13T04:01:39.498 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.494+0000 7f248f0036c0 1 -- 10.20.193.92:0/1455743191 wait complete. 2026-02-13T04:01:39.500 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.495+0000 7f248f0036c0 1 Processor -- start 2026-02-13T04:01:39.500 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.495+0000 7f248f0036c0 1 -- start start 2026-02-13T04:01:39.500 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.495+0000 7f248f0036c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f248805f810 0x7f24880f3610 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:39.500 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.495+0000 7f248f0036c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2488112fe0 0x7f2488173880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:39.500 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.495+0000 7f248f0036c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f24880f3c40 0x7f24880f8ec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:39.500 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.495+0000 7f248f0036c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f24880f4330 con 0x7f24880f3c40 2026-02-13T04:01:39.500 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.495+0000 7f248f0036c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f24880f9400 con 0x7f2488112fe0 2026-02-13T04:01:39.500 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.495+0000 7f248f0036c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f24880f95c0 con 0x7f248805f810 2026-02-13T04:01:39.500 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.495+0000 7f248d8006c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2488112fe0 0x7f2488173880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:39.501 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.495+0000 7f248e0016c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f248805f810 0x7f24880f3610 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:39.501 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.495+0000 7f248d8006c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2488112fe0 0x7f2488173880 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:58626/0 (socket says 10.20.193.92:58626) 2026-02-13T04:01:39.501 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.495+0000 7f248d8006c0 1 -- 10.20.193.92:0/2915359712 learned_addr learned my addr 10.20.193.92:0/2915359712 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:39.501 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.495+0000 7f248e8026c0 1 --2- 10.20.193.92:0/2915359712 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f24880f3c40 0x7f24880f8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:39.501 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.496+0000 7f248e8026c0 1 -- 10.20.193.92:0/2915359712 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f248805f810 msgr2=0x7f24880f3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:39.501 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.496+0000 7f248e8026c0 1 --2- 10.20.193.92:0/2915359712 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f248805f810 0x7f24880f3610 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:39.501 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.496+0000 7f248e8026c0 1 -- 10.20.193.92:0/2915359712 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2488112fe0 msgr2=0x7f2488173880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:39.501 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.496+0000 7f248e8026c0 1 --2- 10.20.193.92:0/2915359712 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2488112fe0 0x7f2488173880 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:39.501 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.496+0000 7f248e8026c0 1 -- 10.20.193.92:0/2915359712 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f247c009590 con 0x7f24880f3c40 2026-02-13T04:01:39.501 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.496+0000 7f248e0016c0 1 --2- 10.20.193.92:0/2915359712 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f248805f810 0x7f24880f3610 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T04:01:39.501 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.496+0000 7f248d8006c0 1 --2- 10.20.193.92:0/2915359712 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2488112fe0 0x7f2488173880 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T04:01:39.501 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.496+0000 7f248e8026c0 1 --2- 10.20.193.92:0/2915359712 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f24880f3c40 0x7f24880f8ec0 secure :-1 s=READY pgs=243 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2484006fd0 tx=0x7f248400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:39.502 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.496+0000 7f2476ffd6c0 1 -- 10.20.193.92:0/2915359712 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2484003c40 con 0x7f24880f3c40 2026-02-13T04:01:39.502 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.496+0000 7f2476ffd6c0 1 -- 10.20.193.92:0/2915359712 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f248400a070 con 0x7f24880f3c40 2026-02-13T04:01:39.502 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.496+0000 7f2476ffd6c0 1 -- 10.20.193.92:0/2915359712 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f24840081c0 con 0x7f24880f3c40 2026-02-13T04:01:39.502 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.496+0000 7f248f0036c0 1 -- 10.20.193.92:0/2915359712 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24880f98a0 con 0x7f24880f3c40 2026-02-13T04:01:39.502 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.496+0000 7f248f0036c0 1 -- 10.20.193.92:0/2915359712 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24880f9d30 con 0x7f24880f3c40 2026-02-13T04:01:39.502 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.497+0000 7f248f0036c0 1 -- 10.20.193.92:0/2915359712 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f248810e0a0 con 0x7f24880f3c40 2026-02-13T04:01:39.502 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.499+0000 7f2476ffd6c0 1 -- 10.20.193.92:0/2915359712 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f248400d560 con 0x7f24880f3c40 2026-02-13T04:01:39.504 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.501+0000 7f2476ffd6c0 1 --2- 10.20.193.92:0/2915359712 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f24640b57e0 0x7f24640d5c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:39.504 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.501+0000 7f2476ffd6c0 1 -- 10.20.193.92:0/2915359712 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f24840e4a50 con 0x7f24880f3c40 2026-02-13T04:01:39.504 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.501+0000 7f248e0016c0 1 --2- 10.20.193.92:0/2915359712 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f24640b57e0 0x7f24640d5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:39.504 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.501+0000 7f2476ffd6c0 1 -- 10.20.193.92:0/2915359712 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f24840e4e50 con 0x7f24880f3c40 2026-02-13T04:01:39.504 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.502+0000 7f248e0016c0 1 --2- 10.20.193.92:0/2915359712 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f24640b57e0 0x7f24640d5c90 secure :-1 s=READY pgs=194 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2478004750 tx=0x7f2478009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:39.628 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.625+0000 7f248f0036c0 1 -- 10.20.193.92:0/2915359712 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f24880f9d30 con 0x7f24880f3c40 2026-02-13T04:01:39.628 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.625+0000 7f2476ffd6c0 1 -- 10.20.193.92:0/2915359712 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f24840a7290 con 0x7f24880f3c40 2026-02-13T04:01:39.628 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:01:39.628 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:01:39.629 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.626+0000 7f248f0036c0 1 -- 10.20.193.92:0/2915359712 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f24640b57e0 msgr2=0x7f24640d5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:39.629 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.626+0000 7f248f0036c0 1 --2- 10.20.193.92:0/2915359712 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f24640b57e0 0x7f24640d5c90 secure :-1 s=READY pgs=194 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2478004750 tx=0x7f2478009260 comp rx=0 tx=0).stop 2026-02-13T04:01:39.629 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.626+0000 7f248f0036c0 1 -- 10.20.193.92:0/2915359712 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f24880f3c40 msgr2=0x7f24880f8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:39.630 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.626+0000 7f248f0036c0 1 --2- 10.20.193.92:0/2915359712 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f24880f3c40 0x7f24880f8ec0 secure :-1 s=READY pgs=243 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2484006fd0 tx=0x7f248400cc00 comp rx=0 tx=0).stop 2026-02-13T04:01:39.630 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.626+0000 7f248f0036c0 1 -- 10.20.193.92:0/2915359712 shutdown_connections 2026-02-13T04:01:39.630 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.626+0000 7f248f0036c0 1 --2- 10.20.193.92:0/2915359712 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f24640b57e0 0x7f24640d5c90 unknown :-1 s=CLOSED pgs=194 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:39.630 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.626+0000 7f248f0036c0 1 --2- 10.20.193.92:0/2915359712 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2488112fe0 0x7f2488173880 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:39.630 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.626+0000 7f248f0036c0 1 --2- 10.20.193.92:0/2915359712 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f24880f3c40 0x7f24880f8ec0 unknown :-1 s=CLOSED pgs=243 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:39.630 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.626+0000 7f248f0036c0 1 --2- 10.20.193.92:0/2915359712 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f248805f810 0x7f24880f3610 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:39.630 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.626+0000 7f248f0036c0 1 -- 10.20.193.92:0/2915359712 >> 10.20.193.92:0/2915359712 conn(0x7f24880e9590 msgr2=0x7f2488111660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:39.630 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.626+0000 7f248f0036c0 1 -- 10.20.193.92:0/2915359712 shutdown_connections 2026-02-13T04:01:39.630 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:39.626+0000 7f248f0036c0 1 -- 10.20.193.92:0/2915359712 wait complete. 2026-02-13T04:01:40.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:40 trial158 ceph-mon[27763]: pgmap v204: 97 pgs: 4 peering, 93 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 6 op/s; 200 B/s, 0 objects/s recovering 2026-02-13T04:01:40.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:40 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/2915359712' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:01:40.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:40 trial099 ceph-mon[27808]: pgmap v204: 97 pgs: 4 peering, 93 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 6 op/s; 200 B/s, 0 objects/s recovering 2026-02-13T04:01:40.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:40 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/2915359712' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:01:40.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:40 trial092 ceph-mon[23047]: pgmap v204: 97 pgs: 4 peering, 93 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 6 op/s; 200 B/s, 0 objects/s recovering 2026-02-13T04:01:40.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:40 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/2915359712' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:01:42.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:42 trial158 ceph-mon[27763]: pgmap v205: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 3 op/s; 289 B/s, 1 objects/s recovering 2026-02-13T04:01:42.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:42 trial099 ceph-mon[27808]: pgmap v205: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 3 op/s; 289 B/s, 1 objects/s recovering 2026-02-13T04:01:42.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:42 trial092 ceph-mon[23047]: pgmap v205: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.2 KiB/s rd, 3 op/s; 289 B/s, 1 objects/s recovering 2026-02-13T04:01:42.733 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:01:42.918 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:43.112 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.108+0000 7f22ff5cb6c0 1 -- 10.20.193.92:0/310768692 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f22f8060200 msgr2=0x7f22f8112800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:43.112 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.108+0000 7f22ff5cb6c0 1 --2- 10.20.193.92:0/310768692 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f22f8060200 0x7f22f8112800 secure :-1 s=READY pgs=244 gs=1 cs=0 l=1 c_cookie=10604406292916399782 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22e40099a0 tx=0x7f22e402ed00 comp rx=0 tx=0).stop 2026-02-13T04:01:43.112 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.109+0000 7f22ff5cb6c0 1 -- 10.20.193.92:0/310768692 shutdown_connections 2026-02-13T04:01:43.112 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.109+0000 7f22ff5cb6c0 1 --2- 10.20.193.92:0/310768692 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f22f8112fe0 0x7f22f8173980 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:43.112 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.109+0000 7f22ff5cb6c0 1 --2- 10.20.193.92:0/310768692 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f22f8060200 0x7f22f8112800 unknown :-1 s=CLOSED pgs=244 gs=1 cs=0 l=1 c_cookie=10604406292916399782 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:43.113 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.109+0000 7f22ff5cb6c0 1 --2- 10.20.193.92:0/310768692 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f22f805f810 0x7f22f805fbe0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:43.113 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.109+0000 7f22ff5cb6c0 1 -- 10.20.193.92:0/310768692 >> 10.20.193.92:0/310768692 conn(0x7f22f80e9590 msgr2=0x7f22f81099a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:43.113 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.109+0000 7f22ff5cb6c0 1 -- 10.20.193.92:0/310768692 shutdown_connections 2026-02-13T04:01:43.113 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.109+0000 7f22ff5cb6c0 1 -- 10.20.193.92:0/310768692 wait complete. 2026-02-13T04:01:43.115 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.110+0000 7f22ff5cb6c0 1 Processor -- start 2026-02-13T04:01:43.115 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.110+0000 7f22ff5cb6c0 1 -- start start 2026-02-13T04:01:43.115 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.110+0000 7f22ff5cb6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f22f805f810 0x7f22f80f3650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:43.115 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.110+0000 7f22ff5cb6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f22f8112fe0 0x7f22f8173880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:43.115 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.110+0000 7f22ff5cb6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f22f80f3c80 0x7f22f80f8f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:43.115 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.110+0000 7f22ff5cb6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f22f80f42e0 con 0x7f22f80f3c80 2026-02-13T04:01:43.115 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.110+0000 7f22ff5cb6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f22f80f9440 con 0x7f22f8112fe0 2026-02-13T04:01:43.116 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.110+0000 7f22ff5cb6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f22f80f9600 con 0x7f22f805f810 2026-02-13T04:01:43.116 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.110+0000 7f22fedca6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f22f80f3c80 0x7f22f80f8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:43.116 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.110+0000 7f22fedca6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f22f80f3c80 0x7f22f80f8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:40626/0 (socket says 10.20.193.92:40626) 2026-02-13T04:01:43.116 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.110+0000 7f22fedca6c0 1 -- 10.20.193.92:0/2390486710 learned_addr learned my addr 10.20.193.92:0/2390486710 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:43.116 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.110+0000 7f22fddc86c0 1 --2- 10.20.193.92:0/2390486710 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f22f8112fe0 0x7f22f8173880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:43.116 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.110+0000 7f22fe5c96c0 1 --2- 10.20.193.92:0/2390486710 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f22f805f810 0x7f22f80f3650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:43.116 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.111+0000 7f22fedca6c0 1 -- 10.20.193.92:0/2390486710 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f22f805f810 msgr2=0x7f22f80f3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:43.116 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.111+0000 7f22fedca6c0 1 --2- 10.20.193.92:0/2390486710 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f22f805f810 0x7f22f80f3650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:43.116 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.111+0000 7f22fedca6c0 1 -- 10.20.193.92:0/2390486710 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f22f8112fe0 msgr2=0x7f22f8173880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:43.116 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.111+0000 7f22fedca6c0 1 --2- 10.20.193.92:0/2390486710 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f22f8112fe0 0x7f22f8173880 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:43.116 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.111+0000 7f22fedca6c0 1 -- 10.20.193.92:0/2390486710 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22e4009590 con 0x7f22f80f3c80 2026-02-13T04:01:43.117 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.111+0000 7f22fddc86c0 1 --2- 10.20.193.92:0/2390486710 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f22f8112fe0 0x7f22f8173880 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T04:01:43.117 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.111+0000 7f22fe5c96c0 1 --2- 10.20.193.92:0/2390486710 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f22f805f810 0x7f22f80f3650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T04:01:43.117 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.111+0000 7f22fedca6c0 1 --2- 10.20.193.92:0/2390486710 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f22f80f3c80 0x7f22f80f8f00 secure :-1 s=READY pgs=245 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22ec00c730 tx=0x7f22ec00cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:43.117 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.111+0000 7f22e37fe6c0 1 -- 10.20.193.92:0/2390486710 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f22ec003c40 con 0x7f22f80f3c80 2026-02-13T04:01:43.117 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.111+0000 7f22e37fe6c0 1 -- 10.20.193.92:0/2390486710 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f22ec00a070 con 0x7f22f80f3c80 2026-02-13T04:01:43.117 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.111+0000 7f22e37fe6c0 1 -- 10.20.193.92:0/2390486710 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f22ec0081c0 con 0x7f22f80f3c80 2026-02-13T04:01:43.117 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.111+0000 7f22ff5cb6c0 1 -- 10.20.193.92:0/2390486710 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22f80f9880 con 0x7f22f80f3c80 2026-02-13T04:01:43.117 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.111+0000 7f22ff5cb6c0 1 -- 10.20.193.92:0/2390486710 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22f80f9d10 con 0x7f22f80f3c80 2026-02-13T04:01:43.117 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.112+0000 7f22ff5cb6c0 1 -- 10.20.193.92:0/2390486710 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22f810e0a0 con 0x7f22f80f3c80 2026-02-13T04:01:43.118 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.114+0000 7f22e37fe6c0 1 -- 10.20.193.92:0/2390486710 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f22ec005860 con 0x7f22f80f3c80 2026-02-13T04:01:43.118 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.116+0000 7f22e37fe6c0 1 --2- 10.20.193.92:0/2390486710 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f22d40b5760 0x7f22d40d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:43.119 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.116+0000 7f22e37fe6c0 1 -- 10.20.193.92:0/2390486710 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f22ec0e4db0 con 0x7f22f80f3c80 2026-02-13T04:01:43.119 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.116+0000 7f22fe5c96c0 1 --2- 10.20.193.92:0/2390486710 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f22d40b5760 0x7f22d40d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:43.119 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.116+0000 7f22e37fe6c0 1 -- 10.20.193.92:0/2390486710 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f22ec0e5230 con 0x7f22f80f3c80 2026-02-13T04:01:43.120 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.116+0000 7f22fe5c96c0 1 --2- 10.20.193.92:0/2390486710 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f22d40b5760 0x7f22d40d5c10 secure :-1 s=READY pgs=195 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22f0004750 tx=0x7f22f00095b0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:43.242 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.239+0000 7f22ff5cb6c0 1 -- 10.20.193.92:0/2390486710 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f22f805fbe0 con 0x7f22f80f3c80 2026-02-13T04:01:43.242 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.239+0000 7f22e37fe6c0 1 -- 10.20.193.92:0/2390486710 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f22ec0a75f0 con 0x7f22f80f3c80 2026-02-13T04:01:43.243 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:01:43.243 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:01:43.243 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.241+0000 7f22ff5cb6c0 1 -- 10.20.193.92:0/2390486710 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f22d40b5760 msgr2=0x7f22d40d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:43.244 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.241+0000 7f22ff5cb6c0 1 --2- 10.20.193.92:0/2390486710 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f22d40b5760 0x7f22d40d5c10 secure :-1 s=READY pgs=195 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22f0004750 tx=0x7f22f00095b0 comp rx=0 tx=0).stop 2026-02-13T04:01:43.244 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.241+0000 7f22ff5cb6c0 1 -- 10.20.193.92:0/2390486710 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f22f80f3c80 msgr2=0x7f22f80f8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:43.244 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.241+0000 7f22ff5cb6c0 1 --2- 10.20.193.92:0/2390486710 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f22f80f3c80 0x7f22f80f8f00 secure :-1 s=READY pgs=245 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f22ec00c730 tx=0x7f22ec00cc00 comp rx=0 tx=0).stop 2026-02-13T04:01:43.245 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.241+0000 7f22ff5cb6c0 1 -- 10.20.193.92:0/2390486710 shutdown_connections 2026-02-13T04:01:43.245 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.241+0000 7f22ff5cb6c0 1 --2- 10.20.193.92:0/2390486710 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f22d40b5760 0x7f22d40d5c10 unknown :-1 s=CLOSED pgs=195 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:43.245 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.241+0000 7f22ff5cb6c0 1 --2- 10.20.193.92:0/2390486710 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f22f8112fe0 0x7f22f8173880 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:43.245 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.241+0000 7f22ff5cb6c0 1 --2- 10.20.193.92:0/2390486710 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f22f80f3c80 0x7f22f80f8f00 unknown :-1 s=CLOSED pgs=245 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:43.245 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.241+0000 7f22ff5cb6c0 1 --2- 10.20.193.92:0/2390486710 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f22f805f810 0x7f22f80f3650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:43.245 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.241+0000 7f22ff5cb6c0 1 -- 10.20.193.92:0/2390486710 >> 10.20.193.92:0/2390486710 conn(0x7f22f80e9590 msgr2=0x7f22f8111660 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:43.245 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.241+0000 7f22ff5cb6c0 1 -- 10.20.193.92:0/2390486710 shutdown_connections 2026-02-13T04:01:43.245 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:43.241+0000 7f22ff5cb6c0 1 -- 10.20.193.92:0/2390486710 wait complete. 2026-02-13T04:01:44.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:44 trial158 ceph-mon[27763]: pgmap v206: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 5 op/s; 261 B/s, 1 objects/s recovering 2026-02-13T04:01:44.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:44 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/2390486710' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:01:44.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:44 trial099 ceph-mon[27808]: pgmap v206: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 5 op/s; 261 B/s, 1 objects/s recovering 2026-02-13T04:01:44.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:44 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/2390486710' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:01:44.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:44 trial092 ceph-mon[23047]: pgmap v206: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 5 op/s; 261 B/s, 1 objects/s recovering 2026-02-13T04:01:44.684 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:44 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/2390486710' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:01:46.350 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:01:46.534 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:46.579 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:46 trial092 ceph-mon[23047]: pgmap v207: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 6 op/s; 231 B/s, 1 objects/s recovering 2026-02-13T04:01:46.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:46 trial158 ceph-mon[27763]: pgmap v207: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 6 op/s; 231 B/s, 1 objects/s recovering 2026-02-13T04:01:46.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:46 trial099 ceph-mon[27808]: pgmap v207: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 6 op/s; 231 B/s, 1 objects/s recovering 2026-02-13T04:01:46.735 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.732+0000 7f7cacca26c0 1 -- 10.20.193.92:0/736755127 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7ca810f060 msgr2=0x7f7ca810f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:46.735 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.732+0000 7f7cacca26c0 1 --2- 10.20.193.92:0/736755127 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7ca810f060 0x7f7ca810f430 secure :-1 s=READY pgs=246 gs=1 cs=0 l=1 c_cookie=16046530571212274985 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7c940099a0 tx=0x7f7c9402ed00 comp rx=0 tx=0).stop 2026-02-13T04:01:46.736 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.732+0000 7f7cacca26c0 1 -- 10.20.193.92:0/736755127 shutdown_connections 2026-02-13T04:01:46.736 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.732+0000 7f7cacca26c0 1 --2- 10.20.193.92:0/736755127 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7ca810fa50 0x7f7ca8114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:46.736 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.732+0000 7f7cacca26c0 1 --2- 10.20.193.92:0/736755127 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7ca8115270 0x7f7ca8175c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:46.736 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.732+0000 7f7cacca26c0 1 --2- 10.20.193.92:0/736755127 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7ca810f060 0x7f7ca810f430 unknown :-1 s=CLOSED pgs=246 gs=1 cs=0 l=1 c_cookie=16046530571212274985 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:46.736 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.732+0000 7f7cacca26c0 1 -- 10.20.193.92:0/736755127 >> 10.20.193.92:0/736755127 conn(0x7f7ca80ec980 msgr2=0x7f7ca810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:46.736 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.732+0000 7f7cacca26c0 1 -- 10.20.193.92:0/736755127 shutdown_connections 2026-02-13T04:01:46.736 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.732+0000 7f7cacca26c0 1 -- 10.20.193.92:0/736755127 wait complete. 2026-02-13T04:01:46.738 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.733+0000 7f7cacca26c0 1 Processor -- start 2026-02-13T04:01:46.738 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.733+0000 7f7cacca26c0 1 -- start start 2026-02-13T04:01:46.738 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.733+0000 7f7cacca26c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7ca810f060 0x7f7ca811ce30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:46.738 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.733+0000 7f7cacca26c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7ca8115270 0x7f7ca811d370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:46.738 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.733+0000 7f7cacca26c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7ca8122730 0x7f7ca8122bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:46.739 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.733+0000 7f7cacca26c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca8123140 con 0x7f7ca810f060 2026-02-13T04:01:46.739 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.733+0000 7f7cacca26c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca81232b0 con 0x7f7ca8115270 2026-02-13T04:01:46.739 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.733+0000 7f7cacca26c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca8123470 con 0x7f7ca8122730 2026-02-13T04:01:46.739 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.733+0000 7f7ca6ffd6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7ca8115270 0x7f7ca811d370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:46.739 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.733+0000 7f7ca6ffd6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7ca8115270 0x7f7ca811d370 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:58464/0 (socket says 10.20.193.92:58464) 2026-02-13T04:01:46.739 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.733+0000 7f7ca6ffd6c0 1 -- 10.20.193.92:0/676950683 learned_addr learned my addr 10.20.193.92:0/676950683 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:46.739 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.733+0000 7f7ca7fff6c0 1 --2- 10.20.193.92:0/676950683 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7ca8122730 0x7f7ca8122bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:46.739 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.734+0000 7f7ca77fe6c0 1 --2- 10.20.193.92:0/676950683 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7ca810f060 0x7f7ca811ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:46.739 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.734+0000 7f7ca6ffd6c0 1 -- 10.20.193.92:0/676950683 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7ca8122730 msgr2=0x7f7ca8122bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:46.739 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.734+0000 7f7ca6ffd6c0 1 --2- 10.20.193.92:0/676950683 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7ca8122730 0x7f7ca8122bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:46.739 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.734+0000 7f7ca6ffd6c0 1 -- 10.20.193.92:0/676950683 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7ca810f060 msgr2=0x7f7ca811ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:46.740 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.734+0000 7f7ca6ffd6c0 1 --2- 10.20.193.92:0/676950683 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7ca810f060 0x7f7ca811ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:46.740 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.734+0000 7f7ca6ffd6c0 1 -- 10.20.193.92:0/676950683 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c94009590 con 0x7f7ca8115270 2026-02-13T04:01:46.740 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.734+0000 7f7ca77fe6c0 1 --2- 10.20.193.92:0/676950683 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7ca810f060 0x7f7ca811ce30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T04:01:46.740 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.734+0000 7f7ca6ffd6c0 1 --2- 10.20.193.92:0/676950683 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7ca8115270 0x7f7ca811d370 secure :-1 s=READY pgs=110 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7c9800b800 tx=0x7f7c9800bcd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:46.740 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.734+0000 7f7ca4ff96c0 1 -- 10.20.193.92:0/676950683 <== mon.2 v2:10.20.193.99:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7c98004a80 con 0x7f7ca8115270 2026-02-13T04:01:46.740 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.734+0000 7f7ca4ff96c0 1 -- 10.20.193.92:0/676950683 <== mon.2 v2:10.20.193.99:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f7c98009070 con 0x7f7ca8115270 2026-02-13T04:01:46.740 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.734+0000 7f7ca4ff96c0 1 -- 10.20.193.92:0/676950683 <== mon.2 v2:10.20.193.99:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7c980071c0 con 0x7f7ca8115270 2026-02-13T04:01:46.740 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.734+0000 7f7cacca26c0 1 -- 10.20.193.92:0/676950683 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ca8163920 con 0x7f7ca8115270 2026-02-13T04:01:46.740 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.734+0000 7f7cacca26c0 1 -- 10.20.193.92:0/676950683 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ca8163db0 con 0x7f7ca8115270 2026-02-13T04:01:46.740 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.735+0000 7f7cacca26c0 1 -- 10.20.193.92:0/676950683 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ca8110330 con 0x7f7ca8115270 2026-02-13T04:01:46.741 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.737+0000 7f7ca4ff96c0 1 -- 10.20.193.92:0/676950683 <== mon.2 v2:10.20.193.99:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f7c98004060 con 0x7f7ca8115270 2026-02-13T04:01:46.741 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.739+0000 7f7ca4ff96c0 1 --2- 10.20.193.92:0/676950683 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f7c7c0b56e0 0x7f7c7c0d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:46.742 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.739+0000 7f7ca4ff96c0 1 -- 10.20.193.92:0/676950683 <== mon.2 v2:10.20.193.99:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f7c980e3db0 con 0x7f7ca8115270 2026-02-13T04:01:46.742 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.739+0000 7f7ca4ff96c0 1 -- 10.20.193.92:0/676950683 <== mon.2 v2:10.20.193.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f7c980e4230 con 0x7f7ca8115270 2026-02-13T04:01:46.742 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.739+0000 7f7ca77fe6c0 1 --2- 10.20.193.92:0/676950683 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f7c7c0b56e0 0x7f7c7c0d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:46.742 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.739+0000 7f7ca77fe6c0 1 --2- 10.20.193.92:0/676950683 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f7c7c0b56e0 0x7f7c7c0d5b90 secure :-1 s=READY pgs=196 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7c940023e0 tx=0x7f7c940071c0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:46.866 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.863+0000 7f7cacca26c0 1 -- 10.20.193.92:0/676950683 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7ca810f430 con 0x7f7ca8115270 2026-02-13T04:01:46.866 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.863+0000 7f7ca4ff96c0 1 -- 10.20.193.92:0/676950683 <== mon.2 v2:10.20.193.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f7c980a65f0 con 0x7f7ca8115270 2026-02-13T04:01:46.866 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:01:46.867 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:01:46.867 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.864+0000 7f7cacca26c0 1 -- 10.20.193.92:0/676950683 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f7c7c0b56e0 msgr2=0x7f7c7c0d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:46.868 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.864+0000 7f7cacca26c0 1 --2- 10.20.193.92:0/676950683 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f7c7c0b56e0 0x7f7c7c0d5b90 secure :-1 s=READY pgs=196 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7c940023e0 tx=0x7f7c940071c0 comp rx=0 tx=0).stop 2026-02-13T04:01:46.868 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.864+0000 7f7cacca26c0 1 -- 10.20.193.92:0/676950683 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7ca8115270 msgr2=0x7f7ca811d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:46.868 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.864+0000 7f7cacca26c0 1 --2- 10.20.193.92:0/676950683 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7ca8115270 0x7f7ca811d370 secure :-1 s=READY pgs=110 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7c9800b800 tx=0x7f7c9800bcd0 comp rx=0 tx=0).stop 2026-02-13T04:01:46.868 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.864+0000 7f7cacca26c0 1 -- 10.20.193.92:0/676950683 shutdown_connections 2026-02-13T04:01:46.868 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.864+0000 7f7cacca26c0 1 --2- 10.20.193.92:0/676950683 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f7c7c0b56e0 0x7f7c7c0d5b90 unknown :-1 s=CLOSED pgs=196 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:46.868 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.864+0000 7f7cacca26c0 1 --2- 10.20.193.92:0/676950683 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f7ca8115270 0x7f7ca811d370 unknown :-1 s=CLOSED pgs=110 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:46.868 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.864+0000 7f7cacca26c0 1 --2- 10.20.193.92:0/676950683 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f7ca8122730 0x7f7ca8122bd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:46.868 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.864+0000 7f7cacca26c0 1 --2- 10.20.193.92:0/676950683 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f7ca810f060 0x7f7ca811ce30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:46.868 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.864+0000 7f7cacca26c0 1 -- 10.20.193.92:0/676950683 >> 10.20.193.92:0/676950683 conn(0x7f7ca80ec980 msgr2=0x7f7ca810cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:46.868 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.864+0000 7f7cacca26c0 1 -- 10.20.193.92:0/676950683 shutdown_connections 2026-02-13T04:01:46.868 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:46.864+0000 7f7cacca26c0 1 -- 10.20.193.92:0/676950683 wait complete. 2026-02-13T04:01:47.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:47 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/676950683' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:01:47.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:47 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/676950683' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:01:47.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:47 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/676950683' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:01:48.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:48 trial158 ceph-mon[27763]: pgmap v208: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 7 op/s; 195 B/s, 0 objects/s recovering 2026-02-13T04:01:48.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:48 trial099 ceph-mon[27808]: pgmap v208: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 7 op/s; 195 B/s, 0 objects/s recovering 2026-02-13T04:01:48.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:48 trial092 ceph-mon[23047]: pgmap v208: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 7 op/s; 195 B/s, 0 objects/s recovering 2026-02-13T04:01:49.516 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:49 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:01:49.521 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:49 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:01:49.680 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:49 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:01:50.006 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:01:50.194 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:50.308 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:50 trial092 ceph-mon[23047]: pgmap v209: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 6 op/s; 193 B/s, 0 objects/s recovering 2026-02-13T04:01:50.308 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:50 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:01:50.308 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:50 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:01:50.308 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:50 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:01:50.308 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:50 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:01:50.397 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.394+0000 7fe1d75776c0 1 -- 10.20.193.92:0/1884230903 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe1d810cde0 msgr2=0x7fe1d810d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:50.397 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.394+0000 7fe1d75776c0 1 --2- 10.20.193.92:0/1884230903 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe1d810cde0 0x7fe1d810d1b0 secure :-1 s=READY pgs=247 gs=1 cs=0 l=1 c_cookie=11862317428753377041 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1cc0099a0 tx=0x7fe1cc02ed50 comp rx=0 tx=0).stop 2026-02-13T04:01:50.397 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.394+0000 7fe1d75776c0 1 -- 10.20.193.92:0/1884230903 shutdown_connections 2026-02-13T04:01:50.397 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.394+0000 7fe1d75776c0 1 --2- 10.20.193.92:0/1884230903 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe1d810d7d0 0x7fe1d8112810 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:50.397 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.394+0000 7fe1d75776c0 1 --2- 10.20.193.92:0/1884230903 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe1d8112ff0 0x7fe1d8173990 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:50.397 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.394+0000 7fe1d75776c0 1 --2- 10.20.193.92:0/1884230903 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe1d810cde0 0x7fe1d810d1b0 unknown :-1 s=CLOSED pgs=247 gs=1 cs=0 l=1 c_cookie=11862317428753377041 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:50.397 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.394+0000 7fe1d75776c0 1 -- 10.20.193.92:0/1884230903 >> 10.20.193.92:0/1884230903 conn(0x7fe1d80ea6a0 msgr2=0x7fe1d810aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:50.397 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.394+0000 7fe1d75776c0 1 -- 10.20.193.92:0/1884230903 shutdown_connections 2026-02-13T04:01:50.397 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.394+0000 7fe1d75776c0 1 -- 10.20.193.92:0/1884230903 wait complete. 2026-02-13T04:01:50.398 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.395+0000 7fe1d75776c0 1 Processor -- start 2026-02-13T04:01:50.398 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.395+0000 7fe1d75776c0 1 -- start start 2026-02-13T04:01:50.398 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.395+0000 7fe1d75776c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe1d810cde0 0x7fe1d805dbd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:50.398 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.395+0000 7fe1d75776c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe1d8112ff0 0x7fe1d8173890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:50.398 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.395+0000 7fe1d75776c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe1d805e200 0x7fe1d80fd530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:50.398 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.395+0000 7fe1d75776c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d805e8f0 con 0x7fe1d8112ff0 2026-02-13T04:01:50.398 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.395+0000 7fe1d75776c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d80fda70 con 0x7fe1d810cde0 2026-02-13T04:01:50.399 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.395+0000 7fe1d75776c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d80fdc30 con 0x7fe1d805e200 2026-02-13T04:01:50.399 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.395+0000 7fe1d65756c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe1d810cde0 0x7fe1d805dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:50.399 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.395+0000 7fe1d65756c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe1d810cde0 0x7fe1d805dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:58492/0 (socket says 10.20.193.92:58492) 2026-02-13T04:01:50.399 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.395+0000 7fe1d65756c0 1 -- 10.20.193.92:0/1817712702 learned_addr learned my addr 10.20.193.92:0/1817712702 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:50.399 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.395+0000 7fe1d6d766c0 1 --2- 10.20.193.92:0/1817712702 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe1d805e200 0x7fe1d80fd530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:50.399 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.396+0000 7fe1d5d746c0 1 --2- 10.20.193.92:0/1817712702 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe1d8112ff0 0x7fe1d8173890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:50.399 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.396+0000 7fe1d65756c0 1 -- 10.20.193.92:0/1817712702 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe1d805e200 msgr2=0x7fe1d80fd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:50.399 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.396+0000 7fe1d65756c0 1 --2- 10.20.193.92:0/1817712702 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe1d805e200 0x7fe1d80fd530 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:50.399 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.396+0000 7fe1d65756c0 1 -- 10.20.193.92:0/1817712702 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe1d8112ff0 msgr2=0x7fe1d8173890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:50.399 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.396+0000 7fe1d65756c0 1 --2- 10.20.193.92:0/1817712702 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe1d8112ff0 0x7fe1d8173890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:50.399 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.396+0000 7fe1d65756c0 1 -- 10.20.193.92:0/1817712702 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1cc009590 con 0x7fe1d810cde0 2026-02-13T04:01:50.399 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.396+0000 7fe1d65756c0 1 --2- 10.20.193.92:0/1817712702 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe1d810cde0 0x7fe1d805dbd0 secure :-1 s=READY pgs=111 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1cc02f820 tx=0x7fe1cc02f850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:50.399 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.396+0000 7fe1bf7fe6c0 1 -- 10.20.193.92:0/1817712702 <== mon.2 v2:10.20.193.99:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe1cc0046b0 con 0x7fe1d810cde0 2026-02-13T04:01:50.399 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.396+0000 7fe1bf7fe6c0 1 -- 10.20.193.92:0/1817712702 <== mon.2 v2:10.20.193.99:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fe1cc005e70 con 0x7fe1d810cde0 2026-02-13T04:01:50.399 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.396+0000 7fe1bf7fe6c0 1 -- 10.20.193.92:0/1817712702 <== mon.2 v2:10.20.193.99:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe1cc007350 con 0x7fe1d810cde0 2026-02-13T04:01:50.399 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.396+0000 7fe1d75776c0 1 -- 10.20.193.92:0/1817712702 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1d80fdeb0 con 0x7fe1d810cde0 2026-02-13T04:01:50.399 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.396+0000 7fe1d75776c0 1 -- 10.20.193.92:0/1817712702 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1d80fe2e0 con 0x7fe1d810cde0 2026-02-13T04:01:50.399 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.397+0000 7fe1d75776c0 1 -- 10.20.193.92:0/1817712702 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1d810e0b0 con 0x7fe1d810cde0 2026-02-13T04:01:50.401 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.399+0000 7fe1bf7fe6c0 1 -- 10.20.193.92:0/1817712702 <== mon.2 v2:10.20.193.99:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fe1cc002750 con 0x7fe1d810cde0 2026-02-13T04:01:50.403 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.400+0000 7fe1bf7fe6c0 1 --2- 10.20.193.92:0/1817712702 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fe1b00b5760 0x7fe1b00d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:50.403 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.400+0000 7fe1bf7fe6c0 1 -- 10.20.193.92:0/1817712702 <== mon.2 v2:10.20.193.99:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7fe1cc107d60 con 0x7fe1d810cde0 2026-02-13T04:01:50.403 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.400+0000 7fe1bf7fe6c0 1 -- 10.20.193.92:0/1817712702 <== mon.2 v2:10.20.193.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe1cc1081e0 con 0x7fe1d810cde0 2026-02-13T04:01:50.403 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.400+0000 7fe1d5d746c0 1 --2- 10.20.193.92:0/1817712702 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fe1b00b5760 0x7fe1b00d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:50.403 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.401+0000 7fe1d5d746c0 1 --2- 10.20.193.92:0/1817712702 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fe1b00b5760 0x7fe1b00d5c10 secure :-1 s=READY pgs=197 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1d8101800 tx=0x7fe1c0009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:50.528 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.525+0000 7fe1d75776c0 1 -- 10.20.193.92:0/1817712702 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe1d810d1b0 con 0x7fe1d810cde0 2026-02-13T04:01:50.528 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.525+0000 7fe1bf7fe6c0 1 -- 10.20.193.92:0/1817712702 <== mon.2 v2:10.20.193.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fe1cc0ca5a0 con 0x7fe1d810cde0 2026-02-13T04:01:50.529 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:01:50.529 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:01:50.530 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.527+0000 7fe1d75776c0 1 -- 10.20.193.92:0/1817712702 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fe1b00b5760 msgr2=0x7fe1b00d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:50.530 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.527+0000 7fe1d75776c0 1 --2- 10.20.193.92:0/1817712702 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fe1b00b5760 0x7fe1b00d5c10 secure :-1 s=READY pgs=197 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1d8101800 tx=0x7fe1c0009260 comp rx=0 tx=0).stop 2026-02-13T04:01:50.530 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.527+0000 7fe1d75776c0 1 -- 10.20.193.92:0/1817712702 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe1d810cde0 msgr2=0x7fe1d805dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:50.531 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.527+0000 7fe1d75776c0 1 --2- 10.20.193.92:0/1817712702 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe1d810cde0 0x7fe1d805dbd0 secure :-1 s=READY pgs=111 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe1cc02f820 tx=0x7fe1cc02f850 comp rx=0 tx=0).stop 2026-02-13T04:01:50.531 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.527+0000 7fe1d75776c0 1 -- 10.20.193.92:0/1817712702 shutdown_connections 2026-02-13T04:01:50.531 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.527+0000 7fe1d75776c0 1 --2- 10.20.193.92:0/1817712702 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe1d805e200 0x7fe1d80fd530 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:50.531 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.527+0000 7fe1d75776c0 1 --2- 10.20.193.92:0/1817712702 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe1d8112ff0 0x7fe1d8173890 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:50.531 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.527+0000 7fe1d75776c0 1 --2- 10.20.193.92:0/1817712702 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fe1b00b5760 0x7fe1b00d5c10 unknown :-1 s=CLOSED pgs=197 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:50.531 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.527+0000 7fe1d75776c0 1 --2- 10.20.193.92:0/1817712702 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe1d810cde0 0x7fe1d805dbd0 unknown :-1 s=CLOSED pgs=111 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:50.531 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.527+0000 7fe1d75776c0 1 -- 10.20.193.92:0/1817712702 >> 10.20.193.92:0/1817712702 conn(0x7fe1d80ea6a0 msgr2=0x7fe1d810b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:50.531 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.527+0000 7fe1d75776c0 1 -- 10.20.193.92:0/1817712702 shutdown_connections 2026-02-13T04:01:50.531 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:50.527+0000 7fe1d75776c0 1 -- 10.20.193.92:0/1817712702 wait complete. 2026-02-13T04:01:50.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:50 trial158 ceph-mon[27763]: pgmap v209: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 6 op/s; 193 B/s, 0 objects/s recovering 2026-02-13T04:01:50.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:50 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:01:50.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:50 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:01:50.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:50 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:01:50.579 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:50 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:01:50.616 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:50 trial099 ceph-mon[27808]: pgmap v209: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 6 op/s; 193 B/s, 0 objects/s recovering 2026-02-13T04:01:50.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:50 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:01:50.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:50 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:01:50.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:50 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:01:50.617 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:50 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:01:51.712 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:51 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:01:51.712 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:51 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:01:51.712 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:51 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/1817712702' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:01:51.712 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:51 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:01:51.712 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:51 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:01:51.712 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:51 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:01:51.712 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:51 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:01:51.712 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:51 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:01:51.712 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:51 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:01:51.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:51 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:01:51.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:51 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:01:51.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:51 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/1817712702' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:01:51.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:51 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:01:51.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:51 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:01:51.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:51 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:01:51.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:51 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:01:51.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:51 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:01:51.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:51 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:01:51.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:51 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:01:51.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:51 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:01:51.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:51 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1817712702' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:01:51.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:51 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:01:51.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:51 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:01:51.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:51 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:01:51.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:51 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:01:51.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:51 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:01:51.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:51 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:01:52.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:52 trial158 ceph-mon[27763]: pgmap v210: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s; 59 B/s, 0 objects/s recovering 2026-02-13T04:01:52.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:52 trial158 ceph-mon[27763]: pgmap v211: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 9 op/s 2026-02-13T04:01:52.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:52 trial158 ceph-mon[27763]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T04:01:52.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:52 trial158 ceph-mon[27763]: Cluster is now healthy 2026-02-13T04:01:52.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:52 trial099 ceph-mon[27808]: pgmap v210: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s; 59 B/s, 0 objects/s recovering 2026-02-13T04:01:52.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:52 trial099 ceph-mon[27808]: pgmap v211: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 9 op/s 2026-02-13T04:01:52.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:52 trial099 ceph-mon[27808]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T04:01:52.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:52 trial099 ceph-mon[27808]: Cluster is now healthy 2026-02-13T04:01:52.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:52 trial092 ceph-mon[23047]: pgmap v210: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s; 59 B/s, 0 objects/s recovering 2026-02-13T04:01:52.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:52 trial092 ceph-mon[23047]: pgmap v211: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 9 op/s 2026-02-13T04:01:52.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:52 trial092 ceph-mon[23047]: Health check cleared: CEPHADM_APPLY_SPEC_FAIL (was: Failed to apply 1 service(s): osd.default) 2026-02-13T04:01:52.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:52 trial092 ceph-mon[23047]: Cluster is now healthy 2026-02-13T04:01:53.671 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:01:53.722 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:53 trial092 ceph-mon[23047]: pgmap v212: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 10 op/s 2026-02-13T04:01:53.722 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:53 trial092 ceph-mon[23047]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T04:01:53.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:53 trial158 ceph-mon[27763]: pgmap v212: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 10 op/s 2026-02-13T04:01:53.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:53 trial158 ceph-mon[27763]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T04:01:53.856 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:53.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:53 trial099 ceph-mon[27808]: pgmap v212: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 10 op/s 2026-02-13T04:01:53.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:53 trial099 ceph-mon[27808]: Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T04:01:54.045 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.041+0000 7f74147606c0 1 -- 10.20.193.92:0/2197186344 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f740c115410 msgr2=0x7f740c175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:54.045 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.041+0000 7f74147606c0 1 --2- 10.20.193.92:0/2197186344 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f740c115410 0x7f740c175db0 secure :-1 s=READY pgs=112 gs=2 cs=0 l=1 c_cookie=12298064007635217394 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f740800aa40 tx=0x7f740802fdf0 comp rx=0 tx=0).stop 2026-02-13T04:01:54.045 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.041+0000 7f74147606c0 1 -- 10.20.193.92:0/2197186344 shutdown_connections 2026-02-13T04:01:54.045 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.041+0000 7f74147606c0 1 --2- 10.20.193.92:0/2197186344 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f740c115410 0x7f740c175db0 unknown :-1 s=CLOSED pgs=112 gs=2 cs=0 l=1 c_cookie=12298064007635217394 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:54.045 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.041+0000 7f74147606c0 1 --2- 10.20.193.92:0/2197186344 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f740c10fbf0 0x7f740c114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:54.045 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.041+0000 7f74147606c0 1 --2- 10.20.193.92:0/2197186344 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f740c10f200 0x7f740c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:54.045 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.041+0000 7f74147606c0 1 -- 10.20.193.92:0/2197186344 >> 10.20.193.92:0/2197186344 conn(0x7f740c0ecb00 msgr2=0x7f740c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:54.045 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.041+0000 7f74147606c0 1 -- 10.20.193.92:0/2197186344 shutdown_connections 2026-02-13T04:01:54.046 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.041+0000 7f74147606c0 1 -- 10.20.193.92:0/2197186344 wait complete. 2026-02-13T04:01:54.047 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.042+0000 7f74147606c0 1 Processor -- start 2026-02-13T04:01:54.048 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.042+0000 7f74147606c0 1 -- start start 2026-02-13T04:01:54.048 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.043+0000 7f74147606c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f740c10f200 0x7f740c11cf30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:54.048 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.043+0000 7f74147606c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f740c115410 0x7f740c11d470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:54.048 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.043+0000 7f74147606c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f740c1227e0 0x7f740c122c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:54.048 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.043+0000 7f74147606c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f740c1231f0 con 0x7f740c115410 2026-02-13T04:01:54.048 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.043+0000 7f74147606c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f740c123360 con 0x7f740c10f200 2026-02-13T04:01:54.048 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.043+0000 7f74147606c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f740c123520 con 0x7f740c1227e0 2026-02-13T04:01:54.048 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.043+0000 7f7411cd06c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f740c115410 0x7f740c11d470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:54.048 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.043+0000 7f7412cd26c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f740c1227e0 0x7f740c122c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:54.048 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.043+0000 7f7411cd06c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f740c115410 0x7f740c11d470 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:39936/0 (socket says 10.20.193.92:39936) 2026-02-13T04:01:54.049 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.043+0000 7f7411cd06c0 1 -- 10.20.193.92:0/4239825081 learned_addr learned my addr 10.20.193.92:0/4239825081 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:54.049 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.043+0000 7f74124d16c0 1 --2- 10.20.193.92:0/4239825081 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f740c10f200 0x7f740c11cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:54.049 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.043+0000 7f7411cd06c0 1 -- 10.20.193.92:0/4239825081 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f740c1227e0 msgr2=0x7f740c122c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:54.049 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.043+0000 7f7411cd06c0 1 --2- 10.20.193.92:0/4239825081 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f740c1227e0 0x7f740c122c80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:54.049 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.043+0000 7f7411cd06c0 1 -- 10.20.193.92:0/4239825081 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f740c10f200 msgr2=0x7f740c11cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:54.049 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.043+0000 7f7411cd06c0 1 --2- 10.20.193.92:0/4239825081 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f740c10f200 0x7f740c11cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:54.049 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.043+0000 7f7411cd06c0 1 -- 10.20.193.92:0/4239825081 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73fc0094c0 con 0x7f740c115410 2026-02-13T04:01:54.049 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.043+0000 7f7412cd26c0 1 --2- 10.20.193.92:0/4239825081 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f740c1227e0 0x7f740c122c80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T04:01:54.049 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.043+0000 7f74124d16c0 1 --2- 10.20.193.92:0/4239825081 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f740c10f200 0x7f740c11cf30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T04:01:54.049 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.043+0000 7f7411cd06c0 1 --2- 10.20.193.92:0/4239825081 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f740c115410 0x7f740c11d470 secure :-1 s=READY pgs=248 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f740000b750 tx=0x7f740000bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:54.049 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.043+0000 7f73f37fe6c0 1 -- 10.20.193.92:0/4239825081 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f7400004a80 con 0x7f740c115410 2026-02-13T04:01:54.050 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.044+0000 7f74147606c0 1 -- 10.20.193.92:0/4239825081 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f740800a660 con 0x7f740c115410 2026-02-13T04:01:54.050 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.044+0000 7f73f37fe6c0 1 -- 10.20.193.92:0/4239825081 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f7400009030 con 0x7f740c115410 2026-02-13T04:01:54.050 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.044+0000 7f73f37fe6c0 1 -- 10.20.193.92:0/4239825081 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f74000071c0 con 0x7f740c115410 2026-02-13T04:01:54.050 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.044+0000 7f74147606c0 1 -- 10.20.193.92:0/4239825081 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f740c163cd0 con 0x7f740c115410 2026-02-13T04:01:54.050 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.044+0000 7f73f17fa6c0 1 -- 10.20.193.92:0/4239825081 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f740c1104d0 con 0x7f740c115410 2026-02-13T04:01:54.051 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.046+0000 7f73f37fe6c0 1 -- 10.20.193.92:0/4239825081 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7f7400005020 con 0x7f740c115410 2026-02-13T04:01:54.051 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.048+0000 7f73f37fe6c0 1 --2- 10.20.193.92:0/4239825081 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f73e80b5760 0x7f73e80d5c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:54.051 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.048+0000 7f73f37fe6c0 1 -- 10.20.193.92:0/4239825081 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f74000e3dc0 con 0x7f740c115410 2026-02-13T04:01:54.051 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.048+0000 7f74124d16c0 1 --2- 10.20.193.92:0/4239825081 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f73e80b5760 0x7f73e80d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:54.051 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.048+0000 7f73f37fe6c0 1 -- 10.20.193.92:0/4239825081 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f74000e4240 con 0x7f740c115410 2026-02-13T04:01:54.052 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.048+0000 7f74124d16c0 1 --2- 10.20.193.92:0/4239825081 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f73e80b5760 0x7f73e80d5c10 secure :-1 s=READY pgs=198 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f73fc004750 tx=0x7f73fc009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:54.174 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.171+0000 7f73f17fa6c0 1 -- 10.20.193.92:0/4239825081 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f740c11e030 con 0x7f740c115410 2026-02-13T04:01:54.174 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.171+0000 7f73f37fe6c0 1 -- 10.20.193.92:0/4239825081 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f74000a6600 con 0x7f740c115410 2026-02-13T04:01:54.174 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:01:54.175 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:01:54.176 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.172+0000 7f73f17fa6c0 1 -- 10.20.193.92:0/4239825081 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f73e80b5760 msgr2=0x7f73e80d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:54.176 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.172+0000 7f73f17fa6c0 1 --2- 10.20.193.92:0/4239825081 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f73e80b5760 0x7f73e80d5c10 secure :-1 s=READY pgs=198 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f73fc004750 tx=0x7f73fc009260 comp rx=0 tx=0).stop 2026-02-13T04:01:54.176 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.172+0000 7f73f17fa6c0 1 -- 10.20.193.92:0/4239825081 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f740c115410 msgr2=0x7f740c11d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:54.176 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.172+0000 7f73f17fa6c0 1 --2- 10.20.193.92:0/4239825081 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f740c115410 0x7f740c11d470 secure :-1 s=READY pgs=248 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f740000b750 tx=0x7f740000bc20 comp rx=0 tx=0).stop 2026-02-13T04:01:54.176 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.173+0000 7f73f17fa6c0 1 -- 10.20.193.92:0/4239825081 shutdown_connections 2026-02-13T04:01:54.176 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.173+0000 7f73f17fa6c0 1 --2- 10.20.193.92:0/4239825081 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f740c1227e0 0x7f740c122c80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:54.176 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.173+0000 7f73f17fa6c0 1 --2- 10.20.193.92:0/4239825081 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f740c115410 0x7f740c11d470 unknown :-1 s=CLOSED pgs=248 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:54.176 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.173+0000 7f73f17fa6c0 1 --2- 10.20.193.92:0/4239825081 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f73e80b5760 0x7f73e80d5c10 unknown :-1 s=CLOSED pgs=198 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:54.176 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.173+0000 7f73f17fa6c0 1 --2- 10.20.193.92:0/4239825081 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f740c10f200 0x7f740c11cf30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:54.176 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.173+0000 7f73f17fa6c0 1 -- 10.20.193.92:0/4239825081 >> 10.20.193.92:0/4239825081 conn(0x7f740c0ecb00 msgr2=0x7f740c10cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:54.177 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.173+0000 7f73f17fa6c0 1 -- 10.20.193.92:0/4239825081 shutdown_connections 2026-02-13T04:01:54.177 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:54.173+0000 7f73f17fa6c0 1 -- 10.20.193.92:0/4239825081 wait complete. 2026-02-13T04:01:54.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:54 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/4239825081' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:01:54.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:54 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/4239825081' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:01:54.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:54 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/4239825081' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:01:55.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:55 trial158 ceph-mon[27763]: pgmap v213: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 9 op/s 2026-02-13T04:01:55.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:55 trial099 ceph-mon[27808]: pgmap v213: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 9 op/s 2026-02-13T04:01:55.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:55 trial092 ceph-mon[23047]: pgmap v213: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 9 op/s 2026-02-13T04:01:57.281 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:01:57.467 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:01:57.598 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:57 trial092 ceph-mon[23047]: pgmap v214: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 8 op/s 2026-02-13T04:01:57.664 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.661+0000 7fe9af46c6c0 1 -- 10.20.193.92:0/2240666458 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe9a810ecd0 msgr2=0x7fe9a810f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:57.664 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.661+0000 7fe9af46c6c0 1 --2- 10.20.193.92:0/2240666458 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe9a810ecd0 0x7fe9a810f170 secure :-1 s=READY pgs=249 gs=1 cs=0 l=1 c_cookie=4081899625897818143 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9a400aa40 tx=0x7fe9a402fdf0 comp rx=0 tx=0).stop 2026-02-13T04:01:57.664 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.661+0000 7fe9af46c6c0 1 -- 10.20.193.92:0/2240666458 shutdown_connections 2026-02-13T04:01:57.664 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.661+0000 7fe9af46c6c0 1 --2- 10.20.193.92:0/2240666458 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe9a810bc30 0x7fe9a810e600 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:57.664 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.661+0000 7fe9af46c6c0 1 --2- 10.20.193.92:0/2240666458 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe9a810ecd0 0x7fe9a810f170 unknown :-1 s=CLOSED pgs=249 gs=1 cs=0 l=1 c_cookie=4081899625897818143 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:57.665 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.661+0000 7fe9af46c6c0 1 --2- 10.20.193.92:0/2240666458 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe9a810b320 0x7fe9a810b6f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:57.665 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.661+0000 7fe9af46c6c0 1 -- 10.20.193.92:0/2240666458 >> 10.20.193.92:0/2240666458 conn(0x7fe9a8062eb0 msgr2=0x7fe9a8109620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:57.665 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.661+0000 7fe9af46c6c0 1 -- 10.20.193.92:0/2240666458 shutdown_connections 2026-02-13T04:01:57.665 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.661+0000 7fe9af46c6c0 1 -- 10.20.193.92:0/2240666458 wait complete. 2026-02-13T04:01:57.667 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.662+0000 7fe9af46c6c0 1 Processor -- start 2026-02-13T04:01:57.667 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.662+0000 7fe9af46c6c0 1 -- start start 2026-02-13T04:01:57.667 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.662+0000 7fe9af46c6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe9a810b320 0x7fe9a8122010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:57.667 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.662+0000 7fe9af46c6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe9a810bc30 0x7fe9a8122550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:57.667 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.662+0000 7fe9af46c6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe9a810ecd0 0x7fe9a8127910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:57.667 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.662+0000 7fe9af46c6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a8127f60 con 0x7fe9a810ecd0 2026-02-13T04:01:57.667 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.662+0000 7fe9af46c6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a81280d0 con 0x7fe9a810bc30 2026-02-13T04:01:57.667 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.662+0000 7fe9af46c6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fe9a8128290 con 0x7fe9a810b320 2026-02-13T04:01:57.667 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.662+0000 7fe9ad1e16c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe9a810b320 0x7fe9a8122010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:57.667 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.662+0000 7fe9ad9e26c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe9a810ecd0 0x7fe9a8127910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:57.667 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.662+0000 7fe9ad1e16c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe9a810b320 0x7fe9a8122010 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:47012/0 (socket says 10.20.193.92:47012) 2026-02-13T04:01:57.668 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.662+0000 7fe9ad1e16c0 1 -- 10.20.193.92:0/1716401513 learned_addr learned my addr 10.20.193.92:0/1716401513 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:01:57.668 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.662+0000 7fe9ac9e06c0 1 --2- 10.20.193.92:0/1716401513 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe9a810bc30 0x7fe9a8122550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:57.668 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.662+0000 7fe9ad9e26c0 1 -- 10.20.193.92:0/1716401513 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe9a810b320 msgr2=0x7fe9a8122010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:57.668 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.662+0000 7fe9ad9e26c0 1 --2- 10.20.193.92:0/1716401513 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe9a810b320 0x7fe9a8122010 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:57.668 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.662+0000 7fe9ad9e26c0 1 -- 10.20.193.92:0/1716401513 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe9a810bc30 msgr2=0x7fe9a8122550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:57.668 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.662+0000 7fe9ad9e26c0 1 --2- 10.20.193.92:0/1716401513 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe9a810bc30 0x7fe9a8122550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:57.668 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.662+0000 7fe9ad9e26c0 1 -- 10.20.193.92:0/1716401513 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a400a660 con 0x7fe9a810ecd0 2026-02-13T04:01:57.668 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.663+0000 7fe9ad9e26c0 1 --2- 10.20.193.92:0/1716401513 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe9a810ecd0 0x7fe9a8127910 secure :-1 s=READY pgs=250 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9a4030300 tx=0x7fe9a4030bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:57.668 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.663+0000 7fe9967fc6c0 1 -- 10.20.193.92:0/1716401513 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe9a40054a0 con 0x7fe9a810ecd0 2026-02-13T04:01:57.668 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.663+0000 7fe9967fc6c0 1 -- 10.20.193.92:0/1716401513 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fe9a4003d40 con 0x7fe9a810ecd0 2026-02-13T04:01:57.668 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.663+0000 7fe9967fc6c0 1 -- 10.20.193.92:0/1716401513 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe9a40322b0 con 0x7fe9a810ecd0 2026-02-13T04:01:57.669 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.663+0000 7fe9af46c6c0 1 -- 10.20.193.92:0/1716401513 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9a8128510 con 0x7fe9a810ecd0 2026-02-13T04:01:57.669 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.663+0000 7fe9af46c6c0 1 -- 10.20.193.92:0/1716401513 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9a8128790 con 0x7fe9a810ecd0 2026-02-13T04:01:57.669 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.663+0000 7fe977fff6c0 1 -- 10.20.193.92:0/1716401513 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9a810c0f0 con 0x7fe9a810ecd0 2026-02-13T04:01:57.669 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.666+0000 7fe9967fc6c0 1 -- 10.20.193.92:0/1716401513 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7fe9a4005600 con 0x7fe9a810ecd0 2026-02-13T04:01:57.670 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.667+0000 7fe9967fc6c0 1 --2- 10.20.193.92:0/1716401513 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fe9840b56e0 0x7fe9840d5b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:01:57.670 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.667+0000 7fe9967fc6c0 1 -- 10.20.193.92:0/1716401513 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7fe9a4108f30 con 0x7fe9a810ecd0 2026-02-13T04:01:57.670 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.668+0000 7fe9ad1e16c0 1 --2- 10.20.193.92:0/1716401513 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fe9840b56e0 0x7fe9840d5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:01:57.670 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.668+0000 7fe9967fc6c0 1 -- 10.20.193.92:0/1716401513 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe9a41093b0 con 0x7fe9a810ecd0 2026-02-13T04:01:57.671 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.668+0000 7fe9ad1e16c0 1 --2- 10.20.193.92:0/1716401513 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fe9840b56e0 0x7fe9840d5b90 secure :-1 s=READY pgs=199 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe998009240 tx=0x7fe998009420 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:01:57.794 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.791+0000 7fe977fff6c0 1 -- 10.20.193.92:0/1716401513 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe9a810b6f0 con 0x7fe9a810ecd0 2026-02-13T04:01:57.794 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.791+0000 7fe9967fc6c0 1 -- 10.20.193.92:0/1716401513 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fe9a40cb800 con 0x7fe9a810ecd0 2026-02-13T04:01:57.794 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:01:57.794 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:01:57.795 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.792+0000 7fe977fff6c0 1 -- 10.20.193.92:0/1716401513 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fe9840b56e0 msgr2=0x7fe9840d5b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:57.795 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.792+0000 7fe977fff6c0 1 --2- 10.20.193.92:0/1716401513 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fe9840b56e0 0x7fe9840d5b90 secure :-1 s=READY pgs=199 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe998009240 tx=0x7fe998009420 comp rx=0 tx=0).stop 2026-02-13T04:01:57.795 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.792+0000 7fe977fff6c0 1 -- 10.20.193.92:0/1716401513 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe9a810ecd0 msgr2=0x7fe9a8127910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:01:57.796 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.792+0000 7fe977fff6c0 1 --2- 10.20.193.92:0/1716401513 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe9a810ecd0 0x7fe9a8127910 secure :-1 s=READY pgs=250 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe9a4030300 tx=0x7fe9a4030bf0 comp rx=0 tx=0).stop 2026-02-13T04:01:57.796 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.792+0000 7fe977fff6c0 1 -- 10.20.193.92:0/1716401513 shutdown_connections 2026-02-13T04:01:57.796 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.792+0000 7fe977fff6c0 1 --2- 10.20.193.92:0/1716401513 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fe9840b56e0 0x7fe9840d5b90 unknown :-1 s=CLOSED pgs=199 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:57.796 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.792+0000 7fe977fff6c0 1 --2- 10.20.193.92:0/1716401513 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe9a810bc30 0x7fe9a8122550 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:57.796 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.792+0000 7fe977fff6c0 1 --2- 10.20.193.92:0/1716401513 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe9a810ecd0 0x7fe9a8127910 unknown :-1 s=CLOSED pgs=250 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:57.796 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.792+0000 7fe977fff6c0 1 --2- 10.20.193.92:0/1716401513 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe9a810b320 0x7fe9a8122010 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:01:57.796 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.792+0000 7fe977fff6c0 1 -- 10.20.193.92:0/1716401513 >> 10.20.193.92:0/1716401513 conn(0x7fe9a8062eb0 msgr2=0x7fe9a810ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:01:57.796 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.792+0000 7fe977fff6c0 1 -- 10.20.193.92:0/1716401513 shutdown_connections 2026-02-13T04:01:57.796 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:01:57.792+0000 7fe977fff6c0 1 -- 10.20.193.92:0/1716401513 wait complete. 2026-02-13T04:01:57.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:57 trial158 ceph-mon[27763]: pgmap v214: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 8 op/s 2026-02-13T04:01:57.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:57 trial099 ceph-mon[27808]: pgmap v214: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 8 op/s 2026-02-13T04:01:58.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:58 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/1716401513' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:01:58.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:58 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/1716401513' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:01:58.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:58 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1716401513' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:01:59.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:01:59 trial158 ceph-mon[27763]: pgmap v215: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 9 op/s 2026-02-13T04:01:59.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:01:59 trial099 ceph-mon[27808]: pgmap v215: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 9 op/s 2026-02-13T04:01:59.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:01:59 trial092 ceph-mon[23047]: pgmap v215: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 9 op/s 2026-02-13T04:02:00.898 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:02:01.082 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:02:01.276 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.273+0000 7efe8353f6c0 1 -- 10.20.193.92:0/3289205969 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efe7c10fa50 msgr2=0x7efe7c114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:01.276 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.273+0000 7efe8353f6c0 1 --2- 10.20.193.92:0/3289205969 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efe7c10fa50 0x7efe7c114a90 secure :-1 s=READY pgs=251 gs=1 cs=0 l=1 c_cookie=5334920832335513752 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe700099a0 tx=0x7efe7002ed00 comp rx=0 tx=0).stop 2026-02-13T04:02:01.277 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.273+0000 7efe8353f6c0 1 -- 10.20.193.92:0/3289205969 shutdown_connections 2026-02-13T04:02:01.277 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.273+0000 7efe8353f6c0 1 --2- 10.20.193.92:0/3289205969 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7efe7c115270 0x7efe7c175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:01.277 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.273+0000 7efe8353f6c0 1 --2- 10.20.193.92:0/3289205969 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efe7c10fa50 0x7efe7c114a90 unknown :-1 s=CLOSED pgs=251 gs=1 cs=0 l=1 c_cookie=5334920832335513752 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:01.277 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.273+0000 7efe8353f6c0 1 --2- 10.20.193.92:0/3289205969 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7efe7c10f060 0x7efe7c10f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:01.277 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.273+0000 7efe8353f6c0 1 -- 10.20.193.92:0/3289205969 >> 10.20.193.92:0/3289205969 conn(0x7efe7c0ec980 msgr2=0x7efe7c10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:02:01.277 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.273+0000 7efe8353f6c0 1 -- 10.20.193.92:0/3289205969 shutdown_connections 2026-02-13T04:02:01.277 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.273+0000 7efe8353f6c0 1 -- 10.20.193.92:0/3289205969 wait complete. 2026-02-13T04:02:01.277 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.274+0000 7efe8353f6c0 1 Processor -- start 2026-02-13T04:02:01.277 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.274+0000 7efe8353f6c0 1 -- start start 2026-02-13T04:02:01.279 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.274+0000 7efe8353f6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efe7c10f060 0x7efe7c0f49b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:01.279 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.274+0000 7efe8353f6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7efe7c115270 0x7efe7c175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:01.279 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.274+0000 7efe8353f6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7efe7c0f4fe0 0x7efe7c0fa2b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:01.279 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.274+0000 7efe8353f6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7efe7c0f56d0 con 0x7efe7c10f060 2026-02-13T04:02:01.279 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.274+0000 7efe8353f6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7efe7c0fa7f0 con 0x7efe7c0f4fe0 2026-02-13T04:02:01.279 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.274+0000 7efe8353f6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7efe7c0fa9b0 con 0x7efe7c115270 2026-02-13T04:02:01.279 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.274+0000 7efe82d3e6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7efe7c0f4fe0 0x7efe7c0fa2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:01.280 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.274+0000 7efe81d3c6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7efe7c115270 0x7efe7c175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:01.280 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.274+0000 7efe82d3e6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7efe7c0f4fe0 0x7efe7c0fa2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:52392/0 (socket says 10.20.193.92:52392) 2026-02-13T04:02:01.280 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.274+0000 7efe82d3e6c0 1 -- 10.20.193.92:0/4138692552 learned_addr learned my addr 10.20.193.92:0/4138692552 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:02:01.280 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.274+0000 7efe8253d6c0 1 --2- 10.20.193.92:0/4138692552 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efe7c10f060 0x7efe7c0f49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:01.280 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.275+0000 7efe8253d6c0 1 -- 10.20.193.92:0/4138692552 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7efe7c115270 msgr2=0x7efe7c175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:01.280 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.275+0000 7efe8253d6c0 1 --2- 10.20.193.92:0/4138692552 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7efe7c115270 0x7efe7c175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:01.280 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.275+0000 7efe8253d6c0 1 -- 10.20.193.92:0/4138692552 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7efe7c0f4fe0 msgr2=0x7efe7c0fa2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:01.280 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.275+0000 7efe8253d6c0 1 --2- 10.20.193.92:0/4138692552 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7efe7c0f4fe0 0x7efe7c0fa2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:01.280 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.275+0000 7efe8253d6c0 1 -- 10.20.193.92:0/4138692552 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe70009590 con 0x7efe7c10f060 2026-02-13T04:02:01.280 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.275+0000 7efe82d3e6c0 1 --2- 10.20.193.92:0/4138692552 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7efe7c0f4fe0 0x7efe7c0fa2b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T04:02:01.280 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.275+0000 7efe8253d6c0 1 --2- 10.20.193.92:0/4138692552 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efe7c10f060 0x7efe7c0f49b0 secure :-1 s=READY pgs=252 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe6c00b640 tx=0x7efe6c00bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:02:01.280 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.275+0000 7efe637fe6c0 1 -- 10.20.193.92:0/4138692552 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efe6c0044a0 con 0x7efe7c10f060 2026-02-13T04:02:01.281 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.275+0000 7efe637fe6c0 1 -- 10.20.193.92:0/4138692552 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7efe6c009030 con 0x7efe7c10f060 2026-02-13T04:02:01.281 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.275+0000 7efe8353f6c0 1 -- 10.20.193.92:0/4138692552 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe7c0fac90 con 0x7efe7c10f060 2026-02-13T04:02:01.281 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.275+0000 7efe637fe6c0 1 -- 10.20.193.92:0/4138692552 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7efe6c00ce60 con 0x7efe7c10f060 2026-02-13T04:02:01.281 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.275+0000 7efe8353f6c0 1 -- 10.20.193.92:0/4138692552 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe7c0fb420 con 0x7efe7c10f060 2026-02-13T04:02:01.281 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.275+0000 7efe8353f6c0 1 -- 10.20.193.92:0/4138692552 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe7c110330 con 0x7efe7c10f060 2026-02-13T04:02:01.281 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.278+0000 7efe637fe6c0 1 -- 10.20.193.92:0/4138692552 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7efe6c00c410 con 0x7efe7c10f060 2026-02-13T04:02:01.282 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.279+0000 7efe637fe6c0 1 --2- 10.20.193.92:0/4138692552 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7efe580b5820 0x7efe580d5cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:01.282 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.280+0000 7efe637fe6c0 1 -- 10.20.193.92:0/4138692552 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7efe6c0e3af0 con 0x7efe7c10f060 2026-02-13T04:02:01.282 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.280+0000 7efe81d3c6c0 1 --2- 10.20.193.92:0/4138692552 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7efe580b5820 0x7efe580d5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:01.283 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.280+0000 7efe637fe6c0 1 -- 10.20.193.92:0/4138692552 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7efe6c11c5e0 con 0x7efe7c10f060 2026-02-13T04:02:01.283 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.280+0000 7efe81d3c6c0 1 --2- 10.20.193.92:0/4138692552 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7efe580b5820 0x7efe580d5cd0 secure :-1 s=READY pgs=200 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe7c0fb340 tx=0x7efe700023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:02:01.408 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.405+0000 7efe8353f6c0 1 -- 10.20.193.92:0/4138692552 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7efe7c0f5b00 con 0x7efe7c10f060 2026-02-13T04:02:01.408 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.405+0000 7efe637fe6c0 1 -- 10.20.193.92:0/4138692552 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7efe6c0a6330 con 0x7efe7c10f060 2026-02-13T04:02:01.408 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:02:01.408 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:02:01.409 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.406+0000 7efe8353f6c0 1 -- 10.20.193.92:0/4138692552 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7efe580b5820 msgr2=0x7efe580d5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:01.409 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.406+0000 7efe8353f6c0 1 --2- 10.20.193.92:0/4138692552 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7efe580b5820 0x7efe580d5cd0 secure :-1 s=READY pgs=200 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe7c0fb340 tx=0x7efe700023a0 comp rx=0 tx=0).stop 2026-02-13T04:02:01.409 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.406+0000 7efe8353f6c0 1 -- 10.20.193.92:0/4138692552 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efe7c10f060 msgr2=0x7efe7c0f49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:01.409 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.406+0000 7efe8353f6c0 1 --2- 10.20.193.92:0/4138692552 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efe7c10f060 0x7efe7c0f49b0 secure :-1 s=READY pgs=252 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efe6c00b640 tx=0x7efe6c00bb10 comp rx=0 tx=0).stop 2026-02-13T04:02:01.409 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.406+0000 7efe8353f6c0 1 -- 10.20.193.92:0/4138692552 shutdown_connections 2026-02-13T04:02:01.409 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.406+0000 7efe8353f6c0 1 --2- 10.20.193.92:0/4138692552 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7efe580b5820 0x7efe580d5cd0 unknown :-1 s=CLOSED pgs=200 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:01.409 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.406+0000 7efe8353f6c0 1 --2- 10.20.193.92:0/4138692552 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7efe7c0f4fe0 0x7efe7c0fa2b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:01.409 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.406+0000 7efe8353f6c0 1 --2- 10.20.193.92:0/4138692552 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7efe7c115270 0x7efe7c175b10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:01.409 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.406+0000 7efe8353f6c0 1 --2- 10.20.193.92:0/4138692552 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7efe7c10f060 0x7efe7c0f49b0 unknown :-1 s=CLOSED pgs=252 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:01.409 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.406+0000 7efe8353f6c0 1 -- 10.20.193.92:0/4138692552 >> 10.20.193.92:0/4138692552 conn(0x7efe7c0ec980 msgr2=0x7efe7c10d680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:02:01.409 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.407+0000 7efe8353f6c0 1 -- 10.20.193.92:0/4138692552 shutdown_connections 2026-02-13T04:02:01.409 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:01.407+0000 7efe8353f6c0 1 -- 10.20.193.92:0/4138692552 wait complete. 2026-02-13T04:02:01.469 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:01 trial092 ceph-mon[23047]: pgmap v216: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 10 op/s 2026-02-13T04:02:01.469 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:01 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/4138692552' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:01.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:01 trial158 ceph-mon[27763]: pgmap v216: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 10 op/s 2026-02-13T04:02:01.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:01 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/4138692552' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:01.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:01 trial099 ceph-mon[27808]: pgmap v216: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 10 op/s 2026-02-13T04:02:01.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:01 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/4138692552' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:03.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:03 trial158 ceph-mon[27763]: pgmap v217: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.1 KiB/s rd, 11 op/s 2026-02-13T04:02:03.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:03 trial099 ceph-mon[27808]: pgmap v217: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.1 KiB/s rd, 11 op/s 2026-02-13T04:02:03.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:03 trial092 ceph-mon[23047]: pgmap v217: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.1 KiB/s rd, 11 op/s 2026-02-13T04:02:04.513 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:02:04.697 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:02:04.898 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:04.895+0000 7ff08086b6c0 1 -- 10.20.193.92:0/720673331 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff07c10fa50 msgr2=0x7ff07c114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:04.898 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:04.895+0000 7ff08086b6c0 1 --2- 10.20.193.92:0/720673331 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff07c10fa50 0x7ff07c114a90 secure :-1 s=READY pgs=109 gs=2 cs=0 l=1 c_cookie=11656490748190593090 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff0640099a0 tx=0x7ff06402ed00 comp rx=0 tx=0).stop 2026-02-13T04:02:04.898 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:04.895+0000 7ff08086b6c0 1 -- 10.20.193.92:0/720673331 shutdown_connections 2026-02-13T04:02:04.898 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:04.895+0000 7ff08086b6c0 1 --2- 10.20.193.92:0/720673331 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff07c115270 0x7ff07c175c10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:04.898 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:04.895+0000 7ff08086b6c0 1 --2- 10.20.193.92:0/720673331 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff07c10fa50 0x7ff07c114a90 unknown :-1 s=CLOSED pgs=109 gs=2 cs=0 l=1 c_cookie=11656490748190593090 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:04.898 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:04.895+0000 7ff08086b6c0 1 --2- 10.20.193.92:0/720673331 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff07c10f060 0x7ff07c10f430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:04.898 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:04.895+0000 7ff08086b6c0 1 -- 10.20.193.92:0/720673331 >> 10.20.193.92:0/720673331 conn(0x7ff07c0ec980 msgr2=0x7ff07c10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:02:04.898 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:04.895+0000 7ff08086b6c0 1 -- 10.20.193.92:0/720673331 shutdown_connections 2026-02-13T04:02:04.898 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:04.895+0000 7ff08086b6c0 1 -- 10.20.193.92:0/720673331 wait complete. 2026-02-13T04:02:04.898 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:04.895+0000 7ff08086b6c0 1 Processor -- start 2026-02-13T04:02:04.898 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:04.896+0000 7ff08086b6c0 1 -- start start 2026-02-13T04:02:04.898 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:04.896+0000 7ff08086b6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff07c10f060 0x7ff07c0f47f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:04.898 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:04.896+0000 7ff08086b6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff07c115270 0x7ff07c175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:04.898 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:04.896+0000 7ff08086b6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff07c0f4e20 0x7ff07c0fa0f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:04.898 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:04.896+0000 7ff08086b6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff07c0f5510 con 0x7ff07c0f4e20 2026-02-13T04:02:04.898 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:04.896+0000 7ff08086b6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff07c0fa630 con 0x7ff07c115270 2026-02-13T04:02:04.898 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:04.896+0000 7ff08086b6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7ff07c0fa7f0 con 0x7ff07c10f060 2026-02-13T04:02:04.898 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:04.896+0000 7ff07b5776c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff07c0f4e20 0x7ff07c0fa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:04.898 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:04.896+0000 7ff07a5756c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff07c115270 0x7ff07c175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:04.899 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:04.896+0000 7ff07b5776c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff07c0f4e20 0x7ff07c0fa0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:32872/0 (socket says 10.20.193.92:32872) 2026-02-13T04:02:04.899 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:04.896+0000 7ff07b5776c0 1 -- 10.20.193.92:0/431229460 learned_addr learned my addr 10.20.193.92:0/431229460 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:02:04.899 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:04.896+0000 7ff07ad766c0 1 --2- 10.20.193.92:0/431229460 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff07c10f060 0x7ff07c0f47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:04.899 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:04.896+0000 7ff07b5776c0 1 -- 10.20.193.92:0/431229460 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff07c10f060 msgr2=0x7ff07c0f47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:04.899 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:04.896+0000 7ff07b5776c0 1 --2- 10.20.193.92:0/431229460 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff07c10f060 0x7ff07c0f47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:04.899 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:04.896+0000 7ff07b5776c0 1 -- 10.20.193.92:0/431229460 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff07c115270 msgr2=0x7ff07c175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:04.899 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:04.896+0000 7ff07b5776c0 1 --2- 10.20.193.92:0/431229460 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff07c115270 0x7ff07c175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:04.899 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:04.896+0000 7ff07b5776c0 1 -- 10.20.193.92:0/431229460 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff064009590 con 0x7ff07c0f4e20 2026-02-13T04:02:04.899 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:04.896+0000 7ff07b5776c0 1 --2- 10.20.193.92:0/431229460 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff07c0f4e20 0x7ff07c0fa0f0 secure :-1 s=READY pgs=253 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff06c006ea0 tx=0x7ff06c00ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:02:04.899 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:04.897+0000 7ff05bfff6c0 1 -- 10.20.193.92:0/431229460 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff06c003c40 con 0x7ff07c0f4e20 2026-02-13T04:02:04.899 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:04.897+0000 7ff05bfff6c0 1 -- 10.20.193.92:0/431229460 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7ff06c003da0 con 0x7ff07c0f4e20 2026-02-13T04:02:04.899 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:04.897+0000 7ff08086b6c0 1 -- 10.20.193.92:0/431229460 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff07c0faad0 con 0x7ff07c0f4e20 2026-02-13T04:02:04.899 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:04.897+0000 7ff05bfff6c0 1 -- 10.20.193.92:0/431229460 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff06c008440 con 0x7ff07c0f4e20 2026-02-13T04:02:04.899 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:04.897+0000 7ff08086b6c0 1 -- 10.20.193.92:0/431229460 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff07c0fb260 con 0x7ff07c0f4e20 2026-02-13T04:02:04.900 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:04.897+0000 7ff08086b6c0 1 -- 10.20.193.92:0/431229460 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff07c0fafb0 con 0x7ff07c0f4e20 2026-02-13T04:02:04.902 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:04.899+0000 7ff05bfff6c0 1 -- 10.20.193.92:0/431229460 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 16) ==== 157134+0+0 (secure 0 0 0) 0x7ff06c00d690 con 0x7ff07c0f4e20 2026-02-13T04:02:04.904 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:04.901+0000 7ff05bfff6c0 1 --2- 10.20.193.92:0/431229460 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff0500b5830 0x7ff0500d5ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:04.904 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:04.901+0000 7ff05bfff6c0 1 -- 10.20.193.92:0/431229460 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7ff06c0e4c90 con 0x7ff07c0f4e20 2026-02-13T04:02:04.904 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:04.901+0000 7ff05bfff6c0 1 -- 10.20.193.92:0/431229460 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff06c0e5110 con 0x7ff07c0f4e20 2026-02-13T04:02:04.904 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:04.901+0000 7ff07ad766c0 1 --2- 10.20.193.92:0/431229460 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff0500b5830 0x7ff0500d5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:04.904 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:04.902+0000 7ff07ad766c0 1 --2- 10.20.193.92:0/431229460 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff0500b5830 0x7ff0500d5ce0 secure :-1 s=READY pgs=201 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff070005fd0 tx=0x7ff0700093f0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:02:05.028 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:05.026+0000 7ff08086b6c0 1 -- 10.20.193.92:0/431229460 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff07c110330 con 0x7ff07c0f4e20 2026-02-13T04:02:05.028 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:05.026+0000 7ff05bfff6c0 1 -- 10.20.193.92:0/431229460 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ff06c0a74d0 con 0x7ff07c0f4e20 2026-02-13T04:02:05.028 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:02:05.028 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:02:05.029 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:05.027+0000 7ff08086b6c0 1 -- 10.20.193.92:0/431229460 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff0500b5830 msgr2=0x7ff0500d5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:05.029 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:05.027+0000 7ff08086b6c0 1 --2- 10.20.193.92:0/431229460 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff0500b5830 0x7ff0500d5ce0 secure :-1 s=READY pgs=201 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff070005fd0 tx=0x7ff0700093f0 comp rx=0 tx=0).stop 2026-02-13T04:02:05.029 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:05.027+0000 7ff08086b6c0 1 -- 10.20.193.92:0/431229460 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff07c0f4e20 msgr2=0x7ff07c0fa0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:05.029 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:05.027+0000 7ff08086b6c0 1 --2- 10.20.193.92:0/431229460 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff07c0f4e20 0x7ff07c0fa0f0 secure :-1 s=READY pgs=253 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff06c006ea0 tx=0x7ff06c00ce50 comp rx=0 tx=0).stop 2026-02-13T04:02:05.030 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:05.027+0000 7ff08086b6c0 1 -- 10.20.193.92:0/431229460 shutdown_connections 2026-02-13T04:02:05.030 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:05.027+0000 7ff08086b6c0 1 --2- 10.20.193.92:0/431229460 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff0500b5830 0x7ff0500d5ce0 unknown :-1 s=CLOSED pgs=201 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:05.030 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:05.027+0000 7ff08086b6c0 1 --2- 10.20.193.92:0/431229460 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff07c115270 0x7ff07c175b10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:05.030 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:05.027+0000 7ff08086b6c0 1 --2- 10.20.193.92:0/431229460 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff07c0f4e20 0x7ff07c0fa0f0 unknown :-1 s=CLOSED pgs=253 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:05.030 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:05.027+0000 7ff08086b6c0 1 --2- 10.20.193.92:0/431229460 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff07c10f060 0x7ff07c0f47f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:05.030 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:05.027+0000 7ff08086b6c0 1 -- 10.20.193.92:0/431229460 >> 10.20.193.92:0/431229460 conn(0x7ff07c0ec980 msgr2=0x7ff07c10d540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:02:05.030 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:05.027+0000 7ff08086b6c0 1 -- 10.20.193.92:0/431229460 shutdown_connections 2026-02-13T04:02:05.030 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:05.027+0000 7ff08086b6c0 1 -- 10.20.193.92:0/431229460 wait complete. 2026-02-13T04:02:05.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:05 trial158 ceph-mon[27763]: pgmap v218: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:02:05.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:05 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/431229460' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:05.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:05 trial099 ceph-mon[27808]: pgmap v218: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:02:05.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:05 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/431229460' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:05.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:05 trial092 ceph-mon[23047]: pgmap v218: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:02:05.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:05 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/431229460' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:07.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:07 trial158 ceph-mon[27763]: pgmap v219: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T04:02:07.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:07 trial158 ceph-mon[27763]: mgrmap e17: x(active, since 3m), standbys: z, y 2026-02-13T04:02:07.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:07 trial099 ceph-mon[27808]: pgmap v219: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T04:02:07.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:07 trial099 ceph-mon[27808]: mgrmap e17: x(active, since 3m), standbys: z, y 2026-02-13T04:02:07.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:07 trial092 ceph-mon[23047]: pgmap v219: 97 pgs: 97 active+clean; 654 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T04:02:07.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:07 trial092 ceph-mon[23047]: mgrmap e17: x(active, since 3m), standbys: z, y 2026-02-13T04:02:08.134 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:02:08.320 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:02:08.508 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.505+0000 7f9f8bfff6c0 1 -- 10.20.193.92:0/2344182080 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9f8c11a8a0 msgr2=0x7f9f8c17b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:08.508 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.505+0000 7f9f8bfff6c0 1 --2- 10.20.193.92:0/2344182080 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9f8c11a8a0 0x7f9f8c17b240 secure :-1 s=READY pgs=113 gs=3 cs=0 l=1 c_cookie=8678568012593985966 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f7c006fd0 tx=0x7f9f7c02fd30 comp rx=0 tx=0).stop 2026-02-13T04:02:08.508 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.505+0000 7f9f8bfff6c0 1 -- 10.20.193.92:0/2344182080 shutdown_connections 2026-02-13T04:02:08.508 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.505+0000 7f9f8bfff6c0 1 --2- 10.20.193.92:0/2344182080 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9f8c11a8a0 0x7f9f8c17b240 unknown :-1 s=CLOSED pgs=113 gs=3 cs=0 l=1 c_cookie=8678568012593985966 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:08.508 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.505+0000 7f9f8bfff6c0 1 --2- 10.20.193.92:0/2344182080 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9f8c115080 0x7f9f8c11a0c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:08.509 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.505+0000 7f9f8bfff6c0 1 --2- 10.20.193.92:0/2344182080 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f9f8c114690 0x7f9f8c114a60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:08.509 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.505+0000 7f9f8bfff6c0 1 -- 10.20.193.92:0/2344182080 >> 10.20.193.92:0/2344182080 conn(0x7f9f8c05cd80 msgr2=0x7f9f8c05d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:02:08.509 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.505+0000 7f9f8bfff6c0 1 -- 10.20.193.92:0/2344182080 shutdown_connections 2026-02-13T04:02:08.509 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.505+0000 7f9f8bfff6c0 1 -- 10.20.193.92:0/2344182080 wait complete. 2026-02-13T04:02:08.511 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.506+0000 7f9f8bfff6c0 1 Processor -- start 2026-02-13T04:02:08.511 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.506+0000 7f9f8bfff6c0 1 -- start start 2026-02-13T04:02:08.511 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.506+0000 7f9f8bfff6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9f8c114690 0x7f9f8c17bba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:08.511 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.506+0000 7f9f8bfff6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f9f8c11a8a0 0x7f9f8c17c0e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:08.511 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.506+0000 7f9f8bfff6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9f8c17c620 0x7f9f8c16a680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:08.511 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.506+0000 7f9f8bfff6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9f8c16abc0 con 0x7f9f8c17c620 2026-02-13T04:02:08.512 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.506+0000 7f9f8bfff6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9f8c16ad30 con 0x7f9f8c114690 2026-02-13T04:02:08.512 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.506+0000 7f9f8bfff6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f9f8c16aef0 con 0x7f9f8c11a8a0 2026-02-13T04:02:08.512 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.506+0000 7f9f8affd6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9f8c114690 0x7f9f8c17bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:08.512 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.506+0000 7f9f8affd6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9f8c114690 0x7f9f8c17bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:59362/0 (socket says 10.20.193.92:59362) 2026-02-13T04:02:08.512 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.506+0000 7f9f8affd6c0 1 -- 10.20.193.92:0/2858327609 learned_addr learned my addr 10.20.193.92:0/2858327609 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:02:08.512 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.506+0000 7f9f8a7fc6c0 1 --2- 10.20.193.92:0/2858327609 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f9f8c11a8a0 0x7f9f8c17c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:08.512 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.506+0000 7f9f8b7fe6c0 1 --2- 10.20.193.92:0/2858327609 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9f8c17c620 0x7f9f8c16a680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:08.512 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.507+0000 7f9f8affd6c0 1 -- 10.20.193.92:0/2858327609 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f9f8c11a8a0 msgr2=0x7f9f8c17c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:08.512 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.507+0000 7f9f8affd6c0 1 --2- 10.20.193.92:0/2858327609 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f9f8c11a8a0 0x7f9f8c17c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:08.512 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.507+0000 7f9f8affd6c0 1 -- 10.20.193.92:0/2858327609 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9f8c17c620 msgr2=0x7f9f8c16a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:08.512 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.507+0000 7f9f8affd6c0 1 --2- 10.20.193.92:0/2858327609 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9f8c17c620 0x7f9f8c16a680 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:08.513 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.507+0000 7f9f8affd6c0 1 -- 10.20.193.92:0/2858327609 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f74009590 con 0x7f9f8c114690 2026-02-13T04:02:08.513 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.507+0000 7f9f8b7fe6c0 1 --2- 10.20.193.92:0/2858327609 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9f8c17c620 0x7f9f8c16a680 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T04:02:08.513 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.507+0000 7f9f8affd6c0 1 --2- 10.20.193.92:0/2858327609 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9f8c114690 0x7f9f8c17bba0 secure :-1 s=READY pgs=114 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f80009490 tx=0x7f9f8000bc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:02:08.513 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.507+0000 7f9f6bfff6c0 1 -- 10.20.193.92:0/2858327609 <== mon.2 v2:10.20.193.99:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f80004a80 con 0x7f9f8c114690 2026-02-13T04:02:08.513 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.507+0000 7f9f6bfff6c0 1 -- 10.20.193.92:0/2858327609 <== mon.2 v2:10.20.193.99:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f9f80009030 con 0x7f9f8c114690 2026-02-13T04:02:08.513 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.507+0000 7f9f6bfff6c0 1 -- 10.20.193.92:0/2858327609 <== mon.2 v2:10.20.193.99:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9f800071c0 con 0x7f9f8c114690 2026-02-13T04:02:08.513 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.507+0000 7f9f8bfff6c0 1 -- 10.20.193.92:0/2858327609 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f7c00a5b0 con 0x7f9f8c114690 2026-02-13T04:02:08.513 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.507+0000 7f9f8bfff6c0 1 -- 10.20.193.92:0/2858327609 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f8c16b4d0 con 0x7f9f8c114690 2026-02-13T04:02:08.513 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.508+0000 7f9f8bfff6c0 1 -- 10.20.193.92:0/2858327609 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f8c115960 con 0x7f9f8c114690 2026-02-13T04:02:08.514 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.510+0000 7f9f6bfff6c0 1 -- 10.20.193.92:0/2858327609 <== mon.2 v2:10.20.193.99:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f9f80004e90 con 0x7f9f8c114690 2026-02-13T04:02:08.515 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.512+0000 7f9f6bfff6c0 1 --2- 10.20.193.92:0/2858327609 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f9f600b56d0 0x7f9f600d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:08.515 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.512+0000 7f9f6bfff6c0 1 -- 10.20.193.92:0/2858327609 <== mon.2 v2:10.20.193.99:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f9f800e3aa0 con 0x7f9f8c114690 2026-02-13T04:02:08.515 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.512+0000 7f9f6bfff6c0 1 -- 10.20.193.92:0/2858327609 <== mon.2 v2:10.20.193.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f9f8011c5e0 con 0x7f9f8c114690 2026-02-13T04:02:08.515 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.512+0000 7f9f8a7fc6c0 1 --2- 10.20.193.92:0/2858327609 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f9f600b56d0 0x7f9f600d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:08.516 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.513+0000 7f9f8a7fc6c0 1 --2- 10.20.193.92:0/2858327609 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f9f600b56d0 0x7f9f600d5b80 secure :-1 s=READY pgs=202 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f8c11a410 tx=0x7f9f74009310 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:02:08.638 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.635+0000 7f9f8bfff6c0 1 -- 10.20.193.92:0/2858327609 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9f8c114a60 con 0x7f9f8c114690 2026-02-13T04:02:08.638 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.635+0000 7f9f6bfff6c0 1 -- 10.20.193.92:0/2858327609 <== mon.2 v2:10.20.193.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f9f800a6440 con 0x7f9f8c114690 2026-02-13T04:02:08.638 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:02:08.638 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:02:08.639 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.636+0000 7f9f8bfff6c0 1 -- 10.20.193.92:0/2858327609 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f9f600b56d0 msgr2=0x7f9f600d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:08.639 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.636+0000 7f9f8bfff6c0 1 --2- 10.20.193.92:0/2858327609 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f9f600b56d0 0x7f9f600d5b80 secure :-1 s=READY pgs=202 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f8c11a410 tx=0x7f9f74009310 comp rx=0 tx=0).stop 2026-02-13T04:02:08.639 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.636+0000 7f9f8bfff6c0 1 -- 10.20.193.92:0/2858327609 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9f8c114690 msgr2=0x7f9f8c17bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:08.640 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.636+0000 7f9f8bfff6c0 1 --2- 10.20.193.92:0/2858327609 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9f8c114690 0x7f9f8c17bba0 secure :-1 s=READY pgs=114 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9f80009490 tx=0x7f9f8000bc50 comp rx=0 tx=0).stop 2026-02-13T04:02:08.640 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.636+0000 7f9f8bfff6c0 1 -- 10.20.193.92:0/2858327609 shutdown_connections 2026-02-13T04:02:08.640 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.636+0000 7f9f8bfff6c0 1 --2- 10.20.193.92:0/2858327609 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9f8c17c620 0x7f9f8c16a680 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:08.640 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.636+0000 7f9f8bfff6c0 1 --2- 10.20.193.92:0/2858327609 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f9f8c11a8a0 0x7f9f8c17c0e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:08.640 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.636+0000 7f9f8bfff6c0 1 --2- 10.20.193.92:0/2858327609 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f9f600b56d0 0x7f9f600d5b80 unknown :-1 s=CLOSED pgs=202 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:08.640 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.636+0000 7f9f8bfff6c0 1 --2- 10.20.193.92:0/2858327609 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9f8c114690 0x7f9f8c17bba0 unknown :-1 s=CLOSED pgs=114 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:08.640 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.636+0000 7f9f8bfff6c0 1 -- 10.20.193.92:0/2858327609 >> 10.20.193.92:0/2858327609 conn(0x7f9f8c05cd80 msgr2=0x7f9f8c1186c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:02:08.640 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.636+0000 7f9f8bfff6c0 1 -- 10.20.193.92:0/2858327609 shutdown_connections 2026-02-13T04:02:08.640 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:08.636+0000 7f9f8bfff6c0 1 -- 10.20.193.92:0/2858327609 wait complete. 2026-02-13T04:02:09.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:09 trial158 ceph-mon[27763]: pgmap v220: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.0 KiB/s rd, 597 B/s wr, 11 op/s 2026-02-13T04:02:09.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:09 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/2858327609' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:09.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:09 trial099 ceph-mon[27808]: pgmap v220: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.0 KiB/s rd, 597 B/s wr, 11 op/s 2026-02-13T04:02:09.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:09 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/2858327609' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:09.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:09 trial092 ceph-mon[23047]: pgmap v220: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.0 KiB/s rd, 597 B/s wr, 11 op/s 2026-02-13T04:02:09.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:09 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/2858327609' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:11.743 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:02:11.794 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:11 trial092 ceph-mon[23047]: pgmap v221: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 11 op/s 2026-02-13T04:02:11.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:11 trial158 ceph-mon[27763]: pgmap v221: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 11 op/s 2026-02-13T04:02:11.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:11 trial099 ceph-mon[27808]: pgmap v221: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 767 B/s wr, 11 op/s 2026-02-13T04:02:11.927 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:02:12.118 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.115+0000 7f74bf03c6c0 1 -- 10.20.193.92:0/2817485455 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f74b810c4e0 msgr2=0x7f74b810c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:12.118 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.115+0000 7f74bf03c6c0 1 --2- 10.20.193.92:0/2817485455 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f74b810c4e0 0x7f74b810c980 secure :-1 s=READY pgs=254 gs=1 cs=0 l=1 c_cookie=2166160239188832987 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74b400aa40 tx=0x7f74b402fde0 comp rx=0 tx=0).stop 2026-02-13T04:02:12.118 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.115+0000 7f74bf03c6c0 1 -- 10.20.193.92:0/2817485455 shutdown_connections 2026-02-13T04:02:12.118 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.115+0000 7f74bf03c6c0 1 --2- 10.20.193.92:0/2817485455 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f74b810c4e0 0x7f74b810c980 unknown :-1 s=CLOSED pgs=254 gs=1 cs=0 l=1 c_cookie=2166160239188832987 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:12.119 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.115+0000 7f74bf03c6c0 1 --2- 10.20.193.92:0/2817485455 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f74b8112fc0 0x7f74b810b730 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:12.119 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.115+0000 7f74bf03c6c0 1 --2- 10.20.193.92:0/2817485455 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f74b8112b10 0x7f74b810b1f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:12.119 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.115+0000 7f74bf03c6c0 1 -- 10.20.193.92:0/2817485455 >> 10.20.193.92:0/2817485455 conn(0x7f74b8063af0 msgr2=0x7f74b80642b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:02:12.119 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.115+0000 7f74bf03c6c0 1 -- 10.20.193.92:0/2817485455 shutdown_connections 2026-02-13T04:02:12.119 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.115+0000 7f74bf03c6c0 1 -- 10.20.193.92:0/2817485455 wait complete. 2026-02-13T04:02:12.121 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.116+0000 7f74bf03c6c0 1 Processor -- start 2026-02-13T04:02:12.121 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.116+0000 7f74bf03c6c0 1 -- start start 2026-02-13T04:02:12.121 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.116+0000 7f74bf03c6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f74b810c4e0 0x7f74b81229b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:12.121 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.116+0000 7f74bf03c6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f74b8112b10 0x7f74b8122ef0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:12.121 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.116+0000 7f74bf03c6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f74b8112fc0 0x7f74b81282b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:12.121 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.116+0000 7f74bf03c6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f74b8128900 con 0x7f74b810c4e0 2026-02-13T04:02:12.121 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.116+0000 7f74bf03c6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f74b8128a70 con 0x7f74b8112b10 2026-02-13T04:02:12.121 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.116+0000 7f74bf03c6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f74b8128c30 con 0x7f74b8112fc0 2026-02-13T04:02:12.122 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.116+0000 7f74bcdb16c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f74b810c4e0 0x7f74b81229b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:12.122 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.116+0000 7f74bcdb16c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f74b810c4e0 0x7f74b81229b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:32916/0 (socket says 10.20.193.92:32916) 2026-02-13T04:02:12.122 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.116+0000 7f74bcdb16c0 1 -- 10.20.193.92:0/1537292357 learned_addr learned my addr 10.20.193.92:0/1537292357 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:02:12.122 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.117+0000 7f74bd5b26c0 1 --2- 10.20.193.92:0/1537292357 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f74b8112fc0 0x7f74b81282b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:12.122 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.117+0000 7f74affff6c0 1 --2- 10.20.193.92:0/1537292357 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f74b8112b10 0x7f74b8122ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:12.122 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.117+0000 7f74bcdb16c0 1 -- 10.20.193.92:0/1537292357 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f74b8112fc0 msgr2=0x7f74b81282b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:12.122 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.117+0000 7f74bcdb16c0 1 --2- 10.20.193.92:0/1537292357 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f74b8112fc0 0x7f74b81282b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:12.122 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.117+0000 7f74bcdb16c0 1 -- 10.20.193.92:0/1537292357 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f74b8112b10 msgr2=0x7f74b8122ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:12.122 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.117+0000 7f74bcdb16c0 1 --2- 10.20.193.92:0/1537292357 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f74b8112b10 0x7f74b8122ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:12.122 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.117+0000 7f74bcdb16c0 1 -- 10.20.193.92:0/1537292357 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74b400a660 con 0x7f74b810c4e0 2026-02-13T04:02:12.122 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.117+0000 7f74bcdb16c0 1 --2- 10.20.193.92:0/1537292357 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f74b810c4e0 0x7f74b81229b0 secure :-1 s=READY pgs=255 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74a800b710 tx=0x7f74a800bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:02:12.123 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.117+0000 7f74adffb6c0 1 -- 10.20.193.92:0/1537292357 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f74a8004250 con 0x7f74b810c4e0 2026-02-13T04:02:12.123 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.117+0000 7f74adffb6c0 1 -- 10.20.193.92:0/1537292357 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f74a8009070 con 0x7f74b810c4e0 2026-02-13T04:02:12.123 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.117+0000 7f74adffb6c0 1 -- 10.20.193.92:0/1537292357 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f74a8004250 con 0x7f74b810c4e0 2026-02-13T04:02:12.123 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.117+0000 7f74bf03c6c0 1 -- 10.20.193.92:0/1537292357 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74b8128f10 con 0x7f74b810c4e0 2026-02-13T04:02:12.123 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.117+0000 7f74bf03c6c0 1 -- 10.20.193.92:0/1537292357 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74b81695f0 con 0x7f74b810c4e0 2026-02-13T04:02:12.123 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.118+0000 7f74bf03c6c0 1 -- 10.20.193.92:0/1537292357 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74b8129130 con 0x7f74b810c4e0 2026-02-13T04:02:12.123 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.121+0000 7f74adffb6c0 1 -- 10.20.193.92:0/1537292357 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f74a800ccf0 con 0x7f74b810c4e0 2026-02-13T04:02:12.125 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.122+0000 7f74adffb6c0 1 --2- 10.20.193.92:0/1537292357 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f74940b5730 0x7f74940d5be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:12.125 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.122+0000 7f74adffb6c0 1 -- 10.20.193.92:0/1537292357 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f74a80e3820 con 0x7f74b810c4e0 2026-02-13T04:02:12.125 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.122+0000 7f74affff6c0 1 --2- 10.20.193.92:0/1537292357 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f74940b5730 0x7f74940d5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:12.125 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.122+0000 7f74adffb6c0 1 -- 10.20.193.92:0/1537292357 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f74a80e3ca0 con 0x7f74b810c4e0 2026-02-13T04:02:12.126 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.123+0000 7f74affff6c0 1 --2- 10.20.193.92:0/1537292357 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f74940b5730 0x7f74940d5be0 secure :-1 s=READY pgs=203 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74a0005980 tx=0x7f74a0005910 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:02:12.250 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.247+0000 7f74bf03c6c0 1 -- 10.20.193.92:0/1537292357 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f74b8065120 con 0x7f74b810c4e0 2026-02-13T04:02:12.250 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.247+0000 7f74adffb6c0 1 -- 10.20.193.92:0/1537292357 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f74a80a61c0 con 0x7f74b810c4e0 2026-02-13T04:02:12.250 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:02:12.251 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:02:12.251 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.248+0000 7f74bf03c6c0 1 -- 10.20.193.92:0/1537292357 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f74940b5730 msgr2=0x7f74940d5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:12.251 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.248+0000 7f74bf03c6c0 1 --2- 10.20.193.92:0/1537292357 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f74940b5730 0x7f74940d5be0 secure :-1 s=READY pgs=203 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74a0005980 tx=0x7f74a0005910 comp rx=0 tx=0).stop 2026-02-13T04:02:12.252 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.248+0000 7f74bf03c6c0 1 -- 10.20.193.92:0/1537292357 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f74b810c4e0 msgr2=0x7f74b81229b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:12.252 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.248+0000 7f74bf03c6c0 1 --2- 10.20.193.92:0/1537292357 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f74b810c4e0 0x7f74b81229b0 secure :-1 s=READY pgs=255 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74a800b710 tx=0x7f74a800bbe0 comp rx=0 tx=0).stop 2026-02-13T04:02:12.252 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.249+0000 7f74bf03c6c0 1 -- 10.20.193.92:0/1537292357 shutdown_connections 2026-02-13T04:02:12.252 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.249+0000 7f74bf03c6c0 1 --2- 10.20.193.92:0/1537292357 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f74940b5730 0x7f74940d5be0 unknown :-1 s=CLOSED pgs=203 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:12.252 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.249+0000 7f74bf03c6c0 1 --2- 10.20.193.92:0/1537292357 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f74b8112b10 0x7f74b8122ef0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:12.252 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.249+0000 7f74bf03c6c0 1 --2- 10.20.193.92:0/1537292357 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f74b8112fc0 0x7f74b81282b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:12.252 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.249+0000 7f74bf03c6c0 1 --2- 10.20.193.92:0/1537292357 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f74b810c4e0 0x7f74b81229b0 unknown :-1 s=CLOSED pgs=255 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:12.252 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.249+0000 7f74bf03c6c0 1 -- 10.20.193.92:0/1537292357 >> 10.20.193.92:0/1537292357 conn(0x7f74b8063af0 msgr2=0x7f74b81117f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:02:12.252 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.249+0000 7f74bf03c6c0 1 -- 10.20.193.92:0/1537292357 shutdown_connections 2026-02-13T04:02:12.253 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:12.249+0000 7f74bf03c6c0 1 -- 10.20.193.92:0/1537292357 wait complete. 2026-02-13T04:02:12.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:12 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1537292357' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:12.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:12 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/1537292357' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:12.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:12 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/1537292357' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:13.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:13 trial158 ceph-mon[27763]: pgmap v222: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 11 op/s 2026-02-13T04:02:13.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:13 trial099 ceph-mon[27808]: pgmap v222: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 11 op/s 2026-02-13T04:02:13.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:13 trial092 ceph-mon[23047]: pgmap v222: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 767 B/s wr, 11 op/s 2026-02-13T04:02:15.388 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:02:15.573 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:02:15.703 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:15 trial092 ceph-mon[23047]: pgmap v223: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 767 B/s wr, 10 op/s 2026-02-13T04:02:15.766 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.763+0000 7fbfbaf246c0 1 -- 10.20.193.92:0/3579245672 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbfb4115270 msgr2=0x7fbfb4175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:15.766 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.763+0000 7fbfbaf246c0 1 --2- 10.20.193.92:0/3579245672 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbfb4115270 0x7fbfb4175c10 secure :-1 s=READY pgs=256 gs=1 cs=0 l=1 c_cookie=9356769744147395665 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbfb000a9b0 tx=0x7fbfb002fd20 comp rx=0 tx=0).stop 2026-02-13T04:02:15.766 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.763+0000 7fbfbaf246c0 1 -- 10.20.193.92:0/3579245672 shutdown_connections 2026-02-13T04:02:15.766 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.763+0000 7fbfbaf246c0 1 --2- 10.20.193.92:0/3579245672 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbfb4115270 0x7fbfb4175c10 unknown :-1 s=CLOSED pgs=256 gs=1 cs=0 l=1 c_cookie=9356769744147395665 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:15.766 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.763+0000 7fbfbaf246c0 1 --2- 10.20.193.92:0/3579245672 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fbfb410fa50 0x7fbfb4114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:15.766 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.763+0000 7fbfbaf246c0 1 --2- 10.20.193.92:0/3579245672 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fbfb410f060 0x7fbfb410f430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:15.766 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.763+0000 7fbfbaf246c0 1 -- 10.20.193.92:0/3579245672 >> 10.20.193.92:0/3579245672 conn(0x7fbfb40ec980 msgr2=0x7fbfb410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:02:15.766 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.763+0000 7fbfbaf246c0 1 -- 10.20.193.92:0/3579245672 shutdown_connections 2026-02-13T04:02:15.766 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.764+0000 7fbfbaf246c0 1 -- 10.20.193.92:0/3579245672 wait complete. 2026-02-13T04:02:15.767 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.764+0000 7fbfbaf246c0 1 Processor -- start 2026-02-13T04:02:15.767 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.765+0000 7fbfbaf246c0 1 -- start start 2026-02-13T04:02:15.767 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.765+0000 7fbfbaf246c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbfb410f060 0x7fbfb411cdd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:15.767 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.765+0000 7fbfbaf246c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fbfb4115270 0x7fbfb411d310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:15.767 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.765+0000 7fbfbaf246c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fbfb41226d0 0x7fbfb4122b70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:15.767 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.765+0000 7fbfbaf246c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb41230e0 con 0x7fbfb410f060 2026-02-13T04:02:15.767 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.765+0000 7fbfbaf246c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb4123250 con 0x7fbfb41226d0 2026-02-13T04:02:15.767 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.765+0000 7fbfbaf246c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb4123410 con 0x7fbfb4115270 2026-02-13T04:02:15.768 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.765+0000 7fbfb9f226c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbfb410f060 0x7fbfb411cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:15.768 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.765+0000 7fbfb97216c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fbfb4115270 0x7fbfb411d310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:15.768 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.765+0000 7fbfb9f226c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbfb410f060 0x7fbfb411cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:56390/0 (socket says 10.20.193.92:56390) 2026-02-13T04:02:15.768 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.765+0000 7fbfb97216c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fbfb4115270 0x7fbfb411d310 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:37210/0 (socket says 10.20.193.92:37210) 2026-02-13T04:02:15.768 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.765+0000 7fbfb9f226c0 1 -- 10.20.193.92:0/4165951328 learned_addr learned my addr 10.20.193.92:0/4165951328 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:02:15.768 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.765+0000 7fbfba7236c0 1 --2- 10.20.193.92:0/4165951328 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fbfb41226d0 0x7fbfb4122b70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:15.768 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.765+0000 7fbfb9f226c0 1 -- 10.20.193.92:0/4165951328 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fbfb4115270 msgr2=0x7fbfb411d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:15.768 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.765+0000 7fbfb9f226c0 1 --2- 10.20.193.92:0/4165951328 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fbfb4115270 0x7fbfb411d310 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:15.768 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.765+0000 7fbfb9f226c0 1 -- 10.20.193.92:0/4165951328 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fbfb41226d0 msgr2=0x7fbfb4122b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:15.768 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.765+0000 7fbfb9f226c0 1 --2- 10.20.193.92:0/4165951328 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fbfb41226d0 0x7fbfb4122b70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:15.768 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.765+0000 7fbfb9f226c0 1 -- 10.20.193.92:0/4165951328 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb000a5b0 con 0x7fbfb410f060 2026-02-13T04:02:15.768 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.765+0000 7fbfb9f226c0 1 --2- 10.20.193.92:0/4165951328 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbfb410f060 0x7fbfb411cdd0 secure :-1 s=READY pgs=257 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbfa400b800 tx=0x7fbfa400bcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:02:15.768 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.766+0000 7fbfa2ffd6c0 1 -- 10.20.193.92:0/4165951328 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbfa4004a80 con 0x7fbfb410f060 2026-02-13T04:02:15.768 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.766+0000 7fbfbaf246c0 1 -- 10.20.193.92:0/4165951328 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfb41638c0 con 0x7fbfb410f060 2026-02-13T04:02:15.768 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.766+0000 7fbfbaf246c0 1 -- 10.20.193.92:0/4165951328 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfb4163da0 con 0x7fbfb410f060 2026-02-13T04:02:15.768 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.766+0000 7fbfa2ffd6c0 1 -- 10.20.193.92:0/4165951328 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fbfa4009030 con 0x7fbfb410f060 2026-02-13T04:02:15.768 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.766+0000 7fbfa2ffd6c0 1 -- 10.20.193.92:0/4165951328 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbfa4007440 con 0x7fbfb410f060 2026-02-13T04:02:15.769 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.766+0000 7fbfbaf246c0 1 -- 10.20.193.92:0/4165951328 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfb4110330 con 0x7fbfb410f060 2026-02-13T04:02:15.771 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.768+0000 7fbfa2ffd6c0 1 -- 10.20.193.92:0/4165951328 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fbfa4004e90 con 0x7fbfb410f060 2026-02-13T04:02:15.772 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.770+0000 7fbfa2ffd6c0 1 --2- 10.20.193.92:0/4165951328 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fbf900b56d0 0x7fbf900d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:15.772 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.770+0000 7fbfa2ffd6c0 1 -- 10.20.193.92:0/4165951328 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7fbfa40e3bb0 con 0x7fbfb410f060 2026-02-13T04:02:15.773 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.770+0000 7fbfa2ffd6c0 1 -- 10.20.193.92:0/4165951328 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fbfa411c620 con 0x7fbfb410f060 2026-02-13T04:02:15.773 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.770+0000 7fbfb97216c0 1 --2- 10.20.193.92:0/4165951328 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fbf900b56d0 0x7fbf900d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:15.773 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.771+0000 7fbfb97216c0 1 --2- 10.20.193.92:0/4165951328 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fbf900b56d0 0x7fbf900d5b80 secure :-1 s=READY pgs=204 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbfb4123760 tx=0x7fbfa8009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:02:15.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:15 trial158 ceph-mon[27763]: pgmap v223: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 767 B/s wr, 10 op/s 2026-02-13T04:02:15.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:15 trial099 ceph-mon[27808]: pgmap v223: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 767 B/s wr, 10 op/s 2026-02-13T04:02:15.897 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.894+0000 7fbfbaf246c0 1 -- 10.20.193.92:0/4165951328 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbfb411df20 con 0x7fbfb410f060 2026-02-13T04:02:15.897 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.895+0000 7fbfa2ffd6c0 1 -- 10.20.193.92:0/4165951328 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fbfa40a6550 con 0x7fbfb410f060 2026-02-13T04:02:15.897 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:02:15.897 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:02:15.898 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.896+0000 7fbfbaf246c0 1 -- 10.20.193.92:0/4165951328 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fbf900b56d0 msgr2=0x7fbf900d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:15.898 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.896+0000 7fbfbaf246c0 1 --2- 10.20.193.92:0/4165951328 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fbf900b56d0 0x7fbf900d5b80 secure :-1 s=READY pgs=204 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbfb4123760 tx=0x7fbfa8009260 comp rx=0 tx=0).stop 2026-02-13T04:02:15.898 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.896+0000 7fbfbaf246c0 1 -- 10.20.193.92:0/4165951328 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbfb410f060 msgr2=0x7fbfb411cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:15.898 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.896+0000 7fbfbaf246c0 1 --2- 10.20.193.92:0/4165951328 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbfb410f060 0x7fbfb411cdd0 secure :-1 s=READY pgs=257 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbfa400b800 tx=0x7fbfa400bcd0 comp rx=0 tx=0).stop 2026-02-13T04:02:15.898 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.896+0000 7fbfbaf246c0 1 -- 10.20.193.92:0/4165951328 shutdown_connections 2026-02-13T04:02:15.898 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.896+0000 7fbfbaf246c0 1 --2- 10.20.193.92:0/4165951328 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fbf900b56d0 0x7fbf900d5b80 unknown :-1 s=CLOSED pgs=204 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:15.898 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.896+0000 7fbfbaf246c0 1 --2- 10.20.193.92:0/4165951328 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fbfb41226d0 0x7fbfb4122b70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:15.899 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.896+0000 7fbfbaf246c0 1 --2- 10.20.193.92:0/4165951328 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fbfb4115270 0x7fbfb411d310 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:15.899 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.896+0000 7fbfbaf246c0 1 --2- 10.20.193.92:0/4165951328 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbfb410f060 0x7fbfb411cdd0 unknown :-1 s=CLOSED pgs=257 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:15.899 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.896+0000 7fbfbaf246c0 1 -- 10.20.193.92:0/4165951328 >> 10.20.193.92:0/4165951328 conn(0x7fbfb40ec980 msgr2=0x7fbfb410cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:02:15.899 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.896+0000 7fbfbaf246c0 1 -- 10.20.193.92:0/4165951328 shutdown_connections 2026-02-13T04:02:15.899 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:15.896+0000 7fbfbaf246c0 1 -- 10.20.193.92:0/4165951328 wait complete. 2026-02-13T04:02:16.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:16 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/4165951328' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:16.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:16 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/4165951328' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:16.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:16 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/4165951328' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:17.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:17 trial158 ceph-mon[27763]: pgmap v224: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 10 op/s 2026-02-13T04:02:17.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:17 trial099 ceph-mon[27808]: pgmap v224: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 10 op/s 2026-02-13T04:02:17.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:17 trial092 ceph-mon[23047]: pgmap v224: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 767 B/s wr, 10 op/s 2026-02-13T04:02:19.006 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:02:19.193 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:02:19.389 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.386+0000 7f9d8552f6c0 1 -- 10.20.193.92:0/2500892482 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9d8010fa50 msgr2=0x7f9d80114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:19.389 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.386+0000 7f9d8552f6c0 1 --2- 10.20.193.92:0/2500892482 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9d8010fa50 0x7f9d80114a90 secure :-1 s=READY pgs=115 gs=2 cs=0 l=1 c_cookie=13359567006904274013 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d700098a0 tx=0x7f9d7002ec50 comp rx=0 tx=0).stop 2026-02-13T04:02:19.389 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.386+0000 7f9d8552f6c0 1 -- 10.20.193.92:0/2500892482 shutdown_connections 2026-02-13T04:02:19.389 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.386+0000 7f9d8552f6c0 1 --2- 10.20.193.92:0/2500892482 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9d8010fa50 0x7f9d80114a90 unknown :-1 s=CLOSED pgs=115 gs=2 cs=0 l=1 c_cookie=13359567006904274013 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:19.389 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.386+0000 7f9d8552f6c0 1 --2- 10.20.193.92:0/2500892482 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9d80115270 0x7f9d80175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:19.389 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.386+0000 7f9d8552f6c0 1 --2- 10.20.193.92:0/2500892482 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f9d8010f060 0x7f9d8010f430 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:19.389 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.386+0000 7f9d8552f6c0 1 -- 10.20.193.92:0/2500892482 >> 10.20.193.92:0/2500892482 conn(0x7f9d800ec980 msgr2=0x7f9d8010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:02:19.389 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.386+0000 7f9d8552f6c0 1 -- 10.20.193.92:0/2500892482 shutdown_connections 2026-02-13T04:02:19.389 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.386+0000 7f9d8552f6c0 1 -- 10.20.193.92:0/2500892482 wait complete. 2026-02-13T04:02:19.389 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.387+0000 7f9d8552f6c0 1 Processor -- start 2026-02-13T04:02:19.389 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.387+0000 7f9d8552f6c0 1 -- start start 2026-02-13T04:02:19.390 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.387+0000 7f9d8552f6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9d8010f060 0x7f9d8011ce90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:19.390 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.387+0000 7f9d8552f6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9d80115270 0x7f9d8011d3d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:19.390 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.387+0000 7f9d8552f6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f9d80122790 0x7f9d80122c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:19.390 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.387+0000 7f9d8552f6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9d801231a0 con 0x7f9d8010f060 2026-02-13T04:02:19.390 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.387+0000 7f9d8552f6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9d80123310 con 0x7f9d80115270 2026-02-13T04:02:19.390 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.387+0000 7f9d8552f6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f9d801234d0 con 0x7f9d80122790 2026-02-13T04:02:19.390 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.388+0000 7f9d7ffff6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9d8010f060 0x7f9d8011ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:19.390 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.388+0000 7f9d84d2e6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f9d80122790 0x7f9d80122c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:19.390 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.388+0000 7f9d7f7fe6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9d80115270 0x7f9d8011d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:19.390 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.388+0000 7f9d7ffff6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9d8010f060 0x7f9d8011ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:56400/0 (socket says 10.20.193.92:56400) 2026-02-13T04:02:19.390 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.388+0000 7f9d7ffff6c0 1 -- 10.20.193.92:0/1362511087 learned_addr learned my addr 10.20.193.92:0/1362511087 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:02:19.390 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.388+0000 7f9d7ffff6c0 1 -- 10.20.193.92:0/1362511087 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f9d80122790 msgr2=0x7f9d80122c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:19.390 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.388+0000 7f9d7ffff6c0 1 --2- 10.20.193.92:0/1362511087 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f9d80122790 0x7f9d80122c30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:19.390 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.388+0000 7f9d7ffff6c0 1 -- 10.20.193.92:0/1362511087 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9d80115270 msgr2=0x7f9d8011d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:19.391 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.388+0000 7f9d7ffff6c0 1 --2- 10.20.193.92:0/1362511087 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9d80115270 0x7f9d8011d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:19.391 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.388+0000 7f9d7ffff6c0 1 -- 10.20.193.92:0/1362511087 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d7400a5b0 con 0x7f9d8010f060 2026-02-13T04:02:19.391 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.388+0000 7f9d7ffff6c0 1 --2- 10.20.193.92:0/1362511087 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9d8010f060 0x7f9d8011ce90 secure :-1 s=READY pgs=258 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d6c005950 tx=0x7f9d6c00bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:02:19.391 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.388+0000 7f9d7d7fa6c0 1 -- 10.20.193.92:0/1362511087 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9d6c004460 con 0x7f9d8010f060 2026-02-13T04:02:19.391 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.388+0000 7f9d7d7fa6c0 1 -- 10.20.193.92:0/1362511087 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f9d6c0045c0 con 0x7f9d8010f060 2026-02-13T04:02:19.391 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.388+0000 7f9d8552f6c0 1 -- 10.20.193.92:0/1362511087 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d700094c0 con 0x7f9d8010f060 2026-02-13T04:02:19.391 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.388+0000 7f9d7d7fa6c0 1 -- 10.20.193.92:0/1362511087 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9d6c003af0 con 0x7f9d8010f060 2026-02-13T04:02:19.391 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.388+0000 7f9d8552f6c0 1 -- 10.20.193.92:0/1362511087 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d80163c80 con 0x7f9d8010f060 2026-02-13T04:02:19.391 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.389+0000 7f9d52ffd6c0 1 -- 10.20.193.92:0/1362511087 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d80110330 con 0x7f9d8010f060 2026-02-13T04:02:19.394 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.391+0000 7f9d7d7fa6c0 1 -- 10.20.193.92:0/1362511087 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f9d6c005240 con 0x7f9d8010f060 2026-02-13T04:02:19.395 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.393+0000 7f9d7d7fa6c0 1 --2- 10.20.193.92:0/1362511087 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f9d540b56d0 0x7f9d540d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:19.395 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.393+0000 7f9d7d7fa6c0 1 -- 10.20.193.92:0/1362511087 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f9d6c0e3ad0 con 0x7f9d8010f060 2026-02-13T04:02:19.395 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.393+0000 7f9d7f7fe6c0 1 --2- 10.20.193.92:0/1362511087 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f9d540b56d0 0x7f9d540d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:19.395 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.393+0000 7f9d7d7fa6c0 1 -- 10.20.193.92:0/1362511087 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f9d6c11c5e0 con 0x7f9d8010f060 2026-02-13T04:02:19.396 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.394+0000 7f9d7f7fe6c0 1 --2- 10.20.193.92:0/1362511087 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f9d540b56d0 0x7f9d540d5b80 secure :-1 s=READY pgs=205 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d80123820 tx=0x7f9d700023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:02:19.521 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.518+0000 7f9d52ffd6c0 1 -- 10.20.193.92:0/1362511087 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9d8010f430 con 0x7f9d8010f060 2026-02-13T04:02:19.521 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.518+0000 7f9d7d7fa6c0 1 -- 10.20.193.92:0/1362511087 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f9d6c0a6470 con 0x7f9d8010f060 2026-02-13T04:02:19.522 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:02:19.522 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:02:19.523 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.520+0000 7f9d52ffd6c0 1 -- 10.20.193.92:0/1362511087 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f9d540b56d0 msgr2=0x7f9d540d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:19.523 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.520+0000 7f9d52ffd6c0 1 --2- 10.20.193.92:0/1362511087 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f9d540b56d0 0x7f9d540d5b80 secure :-1 s=READY pgs=205 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d80123820 tx=0x7f9d700023a0 comp rx=0 tx=0).stop 2026-02-13T04:02:19.523 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.520+0000 7f9d52ffd6c0 1 -- 10.20.193.92:0/1362511087 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9d8010f060 msgr2=0x7f9d8011ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:19.523 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.520+0000 7f9d52ffd6c0 1 --2- 10.20.193.92:0/1362511087 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9d8010f060 0x7f9d8011ce90 secure :-1 s=READY pgs=258 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9d6c005950 tx=0x7f9d6c00bca0 comp rx=0 tx=0).stop 2026-02-13T04:02:19.523 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.520+0000 7f9d52ffd6c0 1 -- 10.20.193.92:0/1362511087 shutdown_connections 2026-02-13T04:02:19.523 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.520+0000 7f9d52ffd6c0 1 --2- 10.20.193.92:0/1362511087 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f9d540b56d0 0x7f9d540d5b80 unknown :-1 s=CLOSED pgs=205 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:19.523 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.520+0000 7f9d52ffd6c0 1 --2- 10.20.193.92:0/1362511087 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9d80115270 0x7f9d8011d3d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:19.523 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.520+0000 7f9d52ffd6c0 1 --2- 10.20.193.92:0/1362511087 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f9d80122790 0x7f9d80122c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:19.524 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.520+0000 7f9d52ffd6c0 1 --2- 10.20.193.92:0/1362511087 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9d8010f060 0x7f9d8011ce90 unknown :-1 s=CLOSED pgs=258 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:19.524 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.520+0000 7f9d52ffd6c0 1 -- 10.20.193.92:0/1362511087 >> 10.20.193.92:0/1362511087 conn(0x7f9d800ec980 msgr2=0x7f9d8010cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:02:19.524 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.520+0000 7f9d52ffd6c0 1 -- 10.20.193.92:0/1362511087 shutdown_connections 2026-02-13T04:02:19.524 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:19.520+0000 7f9d52ffd6c0 1 -- 10.20.193.92:0/1362511087 wait complete. 2026-02-13T04:02:19.584 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:19 trial092 ceph-mon[23047]: pgmap v225: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 12 op/s 2026-02-13T04:02:19.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:19 trial158 ceph-mon[27763]: pgmap v225: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 12 op/s 2026-02-13T04:02:19.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:19 trial099 ceph-mon[27808]: pgmap v225: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.2 KiB/s rd, 767 B/s wr, 12 op/s 2026-02-13T04:02:20.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:20 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/1362511087' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:20.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:20 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/1362511087' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:20.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:20 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1362511087' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:21.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:21 trial158 ceph-mon[27763]: pgmap v226: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 10 op/s 2026-02-13T04:02:21.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:21 trial099 ceph-mon[27808]: pgmap v226: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 10 op/s 2026-02-13T04:02:21.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:21 trial092 ceph-mon[23047]: pgmap v226: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 10 op/s 2026-02-13T04:02:22.627 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:02:22.813 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:02:23.007 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.004+0000 7ff4910a86c0 1 -- 10.20.193.92:0/4032224596 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff48c10fbf0 msgr2=0x7ff48c114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:23.007 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.004+0000 7ff4910a86c0 1 --2- 10.20.193.92:0/4032224596 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff48c10fbf0 0x7ff48c114c30 secure :-1 s=READY pgs=259 gs=1 cs=0 l=1 c_cookie=8953303958281909301 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4740099a0 tx=0x7ff47402ed00 comp rx=0 tx=0).stop 2026-02-13T04:02:23.008 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.004+0000 7ff4910a86c0 1 -- 10.20.193.92:0/4032224596 shutdown_connections 2026-02-13T04:02:23.008 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.004+0000 7ff4910a86c0 1 --2- 10.20.193.92:0/4032224596 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff48c115410 0x7ff48c175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:23.008 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.004+0000 7ff4910a86c0 1 --2- 10.20.193.92:0/4032224596 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff48c10fbf0 0x7ff48c114c30 unknown :-1 s=CLOSED pgs=259 gs=1 cs=0 l=1 c_cookie=8953303958281909301 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:23.008 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.004+0000 7ff4910a86c0 1 --2- 10.20.193.92:0/4032224596 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff48c10f200 0x7ff48c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:23.008 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.004+0000 7ff4910a86c0 1 -- 10.20.193.92:0/4032224596 >> 10.20.193.92:0/4032224596 conn(0x7ff48c0ecb00 msgr2=0x7ff48c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:02:23.008 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.004+0000 7ff4910a86c0 1 -- 10.20.193.92:0/4032224596 shutdown_connections 2026-02-13T04:02:23.008 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.004+0000 7ff4910a86c0 1 -- 10.20.193.92:0/4032224596 wait complete. 2026-02-13T04:02:23.010 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.005+0000 7ff4910a86c0 1 Processor -- start 2026-02-13T04:02:23.010 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.005+0000 7ff4910a86c0 1 -- start start 2026-02-13T04:02:23.010 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.005+0000 7ff4910a86c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff48c10f200 0x7ff48c0f49d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:23.010 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.005+0000 7ff4910a86c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff48c115410 0x7ff48c175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:23.010 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.005+0000 7ff4910a86c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff48c0f5000 0x7ff48c0fa2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:23.011 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.005+0000 7ff4910a86c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff48c0f56f0 con 0x7ff48c0f5000 2026-02-13T04:02:23.011 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.005+0000 7ff4910a86c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff48c0fa810 con 0x7ff48c115410 2026-02-13T04:02:23.011 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.005+0000 7ff4910a86c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7ff48c0fa9d0 con 0x7ff48c10f200 2026-02-13T04:02:23.011 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.005+0000 7ff48ad766c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff48c10f200 0x7ff48c0f49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:23.011 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.005+0000 7ff48b5776c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff48c0f5000 0x7ff48c0fa2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:23.011 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.005+0000 7ff48a5756c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff48c115410 0x7ff48c175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:23.011 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.005+0000 7ff48ad766c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff48c10f200 0x7ff48c0f49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:37262/0 (socket says 10.20.193.92:37262) 2026-02-13T04:02:23.011 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.005+0000 7ff48ad766c0 1 -- 10.20.193.92:0/1576425739 learned_addr learned my addr 10.20.193.92:0/1576425739 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:02:23.011 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.006+0000 7ff48ad766c0 1 -- 10.20.193.92:0/1576425739 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff48c115410 msgr2=0x7ff48c175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:23.011 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.006+0000 7ff48ad766c0 1 --2- 10.20.193.92:0/1576425739 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff48c115410 0x7ff48c175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:23.011 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.006+0000 7ff48ad766c0 1 -- 10.20.193.92:0/1576425739 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff48c0f5000 msgr2=0x7ff48c0fa2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:23.012 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.006+0000 7ff48ad766c0 1 --2- 10.20.193.92:0/1576425739 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff48c0f5000 0x7ff48c0fa2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:23.012 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.006+0000 7ff48ad766c0 1 -- 10.20.193.92:0/1576425739 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff474009590 con 0x7ff48c10f200 2026-02-13T04:02:23.012 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.006+0000 7ff48ad766c0 1 --2- 10.20.193.92:0/1576425739 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff48c10f200 0x7ff48c0f49d0 secure :-1 s=READY pgs=110 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff48000b740 tx=0x7ff48000bc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:02:23.012 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.006+0000 7ff46bfff6c0 1 -- 10.20.193.92:0/1576425739 <== mon.1 v2:10.20.193.158:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff480004250 con 0x7ff48c10f200 2026-02-13T04:02:23.012 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.006+0000 7ff46bfff6c0 1 -- 10.20.193.92:0/1576425739 <== mon.1 v2:10.20.193.158:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7ff480009070 con 0x7ff48c10f200 2026-02-13T04:02:23.012 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.006+0000 7ff46bfff6c0 1 -- 10.20.193.92:0/1576425739 <== mon.1 v2:10.20.193.158:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff4800071c0 con 0x7ff48c10f200 2026-02-13T04:02:23.012 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.006+0000 7ff4910a86c0 1 -- 10.20.193.92:0/1576425739 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff48c0facb0 con 0x7ff48c10f200 2026-02-13T04:02:23.012 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.006+0000 7ff4910a86c0 1 -- 10.20.193.92:0/1576425739 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff48c0fb440 con 0x7ff48c10f200 2026-02-13T04:02:23.012 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.007+0000 7ff4910a86c0 1 -- 10.20.193.92:0/1576425739 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff48c1104d0 con 0x7ff48c10f200 2026-02-13T04:02:23.013 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.009+0000 7ff46bfff6c0 1 -- 10.20.193.92:0/1576425739 <== mon.1 v2:10.20.193.158:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7ff48000c560 con 0x7ff48c10f200 2026-02-13T04:02:23.014 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.011+0000 7ff46bfff6c0 1 --2- 10.20.193.92:0/1576425739 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff4600b56d0 0x7ff4600d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:23.014 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.011+0000 7ff46bfff6c0 1 -- 10.20.193.92:0/1576425739 <== mon.1 v2:10.20.193.158:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7ff4800e3a90 con 0x7ff48c10f200 2026-02-13T04:02:23.014 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.011+0000 7ff46bfff6c0 1 -- 10.20.193.92:0/1576425739 <== mon.1 v2:10.20.193.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff48011c5e0 con 0x7ff48c10f200 2026-02-13T04:02:23.014 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.011+0000 7ff48a5756c0 1 --2- 10.20.193.92:0/1576425739 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff4600b56d0 0x7ff4600d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:23.015 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.012+0000 7ff48a5756c0 1 --2- 10.20.193.92:0/1576425739 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff4600b56d0 0x7ff4600d5b80 secure :-1 s=READY pgs=206 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff48c0fb360 tx=0x7ff4740023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:02:23.139 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.136+0000 7ff4910a86c0 1 -- 10.20.193.92:0/1576425739 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff48c0f5b20 con 0x7ff48c10f200 2026-02-13T04:02:23.139 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.136+0000 7ff46bfff6c0 1 -- 10.20.193.92:0/1576425739 <== mon.1 v2:10.20.193.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ff4800a6430 con 0x7ff48c10f200 2026-02-13T04:02:23.139 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:02:23.140 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:02:23.140 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.137+0000 7ff4910a86c0 1 -- 10.20.193.92:0/1576425739 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff4600b56d0 msgr2=0x7ff4600d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:23.141 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.137+0000 7ff4910a86c0 1 --2- 10.20.193.92:0/1576425739 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff4600b56d0 0x7ff4600d5b80 secure :-1 s=READY pgs=206 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff48c0fb360 tx=0x7ff4740023a0 comp rx=0 tx=0).stop 2026-02-13T04:02:23.141 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.137+0000 7ff4910a86c0 1 -- 10.20.193.92:0/1576425739 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff48c10f200 msgr2=0x7ff48c0f49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:23.141 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.137+0000 7ff4910a86c0 1 --2- 10.20.193.92:0/1576425739 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff48c10f200 0x7ff48c0f49d0 secure :-1 s=READY pgs=110 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff48000b740 tx=0x7ff48000bc10 comp rx=0 tx=0).stop 2026-02-13T04:02:23.141 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.137+0000 7ff4910a86c0 1 -- 10.20.193.92:0/1576425739 shutdown_connections 2026-02-13T04:02:23.141 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.138+0000 7ff4910a86c0 1 --2- 10.20.193.92:0/1576425739 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff4600b56d0 0x7ff4600d5b80 unknown :-1 s=CLOSED pgs=206 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:23.141 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.138+0000 7ff4910a86c0 1 --2- 10.20.193.92:0/1576425739 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff48c115410 0x7ff48c175cb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:23.141 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.138+0000 7ff4910a86c0 1 --2- 10.20.193.92:0/1576425739 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff48c0f5000 0x7ff48c0fa2d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:23.141 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.138+0000 7ff4910a86c0 1 --2- 10.20.193.92:0/1576425739 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff48c10f200 0x7ff48c0f49d0 unknown :-1 s=CLOSED pgs=110 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:23.141 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.138+0000 7ff4910a86c0 1 -- 10.20.193.92:0/1576425739 >> 10.20.193.92:0/1576425739 conn(0x7ff48c0ecb00 msgr2=0x7ff48c10d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:02:23.141 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.138+0000 7ff4910a86c0 1 -- 10.20.193.92:0/1576425739 shutdown_connections 2026-02-13T04:02:23.142 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:23.138+0000 7ff4910a86c0 1 -- 10.20.193.92:0/1576425739 wait complete. 2026-02-13T04:02:23.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:23 trial158 ceph-mon[27763]: pgmap v227: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:02:23.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:23 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/1576425739' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:23.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:23 trial099 ceph-mon[27808]: pgmap v227: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:02:23.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:23 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/1576425739' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:23.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:23 trial092 ceph-mon[23047]: pgmap v227: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:02:23.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:23 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1576425739' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:25.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:25 trial158 ceph-mon[27763]: pgmap v228: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:02:25.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:25 trial099 ceph-mon[27808]: pgmap v228: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:02:25.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:25 trial092 ceph-mon[23047]: pgmap v228: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:02:26.242 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:02:26.424 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:02:26.616 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.613+0000 7ff25b6b36c0 1 -- 10.20.193.92:0/2480064887 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff2541137a0 msgr2=0x7ff254113b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:26.616 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.613+0000 7ff25b6b36c0 1 --2- 10.20.193.92:0/2480064887 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff2541137a0 0x7ff254113b70 secure :-1 s=READY pgs=116 gs=1 cs=0 l=1 c_cookie=7975585001991645358 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff24c0098a0 tx=0x7ff24c02ec50 comp rx=0 tx=0).stop 2026-02-13T04:02:26.616 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.613+0000 7ff25b6b36c0 1 -- 10.20.193.92:0/2480064887 shutdown_connections 2026-02-13T04:02:26.616 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.613+0000 7ff25b6b36c0 1 --2- 10.20.193.92:0/2480064887 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff254116520 0x7ff25417a100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:26.616 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.613+0000 7ff25b6b36c0 1 --2- 10.20.193.92:0/2480064887 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff254114190 0x7ff254115d40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:26.616 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.613+0000 7ff25b6b36c0 1 --2- 10.20.193.92:0/2480064887 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff2541137a0 0x7ff254113b70 unknown :-1 s=CLOSED pgs=116 gs=1 cs=0 l=1 c_cookie=7975585001991645358 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:26.616 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.613+0000 7ff25b6b36c0 1 -- 10.20.193.92:0/2480064887 >> 10.20.193.92:0/2480064887 conn(0x7ff254061510 msgr2=0x7ff254061910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:02:26.616 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.613+0000 7ff25b6b36c0 1 -- 10.20.193.92:0/2480064887 shutdown_connections 2026-02-13T04:02:26.616 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.613+0000 7ff25b6b36c0 1 -- 10.20.193.92:0/2480064887 wait complete. 2026-02-13T04:02:26.616 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.614+0000 7ff25b6b36c0 1 Processor -- start 2026-02-13T04:02:26.616 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.614+0000 7ff25b6b36c0 1 -- start start 2026-02-13T04:02:26.616 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.614+0000 7ff25b6b36c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff2541137a0 0x7ff254121340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:26.616 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.614+0000 7ff25b6b36c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff254116520 0x7ff254121880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:26.617 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.614+0000 7ff25b6b36c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff254126c40 0x7ff2541270e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:26.617 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.614+0000 7ff25b6b36c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff254127650 con 0x7ff2541137a0 2026-02-13T04:02:26.617 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.614+0000 7ff25b6b36c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff2541277c0 con 0x7ff254116520 2026-02-13T04:02:26.617 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.614+0000 7ff25b6b36c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7ff254127980 con 0x7ff254126c40 2026-02-13T04:02:26.617 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.614+0000 7ff25a6b16c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff2541137a0 0x7ff254121340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:26.617 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.614+0000 7ff25aeb26c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff254126c40 0x7ff2541270e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:26.617 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.614+0000 7ff25aeb26c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff254126c40 0x7ff2541270e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:37210/0 (socket says 10.20.193.92:37210) 2026-02-13T04:02:26.617 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.614+0000 7ff25aeb26c0 1 -- 10.20.193.92:0/3131901048 learned_addr learned my addr 10.20.193.92:0/3131901048 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:02:26.617 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.614+0000 7ff259eb06c0 1 --2- 10.20.193.92:0/3131901048 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff254116520 0x7ff254121880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:26.617 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.614+0000 7ff25aeb26c0 1 -- 10.20.193.92:0/3131901048 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff254116520 msgr2=0x7ff254121880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:26.617 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.614+0000 7ff25aeb26c0 1 --2- 10.20.193.92:0/3131901048 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff254116520 0x7ff254121880 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:26.617 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.614+0000 7ff25aeb26c0 1 -- 10.20.193.92:0/3131901048 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff2541137a0 msgr2=0x7ff254121340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:26.617 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.614+0000 7ff25aeb26c0 1 --2- 10.20.193.92:0/3131901048 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff2541137a0 0x7ff254121340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:26.617 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.614+0000 7ff25aeb26c0 1 -- 10.20.193.92:0/3131901048 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff24c0094c0 con 0x7ff254126c40 2026-02-13T04:02:26.618 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.614+0000 7ff259eb06c0 1 --2- 10.20.193.92:0/3131901048 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff254116520 0x7ff254121880 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T04:02:26.618 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.615+0000 7ff25aeb26c0 1 --2- 10.20.193.92:0/3131901048 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff254126c40 0x7ff2541270e0 secure :-1 s=READY pgs=111 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff24800c9b0 tx=0x7ff24800ce80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:02:26.618 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.615+0000 7ff23f7fe6c0 1 -- 10.20.193.92:0/3131901048 <== mon.1 v2:10.20.193.158:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff248003c40 con 0x7ff254126c40 2026-02-13T04:02:26.618 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.615+0000 7ff23f7fe6c0 1 -- 10.20.193.92:0/3131901048 <== mon.1 v2:10.20.193.158:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7ff24800a070 con 0x7ff254126c40 2026-02-13T04:02:26.618 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.615+0000 7ff25b6b36c0 1 -- 10.20.193.92:0/3131901048 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff254167e30 con 0x7ff254126c40 2026-02-13T04:02:26.618 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.615+0000 7ff23f7fe6c0 1 -- 10.20.193.92:0/3131901048 <== mon.1 v2:10.20.193.158:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff248008440 con 0x7ff254126c40 2026-02-13T04:02:26.618 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.615+0000 7ff25b6b36c0 1 -- 10.20.193.92:0/3131901048 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2541682c0 con 0x7ff254126c40 2026-02-13T04:02:26.618 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.616+0000 7ff25b6b36c0 1 -- 10.20.193.92:0/3131901048 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff254114840 con 0x7ff254126c40 2026-02-13T04:02:26.620 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.618+0000 7ff23f7fe6c0 1 -- 10.20.193.92:0/3131901048 <== mon.1 v2:10.20.193.158:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7ff24800d6c0 con 0x7ff254126c40 2026-02-13T04:02:26.622 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.619+0000 7ff23f7fe6c0 1 --2- 10.20.193.92:0/3131901048 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff2300b5650 0x7ff2300d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:26.622 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.620+0000 7ff23f7fe6c0 1 -- 10.20.193.92:0/3131901048 <== mon.1 v2:10.20.193.158:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7ff2480e4c60 con 0x7ff254126c40 2026-02-13T04:02:26.622 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.620+0000 7ff25a6b16c0 1 --2- 10.20.193.92:0/3131901048 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff2300b5650 0x7ff2300d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:26.622 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.620+0000 7ff23f7fe6c0 1 -- 10.20.193.92:0/3131901048 <== mon.1 v2:10.20.193.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff2480e50e0 con 0x7ff254126c40 2026-02-13T04:02:26.622 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.620+0000 7ff25a6b16c0 1 --2- 10.20.193.92:0/3131901048 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff2300b5650 0x7ff2300d5b00 secure :-1 s=READY pgs=207 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff24c0097f0 tx=0x7ff24c0023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:02:26.746 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.743+0000 7ff25b6b36c0 1 -- 10.20.193.92:0/3131901048 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff2541224c0 con 0x7ff254126c40 2026-02-13T04:02:26.746 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.744+0000 7ff23f7fe6c0 1 -- 10.20.193.92:0/3131901048 <== mon.1 v2:10.20.193.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ff2480a7600 con 0x7ff254126c40 2026-02-13T04:02:26.746 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:02:26.746 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:02:26.747 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.745+0000 7ff25b6b36c0 1 -- 10.20.193.92:0/3131901048 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff2300b5650 msgr2=0x7ff2300d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:26.747 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.745+0000 7ff25b6b36c0 1 --2- 10.20.193.92:0/3131901048 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff2300b5650 0x7ff2300d5b00 secure :-1 s=READY pgs=207 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff24c0097f0 tx=0x7ff24c0023a0 comp rx=0 tx=0).stop 2026-02-13T04:02:26.747 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.745+0000 7ff25b6b36c0 1 -- 10.20.193.92:0/3131901048 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff254126c40 msgr2=0x7ff2541270e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:26.747 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.745+0000 7ff25b6b36c0 1 --2- 10.20.193.92:0/3131901048 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff254126c40 0x7ff2541270e0 secure :-1 s=READY pgs=111 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff24800c9b0 tx=0x7ff24800ce80 comp rx=0 tx=0).stop 2026-02-13T04:02:26.747 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.745+0000 7ff25b6b36c0 1 -- 10.20.193.92:0/3131901048 shutdown_connections 2026-02-13T04:02:26.747 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.745+0000 7ff25b6b36c0 1 --2- 10.20.193.92:0/3131901048 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff2300b5650 0x7ff2300d5b00 unknown :-1 s=CLOSED pgs=207 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:26.748 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.745+0000 7ff25b6b36c0 1 --2- 10.20.193.92:0/3131901048 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff254116520 0x7ff254121880 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:26.748 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.745+0000 7ff25b6b36c0 1 --2- 10.20.193.92:0/3131901048 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff254126c40 0x7ff2541270e0 unknown :-1 s=CLOSED pgs=111 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:26.748 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.745+0000 7ff25b6b36c0 1 --2- 10.20.193.92:0/3131901048 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff2541137a0 0x7ff254121340 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:26.748 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.745+0000 7ff25b6b36c0 1 -- 10.20.193.92:0/3131901048 >> 10.20.193.92:0/3131901048 conn(0x7ff254061510 msgr2=0x7ff254115620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:02:26.748 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.745+0000 7ff25b6b36c0 1 -- 10.20.193.92:0/3131901048 shutdown_connections 2026-02-13T04:02:26.748 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:26.745+0000 7ff25b6b36c0 1 -- 10.20.193.92:0/3131901048 wait complete. 2026-02-13T04:02:27.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:27 trial158 ceph-mon[27763]: pgmap v229: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T04:02:27.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:27 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/3131901048' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:27.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:27 trial099 ceph-mon[27808]: pgmap v229: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T04:02:27.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:27 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/3131901048' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:27.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:27 trial092 ceph-mon[23047]: pgmap v229: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T04:02:27.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:27 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/3131901048' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:29.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:29 trial158 ceph-mon[27763]: pgmap v230: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:02:29.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:29 trial099 ceph-mon[27808]: pgmap v230: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:02:29.884 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:02:29.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:29 trial092 ceph-mon[23047]: pgmap v230: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:02:30.069 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:02:30.266 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.263+0000 7f4681b0f6c0 1 -- 10.20.193.92:0/973931777 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f467c114190 msgr2=0x7f467c115d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:30.266 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.263+0000 7f4681b0f6c0 1 --2- 10.20.193.92:0/973931777 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f467c114190 0x7f467c115d40 secure :-1 s=READY pgs=260 gs=1 cs=0 l=1 c_cookie=6894347708371085988 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46640099a0 tx=0x7f466402ed00 comp rx=0 tx=0).stop 2026-02-13T04:02:30.266 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.263+0000 7f4681b0f6c0 1 -- 10.20.193.92:0/973931777 shutdown_connections 2026-02-13T04:02:30.266 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.263+0000 7f4681b0f6c0 1 --2- 10.20.193.92:0/973931777 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f467c116520 0x7f467c17a100 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:30.267 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.263+0000 7f4681b0f6c0 1 --2- 10.20.193.92:0/973931777 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f467c114190 0x7f467c115d40 unknown :-1 s=CLOSED pgs=260 gs=1 cs=0 l=1 c_cookie=6894347708371085988 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:30.267 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.263+0000 7f4681b0f6c0 1 --2- 10.20.193.92:0/973931777 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f467c1137a0 0x7f467c113b70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:30.267 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.263+0000 7f4681b0f6c0 1 -- 10.20.193.92:0/973931777 >> 10.20.193.92:0/973931777 conn(0x7f467c061510 msgr2=0x7f467c061910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:02:30.267 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.263+0000 7f4681b0f6c0 1 -- 10.20.193.92:0/973931777 shutdown_connections 2026-02-13T04:02:30.267 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.263+0000 7f4681b0f6c0 1 -- 10.20.193.92:0/973931777 wait complete. 2026-02-13T04:02:30.269 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.264+0000 7f4681b0f6c0 1 Processor -- start 2026-02-13T04:02:30.269 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.264+0000 7f4681b0f6c0 1 -- start start 2026-02-13T04:02:30.269 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.264+0000 7f4681b0f6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f467c1137a0 0x7f467c121440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:30.269 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.264+0000 7f4681b0f6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f467c116520 0x7f467c121980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:30.270 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.264+0000 7f4681b0f6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f467c126d40 0x7f467c1271e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:30.270 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.264+0000 7f4681b0f6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f467c127720 con 0x7f467c1137a0 2026-02-13T04:02:30.270 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.264+0000 7f4681b0f6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f467c127890 con 0x7f467c126d40 2026-02-13T04:02:30.270 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.264+0000 7f4681b0f6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f467c127a50 con 0x7f467c116520 2026-02-13T04:02:30.270 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.264+0000 7f4680b0d6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f467c1137a0 0x7f467c121440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:30.270 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.264+0000 7f4680b0d6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f467c1137a0 0x7f467c121440 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:57096/0 (socket says 10.20.193.92:57096) 2026-02-13T04:02:30.270 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.264+0000 7f4680b0d6c0 1 -- 10.20.193.92:0/1765202398 learned_addr learned my addr 10.20.193.92:0/1765202398 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:02:30.270 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.264+0000 7f4673fff6c0 1 --2- 10.20.193.92:0/1765202398 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f467c116520 0x7f467c121980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:30.270 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.265+0000 7f468130e6c0 1 --2- 10.20.193.92:0/1765202398 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f467c126d40 0x7f467c1271e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:30.270 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.265+0000 7f4680b0d6c0 1 -- 10.20.193.92:0/1765202398 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f467c116520 msgr2=0x7f467c121980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:30.270 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.265+0000 7f4680b0d6c0 1 --2- 10.20.193.92:0/1765202398 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f467c116520 0x7f467c121980 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:30.270 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.265+0000 7f4680b0d6c0 1 -- 10.20.193.92:0/1765202398 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f467c126d40 msgr2=0x7f467c1271e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:30.271 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.265+0000 7f4680b0d6c0 1 --2- 10.20.193.92:0/1765202398 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f467c126d40 0x7f467c1271e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:30.271 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.265+0000 7f4680b0d6c0 1 -- 10.20.193.92:0/1765202398 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4664009590 con 0x7f467c1137a0 2026-02-13T04:02:30.271 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.265+0000 7f4680b0d6c0 1 --2- 10.20.193.92:0/1765202398 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f467c1137a0 0x7f467c121440 secure :-1 s=READY pgs=261 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f466c00b6c0 tx=0x7f466c00bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:02:30.271 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.265+0000 7f4671ffb6c0 1 -- 10.20.193.92:0/1765202398 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f466c0044a0 con 0x7f467c1137a0 2026-02-13T04:02:30.271 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.265+0000 7f4671ffb6c0 1 -- 10.20.193.92:0/1765202398 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f466c009030 con 0x7f467c1137a0 2026-02-13T04:02:30.271 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.265+0000 7f4671ffb6c0 1 -- 10.20.193.92:0/1765202398 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f466c0071c0 con 0x7f467c1137a0 2026-02-13T04:02:30.271 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.265+0000 7f4681b0f6c0 1 -- 10.20.193.92:0/1765202398 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f467c167ed0 con 0x7f467c1137a0 2026-02-13T04:02:30.271 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.265+0000 7f4681b0f6c0 1 -- 10.20.193.92:0/1765202398 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f467c168400 con 0x7f467c1137a0 2026-02-13T04:02:30.271 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.266+0000 7f4681b0f6c0 1 -- 10.20.193.92:0/1765202398 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f467c114840 con 0x7f467c1137a0 2026-02-13T04:02:30.272 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.268+0000 7f4671ffb6c0 1 -- 10.20.193.92:0/1765202398 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f466c00c410 con 0x7f467c1137a0 2026-02-13T04:02:30.272 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.270+0000 7f4671ffb6c0 1 --2- 10.20.193.92:0/1765202398 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f46580b56d0 0x7f46580d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:30.273 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.270+0000 7f4671ffb6c0 1 -- 10.20.193.92:0/1765202398 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f466c0e3a70 con 0x7f467c1137a0 2026-02-13T04:02:30.273 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.270+0000 7f4671ffb6c0 1 -- 10.20.193.92:0/1765202398 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f466c11c5e0 con 0x7f467c1137a0 2026-02-13T04:02:30.273 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.270+0000 7f4673fff6c0 1 --2- 10.20.193.92:0/1765202398 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f46580b56d0 0x7f46580d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:30.273 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.271+0000 7f4673fff6c0 1 --2- 10.20.193.92:0/1765202398 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f46580b56d0 0x7f46580d5b80 secure :-1 s=READY pgs=208 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46640023e0 tx=0x7f4664005c60 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:02:30.396 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.393+0000 7f4681b0f6c0 1 -- 10.20.193.92:0/1765202398 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f467c168060 con 0x7f467c1137a0 2026-02-13T04:02:30.397 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.394+0000 7f4671ffb6c0 1 -- 10.20.193.92:0/1765202398 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f467c168060 con 0x7f467c1137a0 2026-02-13T04:02:30.397 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:02:30.397 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:02:30.398 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.395+0000 7f4681b0f6c0 1 -- 10.20.193.92:0/1765202398 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f46580b56d0 msgr2=0x7f46580d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:30.398 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.395+0000 7f4681b0f6c0 1 --2- 10.20.193.92:0/1765202398 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f46580b56d0 0x7f46580d5b80 secure :-1 s=READY pgs=208 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f46640023e0 tx=0x7f4664005c60 comp rx=0 tx=0).stop 2026-02-13T04:02:30.398 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.395+0000 7f4681b0f6c0 1 -- 10.20.193.92:0/1765202398 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f467c1137a0 msgr2=0x7f467c121440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:30.398 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.395+0000 7f4681b0f6c0 1 --2- 10.20.193.92:0/1765202398 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f467c1137a0 0x7f467c121440 secure :-1 s=READY pgs=261 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f466c00b6c0 tx=0x7f466c00bb90 comp rx=0 tx=0).stop 2026-02-13T04:02:30.398 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.395+0000 7f4681b0f6c0 1 -- 10.20.193.92:0/1765202398 shutdown_connections 2026-02-13T04:02:30.399 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.395+0000 7f4681b0f6c0 1 --2- 10.20.193.92:0/1765202398 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f46580b56d0 0x7f46580d5b80 unknown :-1 s=CLOSED pgs=208 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:30.399 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.395+0000 7f4681b0f6c0 1 --2- 10.20.193.92:0/1765202398 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f467c126d40 0x7f467c1271e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:30.399 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.395+0000 7f4681b0f6c0 1 --2- 10.20.193.92:0/1765202398 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f467c116520 0x7f467c121980 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:30.399 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.395+0000 7f4681b0f6c0 1 --2- 10.20.193.92:0/1765202398 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f467c1137a0 0x7f467c121440 unknown :-1 s=CLOSED pgs=261 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:30.399 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.395+0000 7f4681b0f6c0 1 -- 10.20.193.92:0/1765202398 >> 10.20.193.92:0/1765202398 conn(0x7f467c061510 msgr2=0x7f467c116d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:02:30.399 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.395+0000 7f4681b0f6c0 1 -- 10.20.193.92:0/1765202398 shutdown_connections 2026-02-13T04:02:30.399 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:30.395+0000 7f4681b0f6c0 1 -- 10.20.193.92:0/1765202398 wait complete. 2026-02-13T04:02:30.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:30 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/1765202398' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:30.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:30 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/1765202398' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:30.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:30 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1765202398' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:31.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:31 trial158 ceph-mon[27763]: pgmap v231: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:02:31.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:31 trial099 ceph-mon[27808]: pgmap v231: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:02:31.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:31 trial092 ceph-mon[23047]: pgmap v231: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:02:33.501 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:02:33.685 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:02:33.750 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:33 trial092 ceph-mon[23047]: pgmap v232: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:02:33.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:33 trial158 ceph-mon[27763]: pgmap v232: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:02:33.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:33 trial099 ceph-mon[27808]: pgmap v232: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:02:33.871 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:33.869+0000 7fe5b13856c0 1 -- 10.20.193.92:0/666707740 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe5ac11b510 msgr2=0x7fe5ac11b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:33.872 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:33.869+0000 7fe5b13856c0 1 --2- 10.20.193.92:0/666707740 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe5ac11b510 0x7fe5ac11b8e0 secure :-1 s=READY pgs=117 gs=2 cs=0 l=1 c_cookie=10049672127775177638 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe5a00098a0 tx=0x7fe5a002ec50 comp rx=0 tx=0).stop 2026-02-13T04:02:33.872 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:33.869+0000 7fe5b13856c0 1 -- 10.20.193.92:0/666707740 shutdown_connections 2026-02-13T04:02:33.872 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:33.869+0000 7fe5b13856c0 1 --2- 10.20.193.92:0/666707740 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe5ac1149c0 0x7fe5ac114ee0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:33.872 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:33.869+0000 7fe5b13856c0 1 --2- 10.20.193.92:0/666707740 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe5ac113dc0 0x7fe5ac114210 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:33.872 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:33.869+0000 7fe5b13856c0 1 --2- 10.20.193.92:0/666707740 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe5ac11b510 0x7fe5ac11b8e0 unknown :-1 s=CLOSED pgs=117 gs=2 cs=0 l=1 c_cookie=10049672127775177638 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:33.872 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:33.869+0000 7fe5b13856c0 1 -- 10.20.193.92:0/666707740 >> 10.20.193.92:0/666707740 conn(0x7fe5ac058a50 msgr2=0x7fe5ac058e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:02:33.872 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:33.869+0000 7fe5b13856c0 1 -- 10.20.193.92:0/666707740 shutdown_connections 2026-02-13T04:02:33.872 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:33.870+0000 7fe5b13856c0 1 -- 10.20.193.92:0/666707740 wait complete. 2026-02-13T04:02:33.873 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:33.870+0000 7fe5b13856c0 1 Processor -- start 2026-02-13T04:02:33.873 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:33.871+0000 7fe5b13856c0 1 -- start start 2026-02-13T04:02:33.873 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:33.871+0000 7fe5b13856c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe5ac113dc0 0x7fe5ac12b720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:33.873 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:33.871+0000 7fe5b13856c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe5ac1149c0 0x7fe5ac12bc60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:33.873 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:33.871+0000 7fe5b13856c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe5ac11b510 0x7fe5ac131020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:33.873 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:33.871+0000 7fe5b13856c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ac131670 con 0x7fe5ac113dc0 2026-02-13T04:02:33.873 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:33.871+0000 7fe5b13856c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ac1317e0 con 0x7fe5ac1149c0 2026-02-13T04:02:33.873 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:33.871+0000 7fe5b13856c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ac1319a0 con 0x7fe5ac11b510 2026-02-13T04:02:33.873 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:33.871+0000 7fe5aa7fc6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe5ac1149c0 0x7fe5ac12bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:33.873 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:33.871+0000 7fe5aa7fc6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe5ac1149c0 0x7fe5ac12bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:44514/0 (socket says 10.20.193.92:44514) 2026-02-13T04:02:33.874 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:33.871+0000 7fe5aa7fc6c0 1 -- 10.20.193.92:0/2537062526 learned_addr learned my addr 10.20.193.92:0/2537062526 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:02:33.874 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:33.871+0000 7fe5aaffd6c0 1 --2- 10.20.193.92:0/2537062526 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe5ac113dc0 0x7fe5ac12b720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:33.874 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:33.871+0000 7fe5ab7fe6c0 1 --2- 10.20.193.92:0/2537062526 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe5ac11b510 0x7fe5ac131020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:33.874 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:33.871+0000 7fe5aa7fc6c0 1 -- 10.20.193.92:0/2537062526 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe5ac11b510 msgr2=0x7fe5ac131020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:33.874 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:33.871+0000 7fe5aa7fc6c0 1 --2- 10.20.193.92:0/2537062526 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe5ac11b510 0x7fe5ac131020 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:33.874 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:33.871+0000 7fe5aa7fc6c0 1 -- 10.20.193.92:0/2537062526 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe5ac113dc0 msgr2=0x7fe5ac12b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:33.874 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:33.871+0000 7fe5aa7fc6c0 1 --2- 10.20.193.92:0/2537062526 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe5ac113dc0 0x7fe5ac12b720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:33.874 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:33.871+0000 7fe5aa7fc6c0 1 -- 10.20.193.92:0/2537062526 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe594009590 con 0x7fe5ac1149c0 2026-02-13T04:02:33.874 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:33.871+0000 7fe5aaffd6c0 1 --2- 10.20.193.92:0/2537062526 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe5ac113dc0 0x7fe5ac12b720 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T04:02:33.874 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:33.871+0000 7fe5aa7fc6c0 1 --2- 10.20.193.92:0/2537062526 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe5ac1149c0 0x7fe5ac12bc60 secure :-1 s=READY pgs=118 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe594004750 tx=0x7fe59400be00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:02:33.874 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:33.872+0000 7fe58bfff6c0 1 -- 10.20.193.92:0/2537062526 <== mon.2 v2:10.20.193.99:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe594004250 con 0x7fe5ac1149c0 2026-02-13T04:02:33.874 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:33.872+0000 7fe58bfff6c0 1 -- 10.20.193.92:0/2537062526 <== mon.2 v2:10.20.193.99:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fe594009070 con 0x7fe5ac1149c0 2026-02-13T04:02:33.874 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:33.872+0000 7fe58bfff6c0 1 -- 10.20.193.92:0/2537062526 <== mon.2 v2:10.20.193.99:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe594007440 con 0x7fe5ac1149c0 2026-02-13T04:02:33.874 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:33.872+0000 7fe5b13856c0 1 -- 10.20.193.92:0/2537062526 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5a00094c0 con 0x7fe5ac1149c0 2026-02-13T04:02:33.874 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:33.872+0000 7fe5b13856c0 1 -- 10.20.193.92:0/2537062526 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5ac1721b0 con 0x7fe5ac1149c0 2026-02-13T04:02:33.874 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:33.872+0000 7fe5b13856c0 1 -- 10.20.193.92:0/2537062526 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5ac05b000 con 0x7fe5ac1149c0 2026-02-13T04:02:33.877 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:33.874+0000 7fe58bfff6c0 1 -- 10.20.193.92:0/2537062526 <== mon.2 v2:10.20.193.99:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fe5940043b0 con 0x7fe5ac1149c0 2026-02-13T04:02:33.878 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:33.876+0000 7fe58bfff6c0 1 --2- 10.20.193.92:0/2537062526 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fe5800b56d0 0x7fe5800d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:33.878 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:33.876+0000 7fe58bfff6c0 1 -- 10.20.193.92:0/2537062526 <== mon.2 v2:10.20.193.99:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7fe5940e3db0 con 0x7fe5ac1149c0 2026-02-13T04:02:33.879 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:33.876+0000 7fe58bfff6c0 1 -- 10.20.193.92:0/2537062526 <== mon.2 v2:10.20.193.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe5940e4230 con 0x7fe5ac1149c0 2026-02-13T04:02:33.879 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:33.876+0000 7fe5aaffd6c0 1 --2- 10.20.193.92:0/2537062526 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fe5800b56d0 0x7fe5800d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:33.880 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:33.877+0000 7fe5aaffd6c0 1 --2- 10.20.193.92:0/2537062526 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fe5800b56d0 0x7fe5800d5b80 secure :-1 s=READY pgs=209 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe5a00023e0 tx=0x7fe5a0005910 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:02:34.004 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:34.002+0000 7fe5b13856c0 1 -- 10.20.193.92:0/2537062526 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe5ac12c870 con 0x7fe5ac1149c0 2026-02-13T04:02:34.005 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:34.002+0000 7fe58bfff6c0 1 -- 10.20.193.92:0/2537062526 <== mon.2 v2:10.20.193.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fe5940a67e0 con 0x7fe5ac1149c0 2026-02-13T04:02:34.005 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:02:34.005 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:02:34.006 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:34.003+0000 7fe5b13856c0 1 -- 10.20.193.92:0/2537062526 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fe5800b56d0 msgr2=0x7fe5800d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:34.006 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:34.003+0000 7fe5b13856c0 1 --2- 10.20.193.92:0/2537062526 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fe5800b56d0 0x7fe5800d5b80 secure :-1 s=READY pgs=209 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe5a00023e0 tx=0x7fe5a0005910 comp rx=0 tx=0).stop 2026-02-13T04:02:34.006 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:34.003+0000 7fe5b13856c0 1 -- 10.20.193.92:0/2537062526 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe5ac1149c0 msgr2=0x7fe5ac12bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:34.006 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:34.003+0000 7fe5b13856c0 1 --2- 10.20.193.92:0/2537062526 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe5ac1149c0 0x7fe5ac12bc60 secure :-1 s=READY pgs=118 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe594004750 tx=0x7fe59400be00 comp rx=0 tx=0).stop 2026-02-13T04:02:34.006 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:34.004+0000 7fe5b13856c0 1 -- 10.20.193.92:0/2537062526 shutdown_connections 2026-02-13T04:02:34.006 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:34.004+0000 7fe5b13856c0 1 --2- 10.20.193.92:0/2537062526 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fe5800b56d0 0x7fe5800d5b80 unknown :-1 s=CLOSED pgs=209 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:34.006 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:34.004+0000 7fe5b13856c0 1 --2- 10.20.193.92:0/2537062526 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe5ac1149c0 0x7fe5ac12bc60 unknown :-1 s=CLOSED pgs=118 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:34.006 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:34.004+0000 7fe5b13856c0 1 --2- 10.20.193.92:0/2537062526 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe5ac11b510 0x7fe5ac131020 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:34.006 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:34.004+0000 7fe5b13856c0 1 --2- 10.20.193.92:0/2537062526 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe5ac113dc0 0x7fe5ac12b720 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:34.006 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:34.004+0000 7fe5b13856c0 1 -- 10.20.193.92:0/2537062526 >> 10.20.193.92:0/2537062526 conn(0x7fe5ac058a50 msgr2=0x7fe5ac11a520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:02:34.006 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:34.004+0000 7fe5b13856c0 1 -- 10.20.193.92:0/2537062526 shutdown_connections 2026-02-13T04:02:34.006 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:34.004+0000 7fe5b13856c0 1 -- 10.20.193.92:0/2537062526 wait complete. 2026-02-13T04:02:34.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:34 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/2537062526' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:34.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:34 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/2537062526' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:34.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:34 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/2537062526' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:35.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:35 trial158 ceph-mon[27763]: pgmap v233: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:02:35.835 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:35 trial092 ceph-mon[23047]: pgmap v233: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:02:35.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:35 trial099 ceph-mon[27808]: pgmap v233: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:02:37.111 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:02:37.296 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:02:37.492 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.489+0000 7f105b06b6c0 1 -- 10.20.193.92:0/1076388149 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1054114190 msgr2=0x7f1054115d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:37.492 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.489+0000 7f105b06b6c0 1 --2- 10.20.193.92:0/1076388149 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1054114190 0x7f1054115d40 secure :-1 s=READY pgs=112 gs=3 cs=0 l=1 c_cookie=17798338867993608608 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f10480099a0 tx=0x7f104802ed00 comp rx=0 tx=0).stop 2026-02-13T04:02:37.492 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.489+0000 7f105b06b6c0 1 -- 10.20.193.92:0/1076388149 shutdown_connections 2026-02-13T04:02:37.492 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.489+0000 7f105b06b6c0 1 --2- 10.20.193.92:0/1076388149 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1054116520 0x7f105417a100 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:37.492 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.489+0000 7f105b06b6c0 1 --2- 10.20.193.92:0/1076388149 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1054114190 0x7f1054115d40 unknown :-1 s=CLOSED pgs=112 gs=3 cs=0 l=1 c_cookie=17798338867993608608 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:37.493 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.489+0000 7f105b06b6c0 1 --2- 10.20.193.92:0/1076388149 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f10541137a0 0x7f1054113b70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:37.493 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.489+0000 7f105b06b6c0 1 -- 10.20.193.92:0/1076388149 >> 10.20.193.92:0/1076388149 conn(0x7f1054061510 msgr2=0x7f1054061910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:02:37.495 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.489+0000 7f105b06b6c0 1 -- 10.20.193.92:0/1076388149 shutdown_connections 2026-02-13T04:02:37.495 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.489+0000 7f105b06b6c0 1 -- 10.20.193.92:0/1076388149 wait complete. 2026-02-13T04:02:37.495 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.489+0000 7f105b06b6c0 1 Processor -- start 2026-02-13T04:02:37.495 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.490+0000 7f105b06b6c0 1 -- start start 2026-02-13T04:02:37.495 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.490+0000 7f105b06b6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f10541137a0 0x7f105406e090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:37.495 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.490+0000 7f105b06b6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1054116520 0x7f105417a000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:37.496 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.490+0000 7f105b06b6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f105406e6c0 0x7f1054106980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:37.496 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.490+0000 7f105b06b6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f105406ed80 con 0x7f10541137a0 2026-02-13T04:02:37.496 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.490+0000 7f105b06b6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1054106ec0 con 0x7f1054116520 2026-02-13T04:02:37.496 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.490+0000 7f105b06b6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f1054107080 con 0x7f105406e6c0 2026-02-13T04:02:37.496 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.490+0000 7f105a86a6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f105406e6c0 0x7f1054106980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:37.496 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.490+0000 7f105a0696c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f10541137a0 0x7f105406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:37.496 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.490+0000 7f105a86a6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f105406e6c0 0x7f1054106980 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:35498/0 (socket says 10.20.193.92:35498) 2026-02-13T04:02:37.496 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.490+0000 7f105a86a6c0 1 -- 10.20.193.92:0/1188816717 learned_addr learned my addr 10.20.193.92:0/1188816717 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:02:37.496 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.490+0000 7f10598686c0 1 --2- 10.20.193.92:0/1188816717 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1054116520 0x7f105417a000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:37.496 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.490+0000 7f105a86a6c0 1 -- 10.20.193.92:0/1188816717 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1054116520 msgr2=0x7f105417a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:37.497 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.490+0000 7f105a86a6c0 1 --2- 10.20.193.92:0/1188816717 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1054116520 0x7f105417a000 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:37.497 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.490+0000 7f105a86a6c0 1 -- 10.20.193.92:0/1188816717 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f10541137a0 msgr2=0x7f105406e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:37.497 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.490+0000 7f105a86a6c0 1 --2- 10.20.193.92:0/1188816717 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f10541137a0 0x7f105406e090 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:37.497 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.490+0000 7f105a86a6c0 1 -- 10.20.193.92:0/1188816717 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1048009590 con 0x7f105406e6c0 2026-02-13T04:02:37.497 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.490+0000 7f105a0696c0 1 --2- 10.20.193.92:0/1188816717 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f10541137a0 0x7f105406e090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T04:02:37.497 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.490+0000 7f105a86a6c0 1 --2- 10.20.193.92:0/1188816717 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f105406e6c0 0x7f1054106980 secure :-1 s=READY pgs=113 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1050006ea0 tx=0x7f105000ce50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:02:37.497 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.491+0000 7f103b7fe6c0 1 -- 10.20.193.92:0/1188816717 <== mon.1 v2:10.20.193.158:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1050003a30 con 0x7f105406e6c0 2026-02-13T04:02:37.497 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.491+0000 7f103b7fe6c0 1 -- 10.20.193.92:0/1188816717 <== mon.1 v2:10.20.193.158:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f1050005550 con 0x7f105406e6c0 2026-02-13T04:02:37.497 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.491+0000 7f103b7fe6c0 1 -- 10.20.193.92:0/1188816717 <== mon.1 v2:10.20.193.158:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f10500081c0 con 0x7f105406e6c0 2026-02-13T04:02:37.497 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.491+0000 7f105b06b6c0 1 -- 10.20.193.92:0/1188816717 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1054107360 con 0x7f105406e6c0 2026-02-13T04:02:37.497 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.491+0000 7f105b06b6c0 1 -- 10.20.193.92:0/1188816717 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1054109d00 con 0x7f105406e6c0 2026-02-13T04:02:37.498 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.491+0000 7f105b06b6c0 1 -- 10.20.193.92:0/1188816717 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1054114840 con 0x7f105406e6c0 2026-02-13T04:02:37.499 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.494+0000 7f103b7fe6c0 1 -- 10.20.193.92:0/1188816717 <== mon.1 v2:10.20.193.158:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f1050003b90 con 0x7f105406e6c0 2026-02-13T04:02:37.499 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.495+0000 7f103b7fe6c0 1 --2- 10.20.193.92:0/1188816717 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f10300b56d0 0x7f10300d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:37.499 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.496+0000 7f103b7fe6c0 1 -- 10.20.193.92:0/1188816717 <== mon.1 v2:10.20.193.158:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f10500e4ab0 con 0x7f105406e6c0 2026-02-13T04:02:37.499 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.496+0000 7f105a0696c0 1 --2- 10.20.193.92:0/1188816717 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f10300b56d0 0x7f10300d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:37.499 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.496+0000 7f103b7fe6c0 1 -- 10.20.193.92:0/1188816717 <== mon.1 v2:10.20.193.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f105011d5e0 con 0x7f105406e6c0 2026-02-13T04:02:37.499 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.496+0000 7f105a0696c0 1 --2- 10.20.193.92:0/1188816717 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f10300b56d0 0x7f10300d5b80 secure :-1 s=READY pgs=210 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1044004750 tx=0x7f1044009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:02:37.622 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.619+0000 7f105b06b6c0 1 -- 10.20.193.92:0/1188816717 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1054113b70 con 0x7f105406e6c0 2026-02-13T04:02:37.622 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.619+0000 7f103b7fe6c0 1 -- 10.20.193.92:0/1188816717 <== mon.1 v2:10.20.193.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f10500a7450 con 0x7f105406e6c0 2026-02-13T04:02:37.622 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:02:37.622 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:02:37.624 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.620+0000 7f105b06b6c0 1 -- 10.20.193.92:0/1188816717 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f10300b56d0 msgr2=0x7f10300d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:37.624 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.620+0000 7f105b06b6c0 1 --2- 10.20.193.92:0/1188816717 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f10300b56d0 0x7f10300d5b80 secure :-1 s=READY pgs=210 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1044004750 tx=0x7f1044009260 comp rx=0 tx=0).stop 2026-02-13T04:02:37.624 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.620+0000 7f105b06b6c0 1 -- 10.20.193.92:0/1188816717 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f105406e6c0 msgr2=0x7f1054106980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:37.624 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.620+0000 7f105b06b6c0 1 --2- 10.20.193.92:0/1188816717 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f105406e6c0 0x7f1054106980 secure :-1 s=READY pgs=113 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1050006ea0 tx=0x7f105000ce50 comp rx=0 tx=0).stop 2026-02-13T04:02:37.624 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.620+0000 7f105b06b6c0 1 -- 10.20.193.92:0/1188816717 shutdown_connections 2026-02-13T04:02:37.624 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.620+0000 7f105b06b6c0 1 --2- 10.20.193.92:0/1188816717 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f10300b56d0 0x7f10300d5b80 unknown :-1 s=CLOSED pgs=210 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:37.624 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.620+0000 7f105b06b6c0 1 --2- 10.20.193.92:0/1188816717 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1054116520 0x7f105417a000 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:37.624 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.621+0000 7f105b06b6c0 1 --2- 10.20.193.92:0/1188816717 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f105406e6c0 0x7f1054106980 unknown :-1 s=CLOSED pgs=113 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:37.624 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.621+0000 7f105b06b6c0 1 --2- 10.20.193.92:0/1188816717 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f10541137a0 0x7f105406e090 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:37.625 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.621+0000 7f105b06b6c0 1 -- 10.20.193.92:0/1188816717 >> 10.20.193.92:0/1188816717 conn(0x7f1054061510 msgr2=0x7f1054116d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:02:37.625 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.621+0000 7f105b06b6c0 1 -- 10.20.193.92:0/1188816717 shutdown_connections 2026-02-13T04:02:37.625 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:37.621+0000 7f105b06b6c0 1 -- 10.20.193.92:0/1188816717 wait complete. 2026-02-13T04:02:37.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:37 trial092 ceph-mon[23047]: pgmap v234: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T04:02:37.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:37 trial158 ceph-mon[27763]: pgmap v234: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T04:02:37.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:37 trial099 ceph-mon[27808]: pgmap v234: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T04:02:38.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:38 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/1188816717' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:38.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:38 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/1188816717' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:38.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:38 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1188816717' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:39.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:39 trial158 ceph-mon[27763]: pgmap v235: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:02:39.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:39 trial099 ceph-mon[27808]: pgmap v235: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:02:39.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:39 trial092 ceph-mon[23047]: pgmap v235: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:02:40.730 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:02:40.913 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:02:41.116 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.113+0000 7fbde71486c0 1 -- 10.20.193.92:0/3491701392 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fbde010f200 msgr2=0x7fbde010f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:41.116 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.113+0000 7fbde71486c0 1 --2- 10.20.193.92:0/3491701392 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fbde010f200 0x7fbde010f5d0 secure :-1 s=READY pgs=119 gs=1 cs=0 l=1 c_cookie=14321088408814303914 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbdd0009970 tx=0x7fbdd002ed10 comp rx=0 tx=0).stop 2026-02-13T04:02:41.116 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.113+0000 7fbde71486c0 1 -- 10.20.193.92:0/3491701392 shutdown_connections 2026-02-13T04:02:41.117 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.113+0000 7fbde71486c0 1 --2- 10.20.193.92:0/3491701392 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fbde0115410 0x7fbde0175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:41.117 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.113+0000 7fbde71486c0 1 --2- 10.20.193.92:0/3491701392 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbde010fbf0 0x7fbde0114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:41.117 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.113+0000 7fbde71486c0 1 --2- 10.20.193.92:0/3491701392 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fbde010f200 0x7fbde010f5d0 unknown :-1 s=CLOSED pgs=119 gs=1 cs=0 l=1 c_cookie=14321088408814303914 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:41.117 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.113+0000 7fbde71486c0 1 -- 10.20.193.92:0/3491701392 >> 10.20.193.92:0/3491701392 conn(0x7fbde00ecb00 msgr2=0x7fbde010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:02:41.117 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.113+0000 7fbde71486c0 1 -- 10.20.193.92:0/3491701392 shutdown_connections 2026-02-13T04:02:41.117 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.113+0000 7fbde71486c0 1 -- 10.20.193.92:0/3491701392 wait complete. 2026-02-13T04:02:41.119 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.114+0000 7fbde71486c0 1 Processor -- start 2026-02-13T04:02:41.119 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.114+0000 7fbde71486c0 1 -- start start 2026-02-13T04:02:41.120 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.114+0000 7fbde71486c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fbde010f200 0x7fbde011cf60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:41.120 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.114+0000 7fbde71486c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fbde0115410 0x7fbde011d4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:41.120 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.114+0000 7fbde71486c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbde0122860 0x7fbde0122d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:41.120 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.114+0000 7fbde71486c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbde0123270 con 0x7fbde0122860 2026-02-13T04:02:41.120 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.114+0000 7fbde71486c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fbde01233e0 con 0x7fbde0115410 2026-02-13T04:02:41.120 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.114+0000 7fbde71486c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fbde01235a0 con 0x7fbde010f200 2026-02-13T04:02:41.120 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.115+0000 7fbde56be6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbde0122860 0x7fbde0122d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:41.120 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.115+0000 7fbde4ebd6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fbde010f200 0x7fbde011cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:41.120 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.115+0000 7fbdd7fff6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fbde0115410 0x7fbde011d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:41.120 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.115+0000 7fbdd7fff6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fbde0115410 0x7fbde011d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:47412/0 (socket says 10.20.193.92:47412) 2026-02-13T04:02:41.120 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.115+0000 7fbdd7fff6c0 1 -- 10.20.193.92:0/3816881778 learned_addr learned my addr 10.20.193.92:0/3816881778 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:02:41.121 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.115+0000 7fbde4ebd6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fbde010f200 0x7fbde011cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:35520/0 (socket says 10.20.193.92:35520) 2026-02-13T04:02:41.121 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.115+0000 7fbdd7fff6c0 1 -- 10.20.193.92:0/3816881778 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fbde010f200 msgr2=0x7fbde011cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:41.121 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.115+0000 7fbdd7fff6c0 1 --2- 10.20.193.92:0/3816881778 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fbde010f200 0x7fbde011cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:41.121 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.115+0000 7fbdd7fff6c0 1 -- 10.20.193.92:0/3816881778 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbde0122860 msgr2=0x7fbde0122d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:41.121 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.115+0000 7fbdd7fff6c0 1 --2- 10.20.193.92:0/3816881778 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbde0122860 0x7fbde0122d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:41.121 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.115+0000 7fbdd7fff6c0 1 -- 10.20.193.92:0/3816881778 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdd0009590 con 0x7fbde0115410 2026-02-13T04:02:41.121 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.115+0000 7fbde56be6c0 1 --2- 10.20.193.92:0/3816881778 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbde0122860 0x7fbde0122d00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T04:02:41.121 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.115+0000 7fbdd7fff6c0 1 --2- 10.20.193.92:0/3816881778 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fbde0115410 0x7fbde011d4a0 secure :-1 s=READY pgs=120 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbdc800b800 tx=0x7fbdc800bcd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:02:41.121 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.115+0000 7fbdd5ffb6c0 1 -- 10.20.193.92:0/3816881778 <== mon.2 v2:10.20.193.99:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbdc8004a80 con 0x7fbde0115410 2026-02-13T04:02:41.121 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.115+0000 7fbde71486c0 1 -- 10.20.193.92:0/3816881778 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbde0163a50 con 0x7fbde0115410 2026-02-13T04:02:41.121 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.115+0000 7fbdd5ffb6c0 1 -- 10.20.193.92:0/3816881778 <== mon.2 v2:10.20.193.99:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fbdc8009070 con 0x7fbde0115410 2026-02-13T04:02:41.121 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.115+0000 7fbdd5ffb6c0 1 -- 10.20.193.92:0/3816881778 <== mon.2 v2:10.20.193.99:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbdc80071c0 con 0x7fbde0115410 2026-02-13T04:02:41.121 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.115+0000 7fbde71486c0 1 -- 10.20.193.92:0/3816881778 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbde0163f30 con 0x7fbde0115410 2026-02-13T04:02:41.122 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.116+0000 7fbde71486c0 1 -- 10.20.193.92:0/3816881778 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbde01104d0 con 0x7fbde0115410 2026-02-13T04:02:41.122 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.118+0000 7fbdd5ffb6c0 1 -- 10.20.193.92:0/3816881778 <== mon.2 v2:10.20.193.99:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fbdc8004060 con 0x7fbde0115410 2026-02-13T04:02:41.123 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.120+0000 7fbdd5ffb6c0 1 --2- 10.20.193.92:0/3816881778 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fbdbc0b56d0 0x7fbdbc0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:41.123 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.120+0000 7fbdd5ffb6c0 1 -- 10.20.193.92:0/3816881778 <== mon.2 v2:10.20.193.99:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7fbdc80e3a10 con 0x7fbde0115410 2026-02-13T04:02:41.123 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.120+0000 7fbde4ebd6c0 1 --2- 10.20.193.92:0/3816881778 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fbdbc0b56d0 0x7fbdbc0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:41.123 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.120+0000 7fbdd5ffb6c0 1 -- 10.20.193.92:0/3816881778 <== mon.2 v2:10.20.193.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fbdc811c5e0 con 0x7fbde0115410 2026-02-13T04:02:41.123 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.121+0000 7fbde4ebd6c0 1 --2- 10.20.193.92:0/3816881778 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fbdbc0b56d0 0x7fbdbc0d5b80 secure :-1 s=READY pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbdd0005b40 tx=0x7fbdd00023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:02:41.248 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.245+0000 7fbde71486c0 1 -- 10.20.193.92:0/3816881778 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbde010fbf0 con 0x7fbde0115410 2026-02-13T04:02:41.248 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.246+0000 7fbdd5ffb6c0 1 -- 10.20.193.92:0/3816881778 <== mon.2 v2:10.20.193.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fbdc80a63b0 con 0x7fbde0115410 2026-02-13T04:02:41.249 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:02:41.249 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:02:41.250 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.247+0000 7fbde71486c0 1 -- 10.20.193.92:0/3816881778 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fbdbc0b56d0 msgr2=0x7fbdbc0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:41.250 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.247+0000 7fbde71486c0 1 --2- 10.20.193.92:0/3816881778 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fbdbc0b56d0 0x7fbdbc0d5b80 secure :-1 s=READY pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbdd0005b40 tx=0x7fbdd00023a0 comp rx=0 tx=0).stop 2026-02-13T04:02:41.250 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.247+0000 7fbde71486c0 1 -- 10.20.193.92:0/3816881778 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fbde0115410 msgr2=0x7fbde011d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:41.250 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.247+0000 7fbde71486c0 1 --2- 10.20.193.92:0/3816881778 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fbde0115410 0x7fbde011d4a0 secure :-1 s=READY pgs=120 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbdc800b800 tx=0x7fbdc800bcd0 comp rx=0 tx=0).stop 2026-02-13T04:02:41.250 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.247+0000 7fbde71486c0 1 -- 10.20.193.92:0/3816881778 shutdown_connections 2026-02-13T04:02:41.250 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.247+0000 7fbde71486c0 1 --2- 10.20.193.92:0/3816881778 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fbdbc0b56d0 0x7fbdbc0d5b80 unknown :-1 s=CLOSED pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:41.251 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.247+0000 7fbde71486c0 1 --2- 10.20.193.92:0/3816881778 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fbde0115410 0x7fbde011d4a0 unknown :-1 s=CLOSED pgs=120 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:41.251 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.247+0000 7fbde71486c0 1 --2- 10.20.193.92:0/3816881778 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbde0122860 0x7fbde0122d00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:41.251 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.247+0000 7fbde71486c0 1 --2- 10.20.193.92:0/3816881778 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fbde010f200 0x7fbde011cf60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:41.251 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.247+0000 7fbde71486c0 1 -- 10.20.193.92:0/3816881778 >> 10.20.193.92:0/3816881778 conn(0x7fbde00ecb00 msgr2=0x7fbde010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:02:41.251 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.247+0000 7fbde71486c0 1 -- 10.20.193.92:0/3816881778 shutdown_connections 2026-02-13T04:02:41.251 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:41.247+0000 7fbde71486c0 1 -- 10.20.193.92:0/3816881778 wait complete. 2026-02-13T04:02:41.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:41 trial092 ceph-mon[23047]: pgmap v236: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:02:41.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:41 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/3816881778' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:41.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:41 trial158 ceph-mon[27763]: pgmap v236: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:02:41.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:41 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/3816881778' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:41.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:41 trial099 ceph-mon[27808]: pgmap v236: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:02:41.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:41 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/3816881778' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:43.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:43 trial158 ceph-mon[27763]: pgmap v237: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:02:43.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:43 trial099 ceph-mon[27808]: pgmap v237: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:02:43.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:43 trial092 ceph-mon[23047]: pgmap v237: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:02:44.351 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:02:44.535 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:02:44.722 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.719+0000 7f584f6f76c0 1 -- 10.20.193.92:0/3665208448 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f58481137a0 msgr2=0x7f5848113b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:44.723 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.719+0000 7f584f6f76c0 1 --2- 10.20.193.92:0/3665208448 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f58481137a0 0x7f5848113b70 secure :-1 s=READY pgs=262 gs=1 cs=0 l=1 c_cookie=8412749715010215086 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58400099a0 tx=0x7f584002ed20 comp rx=0 tx=0).stop 2026-02-13T04:02:44.723 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.719+0000 7f584f6f76c0 1 -- 10.20.193.92:0/3665208448 shutdown_connections 2026-02-13T04:02:44.723 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.719+0000 7f584f6f76c0 1 --2- 10.20.193.92:0/3665208448 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5848114190 0x7f5848115d40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:44.723 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.719+0000 7f584f6f76c0 1 --2- 10.20.193.92:0/3665208448 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f5848116520 0x7f584817a100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:44.723 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.719+0000 7f584f6f76c0 1 --2- 10.20.193.92:0/3665208448 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f58481137a0 0x7f5848113b70 unknown :-1 s=CLOSED pgs=262 gs=1 cs=0 l=1 c_cookie=8412749715010215086 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:44.723 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.719+0000 7f584f6f76c0 1 -- 10.20.193.92:0/3665208448 >> 10.20.193.92:0/3665208448 conn(0x7f5848061510 msgr2=0x7f5848061910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:02:44.723 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.719+0000 7f584f6f76c0 1 -- 10.20.193.92:0/3665208448 shutdown_connections 2026-02-13T04:02:44.723 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.719+0000 7f584f6f76c0 1 -- 10.20.193.92:0/3665208448 wait complete. 2026-02-13T04:02:44.724 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.720+0000 7f584f6f76c0 1 Processor -- start 2026-02-13T04:02:44.724 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.720+0000 7f584f6f76c0 1 -- start start 2026-02-13T04:02:44.725 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.720+0000 7f584f6f76c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f58481137a0 0x7f5848121340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:44.725 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.720+0000 7f584f6f76c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5848116520 0x7f5848121880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:44.726 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.720+0000 7f584f6f76c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f5848126c40 0x7f58481270e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:44.726 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.720+0000 7f584f6f76c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5848127650 con 0x7f58481137a0 2026-02-13T04:02:44.726 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.720+0000 7f584f6f76c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f58481277c0 con 0x7f5848116520 2026-02-13T04:02:44.726 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.720+0000 7f584f6f76c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f5848127980 con 0x7f5848126c40 2026-02-13T04:02:44.726 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.721+0000 7f584def46c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5848116520 0x7f5848121880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:44.726 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.721+0000 7f584def46c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5848116520 0x7f5848121880 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:47428/0 (socket says 10.20.193.92:47428) 2026-02-13T04:02:44.726 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.721+0000 7f584def46c0 1 -- 10.20.193.92:0/420335196 learned_addr learned my addr 10.20.193.92:0/420335196 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:02:44.726 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.721+0000 7f584e6f56c0 1 --2- 10.20.193.92:0/420335196 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f58481137a0 0x7f5848121340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:44.726 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.721+0000 7f584eef66c0 1 --2- 10.20.193.92:0/420335196 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f5848126c40 0x7f58481270e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:44.726 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.721+0000 7f584e6f56c0 1 -- 10.20.193.92:0/420335196 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f5848126c40 msgr2=0x7f58481270e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:44.726 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.721+0000 7f584e6f56c0 1 --2- 10.20.193.92:0/420335196 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f5848126c40 0x7f58481270e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:44.727 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.721+0000 7f584e6f56c0 1 -- 10.20.193.92:0/420335196 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5848116520 msgr2=0x7f5848121880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:44.727 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.721+0000 7f584e6f56c0 1 --2- 10.20.193.92:0/420335196 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5848116520 0x7f5848121880 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:44.727 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.721+0000 7f584e6f56c0 1 -- 10.20.193.92:0/420335196 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5840009590 con 0x7f58481137a0 2026-02-13T04:02:44.727 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.721+0000 7f584def46c0 1 --2- 10.20.193.92:0/420335196 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5848116520 0x7f5848121880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T04:02:44.727 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.721+0000 7f584e6f56c0 1 --2- 10.20.193.92:0/420335196 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f58481137a0 0x7f5848121340 secure :-1 s=READY pgs=263 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58400099a0 tx=0x7f584002f830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:02:44.727 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.721+0000 7f58337fe6c0 1 -- 10.20.193.92:0/420335196 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f58400046b0 con 0x7f58481137a0 2026-02-13T04:02:44.727 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.721+0000 7f58337fe6c0 1 -- 10.20.193.92:0/420335196 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f5840002be0 con 0x7f58481137a0 2026-02-13T04:02:44.727 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.721+0000 7f58337fe6c0 1 -- 10.20.193.92:0/420335196 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f58400073f0 con 0x7f58481137a0 2026-02-13T04:02:44.727 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.721+0000 7f584f6f76c0 1 -- 10.20.193.92:0/420335196 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5848167dd0 con 0x7f58481137a0 2026-02-13T04:02:44.727 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.722+0000 7f584f6f76c0 1 -- 10.20.193.92:0/420335196 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5848168200 con 0x7f58481137a0 2026-02-13T04:02:44.727 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.722+0000 7f58317fa6c0 1 -- 10.20.193.92:0/420335196 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5848114840 con 0x7f58481137a0 2026-02-13T04:02:44.728 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.724+0000 7f58337fe6c0 1 -- 10.20.193.92:0/420335196 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f58400026b0 con 0x7f58481137a0 2026-02-13T04:02:44.729 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.726+0000 7f58337fe6c0 1 --2- 10.20.193.92:0/420335196 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f58240b56d0 0x7f58240d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:44.729 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.726+0000 7f58337fe6c0 1 -- 10.20.193.92:0/420335196 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f5840107de0 con 0x7f58481137a0 2026-02-13T04:02:44.729 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.726+0000 7f58337fe6c0 1 -- 10.20.193.92:0/420335196 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f5840108260 con 0x7f58481137a0 2026-02-13T04:02:44.729 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.726+0000 7f584def46c0 1 --2- 10.20.193.92:0/420335196 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f58240b56d0 0x7f58240d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:44.729 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.726+0000 7f584def46c0 1 --2- 10.20.193.92:0/420335196 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f58240b56d0 0x7f58240d5b80 secure :-1 s=READY pgs=212 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5848127cd0 tx=0x7f5834009420 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:02:44.853 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.850+0000 7f58317fa6c0 1 -- 10.20.193.92:0/420335196 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5848113b70 con 0x7f58481137a0 2026-02-13T04:02:44.853 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.850+0000 7f58337fe6c0 1 -- 10.20.193.92:0/420335196 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f58400ca780 con 0x7f58481137a0 2026-02-13T04:02:44.853 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:02:44.853 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:02:44.854 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.851+0000 7f58317fa6c0 1 -- 10.20.193.92:0/420335196 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f58240b56d0 msgr2=0x7f58240d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:44.854 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.851+0000 7f58317fa6c0 1 --2- 10.20.193.92:0/420335196 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f58240b56d0 0x7f58240d5b80 secure :-1 s=READY pgs=212 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5848127cd0 tx=0x7f5834009420 comp rx=0 tx=0).stop 2026-02-13T04:02:44.855 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.851+0000 7f58317fa6c0 1 -- 10.20.193.92:0/420335196 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f58481137a0 msgr2=0x7f5848121340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:44.855 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.851+0000 7f58317fa6c0 1 --2- 10.20.193.92:0/420335196 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f58481137a0 0x7f5848121340 secure :-1 s=READY pgs=263 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58400099a0 tx=0x7f584002f830 comp rx=0 tx=0).stop 2026-02-13T04:02:44.855 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.852+0000 7f58317fa6c0 1 -- 10.20.193.92:0/420335196 shutdown_connections 2026-02-13T04:02:44.855 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.852+0000 7f58317fa6c0 1 --2- 10.20.193.92:0/420335196 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f58240b56d0 0x7f58240d5b80 unknown :-1 s=CLOSED pgs=212 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:44.855 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.852+0000 7f58317fa6c0 1 --2- 10.20.193.92:0/420335196 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5848116520 0x7f5848121880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:44.855 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.852+0000 7f58317fa6c0 1 --2- 10.20.193.92:0/420335196 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f5848126c40 0x7f58481270e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:44.855 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.852+0000 7f58317fa6c0 1 --2- 10.20.193.92:0/420335196 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f58481137a0 0x7f5848121340 unknown :-1 s=CLOSED pgs=263 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:44.855 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.852+0000 7f58317fa6c0 1 -- 10.20.193.92:0/420335196 >> 10.20.193.92:0/420335196 conn(0x7f5848061510 msgr2=0x7f5848115580 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:02:44.855 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.852+0000 7f58317fa6c0 1 -- 10.20.193.92:0/420335196 shutdown_connections 2026-02-13T04:02:44.855 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:44.852+0000 7f58317fa6c0 1 -- 10.20.193.92:0/420335196 wait complete. 2026-02-13T04:02:45.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:45 trial158 ceph-mon[27763]: pgmap v238: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:02:45.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:45 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/420335196' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:45.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:45 trial099 ceph-mon[27808]: pgmap v238: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:02:45.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:45 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/420335196' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:45.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:45 trial092 ceph-mon[23047]: pgmap v238: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:02:45.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:45 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/420335196' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:47.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:47 trial158 ceph-mon[27763]: pgmap v239: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T04:02:47.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:47 trial099 ceph-mon[27808]: pgmap v239: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T04:02:47.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:47 trial092 ceph-mon[23047]: pgmap v239: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T04:02:47.963 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:02:48.147 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:02:48.351 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.348+0000 7fa364d1c6c0 1 -- 10.20.193.92:0/3014180081 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa36011b510 msgr2=0x7fa36011b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:48.351 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.348+0000 7fa364d1c6c0 1 --2- 10.20.193.92:0/3014180081 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa36011b510 0x7fa36011b8e0 secure :-1 s=READY pgs=264 gs=1 cs=0 l=1 c_cookie=13479529715136901291 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa35400aa40 tx=0x7fa35402fdf0 comp rx=0 tx=0).stop 2026-02-13T04:02:48.351 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.348+0000 7fa364d1c6c0 1 -- 10.20.193.92:0/3014180081 shutdown_connections 2026-02-13T04:02:48.351 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.348+0000 7fa364d1c6c0 1 --2- 10.20.193.92:0/3014180081 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa360113dc0 0x7fa360114210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:48.351 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.348+0000 7fa364d1c6c0 1 --2- 10.20.193.92:0/3014180081 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa3601149c0 0x7fa360114ee0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:48.352 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.348+0000 7fa364d1c6c0 1 --2- 10.20.193.92:0/3014180081 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa36011b510 0x7fa36011b8e0 unknown :-1 s=CLOSED pgs=264 gs=1 cs=0 l=1 c_cookie=13479529715136901291 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:48.352 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.348+0000 7fa364d1c6c0 1 -- 10.20.193.92:0/3014180081 >> 10.20.193.92:0/3014180081 conn(0x7fa360058a50 msgr2=0x7fa360058e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:02:48.352 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.348+0000 7fa364d1c6c0 1 -- 10.20.193.92:0/3014180081 shutdown_connections 2026-02-13T04:02:48.352 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.348+0000 7fa364d1c6c0 1 -- 10.20.193.92:0/3014180081 wait complete. 2026-02-13T04:02:48.354 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.349+0000 7fa364d1c6c0 1 Processor -- start 2026-02-13T04:02:48.354 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.349+0000 7fa364d1c6c0 1 -- start start 2026-02-13T04:02:48.354 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.349+0000 7fa364d1c6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa360113dc0 0x7fa36012b690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:48.354 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.349+0000 7fa364d1c6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa3601149c0 0x7fa36012bbd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:48.354 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.349+0000 7fa364d1c6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa36011b510 0x7fa360130f40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:48.354 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.349+0000 7fa364d1c6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa360131590 con 0x7fa3601149c0 2026-02-13T04:02:48.354 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.349+0000 7fa364d1c6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa360131700 con 0x7fa36011b510 2026-02-13T04:02:48.354 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.349+0000 7fa364d1c6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fa3601318c0 con 0x7fa360113dc0 2026-02-13T04:02:48.354 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.349+0000 7fa35dd746c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa3601149c0 0x7fa36012bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:48.354 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.349+0000 7fa35ed766c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa36011b510 0x7fa360130f40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:48.355 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.349+0000 7fa35dd746c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa3601149c0 0x7fa36012bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:59202/0 (socket says 10.20.193.92:59202) 2026-02-13T04:02:48.355 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.349+0000 7fa35dd746c0 1 -- 10.20.193.92:0/2128243033 learned_addr learned my addr 10.20.193.92:0/2128243033 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:02:48.355 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.349+0000 7fa35e5756c0 1 --2- 10.20.193.92:0/2128243033 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa360113dc0 0x7fa36012b690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:48.355 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.349+0000 7fa35dd746c0 1 -- 10.20.193.92:0/2128243033 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa360113dc0 msgr2=0x7fa36012b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:48.355 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.349+0000 7fa35dd746c0 1 --2- 10.20.193.92:0/2128243033 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa360113dc0 0x7fa36012b690 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:48.355 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.349+0000 7fa35dd746c0 1 -- 10.20.193.92:0/2128243033 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa36011b510 msgr2=0x7fa360130f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:48.355 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.349+0000 7fa35dd746c0 1 --2- 10.20.193.92:0/2128243033 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa36011b510 0x7fa360130f40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:48.355 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.349+0000 7fa35dd746c0 1 -- 10.20.193.92:0/2128243033 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa35400a660 con 0x7fa3601149c0 2026-02-13T04:02:48.355 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.350+0000 7fa35dd746c0 1 --2- 10.20.193.92:0/2128243033 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa3601149c0 0x7fa36012bbd0 secure :-1 s=READY pgs=265 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa348009490 tx=0x7fa34800bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:02:48.355 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.350+0000 7fa3477fe6c0 1 -- 10.20.193.92:0/2128243033 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa348004a80 con 0x7fa3601149c0 2026-02-13T04:02:48.355 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.350+0000 7fa3477fe6c0 1 -- 10.20.193.92:0/2128243033 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fa348009030 con 0x7fa3601149c0 2026-02-13T04:02:48.355 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.350+0000 7fa364d1c6c0 1 -- 10.20.193.92:0/2128243033 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa360131ba0 con 0x7fa3601149c0 2026-02-13T04:02:48.356 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.350+0000 7fa3477fe6c0 1 -- 10.20.193.92:0/2128243033 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa348007440 con 0x7fa3601149c0 2026-02-13T04:02:48.356 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.350+0000 7fa364d1c6c0 1 -- 10.20.193.92:0/2128243033 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa360172280 con 0x7fa3601149c0 2026-02-13T04:02:48.356 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.350+0000 7fa3457fa6c0 1 -- 10.20.193.92:0/2128243033 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa328005310 con 0x7fa3601149c0 2026-02-13T04:02:48.356 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.353+0000 7fa3477fe6c0 1 -- 10.20.193.92:0/2128243033 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fa348004060 con 0x7fa3601149c0 2026-02-13T04:02:48.357 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.354+0000 7fa3477fe6c0 1 --2- 10.20.193.92:0/2128243033 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa3380b5650 0x7fa3380d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:48.357 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.354+0000 7fa3477fe6c0 1 -- 10.20.193.92:0/2128243033 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7fa3480e3ac0 con 0x7fa3601149c0 2026-02-13T04:02:48.357 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.355+0000 7fa3477fe6c0 1 -- 10.20.193.92:0/2128243033 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa34811c5e0 con 0x7fa3601149c0 2026-02-13T04:02:48.357 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.355+0000 7fa35e5756c0 1 --2- 10.20.193.92:0/2128243033 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa3380b5650 0x7fa3380d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:48.358 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.355+0000 7fa35e5756c0 1 --2- 10.20.193.92:0/2128243033 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa3380b5650 0x7fa3380d5b00 secure :-1 s=READY pgs=213 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa35400a990 tx=0x7fa354002470 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:02:48.480 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.478+0000 7fa3457fa6c0 1 -- 10.20.193.92:0/2128243033 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa328005960 con 0x7fa3601149c0 2026-02-13T04:02:48.481 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.478+0000 7fa3477fe6c0 1 -- 10.20.193.92:0/2128243033 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fa3480a6460 con 0x7fa3601149c0 2026-02-13T04:02:48.481 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:02:48.481 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:02:48.482 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.479+0000 7fa3457fa6c0 1 -- 10.20.193.92:0/2128243033 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa3380b5650 msgr2=0x7fa3380d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:48.482 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.479+0000 7fa3457fa6c0 1 --2- 10.20.193.92:0/2128243033 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa3380b5650 0x7fa3380d5b00 secure :-1 s=READY pgs=213 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa35400a990 tx=0x7fa354002470 comp rx=0 tx=0).stop 2026-02-13T04:02:48.482 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.479+0000 7fa3457fa6c0 1 -- 10.20.193.92:0/2128243033 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa3601149c0 msgr2=0x7fa36012bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:48.482 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.479+0000 7fa3457fa6c0 1 --2- 10.20.193.92:0/2128243033 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa3601149c0 0x7fa36012bbd0 secure :-1 s=READY pgs=265 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa348009490 tx=0x7fa34800bca0 comp rx=0 tx=0).stop 2026-02-13T04:02:48.483 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.479+0000 7fa3457fa6c0 1 -- 10.20.193.92:0/2128243033 shutdown_connections 2026-02-13T04:02:48.483 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.479+0000 7fa3457fa6c0 1 --2- 10.20.193.92:0/2128243033 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa3380b5650 0x7fa3380d5b00 unknown :-1 s=CLOSED pgs=213 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:48.483 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.479+0000 7fa3457fa6c0 1 --2- 10.20.193.92:0/2128243033 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa36011b510 0x7fa360130f40 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:48.483 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.479+0000 7fa3457fa6c0 1 --2- 10.20.193.92:0/2128243033 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa3601149c0 0x7fa36012bbd0 unknown :-1 s=CLOSED pgs=265 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:48.483 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.479+0000 7fa3457fa6c0 1 --2- 10.20.193.92:0/2128243033 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa360113dc0 0x7fa36012b690 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:48.483 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.479+0000 7fa3457fa6c0 1 -- 10.20.193.92:0/2128243033 >> 10.20.193.92:0/2128243033 conn(0x7fa360058a50 msgr2=0x7fa360059880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:02:48.483 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.479+0000 7fa3457fa6c0 1 -- 10.20.193.92:0/2128243033 shutdown_connections 2026-02-13T04:02:48.483 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:48.479+0000 7fa3457fa6c0 1 -- 10.20.193.92:0/2128243033 wait complete. 2026-02-13T04:02:48.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:48 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/2128243033' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:48.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:48 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/2128243033' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:48.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:48 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/2128243033' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:49.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:49 trial158 ceph-mon[27763]: pgmap v240: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:02:49.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:49 trial099 ceph-mon[27808]: pgmap v240: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:02:49.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:49 trial092 ceph-mon[23047]: pgmap v240: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:02:51.588 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:02:51.775 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:02:51.817 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:51 trial092 ceph-mon[23047]: pgmap v241: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:02:51.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:51 trial158 ceph-mon[27763]: pgmap v241: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:02:51.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:51 trial099 ceph-mon[27808]: pgmap v241: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:02:51.965 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:51.962+0000 7f6271c0b6c0 1 -- 10.20.193.92:0/3393321976 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f626c1137a0 msgr2=0x7f626c113b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:51.965 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:51.962+0000 7f6271c0b6c0 1 --2- 10.20.193.92:0/3393321976 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f626c1137a0 0x7f626c113b70 secure :-1 s=READY pgs=114 gs=3 cs=0 l=1 c_cookie=4743577851157186135 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f625c0099a0 tx=0x7f625c02ed70 comp rx=0 tx=0).stop 2026-02-13T04:02:51.965 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:51.962+0000 7f6271c0b6c0 1 -- 10.20.193.92:0/3393321976 shutdown_connections 2026-02-13T04:02:51.965 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:51.962+0000 7f6271c0b6c0 1 --2- 10.20.193.92:0/3393321976 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f626c114190 0x7f626c115d40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:51.965 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:51.962+0000 7f6271c0b6c0 1 --2- 10.20.193.92:0/3393321976 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f626c116520 0x7f626c17a100 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:51.966 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:51.962+0000 7f6271c0b6c0 1 --2- 10.20.193.92:0/3393321976 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f626c1137a0 0x7f626c113b70 unknown :-1 s=CLOSED pgs=114 gs=3 cs=0 l=1 c_cookie=4743577851157186135 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:51.966 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:51.962+0000 7f6271c0b6c0 1 -- 10.20.193.92:0/3393321976 >> 10.20.193.92:0/3393321976 conn(0x7f626c061510 msgr2=0x7f626c061910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:02:51.966 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:51.962+0000 7f6271c0b6c0 1 -- 10.20.193.92:0/3393321976 shutdown_connections 2026-02-13T04:02:51.966 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:51.962+0000 7f6271c0b6c0 1 -- 10.20.193.92:0/3393321976 wait complete. 2026-02-13T04:02:51.968 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:51.963+0000 7f6271c0b6c0 1 Processor -- start 2026-02-13T04:02:51.968 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:51.963+0000 7f6271c0b6c0 1 -- start start 2026-02-13T04:02:51.968 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:51.963+0000 7f6271c0b6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f626c1137a0 0x7f626c1213d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:51.968 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:51.963+0000 7f6271c0b6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f626c116520 0x7f626c121910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:51.968 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:51.963+0000 7f6271c0b6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f626c126c80 0x7f626c127120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:51.969 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:51.963+0000 7f6271c0b6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f626c127690 con 0x7f626c116520 2026-02-13T04:02:51.969 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:51.963+0000 7f6271c0b6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f626c127800 con 0x7f626c126c80 2026-02-13T04:02:51.969 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:51.963+0000 7f6271c0b6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f626c1279c0 con 0x7f626c1137a0 2026-02-13T04:02:51.969 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:51.963+0000 7f6263fff6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f626c116520 0x7f626c121910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:51.969 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:51.963+0000 7f6263fff6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f626c116520 0x7f626c121910 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:59228/0 (socket says 10.20.193.92:59228) 2026-02-13T04:02:51.969 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:51.963+0000 7f6263fff6c0 1 -- 10.20.193.92:0/3693995814 learned_addr learned my addr 10.20.193.92:0/3693995814 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:02:51.969 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:51.963+0000 7f627140a6c0 1 --2- 10.20.193.92:0/3693995814 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f626c126c80 0x7f626c127120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:51.969 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:51.963+0000 7f6270c096c0 1 --2- 10.20.193.92:0/3693995814 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f626c1137a0 0x7f626c1213d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:51.969 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:51.964+0000 7f627140a6c0 1 -- 10.20.193.92:0/3693995814 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f626c1137a0 msgr2=0x7f626c1213d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:51.969 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:51.964+0000 7f627140a6c0 1 --2- 10.20.193.92:0/3693995814 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f626c1137a0 0x7f626c1213d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:51.969 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:51.964+0000 7f627140a6c0 1 -- 10.20.193.92:0/3693995814 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f626c116520 msgr2=0x7f626c121910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:51.970 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:51.964+0000 7f627140a6c0 1 --2- 10.20.193.92:0/3693995814 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f626c116520 0x7f626c121910 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:51.970 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:51.964+0000 7f627140a6c0 1 -- 10.20.193.92:0/3693995814 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f625c009590 con 0x7f626c126c80 2026-02-13T04:02:51.970 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:51.964+0000 7f6263fff6c0 1 --2- 10.20.193.92:0/3693995814 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f626c116520 0x7f626c121910 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T04:02:51.970 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:51.964+0000 7f627140a6c0 1 --2- 10.20.193.92:0/3693995814 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f626c126c80 0x7f626c127120 secure :-1 s=READY pgs=121 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f626800c6c0 tx=0x7f626800cb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:02:51.970 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:51.964+0000 7f6261ffb6c0 1 -- 10.20.193.92:0/3693995814 <== mon.2 v2:10.20.193.99:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6268005340 con 0x7f626c126c80 2026-02-13T04:02:51.970 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:51.964+0000 7f6271c0b6c0 1 -- 10.20.193.92:0/3693995814 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f626c167e70 con 0x7f626c126c80 2026-02-13T04:02:51.970 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:51.964+0000 7f6261ffb6c0 1 -- 10.20.193.92:0/3693995814 <== mon.2 v2:10.20.193.99:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f6268003d40 con 0x7f626c126c80 2026-02-13T04:02:51.970 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:51.964+0000 7f6271c0b6c0 1 -- 10.20.193.92:0/3693995814 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f626c168350 con 0x7f626c126c80 2026-02-13T04:02:51.970 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:51.964+0000 7f6261ffb6c0 1 -- 10.20.193.92:0/3693995814 <== mon.2 v2:10.20.193.99:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f626800de30 con 0x7f626c126c80 2026-02-13T04:02:51.970 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:51.965+0000 7f6271c0b6c0 1 -- 10.20.193.92:0/3693995814 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f626c114840 con 0x7f626c126c80 2026-02-13T04:02:51.971 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:51.967+0000 7f6261ffb6c0 1 -- 10.20.193.92:0/3693995814 <== mon.2 v2:10.20.193.99:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f626800d410 con 0x7f626c126c80 2026-02-13T04:02:51.972 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:51.969+0000 7f6261ffb6c0 1 --2- 10.20.193.92:0/3693995814 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f62480b56d0 0x7f62480d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:51.972 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:51.969+0000 7f6261ffb6c0 1 -- 10.20.193.92:0/3693995814 <== mon.2 v2:10.20.193.99:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f62680e4af0 con 0x7f626c126c80 2026-02-13T04:02:51.972 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:51.969+0000 7f6261ffb6c0 1 -- 10.20.193.92:0/3693995814 <== mon.2 v2:10.20.193.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f626811d5e0 con 0x7f626c126c80 2026-02-13T04:02:51.972 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:51.969+0000 7f6270c096c0 1 --2- 10.20.193.92:0/3693995814 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f62480b56d0 0x7f62480d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:51.973 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:51.970+0000 7f6270c096c0 1 --2- 10.20.193.92:0/3693995814 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f62480b56d0 0x7f62480d5b80 secure :-1 s=READY pgs=214 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f625c0023e0 tx=0x7f625c009200 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:02:52.097 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:52.094+0000 7f6271c0b6c0 1 -- 10.20.193.92:0/3693995814 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f626c1224d0 con 0x7f626c126c80 2026-02-13T04:02:52.097 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:52.094+0000 7f6261ffb6c0 1 -- 10.20.193.92:0/3693995814 <== mon.2 v2:10.20.193.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f62680a7490 con 0x7f626c126c80 2026-02-13T04:02:52.098 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:02:52.098 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:02:52.100 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:52.097+0000 7f6271c0b6c0 1 -- 10.20.193.92:0/3693995814 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f62480b56d0 msgr2=0x7f62480d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:52.100 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:52.097+0000 7f6271c0b6c0 1 --2- 10.20.193.92:0/3693995814 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f62480b56d0 0x7f62480d5b80 secure :-1 s=READY pgs=214 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f625c0023e0 tx=0x7f625c009200 comp rx=0 tx=0).stop 2026-02-13T04:02:52.100 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:52.097+0000 7f6271c0b6c0 1 -- 10.20.193.92:0/3693995814 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f626c126c80 msgr2=0x7f626c127120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:52.100 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:52.097+0000 7f6271c0b6c0 1 --2- 10.20.193.92:0/3693995814 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f626c126c80 0x7f626c127120 secure :-1 s=READY pgs=121 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f626800c6c0 tx=0x7f626800cb90 comp rx=0 tx=0).stop 2026-02-13T04:02:52.101 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:52.097+0000 7f6271c0b6c0 1 -- 10.20.193.92:0/3693995814 shutdown_connections 2026-02-13T04:02:52.101 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:52.097+0000 7f6271c0b6c0 1 --2- 10.20.193.92:0/3693995814 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f62480b56d0 0x7f62480d5b80 unknown :-1 s=CLOSED pgs=214 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:52.101 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:52.097+0000 7f6271c0b6c0 1 --2- 10.20.193.92:0/3693995814 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f626c126c80 0x7f626c127120 unknown :-1 s=CLOSED pgs=121 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:52.101 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:52.097+0000 7f6271c0b6c0 1 --2- 10.20.193.92:0/3693995814 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f626c116520 0x7f626c121910 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:52.101 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:52.097+0000 7f6271c0b6c0 1 --2- 10.20.193.92:0/3693995814 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f626c1137a0 0x7f626c1213d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:52.101 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:52.097+0000 7f6271c0b6c0 1 -- 10.20.193.92:0/3693995814 >> 10.20.193.92:0/3693995814 conn(0x7f626c061510 msgr2=0x7f626c116d90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:02:52.101 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:52.098+0000 7f6271c0b6c0 1 -- 10.20.193.92:0/3693995814 shutdown_connections 2026-02-13T04:02:52.102 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:52.098+0000 7f6271c0b6c0 1 -- 10.20.193.92:0/3693995814 wait complete. 2026-02-13T04:02:52.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:52 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:02:52.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:52 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/3693995814' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:52.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:52 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:02:52.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:52 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/3693995814' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:52.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:52 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:02:52.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:52 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/3693995814' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:53.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:53 trial092 ceph-mon[23047]: pgmap v242: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:02:53.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:53 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:02:53.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:53 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:02:53.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:53 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:02:53.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:53 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:02:53.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:53 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:02:53.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:53 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:02:54.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:53 trial158 ceph-mon[27763]: pgmap v242: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:02:54.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:53 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:02:54.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:53 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:02:54.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:53 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:02:54.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:53 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:02:54.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:53 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:02:54.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:53 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:02:54.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:53 trial099 ceph-mon[27808]: pgmap v242: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:02:54.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:53 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:02:54.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:53 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:02:54.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:53 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:02:54.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:53 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:02:54.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:53 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:02:54.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:53 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:02:54.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:54 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:02:54.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:54 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:02:54.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:54 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:02:54.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:54 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:02:54.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:54 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:02:54.830 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:54 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:02:54.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:54 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:02:54.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:54 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:02:54.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:54 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:02:54.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:54 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:02:54.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:54 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:02:54.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:54 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:02:55.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:54 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:02:55.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:54 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:02:55.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:54 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:02:55.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:54 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:02:55.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:54 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:02:55.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:54 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:02:55.209 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:02:55.393 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:02:55.590 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.587+0000 7f54e75776c0 1 -- 10.20.193.92:0/2846524787 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f54e8115270 msgr2=0x7f54e8175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:55.590 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.587+0000 7f54e75776c0 1 --2- 10.20.193.92:0/2846524787 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f54e8115270 0x7f54e8175c10 secure :-1 s=READY pgs=115 gs=2 cs=0 l=1 c_cookie=2386267733339927260 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54d800aa70 tx=0x7f54d802fde0 comp rx=0 tx=0).stop 2026-02-13T04:02:55.590 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.588+0000 7f54e75776c0 1 -- 10.20.193.92:0/2846524787 shutdown_connections 2026-02-13T04:02:55.590 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.588+0000 7f54e75776c0 1 --2- 10.20.193.92:0/2846524787 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f54e8115270 0x7f54e8175c10 unknown :-1 s=CLOSED pgs=115 gs=2 cs=0 l=1 c_cookie=2386267733339927260 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:55.590 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.588+0000 7f54e75776c0 1 --2- 10.20.193.92:0/2846524787 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f54e810fa50 0x7f54e8114a90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:55.590 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.588+0000 7f54e75776c0 1 --2- 10.20.193.92:0/2846524787 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f54e810f060 0x7f54e810f430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:55.590 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.588+0000 7f54e75776c0 1 -- 10.20.193.92:0/2846524787 >> 10.20.193.92:0/2846524787 conn(0x7f54e80ec980 msgr2=0x7f54e810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:02:55.590 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.588+0000 7f54e75776c0 1 -- 10.20.193.92:0/2846524787 shutdown_connections 2026-02-13T04:02:55.590 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.588+0000 7f54e75776c0 1 -- 10.20.193.92:0/2846524787 wait complete. 2026-02-13T04:02:55.591 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.588+0000 7f54e75776c0 1 Processor -- start 2026-02-13T04:02:55.591 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.589+0000 7f54e75776c0 1 -- start start 2026-02-13T04:02:55.591 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.589+0000 7f54e75776c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f54e810f060 0x7f54e811cd90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:55.591 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.589+0000 7f54e75776c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f54e8115270 0x7f54e811d2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:55.591 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.589+0000 7f54e75776c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f54e8122690 0x7f54e8122b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:55.591 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.589+0000 7f54e75776c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f54e81230a0 con 0x7f54e8122690 2026-02-13T04:02:55.591 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.589+0000 7f54e75776c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f54e8123210 con 0x7f54e8115270 2026-02-13T04:02:55.591 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.589+0000 7f54e75776c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f54e81233d0 con 0x7f54e810f060 2026-02-13T04:02:55.591 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.589+0000 7f54e65756c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f54e810f060 0x7f54e811cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:55.591 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.589+0000 7f54e6d766c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f54e8122690 0x7f54e8122b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:55.591 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.589+0000 7f54e65756c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f54e810f060 0x7f54e811cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:50176/0 (socket says 10.20.193.92:50176) 2026-02-13T04:02:55.591 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.589+0000 7f54e5d746c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f54e8115270 0x7f54e811d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:55.591 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.589+0000 7f54e5d746c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f54e8115270 0x7f54e811d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:55372/0 (socket says 10.20.193.92:55372) 2026-02-13T04:02:55.591 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.589+0000 7f54e5d746c0 1 -- 10.20.193.92:0/1706953245 learned_addr learned my addr 10.20.193.92:0/1706953245 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:02:55.591 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.589+0000 7f54e6d766c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f54e8122690 0x7f54e8122b30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:45912/0 (socket says 10.20.193.92:45912) 2026-02-13T04:02:55.592 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.589+0000 7f54e6d766c0 1 -- 10.20.193.92:0/1706953245 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f54e810f060 msgr2=0x7f54e811cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:55.592 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.589+0000 7f54e6d766c0 1 --2- 10.20.193.92:0/1706953245 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f54e810f060 0x7f54e811cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:55.592 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.589+0000 7f54e6d766c0 1 -- 10.20.193.92:0/1706953245 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f54e8115270 msgr2=0x7f54e811d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:55.592 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.589+0000 7f54e6d766c0 1 --2- 10.20.193.92:0/1706953245 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f54e8115270 0x7f54e811d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:55.592 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.589+0000 7f54e6d766c0 1 -- 10.20.193.92:0/1706953245 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54d800a660 con 0x7f54e8122690 2026-02-13T04:02:55.592 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.590+0000 7f54e6d766c0 1 --2- 10.20.193.92:0/1706953245 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f54e8122690 0x7f54e8122b30 secure :-1 s=READY pgs=266 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54d800aa40 tx=0x7f54d8032f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:02:55.592 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.590+0000 7f54cf7fe6c0 1 -- 10.20.193.92:0/1706953245 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f54d8005520 con 0x7f54e8122690 2026-02-13T04:02:55.592 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.590+0000 7f54cf7fe6c0 1 -- 10.20.193.92:0/1706953245 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f54d8005680 con 0x7f54e8122690 2026-02-13T04:02:55.592 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.590+0000 7f54cf7fe6c0 1 -- 10.20.193.92:0/1706953245 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f54d8032030 con 0x7f54e8122690 2026-02-13T04:02:55.592 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.590+0000 7f54e75776c0 1 -- 10.20.193.92:0/1706953245 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54e8163820 con 0x7f54e8122690 2026-02-13T04:02:55.592 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.590+0000 7f54e75776c0 1 -- 10.20.193.92:0/1706953245 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54e8163c50 con 0x7f54e8122690 2026-02-13T04:02:55.593 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.590+0000 7f54cd7fa6c0 1 -- 10.20.193.92:0/1706953245 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54e8110330 con 0x7f54e8122690 2026-02-13T04:02:55.597 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.593+0000 7f54cf7fe6c0 1 -- 10.20.193.92:0/1706953245 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f54d8003810 con 0x7f54e8122690 2026-02-13T04:02:55.597 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.594+0000 7f54cf7fe6c0 1 --2- 10.20.193.92:0/1706953245 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f54c00b57a0 0x7f54c00d5c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:55.597 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.594+0000 7f54cf7fe6c0 1 -- 10.20.193.92:0/1706953245 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f54d8108c20 con 0x7f54e8122690 2026-02-13T04:02:55.597 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.595+0000 7f54e65756c0 1 --2- 10.20.193.92:0/1706953245 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f54c00b57a0 0x7f54c00d5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:55.597 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.595+0000 7f54cf7fe6c0 1 -- 10.20.193.92:0/1706953245 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f54d80cb5c0 con 0x7f54e8122690 2026-02-13T04:02:55.597 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.595+0000 7f54e65756c0 1 --2- 10.20.193.92:0/1706953245 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f54c00b57a0 0x7f54c00d5c50 secure :-1 s=READY pgs=215 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54dc004750 tx=0x7f54dc009390 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:02:55.722 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.719+0000 7f54cd7fa6c0 1 -- 10.20.193.92:0/1706953245 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f54e811dee0 con 0x7f54e8122690 2026-02-13T04:02:55.722 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.719+0000 7f54cf7fe6c0 1 -- 10.20.193.92:0/1706953245 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f54d8008670 con 0x7f54e8122690 2026-02-13T04:02:55.722 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:02:55.723 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:02:55.723 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.720+0000 7f54cd7fa6c0 1 -- 10.20.193.92:0/1706953245 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f54c00b57a0 msgr2=0x7f54c00d5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:55.724 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.720+0000 7f54cd7fa6c0 1 --2- 10.20.193.92:0/1706953245 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f54c00b57a0 0x7f54c00d5c50 secure :-1 s=READY pgs=215 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54dc004750 tx=0x7f54dc009390 comp rx=0 tx=0).stop 2026-02-13T04:02:55.724 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.720+0000 7f54cd7fa6c0 1 -- 10.20.193.92:0/1706953245 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f54e8122690 msgr2=0x7f54e8122b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:55.724 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.720+0000 7f54cd7fa6c0 1 --2- 10.20.193.92:0/1706953245 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f54e8122690 0x7f54e8122b30 secure :-1 s=READY pgs=266 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54d800aa40 tx=0x7f54d8032f60 comp rx=0 tx=0).stop 2026-02-13T04:02:55.724 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.721+0000 7f54cd7fa6c0 1 -- 10.20.193.92:0/1706953245 shutdown_connections 2026-02-13T04:02:55.724 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.721+0000 7f54cd7fa6c0 1 --2- 10.20.193.92:0/1706953245 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f54c00b57a0 0x7f54c00d5c50 unknown :-1 s=CLOSED pgs=215 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:55.724 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.721+0000 7f54cd7fa6c0 1 --2- 10.20.193.92:0/1706953245 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f54e8115270 0x7f54e811d2d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:55.724 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.721+0000 7f54cd7fa6c0 1 --2- 10.20.193.92:0/1706953245 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f54e8122690 0x7f54e8122b30 unknown :-1 s=CLOSED pgs=266 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:55.724 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.721+0000 7f54cd7fa6c0 1 --2- 10.20.193.92:0/1706953245 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f54e810f060 0x7f54e811cd90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:55.724 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.721+0000 7f54cd7fa6c0 1 -- 10.20.193.92:0/1706953245 >> 10.20.193.92:0/1706953245 conn(0x7f54e80ec980 msgr2=0x7f54e810cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:02:55.724 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.721+0000 7f54cd7fa6c0 1 -- 10.20.193.92:0/1706953245 shutdown_connections 2026-02-13T04:02:55.725 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:55.721+0000 7f54cd7fa6c0 1 -- 10.20.193.92:0/1706953245 wait complete. 2026-02-13T04:02:55.783 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:55 trial092 ceph-mon[23047]: pgmap v243: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:02:55.783 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:55 trial092 ceph-mon[23047]: pgmap v244: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 10 op/s 2026-02-13T04:02:55.783 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:55 trial092 ceph-mon[23047]: pgmap v245: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:02:56.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:55 trial158 ceph-mon[27763]: pgmap v243: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:02:56.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:55 trial158 ceph-mon[27763]: pgmap v244: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 10 op/s 2026-02-13T04:02:56.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:55 trial158 ceph-mon[27763]: pgmap v245: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:02:56.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:55 trial099 ceph-mon[27808]: pgmap v243: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:02:56.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:55 trial099 ceph-mon[27808]: pgmap v244: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 10 op/s 2026-02-13T04:02:56.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:55 trial099 ceph-mon[27808]: pgmap v245: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:02:56.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:56 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1706953245' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:57.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:56 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/1706953245' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:57.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:56 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/1706953245' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:02:57.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:57 trial092 ceph-mon[23047]: pgmap v246: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 10 op/s 2026-02-13T04:02:58.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:57 trial158 ceph-mon[27763]: pgmap v246: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 10 op/s 2026-02-13T04:02:58.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:57 trial099 ceph-mon[27808]: pgmap v246: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 10 op/s 2026-02-13T04:02:58.827 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:02:59.012 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:02:59.207 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.204+0000 7f2d4d6d76c0 1 -- 10.20.193.92:0/1133519006 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2d48115270 msgr2=0x7f2d48175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:59.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.204+0000 7f2d4d6d76c0 1 --2- 10.20.193.92:0/1133519006 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2d48115270 0x7f2d48175c10 secure :-1 s=READY pgs=122 gs=3 cs=0 l=1 c_cookie=6822765161666868742 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d3c006fd0 tx=0x7f2d3c02fd30 comp rx=0 tx=0).stop 2026-02-13T04:02:59.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.204+0000 7f2d4d6d76c0 1 -- 10.20.193.92:0/1133519006 shutdown_connections 2026-02-13T04:02:59.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.204+0000 7f2d4d6d76c0 1 --2- 10.20.193.92:0/1133519006 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2d48115270 0x7f2d48175c10 unknown :-1 s=CLOSED pgs=122 gs=3 cs=0 l=1 c_cookie=6822765161666868742 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:59.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.204+0000 7f2d4d6d76c0 1 --2- 10.20.193.92:0/1133519006 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2d4810fa50 0x7f2d48114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:59.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.204+0000 7f2d4d6d76c0 1 --2- 10.20.193.92:0/1133519006 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2d4810f060 0x7f2d4810f430 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:59.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.204+0000 7f2d4d6d76c0 1 -- 10.20.193.92:0/1133519006 >> 10.20.193.92:0/1133519006 conn(0x7f2d480ec980 msgr2=0x7f2d4810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:02:59.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.204+0000 7f2d4d6d76c0 1 -- 10.20.193.92:0/1133519006 shutdown_connections 2026-02-13T04:02:59.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.204+0000 7f2d4d6d76c0 1 -- 10.20.193.92:0/1133519006 wait complete. 2026-02-13T04:02:59.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.205+0000 7f2d4d6d76c0 1 Processor -- start 2026-02-13T04:02:59.209 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.205+0000 7f2d4d6d76c0 1 -- start start 2026-02-13T04:02:59.210 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.205+0000 7f2d4d6d76c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2d4810f060 0x7f2d4811cdb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:59.210 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.205+0000 7f2d4d6d76c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2d48115270 0x7f2d4811d2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:59.210 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.205+0000 7f2d4d6d76c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2d48122660 0x7f2d48122b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:59.210 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.205+0000 7f2d4d6d76c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2d48123070 con 0x7f2d4810f060 2026-02-13T04:02:59.210 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.205+0000 7f2d4d6d76c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2d481231e0 con 0x7f2d48122660 2026-02-13T04:02:59.210 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.205+0000 7f2d4d6d76c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f2d481233a0 con 0x7f2d48115270 2026-02-13T04:02:59.211 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.205+0000 7f2d47fff6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2d4810f060 0x7f2d4811cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:59.211 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.205+0000 7f2d47fff6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2d4810f060 0x7f2d4811cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:45942/0 (socket says 10.20.193.92:45942) 2026-02-13T04:02:59.211 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.205+0000 7f2d47fff6c0 1 -- 10.20.193.92:0/4123071146 learned_addr learned my addr 10.20.193.92:0/4123071146 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:02:59.211 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.205+0000 7f2d4ced66c0 1 --2- 10.20.193.92:0/4123071146 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2d48122660 0x7f2d48122b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:59.211 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.205+0000 7f2d477fe6c0 1 --2- 10.20.193.92:0/4123071146 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2d48115270 0x7f2d4811d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:59.211 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.205+0000 7f2d47fff6c0 1 -- 10.20.193.92:0/4123071146 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2d48115270 msgr2=0x7f2d4811d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:59.211 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.205+0000 7f2d47fff6c0 1 --2- 10.20.193.92:0/4123071146 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2d48115270 0x7f2d4811d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:59.211 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.205+0000 7f2d47fff6c0 1 -- 10.20.193.92:0/4123071146 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2d48122660 msgr2=0x7f2d48122b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:59.211 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.205+0000 7f2d47fff6c0 1 --2- 10.20.193.92:0/4123071146 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2d48122660 0x7f2d48122b00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:59.211 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.205+0000 7f2d47fff6c0 1 -- 10.20.193.92:0/4123071146 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d340094c0 con 0x7f2d4810f060 2026-02-13T04:02:59.211 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.205+0000 7f2d477fe6c0 1 --2- 10.20.193.92:0/4123071146 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2d48115270 0x7f2d4811d2f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T04:02:59.211 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.205+0000 7f2d47fff6c0 1 --2- 10.20.193.92:0/4123071146 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2d4810f060 0x7f2d4811cdb0 secure :-1 s=READY pgs=267 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d3400ba30 tx=0x7f2d3400bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:02:59.212 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.206+0000 7f2d457fa6c0 1 -- 10.20.193.92:0/4123071146 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2d34004250 con 0x7f2d4810f060 2026-02-13T04:02:59.212 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.206+0000 7f2d457fa6c0 1 -- 10.20.193.92:0/4123071146 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f2d34009070 con 0x7f2d4810f060 2026-02-13T04:02:59.212 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.206+0000 7f2d457fa6c0 1 -- 10.20.193.92:0/4123071146 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2d34007440 con 0x7f2d4810f060 2026-02-13T04:02:59.212 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.206+0000 7f2d4d6d76c0 1 -- 10.20.193.92:0/4123071146 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d3c00a5b0 con 0x7f2d4810f060 2026-02-13T04:02:59.212 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.206+0000 7f2d4d6d76c0 1 -- 10.20.193.92:0/4123071146 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d48163b50 con 0x7f2d4810f060 2026-02-13T04:02:59.212 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.206+0000 7f2d4d6d76c0 1 -- 10.20.193.92:0/4123071146 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d48110330 con 0x7f2d4810f060 2026-02-13T04:02:59.212 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.209+0000 7f2d457fa6c0 1 -- 10.20.193.92:0/4123071146 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f2d340043b0 con 0x7f2d4810f060 2026-02-13T04:02:59.213 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.210+0000 7f2d457fa6c0 1 --2- 10.20.193.92:0/4123071146 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f2d1c0b56d0 0x7f2d1c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:02:59.214 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.211+0000 7f2d457fa6c0 1 -- 10.20.193.92:0/4123071146 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f2d340e3cf0 con 0x7f2d4810f060 2026-02-13T04:02:59.214 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.211+0000 7f2d477fe6c0 1 --2- 10.20.193.92:0/4123071146 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f2d1c0b56d0 0x7f2d1c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:02:59.214 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.211+0000 7f2d457fa6c0 1 -- 10.20.193.92:0/4123071146 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2d340e4170 con 0x7f2d4810f060 2026-02-13T04:02:59.214 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.211+0000 7f2d477fe6c0 1 --2- 10.20.193.92:0/4123071146 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f2d1c0b56d0 0x7f2d1c0d5b80 secure :-1 s=READY pgs=216 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d481236f0 tx=0x7f2d38009310 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:02:59.339 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.337+0000 7f2d4d6d76c0 1 -- 10.20.193.92:0/4123071146 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2d481637f0 con 0x7f2d4810f060 2026-02-13T04:02:59.340 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.337+0000 7f2d457fa6c0 1 -- 10.20.193.92:0/4123071146 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f2d340a6690 con 0x7f2d4810f060 2026-02-13T04:02:59.340 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:02:59.340 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:02:59.341 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.338+0000 7f2d4d6d76c0 1 -- 10.20.193.92:0/4123071146 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f2d1c0b56d0 msgr2=0x7f2d1c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:59.341 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.338+0000 7f2d4d6d76c0 1 --2- 10.20.193.92:0/4123071146 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f2d1c0b56d0 0x7f2d1c0d5b80 secure :-1 s=READY pgs=216 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d481236f0 tx=0x7f2d38009310 comp rx=0 tx=0).stop 2026-02-13T04:02:59.341 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.338+0000 7f2d4d6d76c0 1 -- 10.20.193.92:0/4123071146 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2d4810f060 msgr2=0x7f2d4811cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:02:59.341 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.338+0000 7f2d4d6d76c0 1 --2- 10.20.193.92:0/4123071146 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2d4810f060 0x7f2d4811cdb0 secure :-1 s=READY pgs=267 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d3400ba30 tx=0x7f2d3400bf00 comp rx=0 tx=0).stop 2026-02-13T04:02:59.341 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.338+0000 7f2d4d6d76c0 1 -- 10.20.193.92:0/4123071146 shutdown_connections 2026-02-13T04:02:59.342 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.338+0000 7f2d4d6d76c0 1 --2- 10.20.193.92:0/4123071146 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f2d1c0b56d0 0x7f2d1c0d5b80 unknown :-1 s=CLOSED pgs=216 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:59.342 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.338+0000 7f2d4d6d76c0 1 --2- 10.20.193.92:0/4123071146 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2d48122660 0x7f2d48122b00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:59.342 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.338+0000 7f2d4d6d76c0 1 --2- 10.20.193.92:0/4123071146 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2d48115270 0x7f2d4811d2f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:59.342 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.338+0000 7f2d4d6d76c0 1 --2- 10.20.193.92:0/4123071146 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2d4810f060 0x7f2d4811cdb0 unknown :-1 s=CLOSED pgs=267 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:02:59.342 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.338+0000 7f2d4d6d76c0 1 -- 10.20.193.92:0/4123071146 >> 10.20.193.92:0/4123071146 conn(0x7f2d480ec980 msgr2=0x7f2d4810cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:02:59.342 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.338+0000 7f2d4d6d76c0 1 -- 10.20.193.92:0/4123071146 shutdown_connections 2026-02-13T04:02:59.342 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:02:59.338+0000 7f2d4d6d76c0 1 -- 10.20.193.92:0/4123071146 wait complete. 2026-02-13T04:02:59.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:59 trial092 ceph-mon[23047]: pgmap v247: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 9 op/s 2026-02-13T04:02:59.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:02:59 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/4123071146' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:00.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:59 trial158 ceph-mon[27763]: pgmap v247: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 9 op/s 2026-02-13T04:03:00.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:02:59 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/4123071146' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:00.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:59 trial099 ceph-mon[27808]: pgmap v247: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 9 op/s 2026-02-13T04:03:00.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:02:59 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/4123071146' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:01.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:01 trial092 ceph-mon[23047]: pgmap v248: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 8 op/s 2026-02-13T04:03:02.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:01 trial158 ceph-mon[27763]: pgmap v248: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 8 op/s 2026-02-13T04:03:02.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:01 trial099 ceph-mon[27808]: pgmap v248: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.0 KiB/s rd, 8 op/s 2026-02-13T04:03:02.443 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:03:02.629 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:03:02.825 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.821+0000 7f6c8b6336c0 1 -- 10.20.193.92:0/4149841727 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6c84115270 msgr2=0x7f6c84175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:02.825 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.821+0000 7f6c8b6336c0 1 --2- 10.20.193.92:0/4149841727 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6c84115270 0x7f6c84175c10 secure :-1 s=READY pgs=268 gs=2 cs=0 l=1 c_cookie=4665597958585607582 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c7800a9b0 tx=0x7f6c7802fd20 comp rx=0 tx=0).stop 2026-02-13T04:03:02.825 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.822+0000 7f6c8b6336c0 1 -- 10.20.193.92:0/4149841727 shutdown_connections 2026-02-13T04:03:02.825 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.822+0000 7f6c8b6336c0 1 --2- 10.20.193.92:0/4149841727 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f6c8410fa50 0x7f6c84114a90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:02.825 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.822+0000 7f6c8b6336c0 1 --2- 10.20.193.92:0/4149841727 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6c84115270 0x7f6c84175c10 unknown :-1 s=CLOSED pgs=268 gs=2 cs=0 l=1 c_cookie=4665597958585607582 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:02.825 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.822+0000 7f6c8b6336c0 1 --2- 10.20.193.92:0/4149841727 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f6c8410f060 0x7f6c8410f430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:02.826 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.822+0000 7f6c8b6336c0 1 -- 10.20.193.92:0/4149841727 >> 10.20.193.92:0/4149841727 conn(0x7f6c840ec980 msgr2=0x7f6c8410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:03:02.826 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.822+0000 7f6c8b6336c0 1 -- 10.20.193.92:0/4149841727 shutdown_connections 2026-02-13T04:03:02.826 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.822+0000 7f6c8b6336c0 1 -- 10.20.193.92:0/4149841727 wait complete. 2026-02-13T04:03:02.826 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.822+0000 7f6c8b6336c0 1 Processor -- start 2026-02-13T04:03:02.827 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.822+0000 7f6c8b6336c0 1 -- start start 2026-02-13T04:03:02.828 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.823+0000 7f6c8b6336c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6c8410f060 0x7f6c8411ce50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:02.828 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.823+0000 7f6c8b6336c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f6c84115270 0x7f6c8411d390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:02.828 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.823+0000 7f6c8b6336c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f6c84122750 0x7f6c84122bf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:02.828 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.823+0000 7f6c8b6336c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6c84123160 con 0x7f6c8410f060 2026-02-13T04:03:02.828 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.823+0000 7f6c8b6336c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6c841232d0 con 0x7f6c84115270 2026-02-13T04:03:02.828 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.823+0000 7f6c8b6336c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f6c84123490 con 0x7f6c84122750 2026-02-13T04:03:02.828 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.823+0000 7f6c8a6316c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6c8410f060 0x7f6c8411ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:02.828 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.823+0000 7f6c8ae326c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f6c84122750 0x7f6c84122bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:02.828 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.823+0000 7f6c8a6316c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6c8410f060 0x7f6c8411ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:45968/0 (socket says 10.20.193.92:45968) 2026-02-13T04:03:02.828 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.823+0000 7f6c8a6316c0 1 -- 10.20.193.92:0/1570016100 learned_addr learned my addr 10.20.193.92:0/1570016100 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:03:02.829 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.823+0000 7f6c89e306c0 1 --2- 10.20.193.92:0/1570016100 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f6c84115270 0x7f6c8411d390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:02.829 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.823+0000 7f6c8a6316c0 1 -- 10.20.193.92:0/1570016100 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f6c84122750 msgr2=0x7f6c84122bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:02.829 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.823+0000 7f6c8a6316c0 1 --2- 10.20.193.92:0/1570016100 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f6c84122750 0x7f6c84122bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:02.829 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.823+0000 7f6c8a6316c0 1 -- 10.20.193.92:0/1570016100 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f6c84115270 msgr2=0x7f6c8411d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:02.829 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.823+0000 7f6c8a6316c0 1 --2- 10.20.193.92:0/1570016100 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f6c84115270 0x7f6c8411d390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:02.829 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.823+0000 7f6c8a6316c0 1 -- 10.20.193.92:0/1570016100 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c7800a5b0 con 0x7f6c8410f060 2026-02-13T04:03:02.829 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.823+0000 7f6c8a6316c0 1 --2- 10.20.193.92:0/1570016100 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6c8410f060 0x7f6c8411ce50 secure :-1 s=READY pgs=269 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c7c009490 tx=0x7f6c7c00bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:03:02.829 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.824+0000 7f6c6f7fe6c0 1 -- 10.20.193.92:0/1570016100 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c7c004a80 con 0x7f6c8410f060 2026-02-13T04:03:02.829 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.824+0000 7f6c6f7fe6c0 1 -- 10.20.193.92:0/1570016100 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f6c7c009030 con 0x7f6c8410f060 2026-02-13T04:03:02.829 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.824+0000 7f6c8b6336c0 1 -- 10.20.193.92:0/1570016100 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c84163940 con 0x7f6c8410f060 2026-02-13T04:03:02.829 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.824+0000 7f6c8b6336c0 1 -- 10.20.193.92:0/1570016100 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c84163dd0 con 0x7f6c8410f060 2026-02-13T04:03:02.829 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.824+0000 7f6c6f7fe6c0 1 -- 10.20.193.92:0/1570016100 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6c7c0071c0 con 0x7f6c8410f060 2026-02-13T04:03:02.830 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.824+0000 7f6c8b6336c0 1 -- 10.20.193.92:0/1570016100 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c84110330 con 0x7f6c8410f060 2026-02-13T04:03:02.830 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.827+0000 7f6c6f7fe6c0 1 -- 10.20.193.92:0/1570016100 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f6c7c004e90 con 0x7f6c8410f060 2026-02-13T04:03:02.831 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.828+0000 7f6c6f7fe6c0 1 --2- 10.20.193.92:0/1570016100 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f6c600b5720 0x7f6c600d5bd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:02.831 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.828+0000 7f6c6f7fe6c0 1 -- 10.20.193.92:0/1570016100 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f6c7c0e3be0 con 0x7f6c8410f060 2026-02-13T04:03:02.831 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.828+0000 7f6c6f7fe6c0 1 -- 10.20.193.92:0/1570016100 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6c7c11c640 con 0x7f6c8410f060 2026-02-13T04:03:02.832 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.828+0000 7f6c89e306c0 1 --2- 10.20.193.92:0/1570016100 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f6c600b5720 0x7f6c600d5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:02.832 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.829+0000 7f6c89e306c0 1 --2- 10.20.193.92:0/1570016100 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f6c600b5720 0x7f6c600d5bd0 secure :-1 s=READY pgs=217 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c841237e0 tx=0x7f6c70009310 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:03:02.956 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.953+0000 7f6c8b6336c0 1 -- 10.20.193.92:0/1570016100 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6c8410f430 con 0x7f6c8410f060 2026-02-13T04:03:02.956 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.953+0000 7f6c6f7fe6c0 1 -- 10.20.193.92:0/1570016100 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f6c7c0a6580 con 0x7f6c8410f060 2026-02-13T04:03:02.956 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:03:02.956 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:03:02.957 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.954+0000 7f6c8b6336c0 1 -- 10.20.193.92:0/1570016100 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f6c600b5720 msgr2=0x7f6c600d5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:02.957 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.954+0000 7f6c8b6336c0 1 --2- 10.20.193.92:0/1570016100 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f6c600b5720 0x7f6c600d5bd0 secure :-1 s=READY pgs=217 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c841237e0 tx=0x7f6c70009310 comp rx=0 tx=0).stop 2026-02-13T04:03:02.957 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.954+0000 7f6c8b6336c0 1 -- 10.20.193.92:0/1570016100 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6c8410f060 msgr2=0x7f6c8411ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:02.957 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.954+0000 7f6c8b6336c0 1 --2- 10.20.193.92:0/1570016100 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6c8410f060 0x7f6c8411ce50 secure :-1 s=READY pgs=269 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c7c009490 tx=0x7f6c7c00bc50 comp rx=0 tx=0).stop 2026-02-13T04:03:02.958 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.954+0000 7f6c8b6336c0 1 -- 10.20.193.92:0/1570016100 shutdown_connections 2026-02-13T04:03:02.958 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.954+0000 7f6c8b6336c0 1 --2- 10.20.193.92:0/1570016100 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f6c600b5720 0x7f6c600d5bd0 unknown :-1 s=CLOSED pgs=217 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:02.958 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.954+0000 7f6c8b6336c0 1 --2- 10.20.193.92:0/1570016100 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f6c84115270 0x7f6c8411d390 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:02.958 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.954+0000 7f6c8b6336c0 1 --2- 10.20.193.92:0/1570016100 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f6c84122750 0x7f6c84122bf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:02.958 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.954+0000 7f6c8b6336c0 1 --2- 10.20.193.92:0/1570016100 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6c8410f060 0x7f6c8411ce50 unknown :-1 s=CLOSED pgs=269 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:02.958 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.954+0000 7f6c8b6336c0 1 -- 10.20.193.92:0/1570016100 >> 10.20.193.92:0/1570016100 conn(0x7f6c840ec980 msgr2=0x7f6c8410cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:03:02.958 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.954+0000 7f6c8b6336c0 1 -- 10.20.193.92:0/1570016100 shutdown_connections 2026-02-13T04:03:02.958 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:02.954+0000 7f6c8b6336c0 1 -- 10.20.193.92:0/1570016100 wait complete. 2026-02-13T04:03:03.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:03 trial092 ceph-mon[23047]: pgmap v249: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 10 op/s 2026-02-13T04:03:03.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:03 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1570016100' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:04.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:03 trial158 ceph-mon[27763]: pgmap v249: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 10 op/s 2026-02-13T04:03:04.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:03 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/1570016100' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:04.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:03 trial099 ceph-mon[27808]: pgmap v249: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 10 op/s 2026-02-13T04:03:04.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:03 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/1570016100' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:05.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:05 trial092 ceph-mon[23047]: pgmap v250: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 9 op/s 2026-02-13T04:03:06.061 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:03:06.078 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:05 trial158 ceph-mon[27763]: pgmap v250: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 9 op/s 2026-02-13T04:03:06.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:05 trial099 ceph-mon[27808]: pgmap v250: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 9 op/s 2026-02-13T04:03:06.245 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:03:06.433 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.430+0000 7f028f6c76c0 1 -- 10.20.193.92:0/2341838757 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f028810f060 msgr2=0x7f028810f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:06.433 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.430+0000 7f028f6c76c0 1 --2- 10.20.193.92:0/2341838757 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f028810f060 0x7f028810f430 secure :-1 s=READY pgs=270 gs=2 cs=0 l=1 c_cookie=681085513274391074 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f02800099a0 tx=0x7f028002ed50 comp rx=0 tx=0).stop 2026-02-13T04:03:06.433 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.430+0000 7f028f6c76c0 1 -- 10.20.193.92:0/2341838757 shutdown_connections 2026-02-13T04:03:06.434 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.430+0000 7f028f6c76c0 1 --2- 10.20.193.92:0/2341838757 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0288115270 0x7f0288175c10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:06.434 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.430+0000 7f028f6c76c0 1 --2- 10.20.193.92:0/2341838757 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f028810fa50 0x7f0288114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:06.434 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.430+0000 7f028f6c76c0 1 --2- 10.20.193.92:0/2341838757 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f028810f060 0x7f028810f430 unknown :-1 s=CLOSED pgs=270 gs=2 cs=0 l=1 c_cookie=681085513274391074 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:06.434 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.430+0000 7f028f6c76c0 1 -- 10.20.193.92:0/2341838757 >> 10.20.193.92:0/2341838757 conn(0x7f02880ec980 msgr2=0x7f028810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:03:06.434 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.430+0000 7f028f6c76c0 1 -- 10.20.193.92:0/2341838757 shutdown_connections 2026-02-13T04:03:06.434 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.430+0000 7f028f6c76c0 1 -- 10.20.193.92:0/2341838757 wait complete. 2026-02-13T04:03:06.436 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.431+0000 7f028f6c76c0 1 Processor -- start 2026-02-13T04:03:06.436 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.431+0000 7f028f6c76c0 1 -- start start 2026-02-13T04:03:06.436 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.431+0000 7f028f6c76c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f028810f060 0x7f028811ce00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:06.436 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.431+0000 7f028f6c76c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0288115270 0x7f028811d340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:06.436 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.431+0000 7f028f6c76c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0288122700 0x7f0288122ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:06.436 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.431+0000 7f028f6c76c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0288123110 con 0x7f0288115270 2026-02-13T04:03:06.436 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.431+0000 7f028f6c76c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0288123280 con 0x7f0288122700 2026-02-13T04:03:06.436 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.431+0000 7f028f6c76c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f0288123440 con 0x7f028810f060 2026-02-13T04:03:06.437 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.431+0000 7f028dec46c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0288115270 0x7f028811d340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:06.437 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.431+0000 7f028dec46c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0288115270 0x7f028811d340 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:45566/0 (socket says 10.20.193.92:45566) 2026-02-13T04:03:06.437 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.431+0000 7f028dec46c0 1 -- 10.20.193.92:0/2577286572 learned_addr learned my addr 10.20.193.92:0/2577286572 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:03:06.437 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.431+0000 7f028e6c56c0 1 --2- 10.20.193.92:0/2577286572 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f028810f060 0x7f028811ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:06.437 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.432+0000 7f028eec66c0 1 --2- 10.20.193.92:0/2577286572 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0288122700 0x7f0288122ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:06.437 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.432+0000 7f028dec46c0 1 -- 10.20.193.92:0/2577286572 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f028810f060 msgr2=0x7f028811ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:06.437 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.432+0000 7f028dec46c0 1 --2- 10.20.193.92:0/2577286572 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f028810f060 0x7f028811ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:06.437 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.432+0000 7f028dec46c0 1 -- 10.20.193.92:0/2577286572 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0288122700 msgr2=0x7f0288122ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:06.437 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.432+0000 7f028dec46c0 1 --2- 10.20.193.92:0/2577286572 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0288122700 0x7f0288122ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:06.437 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.432+0000 7f028dec46c0 1 -- 10.20.193.92:0/2577286572 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0280009590 con 0x7f0288115270 2026-02-13T04:03:06.437 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.432+0000 7f028dec46c0 1 --2- 10.20.193.92:0/2577286572 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0288115270 0x7f028811d340 secure :-1 s=READY pgs=271 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f027400b750 tx=0x7f027400bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:03:06.437 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.432+0000 7f02737fe6c0 1 -- 10.20.193.92:0/2577286572 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0274004a80 con 0x7f0288115270 2026-02-13T04:03:06.438 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.432+0000 7f02737fe6c0 1 -- 10.20.193.92:0/2577286572 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f0274009030 con 0x7f0288115270 2026-02-13T04:03:06.438 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.432+0000 7f028f6c76c0 1 -- 10.20.193.92:0/2577286572 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02881638f0 con 0x7f0288115270 2026-02-13T04:03:06.438 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.432+0000 7f02737fe6c0 1 -- 10.20.193.92:0/2577286572 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f02740071c0 con 0x7f0288115270 2026-02-13T04:03:06.438 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.432+0000 7f028f6c76c0 1 -- 10.20.193.92:0/2577286572 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0288163d80 con 0x7f0288115270 2026-02-13T04:03:06.438 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.433+0000 7f02717fa6c0 1 -- 10.20.193.92:0/2577286572 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0288110330 con 0x7f0288115270 2026-02-13T04:03:06.438 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.435+0000 7f02737fe6c0 1 -- 10.20.193.92:0/2577286572 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f0274005000 con 0x7f0288115270 2026-02-13T04:03:06.439 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.436+0000 7f02737fe6c0 1 --2- 10.20.193.92:0/2577286572 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f02640b5650 0x7f02640d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:06.439 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.436+0000 7f02737fe6c0 1 -- 10.20.193.92:0/2577286572 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f02740e3c70 con 0x7f0288115270 2026-02-13T04:03:06.439 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.437+0000 7f028e6c56c0 1 --2- 10.20.193.92:0/2577286572 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f02640b5650 0x7f02640d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:06.439 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.437+0000 7f02737fe6c0 1 -- 10.20.193.92:0/2577286572 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f02740e40f0 con 0x7f0288115270 2026-02-13T04:03:06.440 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.437+0000 7f028e6c56c0 1 --2- 10.20.193.92:0/2577286572 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f02640b5650 0x7f02640d5b00 secure :-1 s=READY pgs=218 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0280005b40 tx=0x7f02800023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:03:06.565 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.562+0000 7f02717fa6c0 1 -- 10.20.193.92:0/2577286572 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f028811df50 con 0x7f0288115270 2026-02-13T04:03:06.565 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.562+0000 7f02737fe6c0 1 -- 10.20.193.92:0/2577286572 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f02740a6610 con 0x7f0288115270 2026-02-13T04:03:06.566 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:03:06.566 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:03:06.567 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.563+0000 7f02717fa6c0 1 -- 10.20.193.92:0/2577286572 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f02640b5650 msgr2=0x7f02640d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:06.567 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.563+0000 7f02717fa6c0 1 --2- 10.20.193.92:0/2577286572 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f02640b5650 0x7f02640d5b00 secure :-1 s=READY pgs=218 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0280005b40 tx=0x7f02800023a0 comp rx=0 tx=0).stop 2026-02-13T04:03:06.567 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.563+0000 7f02717fa6c0 1 -- 10.20.193.92:0/2577286572 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0288115270 msgr2=0x7f028811d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:06.567 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.563+0000 7f02717fa6c0 1 --2- 10.20.193.92:0/2577286572 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0288115270 0x7f028811d340 secure :-1 s=READY pgs=271 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f027400b750 tx=0x7f027400bc20 comp rx=0 tx=0).stop 2026-02-13T04:03:06.567 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.564+0000 7f02717fa6c0 1 -- 10.20.193.92:0/2577286572 shutdown_connections 2026-02-13T04:03:06.567 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.564+0000 7f02717fa6c0 1 --2- 10.20.193.92:0/2577286572 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f02640b5650 0x7f02640d5b00 unknown :-1 s=CLOSED pgs=218 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:06.568 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.564+0000 7f02717fa6c0 1 --2- 10.20.193.92:0/2577286572 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0288122700 0x7f0288122ba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:06.568 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.564+0000 7f02717fa6c0 1 --2- 10.20.193.92:0/2577286572 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0288115270 0x7f028811d340 unknown :-1 s=CLOSED pgs=271 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:06.568 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.564+0000 7f02717fa6c0 1 --2- 10.20.193.92:0/2577286572 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f028810f060 0x7f028811ce00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:06.568 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.564+0000 7f02717fa6c0 1 -- 10.20.193.92:0/2577286572 >> 10.20.193.92:0/2577286572 conn(0x7f02880ec980 msgr2=0x7f028810cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:03:06.568 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.564+0000 7f02717fa6c0 1 -- 10.20.193.92:0/2577286572 shutdown_connections 2026-02-13T04:03:06.568 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:06.564+0000 7f02717fa6c0 1 -- 10.20.193.92:0/2577286572 wait complete. 2026-02-13T04:03:06.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:06 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/2577286572' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:07.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:06 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/2577286572' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:07.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:06 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/2577286572' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:07.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:07 trial092 ceph-mon[23047]: pgmap v251: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:03:08.078 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:07 trial158 ceph-mon[27763]: pgmap v251: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:03:08.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:07 trial099 ceph-mon[27808]: pgmap v251: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:03:09.675 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:03:09.860 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:03:09.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:09 trial092 ceph-mon[23047]: pgmap v252: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 9 op/s 2026-02-13T04:03:10.060 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.057+0000 7ff4c70036c0 1 -- 10.20.193.92:0/3046333229 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff4c010f060 msgr2=0x7ff4c010f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:10.060 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.057+0000 7ff4c70036c0 1 --2- 10.20.193.92:0/3046333229 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff4c010f060 0x7ff4c010f430 secure :-1 s=READY pgs=123 gs=2 cs=0 l=1 c_cookie=11264958227203100645 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4b0009970 tx=0x7ff4b002ed50 comp rx=0 tx=0).stop 2026-02-13T04:03:10.060 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.057+0000 7ff4c70036c0 1 -- 10.20.193.92:0/3046333229 shutdown_connections 2026-02-13T04:03:10.060 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.057+0000 7ff4c70036c0 1 --2- 10.20.193.92:0/3046333229 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff4c0115270 0x7ff4c0175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:10.060 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.057+0000 7ff4c70036c0 1 --2- 10.20.193.92:0/3046333229 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff4c010fa50 0x7ff4c0114a90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:10.060 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.057+0000 7ff4c70036c0 1 --2- 10.20.193.92:0/3046333229 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff4c010f060 0x7ff4c010f430 unknown :-1 s=CLOSED pgs=123 gs=2 cs=0 l=1 c_cookie=11264958227203100645 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:10.061 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.057+0000 7ff4c70036c0 1 -- 10.20.193.92:0/3046333229 >> 10.20.193.92:0/3046333229 conn(0x7ff4c00ec980 msgr2=0x7ff4c010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:03:10.061 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.057+0000 7ff4c70036c0 1 -- 10.20.193.92:0/3046333229 shutdown_connections 2026-02-13T04:03:10.061 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.057+0000 7ff4c70036c0 1 -- 10.20.193.92:0/3046333229 wait complete. 2026-02-13T04:03:10.062 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.058+0000 7ff4c70036c0 1 Processor -- start 2026-02-13T04:03:10.063 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.058+0000 7ff4c70036c0 1 -- start start 2026-02-13T04:03:10.063 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.058+0000 7ff4c70036c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff4c010f060 0x7ff4c011cd70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:10.063 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.058+0000 7ff4c70036c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff4c0115270 0x7ff4c011d2b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:10.063 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.058+0000 7ff4c70036c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff4c0122670 0x7ff4c0122b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:10.063 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.058+0000 7ff4c70036c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c0123080 con 0x7ff4c010f060 2026-02-13T04:03:10.063 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.058+0000 7ff4c70036c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c01231f0 con 0x7ff4c0122670 2026-02-13T04:03:10.063 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.058+0000 7ff4c70036c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7ff4c01233b0 con 0x7ff4c0115270 2026-02-13T04:03:10.063 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.058+0000 7ff4c60016c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff4c010f060 0x7ff4c011cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:10.063 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.058+0000 7ff4c60016c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff4c010f060 0x7ff4c011cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:45586/0 (socket says 10.20.193.92:45586) 2026-02-13T04:03:10.064 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.058+0000 7ff4c60016c0 1 -- 10.20.193.92:0/3603265193 learned_addr learned my addr 10.20.193.92:0/3603265193 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:03:10.064 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.058+0000 7ff4c68026c0 1 --2- 10.20.193.92:0/3603265193 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff4c0122670 0x7ff4c0122b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:10.064 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.059+0000 7ff4c58006c0 1 --2- 10.20.193.92:0/3603265193 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff4c0115270 0x7ff4c011d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:10.064 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.059+0000 7ff4c60016c0 1 -- 10.20.193.92:0/3603265193 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff4c0115270 msgr2=0x7ff4c011d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:10.064 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.059+0000 7ff4c60016c0 1 --2- 10.20.193.92:0/3603265193 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff4c0115270 0x7ff4c011d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:10.064 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.059+0000 7ff4c60016c0 1 -- 10.20.193.92:0/3603265193 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff4c0122670 msgr2=0x7ff4c0122b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:10.064 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.059+0000 7ff4c60016c0 1 --2- 10.20.193.92:0/3603265193 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff4c0122670 0x7ff4c0122b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:10.064 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.059+0000 7ff4c60016c0 1 -- 10.20.193.92:0/3603265193 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4b0009590 con 0x7ff4c010f060 2026-02-13T04:03:10.064 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.059+0000 7ff4c68026c0 1 --2- 10.20.193.92:0/3603265193 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff4c0122670 0x7ff4c0122b10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T04:03:10.064 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.059+0000 7ff4c60016c0 1 --2- 10.20.193.92:0/3603265193 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff4c010f060 0x7ff4c011cd70 secure :-1 s=READY pgs=272 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4b0005980 tx=0x7ff4b002f820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:03:10.064 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.059+0000 7ff4aeffd6c0 1 -- 10.20.193.92:0/3603265193 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff4b0002ae0 con 0x7ff4c010f060 2026-02-13T04:03:10.064 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.059+0000 7ff4c70036c0 1 -- 10.20.193.92:0/3603265193 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4c0163800 con 0x7ff4c010f060 2026-02-13T04:03:10.065 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.059+0000 7ff4aeffd6c0 1 -- 10.20.193.92:0/3603265193 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7ff4b002fa10 con 0x7ff4c010f060 2026-02-13T04:03:10.065 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.059+0000 7ff4aeffd6c0 1 -- 10.20.193.92:0/3603265193 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7ff4b0038380 con 0x7ff4c010f060 2026-02-13T04:03:10.065 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.059+0000 7ff4c70036c0 1 -- 10.20.193.92:0/3603265193 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4c0163c80 con 0x7ff4c010f060 2026-02-13T04:03:10.065 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.060+0000 7ff4acff96c0 1 -- 10.20.193.92:0/3603265193 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff48c005310 con 0x7ff4c010f060 2026-02-13T04:03:10.065 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.062+0000 7ff4aeffd6c0 1 -- 10.20.193.92:0/3603265193 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7ff4b0002c40 con 0x7ff4c010f060 2026-02-13T04:03:10.066 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.064+0000 7ff4aeffd6c0 1 --2- 10.20.193.92:0/3603265193 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff49c0b56d0 0x7ff49c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:10.066 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.064+0000 7ff4aeffd6c0 1 -- 10.20.193.92:0/3603265193 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7ff4b0107e30 con 0x7ff4c010f060 2026-02-13T04:03:10.067 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.064+0000 7ff4c58006c0 1 --2- 10.20.193.92:0/3603265193 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff49c0b56d0 0x7ff49c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:10.067 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.064+0000 7ff4aeffd6c0 1 -- 10.20.193.92:0/3603265193 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7ff4b01082b0 con 0x7ff4c010f060 2026-02-13T04:03:10.067 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.064+0000 7ff4c58006c0 1 --2- 10.20.193.92:0/3603265193 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff49c0b56d0 0x7ff49c0d5b80 secure :-1 s=READY pgs=219 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4c0123700 tx=0x7ff4b4009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:03:10.078 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:09 trial158 ceph-mon[27763]: pgmap v252: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 9 op/s 2026-02-13T04:03:10.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:09 trial099 ceph-mon[27808]: pgmap v252: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 9 op/s 2026-02-13T04:03:10.190 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.187+0000 7ff4acff96c0 1 -- 10.20.193.92:0/3603265193 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7ff48c005960 con 0x7ff4c010f060 2026-02-13T04:03:10.190 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.187+0000 7ff4aeffd6c0 1 -- 10.20.193.92:0/3603265193 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7ff4b00ca7d0 con 0x7ff4c010f060 2026-02-13T04:03:10.190 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:03:10.190 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:03:10.191 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.189+0000 7ff4acff96c0 1 -- 10.20.193.92:0/3603265193 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff49c0b56d0 msgr2=0x7ff49c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:10.192 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.189+0000 7ff4acff96c0 1 --2- 10.20.193.92:0/3603265193 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff49c0b56d0 0x7ff49c0d5b80 secure :-1 s=READY pgs=219 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4c0123700 tx=0x7ff4b4009260 comp rx=0 tx=0).stop 2026-02-13T04:03:10.192 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.189+0000 7ff4acff96c0 1 -- 10.20.193.92:0/3603265193 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff4c010f060 msgr2=0x7ff4c011cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:10.192 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.189+0000 7ff4acff96c0 1 --2- 10.20.193.92:0/3603265193 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff4c010f060 0x7ff4c011cd70 secure :-1 s=READY pgs=272 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4b0005980 tx=0x7ff4b002f820 comp rx=0 tx=0).stop 2026-02-13T04:03:10.192 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.189+0000 7ff4acff96c0 1 -- 10.20.193.92:0/3603265193 shutdown_connections 2026-02-13T04:03:10.192 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.189+0000 7ff4acff96c0 1 --2- 10.20.193.92:0/3603265193 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7ff49c0b56d0 0x7ff49c0d5b80 unknown :-1 s=CLOSED pgs=219 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:10.192 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.189+0000 7ff4acff96c0 1 --2- 10.20.193.92:0/3603265193 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7ff4c0122670 0x7ff4c0122b10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:10.192 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.189+0000 7ff4acff96c0 1 --2- 10.20.193.92:0/3603265193 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7ff4c0115270 0x7ff4c011d2b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:10.192 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.189+0000 7ff4acff96c0 1 --2- 10.20.193.92:0/3603265193 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7ff4c010f060 0x7ff4c011cd70 unknown :-1 s=CLOSED pgs=272 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:10.192 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.189+0000 7ff4acff96c0 1 -- 10.20.193.92:0/3603265193 >> 10.20.193.92:0/3603265193 conn(0x7ff4c00ec980 msgr2=0x7ff4c010cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:03:10.192 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.189+0000 7ff4acff96c0 1 -- 10.20.193.92:0/3603265193 shutdown_connections 2026-02-13T04:03:10.193 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:10.189+0000 7ff4acff96c0 1 -- 10.20.193.92:0/3603265193 wait complete. 2026-02-13T04:03:11.078 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:10 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/3603265193' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:11.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:10 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/3603265193' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:11.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:10 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/3603265193' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:12.078 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:11 trial158 ceph-mon[27763]: pgmap v253: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 9 op/s 2026-02-13T04:03:12.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:11 trial099 ceph-mon[27808]: pgmap v253: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 9 op/s 2026-02-13T04:03:12.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:11 trial092 ceph-mon[23047]: pgmap v253: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 9 op/s 2026-02-13T04:03:13.298 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:03:13.485 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:03:13.690 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.687+0000 7fc82a1186c0 1 -- 10.20.193.92:0/2332544165 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fc824115410 msgr2=0x7fc824175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:13.691 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.687+0000 7fc82a1186c0 1 --2- 10.20.193.92:0/2332544165 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fc824115410 0x7fc824175db0 secure :-1 s=READY pgs=124 gs=2 cs=0 l=1 c_cookie=17239954939932276366 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc81800aa40 tx=0x7fc81802fde0 comp rx=0 tx=0).stop 2026-02-13T04:03:13.691 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.687+0000 7fc82a1186c0 1 -- 10.20.193.92:0/2332544165 shutdown_connections 2026-02-13T04:03:13.691 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.687+0000 7fc82a1186c0 1 --2- 10.20.193.92:0/2332544165 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fc824115410 0x7fc824175db0 unknown :-1 s=CLOSED pgs=124 gs=2 cs=0 l=1 c_cookie=17239954939932276366 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:13.691 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.687+0000 7fc82a1186c0 1 --2- 10.20.193.92:0/2332544165 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fc82410fbf0 0x7fc824114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:13.691 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.687+0000 7fc82a1186c0 1 --2- 10.20.193.92:0/2332544165 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc82410f200 0x7fc82410f5d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:13.691 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.687+0000 7fc82a1186c0 1 -- 10.20.193.92:0/2332544165 >> 10.20.193.92:0/2332544165 conn(0x7fc8240ecb00 msgr2=0x7fc82410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:03:13.691 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.687+0000 7fc82a1186c0 1 -- 10.20.193.92:0/2332544165 shutdown_connections 2026-02-13T04:03:13.691 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.687+0000 7fc82a1186c0 1 -- 10.20.193.92:0/2332544165 wait complete. 2026-02-13T04:03:13.693 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.688+0000 7fc82a1186c0 1 Processor -- start 2026-02-13T04:03:13.693 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.688+0000 7fc82a1186c0 1 -- start start 2026-02-13T04:03:13.693 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.689+0000 7fc82a1186c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc82410f200 0x7fc82411cf30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:13.693 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.689+0000 7fc82a1186c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fc824115410 0x7fc82411d470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:13.694 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.689+0000 7fc82a1186c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fc8241227e0 0x7fc824122c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:13.694 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.689+0000 7fc82a1186c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc8241231f0 con 0x7fc82410f200 2026-02-13T04:03:13.694 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.689+0000 7fc82a1186c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fc824123360 con 0x7fc824115410 2026-02-13T04:03:13.694 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.689+0000 7fc82a1186c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fc824123520 con 0x7fc8241227e0 2026-02-13T04:03:13.694 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.689+0000 7fc8237fe6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc82410f200 0x7fc82411cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:13.694 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.689+0000 7fc8237fe6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc82410f200 0x7fc82411cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:45598/0 (socket says 10.20.193.92:45598) 2026-02-13T04:03:13.694 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.689+0000 7fc8237fe6c0 1 -- 10.20.193.92:0/3157195440 learned_addr learned my addr 10.20.193.92:0/3157195440 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:03:13.694 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.689+0000 7fc823fff6c0 1 --2- 10.20.193.92:0/3157195440 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fc8241227e0 0x7fc824122c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:13.694 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.689+0000 7fc822ffd6c0 1 --2- 10.20.193.92:0/3157195440 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fc824115410 0x7fc82411d470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:13.694 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.689+0000 7fc8237fe6c0 1 -- 10.20.193.92:0/3157195440 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fc8241227e0 msgr2=0x7fc824122c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:13.694 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.689+0000 7fc8237fe6c0 1 --2- 10.20.193.92:0/3157195440 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fc8241227e0 0x7fc824122c80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:13.694 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.689+0000 7fc8237fe6c0 1 -- 10.20.193.92:0/3157195440 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fc824115410 msgr2=0x7fc82411d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:13.695 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.689+0000 7fc8237fe6c0 1 --2- 10.20.193.92:0/3157195440 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fc824115410 0x7fc82411d470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:13.695 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.689+0000 7fc8237fe6c0 1 -- 10.20.193.92:0/3157195440 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc81800a660 con 0x7fc82410f200 2026-02-13T04:03:13.695 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.689+0000 7fc8237fe6c0 1 --2- 10.20.193.92:0/3157195440 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc82410f200 0x7fc82411cf30 secure :-1 s=READY pgs=273 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc810009490 tx=0x7fc81000bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:03:13.695 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.689+0000 7fc820ff96c0 1 -- 10.20.193.92:0/3157195440 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc810004a80 con 0x7fc82410f200 2026-02-13T04:03:13.695 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.689+0000 7fc820ff96c0 1 -- 10.20.193.92:0/3157195440 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fc810009030 con 0x7fc82410f200 2026-02-13T04:03:13.695 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.689+0000 7fc820ff96c0 1 -- 10.20.193.92:0/3157195440 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fc810007440 con 0x7fc82410f200 2026-02-13T04:03:13.695 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.689+0000 7fc82a1186c0 1 -- 10.20.193.92:0/3157195440 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8241639d0 con 0x7fc82410f200 2026-02-13T04:03:13.695 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.690+0000 7fc82a1186c0 1 -- 10.20.193.92:0/3157195440 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc824163e60 con 0x7fc82410f200 2026-02-13T04:03:13.695 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.690+0000 7fc82a1186c0 1 -- 10.20.193.92:0/3157195440 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8241104d0 con 0x7fc82410f200 2026-02-13T04:03:13.696 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.692+0000 7fc820ff96c0 1 -- 10.20.193.92:0/3157195440 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fc810004060 con 0x7fc82410f200 2026-02-13T04:03:13.696 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.694+0000 7fc820ff96c0 1 --2- 10.20.193.92:0/3157195440 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fc7f80b56d0 0x7fc7f80d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:13.697 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.694+0000 7fc820ff96c0 1 -- 10.20.193.92:0/3157195440 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7fc8100e3c50 con 0x7fc82410f200 2026-02-13T04:03:13.697 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.694+0000 7fc822ffd6c0 1 --2- 10.20.193.92:0/3157195440 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fc7f80b56d0 0x7fc7f80d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:13.697 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.694+0000 7fc820ff96c0 1 -- 10.20.193.92:0/3157195440 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fc8100e40d0 con 0x7fc82410f200 2026-02-13T04:03:13.697 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.694+0000 7fc822ffd6c0 1 --2- 10.20.193.92:0/3157195440 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fc7f80b56d0 0x7fc7f80d5b80 secure :-1 s=READY pgs=220 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc824123870 tx=0x7fc814009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:03:13.821 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.819+0000 7fc82a1186c0 1 -- 10.20.193.92:0/3157195440 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc82410f5d0 con 0x7fc82410f200 2026-02-13T04:03:13.822 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.819+0000 7fc820ff96c0 1 -- 10.20.193.92:0/3157195440 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fc8100a65f0 con 0x7fc82410f200 2026-02-13T04:03:13.822 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:03:13.822 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:03:13.823 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.820+0000 7fc82a1186c0 1 -- 10.20.193.92:0/3157195440 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fc7f80b56d0 msgr2=0x7fc7f80d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:13.823 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.820+0000 7fc82a1186c0 1 --2- 10.20.193.92:0/3157195440 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fc7f80b56d0 0x7fc7f80d5b80 secure :-1 s=READY pgs=220 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc824123870 tx=0x7fc814009260 comp rx=0 tx=0).stop 2026-02-13T04:03:13.823 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.820+0000 7fc82a1186c0 1 -- 10.20.193.92:0/3157195440 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc82410f200 msgr2=0x7fc82411cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:13.823 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.820+0000 7fc82a1186c0 1 --2- 10.20.193.92:0/3157195440 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc82410f200 0x7fc82411cf30 secure :-1 s=READY pgs=273 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc810009490 tx=0x7fc81000bca0 comp rx=0 tx=0).stop 2026-02-13T04:03:13.823 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.820+0000 7fc82a1186c0 1 -- 10.20.193.92:0/3157195440 shutdown_connections 2026-02-13T04:03:13.824 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.820+0000 7fc82a1186c0 1 --2- 10.20.193.92:0/3157195440 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fc7f80b56d0 0x7fc7f80d5b80 unknown :-1 s=CLOSED pgs=220 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:13.824 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.820+0000 7fc82a1186c0 1 --2- 10.20.193.92:0/3157195440 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fc824115410 0x7fc82411d470 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:13.824 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.820+0000 7fc82a1186c0 1 --2- 10.20.193.92:0/3157195440 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fc8241227e0 0x7fc824122c80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:13.824 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.820+0000 7fc82a1186c0 1 --2- 10.20.193.92:0/3157195440 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fc82410f200 0x7fc82411cf30 unknown :-1 s=CLOSED pgs=273 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:13.824 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.820+0000 7fc82a1186c0 1 -- 10.20.193.92:0/3157195440 >> 10.20.193.92:0/3157195440 conn(0x7fc8240ecb00 msgr2=0x7fc82410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:03:13.824 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.820+0000 7fc82a1186c0 1 -- 10.20.193.92:0/3157195440 shutdown_connections 2026-02-13T04:03:13.824 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:13.820+0000 7fc82a1186c0 1 -- 10.20.193.92:0/3157195440 wait complete. 2026-02-13T04:03:13.868 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:13 trial092 ceph-mon[23047]: pgmap v254: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 10 op/s 2026-02-13T04:03:14.078 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:13 trial158 ceph-mon[27763]: pgmap v254: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 10 op/s 2026-02-13T04:03:14.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:13 trial099 ceph-mon[27808]: pgmap v254: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 10 op/s 2026-02-13T04:03:15.017 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:14 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/3157195440' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:15.078 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:14 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/3157195440' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:15.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:14 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/3157195440' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:16.078 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:15 trial158 ceph-mon[27763]: pgmap v255: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 9 op/s 2026-02-13T04:03:16.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:15 trial099 ceph-mon[27808]: pgmap v255: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 9 op/s 2026-02-13T04:03:16.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:15 trial092 ceph-mon[23047]: pgmap v255: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 9 op/s 2026-02-13T04:03:16.929 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:03:17.115 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:03:17.316 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.313+0000 7fb3668476c0 1 -- 10.20.193.92:0/946988608 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb360115270 msgr2=0x7fb360175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:17.317 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.313+0000 7fb3668476c0 1 --2- 10.20.193.92:0/946988608 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb360115270 0x7fb360175c10 secure :-1 s=READY pgs=274 gs=1 cs=0 l=1 c_cookie=7013351697238910987 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb35c00aa70 tx=0x7fb35c02fde0 comp rx=0 tx=0).stop 2026-02-13T04:03:17.317 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.313+0000 7fb3668476c0 1 -- 10.20.193.92:0/946988608 shutdown_connections 2026-02-13T04:03:17.317 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.313+0000 7fb3668476c0 1 --2- 10.20.193.92:0/946988608 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fb36010fa50 0x7fb360114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:17.317 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.313+0000 7fb3668476c0 1 --2- 10.20.193.92:0/946988608 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb360115270 0x7fb360175c10 unknown :-1 s=CLOSED pgs=274 gs=1 cs=0 l=1 c_cookie=7013351697238910987 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:17.317 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.313+0000 7fb3668476c0 1 --2- 10.20.193.92:0/946988608 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fb36010f060 0x7fb36010f430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:17.317 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.313+0000 7fb3668476c0 1 -- 10.20.193.92:0/946988608 >> 10.20.193.92:0/946988608 conn(0x7fb3600ec980 msgr2=0x7fb36010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:03:17.317 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.314+0000 7fb3668476c0 1 -- 10.20.193.92:0/946988608 shutdown_connections 2026-02-13T04:03:17.319 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.314+0000 7fb3668476c0 1 -- 10.20.193.92:0/946988608 wait complete. 2026-02-13T04:03:17.319 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.315+0000 7fb3668476c0 1 Processor -- start 2026-02-13T04:03:17.319 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.315+0000 7fb3668476c0 1 -- start start 2026-02-13T04:03:17.319 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.315+0000 7fb3668476c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fb36010f060 0x7fb36011cdc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:17.319 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.315+0000 7fb3668476c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb360115270 0x7fb36011d300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:17.319 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.315+0000 7fb3668476c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fb360122670 0x7fb360122b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:17.319 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.315+0000 7fb3668476c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb360123080 con 0x7fb360115270 2026-02-13T04:03:17.319 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.315+0000 7fb3668476c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fb3601231f0 con 0x7fb36010f060 2026-02-13T04:03:17.319 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.315+0000 7fb3668476c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fb3601233b0 con 0x7fb360122670 2026-02-13T04:03:17.320 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.315+0000 7fb3650446c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb360115270 0x7fb36011d300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:17.320 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.315+0000 7fb3650446c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb360115270 0x7fb36011d300 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:40274/0 (socket says 10.20.193.92:40274) 2026-02-13T04:03:17.320 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.315+0000 7fb3650446c0 1 -- 10.20.193.92:0/1994553151 learned_addr learned my addr 10.20.193.92:0/1994553151 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:03:17.320 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.315+0000 7fb3660466c0 1 --2- 10.20.193.92:0/1994553151 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fb360122670 0x7fb360122b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:17.320 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.316+0000 7fb3658456c0 1 --2- 10.20.193.92:0/1994553151 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fb36010f060 0x7fb36011cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:17.320 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.316+0000 7fb3650446c0 1 -- 10.20.193.92:0/1994553151 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fb360122670 msgr2=0x7fb360122b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:17.320 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.316+0000 7fb3650446c0 1 --2- 10.20.193.92:0/1994553151 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fb360122670 0x7fb360122b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:17.320 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.316+0000 7fb3650446c0 1 -- 10.20.193.92:0/1994553151 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fb36010f060 msgr2=0x7fb36011cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:17.320 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.316+0000 7fb3650446c0 1 --2- 10.20.193.92:0/1994553151 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fb36010f060 0x7fb36011cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:17.320 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.316+0000 7fb3650446c0 1 -- 10.20.193.92:0/1994553151 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb35c00a660 con 0x7fb360115270 2026-02-13T04:03:17.320 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.316+0000 7fb3650446c0 1 --2- 10.20.193.92:0/1994553151 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb360115270 0x7fb36011d300 secure :-1 s=READY pgs=275 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb354005dc0 tx=0x7fb35400bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:03:17.321 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.316+0000 7fb34effd6c0 1 -- 10.20.193.92:0/1994553151 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb354004250 con 0x7fb360115270 2026-02-13T04:03:17.321 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.316+0000 7fb34effd6c0 1 -- 10.20.193.92:0/1994553151 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fb354009070 con 0x7fb360115270 2026-02-13T04:03:17.321 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.316+0000 7fb3668476c0 1 -- 10.20.193.92:0/1994553151 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb360163860 con 0x7fb360115270 2026-02-13T04:03:17.321 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.316+0000 7fb34effd6c0 1 -- 10.20.193.92:0/1994553151 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fb3540071c0 con 0x7fb360115270 2026-02-13T04:03:17.321 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.316+0000 7fb3668476c0 1 -- 10.20.193.92:0/1994553151 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb360163cf0 con 0x7fb360115270 2026-02-13T04:03:17.321 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.316+0000 7fb3668476c0 1 -- 10.20.193.92:0/1994553151 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb360110330 con 0x7fb360115270 2026-02-13T04:03:17.322 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.319+0000 7fb34effd6c0 1 -- 10.20.193.92:0/1994553151 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fb3540043b0 con 0x7fb360115270 2026-02-13T04:03:17.323 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.321+0000 7fb34effd6c0 1 --2- 10.20.193.92:0/1994553151 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fb33c0b5650 0x7fb33c0d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:17.323 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.321+0000 7fb34effd6c0 1 -- 10.20.193.92:0/1994553151 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7fb3540e3c50 con 0x7fb360115270 2026-02-13T04:03:17.324 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.321+0000 7fb3658456c0 1 --2- 10.20.193.92:0/1994553151 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fb33c0b5650 0x7fb33c0d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:17.324 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.321+0000 7fb34effd6c0 1 -- 10.20.193.92:0/1994553151 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fb3540e40d0 con 0x7fb360115270 2026-02-13T04:03:17.324 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.321+0000 7fb3658456c0 1 --2- 10.20.193.92:0/1994553151 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fb33c0b5650 0x7fb33c0d5b00 secure :-1 s=READY pgs=221 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb350005980 tx=0x7fb350005910 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:03:17.447 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.444+0000 7fb3668476c0 1 -- 10.20.193.92:0/1994553151 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb36010f430 con 0x7fb360115270 2026-02-13T04:03:17.447 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.444+0000 7fb34effd6c0 1 -- 10.20.193.92:0/1994553151 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fb3540a65f0 con 0x7fb360115270 2026-02-13T04:03:17.448 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:03:17.448 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:03:17.449 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.446+0000 7fb3668476c0 1 -- 10.20.193.92:0/1994553151 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fb33c0b5650 msgr2=0x7fb33c0d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:17.449 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.446+0000 7fb3668476c0 1 --2- 10.20.193.92:0/1994553151 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fb33c0b5650 0x7fb33c0d5b00 secure :-1 s=READY pgs=221 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb350005980 tx=0x7fb350005910 comp rx=0 tx=0).stop 2026-02-13T04:03:17.449 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.446+0000 7fb3668476c0 1 -- 10.20.193.92:0/1994553151 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb360115270 msgr2=0x7fb36011d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:17.449 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.446+0000 7fb3668476c0 1 --2- 10.20.193.92:0/1994553151 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb360115270 0x7fb36011d300 secure :-1 s=READY pgs=275 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb354005dc0 tx=0x7fb35400bbb0 comp rx=0 tx=0).stop 2026-02-13T04:03:17.449 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.446+0000 7fb3668476c0 1 -- 10.20.193.92:0/1994553151 shutdown_connections 2026-02-13T04:03:17.450 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.446+0000 7fb3668476c0 1 --2- 10.20.193.92:0/1994553151 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fb360122670 0x7fb360122b10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:17.450 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.446+0000 7fb3668476c0 1 --2- 10.20.193.92:0/1994553151 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fb360115270 0x7fb36011d300 unknown :-1 s=CLOSED pgs=275 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:17.450 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.446+0000 7fb3668476c0 1 --2- 10.20.193.92:0/1994553151 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fb33c0b5650 0x7fb33c0d5b00 unknown :-1 s=CLOSED pgs=221 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:17.450 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.446+0000 7fb3668476c0 1 --2- 10.20.193.92:0/1994553151 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fb36010f060 0x7fb36011cdc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:17.450 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.446+0000 7fb3668476c0 1 -- 10.20.193.92:0/1994553151 >> 10.20.193.92:0/1994553151 conn(0x7fb3600ec980 msgr2=0x7fb36010cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:03:17.450 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.446+0000 7fb3668476c0 1 -- 10.20.193.92:0/1994553151 shutdown_connections 2026-02-13T04:03:17.450 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:17.446+0000 7fb3668476c0 1 -- 10.20.193.92:0/1994553151 wait complete. 2026-02-13T04:03:17.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:17 trial092 ceph-mon[23047]: pgmap v256: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 10 op/s 2026-02-13T04:03:17.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:17 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1994553151' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:18.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:17 trial158 ceph-mon[27763]: pgmap v256: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 10 op/s 2026-02-13T04:03:18.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:17 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/1994553151' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:18.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:17 trial099 ceph-mon[27808]: pgmap v256: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 10 op/s 2026-02-13T04:03:18.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:17 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/1994553151' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:20.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:19 trial158 ceph-mon[27763]: pgmap v257: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 8 op/s 2026-02-13T04:03:20.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:19 trial099 ceph-mon[27808]: pgmap v257: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 8 op/s 2026-02-13T04:03:20.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:19 trial092 ceph-mon[23047]: pgmap v257: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 8 op/s 2026-02-13T04:03:20.587 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:03:20.772 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:03:20.968 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:20.965+0000 7f152e31b6c0 1 -- 10.20.193.92:0/2715760243 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1528060720 msgr2=0x7f1528060af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:20.968 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:20.965+0000 7f152e31b6c0 1 --2- 10.20.193.92:0/2715760243 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1528060720 0x7f1528060af0 secure :-1 s=READY pgs=276 gs=1 cs=0 l=1 c_cookie=5896206299799090032 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1518009970 tx=0x7f151802ed50 comp rx=0 tx=0).stop 2026-02-13T04:03:20.968 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:20.965+0000 7f152e31b6c0 1 -- 10.20.193.92:0/2715760243 shutdown_connections 2026-02-13T04:03:20.968 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:20.965+0000 7f152e31b6c0 1 --2- 10.20.193.92:0/2715760243 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1528061030 0x7f1528154fd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:20.968 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:20.965+0000 7f152e31b6c0 1 --2- 10.20.193.92:0/2715760243 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1528155510 0x7f15281758f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:20.969 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:20.965+0000 7f152e31b6c0 1 --2- 10.20.193.92:0/2715760243 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1528060720 0x7f1528060af0 unknown :-1 s=CLOSED pgs=276 gs=1 cs=0 l=1 c_cookie=5896206299799090032 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:20.969 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:20.965+0000 7f152e31b6c0 1 -- 10.20.193.92:0/2715760243 >> 10.20.193.92:0/2715760243 conn(0x7f15280ea6a0 msgr2=0x7f152810aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:03:20.969 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:20.965+0000 7f152e31b6c0 1 -- 10.20.193.92:0/2715760243 shutdown_connections 2026-02-13T04:03:20.969 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:20.965+0000 7f152e31b6c0 1 -- 10.20.193.92:0/2715760243 wait complete. 2026-02-13T04:03:20.971 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:20.966+0000 7f152e31b6c0 1 Processor -- start 2026-02-13T04:03:20.971 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:20.966+0000 7f152e31b6c0 1 -- start start 2026-02-13T04:03:20.971 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:20.966+0000 7f152e31b6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1528060720 0x7f15281610d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:20.971 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:20.966+0000 7f152e31b6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1528061030 0x7f1528161610 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:20.971 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:20.966+0000 7f152e31b6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1528155510 0x7f15281669d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:20.971 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:20.966+0000 7f152e31b6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1528166f90 con 0x7f1528155510 2026-02-13T04:03:20.972 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:20.966+0000 7f152e31b6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1528167100 con 0x7f1528061030 2026-02-13T04:03:20.972 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:20.966+0000 7f152e31b6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f15281672c0 con 0x7f1528060720 2026-02-13T04:03:20.972 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:20.966+0000 7f152db1a6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1528155510 0x7f15281669d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:20.972 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:20.966+0000 7f152db1a6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1528155510 0x7f15281669d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:40292/0 (socket says 10.20.193.92:40292) 2026-02-13T04:03:20.972 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:20.966+0000 7f152db1a6c0 1 -- 10.20.193.92:0/1847745424 learned_addr learned my addr 10.20.193.92:0/1847745424 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:03:20.972 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:20.966+0000 7f152cb186c0 1 --2- 10.20.193.92:0/1847745424 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1528061030 0x7f1528161610 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:20.972 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:20.967+0000 7f152d3196c0 1 --2- 10.20.193.92:0/1847745424 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1528060720 0x7f15281610d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:20.972 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:20.967+0000 7f152db1a6c0 1 -- 10.20.193.92:0/1847745424 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1528060720 msgr2=0x7f15281610d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:20.972 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:20.967+0000 7f152db1a6c0 1 --2- 10.20.193.92:0/1847745424 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1528060720 0x7f15281610d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:20.972 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:20.967+0000 7f152db1a6c0 1 -- 10.20.193.92:0/1847745424 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1528061030 msgr2=0x7f1528161610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:20.972 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:20.967+0000 7f152db1a6c0 1 --2- 10.20.193.92:0/1847745424 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1528061030 0x7f1528161610 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:20.972 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:20.967+0000 7f152db1a6c0 1 -- 10.20.193.92:0/1847745424 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1518009590 con 0x7f1528155510 2026-02-13T04:03:20.973 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:20.967+0000 7f152db1a6c0 1 --2- 10.20.193.92:0/1847745424 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1528155510 0x7f15281669d0 secure :-1 s=READY pgs=277 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f152400c730 tx=0x7f152400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:03:20.973 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:20.967+0000 7f15167fc6c0 1 -- 10.20.193.92:0/1847745424 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1524003c40 con 0x7f1528155510 2026-02-13T04:03:20.973 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:20.967+0000 7f15167fc6c0 1 -- 10.20.193.92:0/1847745424 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f152400a070 con 0x7f1528155510 2026-02-13T04:03:20.973 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:20.967+0000 7f15167fc6c0 1 -- 10.20.193.92:0/1847745424 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f15240081c0 con 0x7f1528155510 2026-02-13T04:03:20.973 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:20.967+0000 7f152e31b6c0 1 -- 10.20.193.92:0/1847745424 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15281675a0 con 0x7f1528155510 2026-02-13T04:03:20.973 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:20.967+0000 7f152e31b6c0 1 -- 10.20.193.92:0/1847745424 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1528151140 con 0x7f1528155510 2026-02-13T04:03:20.973 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:20.968+0000 7f152e31b6c0 1 -- 10.20.193.92:0/1847745424 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1528061c30 con 0x7f1528155510 2026-02-13T04:03:20.973 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:20.970+0000 7f15167fc6c0 1 -- 10.20.193.92:0/1847745424 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f1524005860 con 0x7f1528155510 2026-02-13T04:03:20.974 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:20.972+0000 7f15167fc6c0 1 --2- 10.20.193.92:0/1847745424 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f15040b56d0 0x7f15040d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:20.975 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:20.972+0000 7f15167fc6c0 1 -- 10.20.193.92:0/1847745424 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f15240e4b80 con 0x7f1528155510 2026-02-13T04:03:20.975 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:20.972+0000 7f152d3196c0 1 --2- 10.20.193.92:0/1847745424 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f15040b56d0 0x7f15040d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:20.975 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:20.972+0000 7f15167fc6c0 1 -- 10.20.193.92:0/1847745424 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f152411d5e0 con 0x7f1528155510 2026-02-13T04:03:20.975 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:20.972+0000 7f152d3196c0 1 --2- 10.20.193.92:0/1847745424 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f15040b56d0 0x7f15040d5b80 secure :-1 s=READY pgs=222 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f151802f260 tx=0x7f15180023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:03:21.099 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:21.096+0000 7f152e31b6c0 1 -- 10.20.193.92:0/1847745424 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f15280008e0 con 0x7f1528155510 2026-02-13T04:03:21.099 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:21.097+0000 7f15167fc6c0 1 -- 10.20.193.92:0/1847745424 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f15240a7520 con 0x7f1528155510 2026-02-13T04:03:21.100 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:03:21.100 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:03:21.100 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:21.098+0000 7f152e31b6c0 1 -- 10.20.193.92:0/1847745424 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f15040b56d0 msgr2=0x7f15040d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:21.101 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:21.098+0000 7f152e31b6c0 1 --2- 10.20.193.92:0/1847745424 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f15040b56d0 0x7f15040d5b80 secure :-1 s=READY pgs=222 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f151802f260 tx=0x7f15180023a0 comp rx=0 tx=0).stop 2026-02-13T04:03:21.101 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:21.098+0000 7f152e31b6c0 1 -- 10.20.193.92:0/1847745424 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1528155510 msgr2=0x7f15281669d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:21.101 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:21.098+0000 7f152e31b6c0 1 --2- 10.20.193.92:0/1847745424 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1528155510 0x7f15281669d0 secure :-1 s=READY pgs=277 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f152400c730 tx=0x7f152400cc00 comp rx=0 tx=0).stop 2026-02-13T04:03:21.101 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:21.099+0000 7f152e31b6c0 1 -- 10.20.193.92:0/1847745424 shutdown_connections 2026-02-13T04:03:21.101 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:21.099+0000 7f152e31b6c0 1 --2- 10.20.193.92:0/1847745424 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f15040b56d0 0x7f15040d5b80 unknown :-1 s=CLOSED pgs=222 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:21.102 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:21.099+0000 7f152e31b6c0 1 --2- 10.20.193.92:0/1847745424 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1528061030 0x7f1528161610 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:21.102 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:21.099+0000 7f152e31b6c0 1 --2- 10.20.193.92:0/1847745424 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1528155510 0x7f15281669d0 unknown :-1 s=CLOSED pgs=277 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:21.102 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:21.099+0000 7f152e31b6c0 1 --2- 10.20.193.92:0/1847745424 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1528060720 0x7f15281610d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:21.102 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:21.099+0000 7f152e31b6c0 1 -- 10.20.193.92:0/1847745424 >> 10.20.193.92:0/1847745424 conn(0x7f15280ea6a0 msgr2=0x7f152810aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:03:21.102 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:21.099+0000 7f152e31b6c0 1 -- 10.20.193.92:0/1847745424 shutdown_connections 2026-02-13T04:03:21.102 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:21.099+0000 7f152e31b6c0 1 -- 10.20.193.92:0/1847745424 wait complete. 2026-02-13T04:03:22.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:21 trial158 ceph-mon[27763]: pgmap v258: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 9 op/s 2026-02-13T04:03:22.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:21 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/1847745424' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:22.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:21 trial099 ceph-mon[27808]: pgmap v258: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 9 op/s 2026-02-13T04:03:22.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:21 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/1847745424' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:22.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:21 trial092 ceph-mon[23047]: pgmap v258: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 9 op/s 2026-02-13T04:03:22.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:21 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1847745424' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:24.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:23 trial158 ceph-mon[27763]: pgmap v259: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 10 op/s 2026-02-13T04:03:24.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:23 trial099 ceph-mon[27808]: pgmap v259: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 10 op/s 2026-02-13T04:03:24.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:23 trial092 ceph-mon[23047]: pgmap v259: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 10 op/s 2026-02-13T04:03:24.206 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:03:24.390 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:03:24.576 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.573+0000 7f2e9cf066c0 1 -- 10.20.193.92:0/3802675947 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2e98159910 msgr2=0x7f2e98179cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:24.576 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.573+0000 7f2e9cf066c0 1 --2- 10.20.193.92:0/3802675947 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2e98159910 0x7f2e98179cf0 secure :-1 s=READY pgs=125 gs=2 cs=0 l=1 c_cookie=4104600969152883697 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e8c00aa40 tx=0x7f2e8c02fdf0 comp rx=0 tx=0).stop 2026-02-13T04:03:24.576 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.573+0000 7f2e9cf066c0 1 -- 10.20.193.92:0/3802675947 shutdown_connections 2026-02-13T04:03:24.576 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.573+0000 7f2e9cf066c0 1 --2- 10.20.193.92:0/3802675947 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2e98159910 0x7f2e98179cf0 unknown :-1 s=CLOSED pgs=125 gs=2 cs=0 l=1 c_cookie=4104600969152883697 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:24.576 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.573+0000 7f2e9cf066c0 1 --2- 10.20.193.92:0/3802675947 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2e98060ce0 0x7f2e98061110 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:24.577 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.573+0000 7f2e9cf066c0 1 --2- 10.20.193.92:0/3802675947 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2e980622d0 0x7f2e980607a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:24.577 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.573+0000 7f2e9cf066c0 1 -- 10.20.193.92:0/3802675947 >> 10.20.193.92:0/3802675947 conn(0x7f2e980ea6d0 msgr2=0x7f2e9810aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:03:24.577 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.573+0000 7f2e9cf066c0 1 -- 10.20.193.92:0/3802675947 shutdown_connections 2026-02-13T04:03:24.578 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.574+0000 7f2e9cf066c0 1 -- 10.20.193.92:0/3802675947 wait complete. 2026-02-13T04:03:24.578 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.574+0000 7f2e9cf066c0 1 Processor -- start 2026-02-13T04:03:24.578 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.575+0000 7f2e9cf066c0 1 -- start start 2026-02-13T04:03:24.578 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.575+0000 7f2e9cf066c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2e98060ce0 0x7f2e98160e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:24.579 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.575+0000 7f2e9cf066c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2e980622d0 0x7f2e98161390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:24.579 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.575+0000 7f2e9cf066c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2e98159910 0x7f2e98166750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:24.579 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.575+0000 7f2e9cf066c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2e98166da0 con 0x7f2e980622d0 2026-02-13T04:03:24.579 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.575+0000 7f2e9cf066c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2e98166f10 con 0x7f2e98159910 2026-02-13T04:03:24.579 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.575+0000 7f2e9cf066c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f2e981670d0 con 0x7f2e98060ce0 2026-02-13T04:03:24.579 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.575+0000 7f2e977fe6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2e98060ce0 0x7f2e98160e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:24.579 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.575+0000 7f2e977fe6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2e98060ce0 0x7f2e98160e50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:45690/0 (socket says 10.20.193.92:45690) 2026-02-13T04:03:24.579 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.575+0000 7f2e977fe6c0 1 -- 10.20.193.92:0/3994944507 learned_addr learned my addr 10.20.193.92:0/3994944507 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:03:24.579 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.575+0000 7f2e97fff6c0 1 --2- 10.20.193.92:0/3994944507 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2e98159910 0x7f2e98166750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:24.579 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.575+0000 7f2e96ffd6c0 1 --2- 10.20.193.92:0/3994944507 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2e980622d0 0x7f2e98161390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:24.579 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.575+0000 7f2e977fe6c0 1 -- 10.20.193.92:0/3994944507 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2e98159910 msgr2=0x7f2e98166750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:24.579 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.575+0000 7f2e977fe6c0 1 --2- 10.20.193.92:0/3994944507 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2e98159910 0x7f2e98166750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:24.580 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.575+0000 7f2e977fe6c0 1 -- 10.20.193.92:0/3994944507 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2e980622d0 msgr2=0x7f2e98161390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:24.580 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.575+0000 7f2e977fe6c0 1 --2- 10.20.193.92:0/3994944507 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2e980622d0 0x7f2e98161390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:24.580 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.575+0000 7f2e977fe6c0 1 -- 10.20.193.92:0/3994944507 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e8c00a660 con 0x7f2e98060ce0 2026-02-13T04:03:24.580 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.576+0000 7f2e977fe6c0 1 --2- 10.20.193.92:0/3994944507 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2e98060ce0 0x7f2e98160e50 secure :-1 s=READY pgs=116 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e84009490 tx=0x7f2e8400bc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:03:24.580 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.576+0000 7f2e94ff96c0 1 -- 10.20.193.92:0/3994944507 <== mon.1 v2:10.20.193.158:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2e84004a80 con 0x7f2e98060ce0 2026-02-13T04:03:24.581 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.576+0000 7f2e9cf066c0 1 -- 10.20.193.92:0/3994944507 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e981673b0 con 0x7f2e98060ce0 2026-02-13T04:03:24.581 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.576+0000 7f2e94ff96c0 1 -- 10.20.193.92:0/3994944507 <== mon.1 v2:10.20.193.158:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f2e84009030 con 0x7f2e98060ce0 2026-02-13T04:03:24.581 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.576+0000 7f2e9cf066c0 1 -- 10.20.193.92:0/3994944507 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e98167a70 con 0x7f2e98060ce0 2026-02-13T04:03:24.581 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.576+0000 7f2e94ff96c0 1 -- 10.20.193.92:0/3994944507 <== mon.1 v2:10.20.193.158:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2e840071c0 con 0x7f2e98060ce0 2026-02-13T04:03:24.581 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.576+0000 7f2e9cf066c0 1 -- 10.20.193.92:0/3994944507 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e98061cb0 con 0x7f2e98060ce0 2026-02-13T04:03:24.581 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.579+0000 7f2e94ff96c0 1 -- 10.20.193.92:0/3994944507 <== mon.1 v2:10.20.193.158:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f2e84004e90 con 0x7f2e98060ce0 2026-02-13T04:03:24.583 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.581+0000 7f2e94ff96c0 1 --2- 10.20.193.92:0/3994944507 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f2e6c0b5650 0x7f2e6c0d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:24.584 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.581+0000 7f2e94ff96c0 1 -- 10.20.193.92:0/3994944507 <== mon.1 v2:10.20.193.158:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f2e840e3ad0 con 0x7f2e98060ce0 2026-02-13T04:03:24.584 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.581+0000 7f2e96ffd6c0 1 --2- 10.20.193.92:0/3994944507 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f2e6c0b5650 0x7f2e6c0d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:24.584 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.581+0000 7f2e94ff96c0 1 -- 10.20.193.92:0/3994944507 <== mon.1 v2:10.20.193.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2e8411c5e0 con 0x7f2e98060ce0 2026-02-13T04:03:24.584 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.581+0000 7f2e96ffd6c0 1 --2- 10.20.193.92:0/3994944507 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f2e6c0b5650 0x7f2e6c0d5b00 secure :-1 s=READY pgs=223 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e981677e0 tx=0x7f2e88009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:03:24.710 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.708+0000 7f2e9cf066c0 1 -- 10.20.193.92:0/3994944507 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2e98061110 con 0x7f2e98060ce0 2026-02-13T04:03:24.711 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.708+0000 7f2e94ff96c0 1 -- 10.20.193.92:0/3994944507 <== mon.1 v2:10.20.193.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f2e840a6470 con 0x7f2e98060ce0 2026-02-13T04:03:24.711 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:03:24.711 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:03:24.712 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.709+0000 7f2e9cf066c0 1 -- 10.20.193.92:0/3994944507 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f2e6c0b5650 msgr2=0x7f2e6c0d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:24.712 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.709+0000 7f2e9cf066c0 1 --2- 10.20.193.92:0/3994944507 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f2e6c0b5650 0x7f2e6c0d5b00 secure :-1 s=READY pgs=223 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e981677e0 tx=0x7f2e88009260 comp rx=0 tx=0).stop 2026-02-13T04:03:24.712 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.709+0000 7f2e9cf066c0 1 -- 10.20.193.92:0/3994944507 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2e98060ce0 msgr2=0x7f2e98160e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:24.713 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.709+0000 7f2e9cf066c0 1 --2- 10.20.193.92:0/3994944507 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2e98060ce0 0x7f2e98160e50 secure :-1 s=READY pgs=116 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2e84009490 tx=0x7f2e8400bc50 comp rx=0 tx=0).stop 2026-02-13T04:03:24.713 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.709+0000 7f2e9cf066c0 1 -- 10.20.193.92:0/3994944507 shutdown_connections 2026-02-13T04:03:24.713 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.709+0000 7f2e9cf066c0 1 --2- 10.20.193.92:0/3994944507 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f2e6c0b5650 0x7f2e6c0d5b00 unknown :-1 s=CLOSED pgs=223 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:24.713 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.709+0000 7f2e9cf066c0 1 --2- 10.20.193.92:0/3994944507 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2e98159910 0x7f2e98166750 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:24.713 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.709+0000 7f2e9cf066c0 1 --2- 10.20.193.92:0/3994944507 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2e980622d0 0x7f2e98161390 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:24.713 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.709+0000 7f2e9cf066c0 1 --2- 10.20.193.92:0/3994944507 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2e98060ce0 0x7f2e98160e50 unknown :-1 s=CLOSED pgs=116 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:24.713 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.709+0000 7f2e9cf066c0 1 -- 10.20.193.92:0/3994944507 >> 10.20.193.92:0/3994944507 conn(0x7f2e980ea6d0 msgr2=0x7f2e9810aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:03:24.713 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.710+0000 7f2e9cf066c0 1 -- 10.20.193.92:0/3994944507 shutdown_connections 2026-02-13T04:03:24.713 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:24.710+0000 7f2e9cf066c0 1 -- 10.20.193.92:0/3994944507 wait complete. 2026-02-13T04:03:26.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:25 trial158 ceph-mon[27763]: pgmap v260: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 9 op/s 2026-02-13T04:03:26.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:25 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/3994944507' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:26.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:25 trial099 ceph-mon[27808]: pgmap v260: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 9 op/s 2026-02-13T04:03:26.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:25 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/3994944507' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:26.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:25 trial092 ceph-mon[23047]: pgmap v260: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.5 KiB/s rd, 9 op/s 2026-02-13T04:03:26.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:25 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/3994944507' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:27.815 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:03:27.999 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:03:28.042 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:27 trial092 ceph-mon[23047]: pgmap v261: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T04:03:28.078 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:27 trial158 ceph-mon[27763]: pgmap v261: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T04:03:28.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:27 trial099 ceph-mon[27808]: pgmap v261: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T04:03:28.190 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.187+0000 7f29535776c0 1 -- 10.20.193.92:0/3446062538 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2954115270 msgr2=0x7f2954175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:28.190 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.187+0000 7f29535776c0 1 --2- 10.20.193.92:0/3446062538 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2954115270 0x7f2954175c10 secure :-1 s=READY pgs=126 gs=2 cs=0 l=1 c_cookie=16109060619668877288 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f294400aa40 tx=0x7f294402fde0 comp rx=0 tx=0).stop 2026-02-13T04:03:28.190 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.187+0000 7f29535776c0 1 -- 10.20.193.92:0/3446062538 shutdown_connections 2026-02-13T04:03:28.191 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.187+0000 7f29535776c0 1 --2- 10.20.193.92:0/3446062538 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2954115270 0x7f2954175c10 unknown :-1 s=CLOSED pgs=126 gs=2 cs=0 l=1 c_cookie=16109060619668877288 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:28.191 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.187+0000 7f29535776c0 1 --2- 10.20.193.92:0/3446062538 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f295410fa50 0x7f2954114a90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:28.191 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.187+0000 7f29535776c0 1 --2- 10.20.193.92:0/3446062538 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f295410f060 0x7f295410f430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:28.191 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.187+0000 7f29535776c0 1 -- 10.20.193.92:0/3446062538 >> 10.20.193.92:0/3446062538 conn(0x7f29540ec980 msgr2=0x7f295410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:03:28.191 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.187+0000 7f29535776c0 1 -- 10.20.193.92:0/3446062538 shutdown_connections 2026-02-13T04:03:28.191 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.187+0000 7f29535776c0 1 -- 10.20.193.92:0/3446062538 wait complete. 2026-02-13T04:03:28.193 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.188+0000 7f29535776c0 1 Processor -- start 2026-02-13T04:03:28.193 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.188+0000 7f29535776c0 1 -- start start 2026-02-13T04:03:28.193 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.188+0000 7f29535776c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f295410f060 0x7f295411cd50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:28.193 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.188+0000 7f29535776c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2954115270 0x7f295411d290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:28.193 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.188+0000 7f29535776c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2954122650 0x7f2954122af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:28.194 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.188+0000 7f29535776c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2954123060 con 0x7f295410f060 2026-02-13T04:03:28.194 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.188+0000 7f29535776c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f29541231d0 con 0x7f2954122650 2026-02-13T04:03:28.194 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.188+0000 7f29535776c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f2954123390 con 0x7f2954115270 2026-02-13T04:03:28.194 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.188+0000 7f29525756c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f295410f060 0x7f295411cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:28.194 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.188+0000 7f2952d766c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2954122650 0x7f2954122af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:28.194 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.188+0000 7f29525756c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f295410f060 0x7f295411cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:37010/0 (socket says 10.20.193.92:37010) 2026-02-13T04:03:28.194 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.188+0000 7f29525756c0 1 -- 10.20.193.92:0/2759261708 learned_addr learned my addr 10.20.193.92:0/2759261708 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:03:28.194 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.188+0000 7f2951d746c0 1 --2- 10.20.193.92:0/2759261708 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2954115270 0x7f295411d290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:28.194 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.189+0000 7f2952d766c0 1 -- 10.20.193.92:0/2759261708 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2954115270 msgr2=0x7f295411d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:28.194 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.189+0000 7f2952d766c0 1 --2- 10.20.193.92:0/2759261708 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2954115270 0x7f295411d290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:28.194 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.189+0000 7f2952d766c0 1 -- 10.20.193.92:0/2759261708 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f295410f060 msgr2=0x7f295411cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:28.194 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.189+0000 7f2952d766c0 1 --2- 10.20.193.92:0/2759261708 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f295410f060 0x7f295411cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:28.195 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.189+0000 7f2952d766c0 1 -- 10.20.193.92:0/2759261708 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f294400a660 con 0x7f2954122650 2026-02-13T04:03:28.195 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.189+0000 7f2952d766c0 1 --2- 10.20.193.92:0/2759261708 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2954122650 0x7f2954122af0 secure :-1 s=READY pgs=127 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f29440302f0 tx=0x7f2944005820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:03:28.195 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.189+0000 7f293b7fe6c0 1 -- 10.20.193.92:0/2759261708 <== mon.2 v2:10.20.193.99:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2944030860 con 0x7f2954122650 2026-02-13T04:03:28.195 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.189+0000 7f293b7fe6c0 1 -- 10.20.193.92:0/2759261708 <== mon.2 v2:10.20.193.99:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f2944003d40 con 0x7f2954122650 2026-02-13T04:03:28.195 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.189+0000 7f293b7fe6c0 1 -- 10.20.193.92:0/2759261708 <== mon.2 v2:10.20.193.99:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f29440322b0 con 0x7f2954122650 2026-02-13T04:03:28.195 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.189+0000 7f29535776c0 1 -- 10.20.193.92:0/2759261708 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29541637e0 con 0x7f2954122650 2026-02-13T04:03:28.195 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.189+0000 7f29535776c0 1 -- 10.20.193.92:0/2759261708 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2954163c10 con 0x7f2954122650 2026-02-13T04:03:28.195 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.189+0000 7f29535776c0 1 -- 10.20.193.92:0/2759261708 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2954110330 con 0x7f2954122650 2026-02-13T04:03:28.196 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.192+0000 7f293b7fe6c0 1 -- 10.20.193.92:0/2759261708 <== mon.2 v2:10.20.193.99:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f2944003810 con 0x7f2954122650 2026-02-13T04:03:28.196 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.193+0000 7f293b7fe6c0 1 --2- 10.20.193.92:0/2759261708 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f292c0b56d0 0x7f292c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:28.196 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.193+0000 7f293b7fe6c0 1 -- 10.20.193.92:0/2759261708 <== mon.2 v2:10.20.193.99:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f2944108e90 con 0x7f2954122650 2026-02-13T04:03:28.197 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.193+0000 7f29525756c0 1 --2- 10.20.193.92:0/2759261708 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f292c0b56d0 0x7f292c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:28.197 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.193+0000 7f293b7fe6c0 1 -- 10.20.193.92:0/2759261708 <== mon.2 v2:10.20.193.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2944109310 con 0x7f2954122650 2026-02-13T04:03:28.197 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.194+0000 7f29525756c0 1 --2- 10.20.193.92:0/2759261708 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f292c0b56d0 0x7f292c0d5b80 secure :-1 s=READY pgs=224 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f29480095c0 tx=0x7f2948009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:03:28.335 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.333+0000 7f29535776c0 1 -- 10.20.193.92:0/2759261708 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f295411dea0 con 0x7f2954122650 2026-02-13T04:03:28.336 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.333+0000 7f293b7fe6c0 1 -- 10.20.193.92:0/2759261708 <== mon.2 v2:10.20.193.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f29440cb830 con 0x7f2954122650 2026-02-13T04:03:28.336 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:03:28.337 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:03:28.338 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.334+0000 7f29535776c0 1 -- 10.20.193.92:0/2759261708 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f292c0b56d0 msgr2=0x7f292c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:28.338 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.334+0000 7f29535776c0 1 --2- 10.20.193.92:0/2759261708 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f292c0b56d0 0x7f292c0d5b80 secure :-1 s=READY pgs=224 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f29480095c0 tx=0x7f2948009260 comp rx=0 tx=0).stop 2026-02-13T04:03:28.338 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.334+0000 7f29535776c0 1 -- 10.20.193.92:0/2759261708 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2954122650 msgr2=0x7f2954122af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:28.338 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.334+0000 7f29535776c0 1 --2- 10.20.193.92:0/2759261708 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2954122650 0x7f2954122af0 secure :-1 s=READY pgs=127 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f29440302f0 tx=0x7f2944005820 comp rx=0 tx=0).stop 2026-02-13T04:03:28.338 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.334+0000 7f29535776c0 1 -- 10.20.193.92:0/2759261708 shutdown_connections 2026-02-13T04:03:28.338 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.334+0000 7f29535776c0 1 --2- 10.20.193.92:0/2759261708 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f292c0b56d0 0x7f292c0d5b80 unknown :-1 s=CLOSED pgs=224 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:28.338 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.334+0000 7f29535776c0 1 --2- 10.20.193.92:0/2759261708 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2954122650 0x7f2954122af0 unknown :-1 s=CLOSED pgs=127 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:28.338 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.334+0000 7f29535776c0 1 --2- 10.20.193.92:0/2759261708 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2954115270 0x7f295411d290 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:28.339 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.334+0000 7f29535776c0 1 --2- 10.20.193.92:0/2759261708 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f295410f060 0x7f295411cd50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:28.339 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.334+0000 7f29535776c0 1 -- 10.20.193.92:0/2759261708 >> 10.20.193.92:0/2759261708 conn(0x7f29540ec980 msgr2=0x7f295410cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:03:28.339 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.335+0000 7f29535776c0 1 -- 10.20.193.92:0/2759261708 shutdown_connections 2026-02-13T04:03:28.339 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:28.335+0000 7f29535776c0 1 -- 10.20.193.92:0/2759261708 wait complete. 2026-02-13T04:03:29.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:28 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/2759261708' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:29.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:28 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/2759261708' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:29.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:28 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/2759261708' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:30.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:29 trial158 ceph-mon[27763]: pgmap v262: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:03:30.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:29 trial099 ceph-mon[27808]: pgmap v262: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:03:30.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:29 trial092 ceph-mon[23047]: pgmap v262: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:03:31.441 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:03:31.625 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:03:31.756 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:31 trial092 ceph-mon[23047]: pgmap v263: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T04:03:31.821 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.818+0000 7f97c86996c0 1 -- 10.20.193.92:0/1702599845 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f97c0115410 msgr2=0x7f97c0175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:31.821 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.818+0000 7f97c86996c0 1 --2- 10.20.193.92:0/1702599845 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f97c0115410 0x7f97c0175db0 secure :-1 s=READY pgs=278 gs=2 cs=0 l=1 c_cookie=15301204173180308787 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97bc00a9b0 tx=0x7f97bc02fd60 comp rx=0 tx=0).stop 2026-02-13T04:03:31.822 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.818+0000 7f97c86996c0 1 -- 10.20.193.92:0/1702599845 shutdown_connections 2026-02-13T04:03:31.822 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.818+0000 7f97c86996c0 1 --2- 10.20.193.92:0/1702599845 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f97c0115410 0x7f97c0175db0 unknown :-1 s=CLOSED pgs=278 gs=2 cs=0 l=1 c_cookie=15301204173180308787 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:31.822 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.818+0000 7f97c86996c0 1 --2- 10.20.193.92:0/1702599845 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f97c010fbf0 0x7f97c0114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:31.822 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.818+0000 7f97c86996c0 1 --2- 10.20.193.92:0/1702599845 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f97c010f200 0x7f97c010f5d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:31.822 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.818+0000 7f97c86996c0 1 -- 10.20.193.92:0/1702599845 >> 10.20.193.92:0/1702599845 conn(0x7f97c00ecb00 msgr2=0x7f97c010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:03:31.822 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.818+0000 7f97c86996c0 1 -- 10.20.193.92:0/1702599845 shutdown_connections 2026-02-13T04:03:31.822 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.818+0000 7f97c86996c0 1 -- 10.20.193.92:0/1702599845 wait complete. 2026-02-13T04:03:31.824 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.819+0000 7f97c86996c0 1 Processor -- start 2026-02-13T04:03:31.824 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.819+0000 7f97c86996c0 1 -- start start 2026-02-13T04:03:31.824 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.819+0000 7f97c86996c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f97c010f200 0x7f97c011cf00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:31.824 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.819+0000 7f97c86996c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f97c0115410 0x7f97c011d440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:31.824 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.819+0000 7f97c86996c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f97c0122800 0x7f97c0122ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:31.824 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.819+0000 7f97c86996c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f97c0123210 con 0x7f97c0122800 2026-02-13T04:03:31.824 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.819+0000 7f97c86996c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f97c0123380 con 0x7f97c0115410 2026-02-13T04:03:31.824 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.819+0000 7f97c86996c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f97c0123540 con 0x7f97c010f200 2026-02-13T04:03:31.825 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.820+0000 7f97c640a6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f97c010f200 0x7f97c011cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:31.825 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.820+0000 7f97c640a6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f97c010f200 0x7f97c011cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:41338/0 (socket says 10.20.193.92:41338) 2026-02-13T04:03:31.825 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.820+0000 7f97c640a6c0 1 -- 10.20.193.92:0/394326686 learned_addr learned my addr 10.20.193.92:0/394326686 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:03:31.825 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.820+0000 7f97c6c0b6c0 1 --2- 10.20.193.92:0/394326686 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f97c0122800 0x7f97c0122ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:31.825 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.820+0000 7f97c5c096c0 1 --2- 10.20.193.92:0/394326686 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f97c0115410 0x7f97c011d440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:31.825 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.820+0000 7f97c6c0b6c0 1 -- 10.20.193.92:0/394326686 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f97c010f200 msgr2=0x7f97c011cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:31.825 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.820+0000 7f97c6c0b6c0 1 --2- 10.20.193.92:0/394326686 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f97c010f200 0x7f97c011cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:31.825 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.820+0000 7f97c6c0b6c0 1 -- 10.20.193.92:0/394326686 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f97c0115410 msgr2=0x7f97c011d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:31.825 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.820+0000 7f97c6c0b6c0 1 --2- 10.20.193.92:0/394326686 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f97c0115410 0x7f97c011d440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:31.825 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.820+0000 7f97c6c0b6c0 1 -- 10.20.193.92:0/394326686 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97bc00a5b0 con 0x7f97c0122800 2026-02-13T04:03:31.825 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.820+0000 7f97c6c0b6c0 1 --2- 10.20.193.92:0/394326686 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f97c0122800 0x7f97c0122ca0 secure :-1 s=READY pgs=279 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97bc00a9b0 tx=0x7f97bc0055e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:03:31.826 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.820+0000 7f97a77fe6c0 1 -- 10.20.193.92:0/394326686 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97bc003810 con 0x7f97c0122800 2026-02-13T04:03:31.826 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.820+0000 7f97a77fe6c0 1 -- 10.20.193.92:0/394326686 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f97bc0083e0 con 0x7f97c0122800 2026-02-13T04:03:31.826 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.820+0000 7f97a77fe6c0 1 -- 10.20.193.92:0/394326686 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f97bc0373f0 con 0x7f97c0122800 2026-02-13T04:03:31.826 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.820+0000 7f97c86996c0 1 -- 10.20.193.92:0/394326686 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97c0163990 con 0x7f97c0122800 2026-02-13T04:03:31.826 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.820+0000 7f97c86996c0 1 -- 10.20.193.92:0/394326686 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97c0163dc0 con 0x7f97c0122800 2026-02-13T04:03:31.826 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.821+0000 7f97c86996c0 1 -- 10.20.193.92:0/394326686 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97c01104d0 con 0x7f97c0122800 2026-02-13T04:03:31.826 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.823+0000 7f97a77fe6c0 1 -- 10.20.193.92:0/394326686 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f97bc008aa0 con 0x7f97c0122800 2026-02-13T04:03:31.828 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.825+0000 7f97a77fe6c0 1 --2- 10.20.193.92:0/394326686 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f979c0b56d0 0x7f979c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:31.828 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.825+0000 7f97a77fe6c0 1 -- 10.20.193.92:0/394326686 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f97bc108c10 con 0x7f97c0122800 2026-02-13T04:03:31.828 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.825+0000 7f97c640a6c0 1 --2- 10.20.193.92:0/394326686 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f979c0b56d0 0x7f979c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:31.828 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.825+0000 7f97a77fe6c0 1 -- 10.20.193.92:0/394326686 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f97bc109090 con 0x7f97c0122800 2026-02-13T04:03:31.828 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.825+0000 7f97c640a6c0 1 --2- 10.20.193.92:0/394326686 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f979c0b56d0 0x7f979c0d5b80 secure :-1 s=READY pgs=225 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97b0005b40 tx=0x7f97b0009310 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:03:31.952 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.949+0000 7f97c86996c0 1 -- 10.20.193.92:0/394326686 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f97c010f5d0 con 0x7f97c0122800 2026-02-13T04:03:31.952 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.949+0000 7f97a77fe6c0 1 -- 10.20.193.92:0/394326686 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f97bc0cb5b0 con 0x7f97c0122800 2026-02-13T04:03:31.952 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:03:31.953 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:03:31.953 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.950+0000 7f97c86996c0 1 -- 10.20.193.92:0/394326686 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f979c0b56d0 msgr2=0x7f979c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:31.954 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.950+0000 7f97c86996c0 1 --2- 10.20.193.92:0/394326686 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f979c0b56d0 0x7f979c0d5b80 secure :-1 s=READY pgs=225 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97b0005b40 tx=0x7f97b0009310 comp rx=0 tx=0).stop 2026-02-13T04:03:31.954 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.950+0000 7f97c86996c0 1 -- 10.20.193.92:0/394326686 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f97c0122800 msgr2=0x7f97c0122ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:31.954 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.950+0000 7f97c86996c0 1 --2- 10.20.193.92:0/394326686 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f97c0122800 0x7f97c0122ca0 secure :-1 s=READY pgs=279 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f97bc00a9b0 tx=0x7f97bc0055e0 comp rx=0 tx=0).stop 2026-02-13T04:03:31.954 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.950+0000 7f97c86996c0 1 -- 10.20.193.92:0/394326686 shutdown_connections 2026-02-13T04:03:31.954 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.950+0000 7f97c86996c0 1 --2- 10.20.193.92:0/394326686 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f979c0b56d0 0x7f979c0d5b80 unknown :-1 s=CLOSED pgs=225 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:31.954 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.950+0000 7f97c86996c0 1 --2- 10.20.193.92:0/394326686 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f97c0115410 0x7f97c011d440 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:31.954 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.950+0000 7f97c86996c0 1 --2- 10.20.193.92:0/394326686 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f97c0122800 0x7f97c0122ca0 unknown :-1 s=CLOSED pgs=279 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:31.954 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.950+0000 7f97c86996c0 1 --2- 10.20.193.92:0/394326686 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f97c010f200 0x7f97c011cf00 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:31.954 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.950+0000 7f97c86996c0 1 -- 10.20.193.92:0/394326686 >> 10.20.193.92:0/394326686 conn(0x7f97c00ecb00 msgr2=0x7f97c010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:03:31.954 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.950+0000 7f97c86996c0 1 -- 10.20.193.92:0/394326686 shutdown_connections 2026-02-13T04:03:31.955 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:31.950+0000 7f97c86996c0 1 -- 10.20.193.92:0/394326686 wait complete. 2026-02-13T04:03:32.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:31 trial158 ceph-mon[27763]: pgmap v263: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T04:03:32.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:31 trial099 ceph-mon[27808]: pgmap v263: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T04:03:33.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:32 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/394326686' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:33.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:32 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/394326686' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:33.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:32 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/394326686' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:34.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:33 trial158 ceph-mon[27763]: pgmap v264: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:03:34.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:33 trial099 ceph-mon[27808]: pgmap v264: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:03:34.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:33 trial092 ceph-mon[23047]: pgmap v264: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:03:35.093 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:03:35.277 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:03:35.462 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.459+0000 7f0463ab96c0 1 -- 10.20.193.92:0/2989225090 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f045c0622d0 msgr2=0x7f045c0607a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:35.463 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.459+0000 7f0463ab96c0 1 --2- 10.20.193.92:0/2989225090 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f045c0622d0 0x7f045c0607a0 secure :-1 s=READY pgs=128 gs=3 cs=0 l=1 c_cookie=8180089210972879272 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f044c0098a0 tx=0x7f044c02ec50 comp rx=0 tx=0).stop 2026-02-13T04:03:35.463 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.459+0000 7f0463ab96c0 1 -- 10.20.193.92:0/2989225090 shutdown_connections 2026-02-13T04:03:35.463 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.459+0000 7f0463ab96c0 1 --2- 10.20.193.92:0/2989225090 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f045c159ac0 0x7f045c179ea0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:35.463 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.459+0000 7f0463ab96c0 1 --2- 10.20.193.92:0/2989225090 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f045c060ce0 0x7f045c061110 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:35.463 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.459+0000 7f0463ab96c0 1 --2- 10.20.193.92:0/2989225090 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f045c0622d0 0x7f045c0607a0 unknown :-1 s=CLOSED pgs=128 gs=3 cs=0 l=1 c_cookie=8180089210972879272 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:35.463 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.459+0000 7f0463ab96c0 1 -- 10.20.193.92:0/2989225090 >> 10.20.193.92:0/2989225090 conn(0x7f045c0ea880 msgr2=0x7f045c10ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:03:35.463 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.459+0000 7f0463ab96c0 1 -- 10.20.193.92:0/2989225090 shutdown_connections 2026-02-13T04:03:35.463 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.459+0000 7f0463ab96c0 1 -- 10.20.193.92:0/2989225090 wait complete. 2026-02-13T04:03:35.463 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.460+0000 7f0463ab96c0 1 Processor -- start 2026-02-13T04:03:35.464 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.460+0000 7f0463ab96c0 1 -- start start 2026-02-13T04:03:35.465 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.460+0000 7f0463ab96c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f045c060ce0 0x7f045c0f2120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:35.465 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.460+0000 7f0463ab96c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f045c0622d0 0x7f045c0f2660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:35.465 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.460+0000 7f0463ab96c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f045c159ac0 0x7f045c0f7a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:35.465 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.460+0000 7f0463ab96c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f045c0f8070 con 0x7f045c0622d0 2026-02-13T04:03:35.465 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.460+0000 7f0463ab96c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f045c0f81e0 con 0x7f045c159ac0 2026-02-13T04:03:35.466 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.460+0000 7f0463ab96c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f045c0f83a0 con 0x7f045c060ce0 2026-02-13T04:03:35.466 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.460+0000 7f046182a6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f045c060ce0 0x7f045c0f2120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:35.466 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.460+0000 7f046202b6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f045c159ac0 0x7f045c0f7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:35.466 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.460+0000 7f046202b6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f045c159ac0 0x7f045c0f7a20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:44140/0 (socket says 10.20.193.92:44140) 2026-02-13T04:03:35.466 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.460+0000 7f046182a6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f045c060ce0 0x7f045c0f2120 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:44440/0 (socket says 10.20.193.92:44440) 2026-02-13T04:03:35.466 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.460+0000 7f046202b6c0 1 -- 10.20.193.92:0/1456352774 learned_addr learned my addr 10.20.193.92:0/1456352774 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:03:35.466 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.460+0000 7f04610296c0 1 --2- 10.20.193.92:0/1456352774 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f045c0622d0 0x7f045c0f2660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:35.466 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.461+0000 7f046202b6c0 1 -- 10.20.193.92:0/1456352774 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f045c060ce0 msgr2=0x7f045c0f2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:35.466 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.461+0000 7f046202b6c0 1 --2- 10.20.193.92:0/1456352774 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f045c060ce0 0x7f045c0f2120 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:35.466 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.461+0000 7f046202b6c0 1 -- 10.20.193.92:0/1456352774 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f045c0622d0 msgr2=0x7f045c0f2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:35.466 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.461+0000 7f046202b6c0 1 --2- 10.20.193.92:0/1456352774 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f045c0622d0 0x7f045c0f2660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:35.466 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.461+0000 7f046202b6c0 1 -- 10.20.193.92:0/1456352774 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f045800a660 con 0x7f045c159ac0 2026-02-13T04:03:35.467 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.461+0000 7f046202b6c0 1 --2- 10.20.193.92:0/1456352774 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f045c159ac0 0x7f045c0f7a20 secure :-1 s=READY pgs=129 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f045800c9d0 tx=0x7f045800cea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:03:35.467 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.461+0000 7f044affd6c0 1 -- 10.20.193.92:0/1456352774 <== mon.2 v2:10.20.193.99:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0458003c40 con 0x7f045c159ac0 2026-02-13T04:03:35.467 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.461+0000 7f044affd6c0 1 -- 10.20.193.92:0/1456352774 <== mon.2 v2:10.20.193.99:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f045800a070 con 0x7f045c159ac0 2026-02-13T04:03:35.467 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.461+0000 7f044affd6c0 1 -- 10.20.193.92:0/1456352774 <== mon.2 v2:10.20.193.99:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0458008440 con 0x7f045c159ac0 2026-02-13T04:03:35.467 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.461+0000 7f0463ab96c0 1 -- 10.20.193.92:0/1456352774 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f044c0094c0 con 0x7f045c159ac0 2026-02-13T04:03:35.467 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.461+0000 7f0463ab96c0 1 -- 10.20.193.92:0/1456352774 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f045c0f8b90 con 0x7f045c159ac0 2026-02-13T04:03:35.467 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.462+0000 7f0463ab96c0 1 -- 10.20.193.92:0/1456352774 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f045c061cb0 con 0x7f045c159ac0 2026-02-13T04:03:35.467 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.464+0000 7f044affd6c0 1 -- 10.20.193.92:0/1456352774 <== mon.2 v2:10.20.193.99:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f045800d860 con 0x7f045c159ac0 2026-02-13T04:03:35.469 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.466+0000 7f044affd6c0 1 --2- 10.20.193.92:0/1456352774 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f04380b57a0 0x7f04380d5c50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:35.469 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.466+0000 7f044affd6c0 1 -- 10.20.193.92:0/1456352774 <== mon.2 v2:10.20.193.99:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f04580e4ba0 con 0x7f045c159ac0 2026-02-13T04:03:35.469 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.466+0000 7f044affd6c0 1 -- 10.20.193.92:0/1456352774 <== mon.2 v2:10.20.193.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f045811d600 con 0x7f045c159ac0 2026-02-13T04:03:35.469 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.466+0000 7f046182a6c0 1 --2- 10.20.193.92:0/1456352774 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f04380b57a0 0x7f04380d5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:35.470 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.467+0000 7f046182a6c0 1 --2- 10.20.193.92:0/1456352774 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f04380b57a0 0x7f04380d5c50 secure :-1 s=READY pgs=226 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f044c0097f0 tx=0x7f044c0023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:03:35.591 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.589+0000 7f0463ab96c0 1 -- 10.20.193.92:0/1456352774 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f045c061110 con 0x7f045c159ac0 2026-02-13T04:03:35.592 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.589+0000 7f044affd6c0 1 -- 10.20.193.92:0/1456352774 <== mon.2 v2:10.20.193.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f04580a7540 con 0x7f045c159ac0 2026-02-13T04:03:35.592 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:03:35.592 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:03:35.593 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.590+0000 7f0463ab96c0 1 -- 10.20.193.92:0/1456352774 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f04380b57a0 msgr2=0x7f04380d5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:35.593 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.590+0000 7f0463ab96c0 1 --2- 10.20.193.92:0/1456352774 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f04380b57a0 0x7f04380d5c50 secure :-1 s=READY pgs=226 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f044c0097f0 tx=0x7f044c0023a0 comp rx=0 tx=0).stop 2026-02-13T04:03:35.593 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.590+0000 7f0463ab96c0 1 -- 10.20.193.92:0/1456352774 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f045c159ac0 msgr2=0x7f045c0f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:35.593 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.590+0000 7f0463ab96c0 1 --2- 10.20.193.92:0/1456352774 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f045c159ac0 0x7f045c0f7a20 secure :-1 s=READY pgs=129 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f045800c9d0 tx=0x7f045800cea0 comp rx=0 tx=0).stop 2026-02-13T04:03:35.593 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.590+0000 7f0463ab96c0 1 -- 10.20.193.92:0/1456352774 shutdown_connections 2026-02-13T04:03:35.593 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.590+0000 7f0463ab96c0 1 --2- 10.20.193.92:0/1456352774 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f04380b57a0 0x7f04380d5c50 unknown :-1 s=CLOSED pgs=226 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:35.593 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.590+0000 7f0463ab96c0 1 --2- 10.20.193.92:0/1456352774 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f045c159ac0 0x7f045c0f7a20 unknown :-1 s=CLOSED pgs=129 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:35.594 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.590+0000 7f0463ab96c0 1 --2- 10.20.193.92:0/1456352774 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f045c0622d0 0x7f045c0f2660 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:35.594 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.590+0000 7f0463ab96c0 1 --2- 10.20.193.92:0/1456352774 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f045c060ce0 0x7f045c0f2120 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:35.594 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.590+0000 7f0463ab96c0 1 -- 10.20.193.92:0/1456352774 >> 10.20.193.92:0/1456352774 conn(0x7f045c0ea880 msgr2=0x7f045c10db90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:03:35.594 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.590+0000 7f0463ab96c0 1 -- 10.20.193.92:0/1456352774 shutdown_connections 2026-02-13T04:03:35.594 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:35.590+0000 7f0463ab96c0 1 -- 10.20.193.92:0/1456352774 wait complete. 2026-02-13T04:03:35.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:35 trial092 ceph-mon[23047]: pgmap v265: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:03:35.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:35 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1456352774' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:36.078 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:35 trial158 ceph-mon[27763]: pgmap v265: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:03:36.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:35 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/1456352774' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:36.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:35 trial099 ceph-mon[27808]: pgmap v265: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:03:36.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:35 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/1456352774' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:38.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:37 trial158 ceph-mon[27763]: pgmap v266: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:03:38.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:37 trial099 ceph-mon[27808]: pgmap v266: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:03:38.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:37 trial092 ceph-mon[23047]: pgmap v266: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:03:38.696 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:03:38.881 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:03:39.075 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.072+0000 7fa3b0c676c0 1 -- 10.20.193.92:0/2724887514 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa3ac10fa50 msgr2=0x7fa3ac114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:39.075 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.072+0000 7fa3b0c676c0 1 --2- 10.20.193.92:0/2724887514 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa3ac10fa50 0x7fa3ac114a90 secure :-1 s=READY pgs=280 gs=1 cs=0 l=1 c_cookie=2407423705203923642 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa39c0099a0 tx=0x7fa39c02ed00 comp rx=0 tx=0).stop 2026-02-13T04:03:39.076 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.072+0000 7fa3b0c676c0 1 -- 10.20.193.92:0/2724887514 shutdown_connections 2026-02-13T04:03:39.076 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.072+0000 7fa3b0c676c0 1 --2- 10.20.193.92:0/2724887514 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa3ac115270 0x7fa3ac175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:39.076 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.072+0000 7fa3b0c676c0 1 --2- 10.20.193.92:0/2724887514 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa3ac10fa50 0x7fa3ac114a90 unknown :-1 s=CLOSED pgs=280 gs=1 cs=0 l=1 c_cookie=2407423705203923642 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:39.076 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.072+0000 7fa3b0c676c0 1 --2- 10.20.193.92:0/2724887514 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa3ac10f060 0x7fa3ac10f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:39.076 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.072+0000 7fa3b0c676c0 1 -- 10.20.193.92:0/2724887514 >> 10.20.193.92:0/2724887514 conn(0x7fa3ac0ec980 msgr2=0x7fa3ac10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:03:39.076 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.072+0000 7fa3b0c676c0 1 -- 10.20.193.92:0/2724887514 shutdown_connections 2026-02-13T04:03:39.076 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.073+0000 7fa3b0c676c0 1 -- 10.20.193.92:0/2724887514 wait complete. 2026-02-13T04:03:39.078 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.073+0000 7fa3b0c676c0 1 Processor -- start 2026-02-13T04:03:39.078 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.073+0000 7fa3b0c676c0 1 -- start start 2026-02-13T04:03:39.078 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.073+0000 7fa3b0c676c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa3ac10f060 0x7fa3ac0f4750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:39.079 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.073+0000 7fa3b0c676c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa3ac115270 0x7fa3ac175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:39.079 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.073+0000 7fa3b0c676c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa3ac0f4d80 0x7fa3ac0fa050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:39.079 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.073+0000 7fa3b0c676c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ac0f53e0 con 0x7fa3ac10f060 2026-02-13T04:03:39.079 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.073+0000 7fa3b0c676c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ac0fa590 con 0x7fa3ac0f4d80 2026-02-13T04:03:39.079 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.073+0000 7fa3b0c676c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ac0fa750 con 0x7fa3ac115270 2026-02-13T04:03:39.079 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.074+0000 7fa3ab7fe6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa3ac10f060 0x7fa3ac0f4750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:39.079 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.074+0000 7fa3ab7fe6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa3ac10f060 0x7fa3ac0f4750 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:40682/0 (socket says 10.20.193.92:40682) 2026-02-13T04:03:39.079 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.074+0000 7fa3ab7fe6c0 1 -- 10.20.193.92:0/2969365602 learned_addr learned my addr 10.20.193.92:0/2969365602 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:03:39.079 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.074+0000 7fa3abfff6c0 1 --2- 10.20.193.92:0/2969365602 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa3ac0f4d80 0x7fa3ac0fa050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:39.079 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.074+0000 7fa3aaffd6c0 1 --2- 10.20.193.92:0/2969365602 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa3ac115270 0x7fa3ac175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:39.079 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.074+0000 7fa3ab7fe6c0 1 -- 10.20.193.92:0/2969365602 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa3ac115270 msgr2=0x7fa3ac175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:39.080 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.074+0000 7fa3ab7fe6c0 1 --2- 10.20.193.92:0/2969365602 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa3ac115270 0x7fa3ac175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:39.080 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.074+0000 7fa3ab7fe6c0 1 -- 10.20.193.92:0/2969365602 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa3ac0f4d80 msgr2=0x7fa3ac0fa050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:39.080 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.074+0000 7fa3ab7fe6c0 1 --2- 10.20.193.92:0/2969365602 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa3ac0f4d80 0x7fa3ac0fa050 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:39.080 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.074+0000 7fa3ab7fe6c0 1 -- 10.20.193.92:0/2969365602 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa39c009590 con 0x7fa3ac10f060 2026-02-13T04:03:39.080 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.074+0000 7fa3abfff6c0 1 --2- 10.20.193.92:0/2969365602 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa3ac0f4d80 0x7fa3ac0fa050 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T04:03:39.080 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.074+0000 7fa3ab7fe6c0 1 --2- 10.20.193.92:0/2969365602 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa3ac10f060 0x7fa3ac0f4750 secure :-1 s=READY pgs=281 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa39800b6c0 tx=0x7fa39800bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:03:39.080 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.074+0000 7fa3a8ff96c0 1 -- 10.20.193.92:0/2969365602 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa398004460 con 0x7fa3ac10f060 2026-02-13T04:03:39.080 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.074+0000 7fa3a8ff96c0 1 -- 10.20.193.92:0/2969365602 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fa3980045c0 con 0x7fa3ac10f060 2026-02-13T04:03:39.080 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.074+0000 7fa3a8ff96c0 1 -- 10.20.193.92:0/2969365602 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa39800ce40 con 0x7fa3ac10f060 2026-02-13T04:03:39.080 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.074+0000 7fa3b0c676c0 1 -- 10.20.193.92:0/2969365602 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3ac0fa9d0 con 0x7fa3ac10f060 2026-02-13T04:03:39.080 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.074+0000 7fa3b0c676c0 1 -- 10.20.193.92:0/2969365602 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3ac0fae60 con 0x7fa3ac10f060 2026-02-13T04:03:39.081 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.075+0000 7fa3b0c676c0 1 -- 10.20.193.92:0/2969365602 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3ac110330 con 0x7fa3ac10f060 2026-02-13T04:03:39.081 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.077+0000 7fa3a8ff96c0 1 -- 10.20.193.92:0/2969365602 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fa39800c410 con 0x7fa3ac10f060 2026-02-13T04:03:39.082 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.079+0000 7fa3a8ff96c0 1 --2- 10.20.193.92:0/2969365602 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa3800b5650 0x7fa3800d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:39.082 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.079+0000 7fa3a8ff96c0 1 -- 10.20.193.92:0/2969365602 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7fa3980e3ae0 con 0x7fa3ac10f060 2026-02-13T04:03:39.082 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.079+0000 7fa3aaffd6c0 1 --2- 10.20.193.92:0/2969365602 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa3800b5650 0x7fa3800d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:39.082 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.079+0000 7fa3a8ff96c0 1 -- 10.20.193.92:0/2969365602 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa39811c5e0 con 0x7fa3ac10f060 2026-02-13T04:03:39.083 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.080+0000 7fa3aaffd6c0 1 --2- 10.20.193.92:0/2969365602 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa3800b5650 0x7fa3800d5b00 secure :-1 s=READY pgs=227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa39c0023e0 tx=0x7fa39c005c80 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:03:39.205 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.203+0000 7fa3b0c676c0 1 -- 10.20.193.92:0/2969365602 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa3ac10f430 con 0x7fa3ac10f060 2026-02-13T04:03:39.206 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.203+0000 7fa3a8ff96c0 1 -- 10.20.193.92:0/2969365602 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fa3980a6480 con 0x7fa3ac10f060 2026-02-13T04:03:39.206 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:03:39.206 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:03:39.207 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.204+0000 7fa3b0c676c0 1 -- 10.20.193.92:0/2969365602 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa3800b5650 msgr2=0x7fa3800d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:39.207 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.204+0000 7fa3b0c676c0 1 --2- 10.20.193.92:0/2969365602 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa3800b5650 0x7fa3800d5b00 secure :-1 s=READY pgs=227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa39c0023e0 tx=0x7fa39c005c80 comp rx=0 tx=0).stop 2026-02-13T04:03:39.207 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.204+0000 7fa3b0c676c0 1 -- 10.20.193.92:0/2969365602 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa3ac10f060 msgr2=0x7fa3ac0f4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:39.207 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.204+0000 7fa3b0c676c0 1 --2- 10.20.193.92:0/2969365602 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa3ac10f060 0x7fa3ac0f4750 secure :-1 s=READY pgs=281 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa39800b6c0 tx=0x7fa39800bb90 comp rx=0 tx=0).stop 2026-02-13T04:03:39.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.204+0000 7fa3b0c676c0 1 -- 10.20.193.92:0/2969365602 shutdown_connections 2026-02-13T04:03:39.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.204+0000 7fa3b0c676c0 1 --2- 10.20.193.92:0/2969365602 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa3800b5650 0x7fa3800d5b00 unknown :-1 s=CLOSED pgs=227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:39.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.204+0000 7fa3b0c676c0 1 --2- 10.20.193.92:0/2969365602 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa3ac0f4d80 0x7fa3ac0fa050 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:39.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.204+0000 7fa3b0c676c0 1 --2- 10.20.193.92:0/2969365602 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa3ac115270 0x7fa3ac175b10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:39.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.204+0000 7fa3b0c676c0 1 --2- 10.20.193.92:0/2969365602 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa3ac10f060 0x7fa3ac0f4750 unknown :-1 s=CLOSED pgs=281 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:39.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.204+0000 7fa3b0c676c0 1 -- 10.20.193.92:0/2969365602 >> 10.20.193.92:0/2969365602 conn(0x7fa3ac0ec980 msgr2=0x7fa3ac10d540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:03:39.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.204+0000 7fa3b0c676c0 1 -- 10.20.193.92:0/2969365602 shutdown_connections 2026-02-13T04:03:39.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:39.204+0000 7fa3b0c676c0 1 -- 10.20.193.92:0/2969365602 wait complete. 2026-02-13T04:03:40.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:39 trial158 ceph-mon[27763]: pgmap v267: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:03:40.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:39 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/2969365602' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:40.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:39 trial099 ceph-mon[27808]: pgmap v267: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:03:40.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:39 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/2969365602' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:40.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:39 trial092 ceph-mon[23047]: pgmap v267: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:03:40.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:39 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/2969365602' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:42.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:41 trial158 ceph-mon[27763]: pgmap v268: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T04:03:42.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:41 trial099 ceph-mon[27808]: pgmap v268: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T04:03:42.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:41 trial092 ceph-mon[23047]: pgmap v268: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T04:03:42.312 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:03:42.497 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:03:42.686 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.683+0000 7fadee7906c0 1 -- 10.20.193.92:0/1191470585 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fade810c480 msgr2=0x7fade8110a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:42.686 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.683+0000 7fadee7906c0 1 --2- 10.20.193.92:0/1191470585 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fade810c480 0x7fade8110a50 secure :-1 s=READY pgs=282 gs=1 cs=0 l=1 c_cookie=9387959248300999586 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fadd8009970 tx=0x7fadd802ed20 comp rx=0 tx=0).stop 2026-02-13T04:03:42.687 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.683+0000 7fadee7906c0 1 -- 10.20.193.92:0/1191470585 shutdown_connections 2026-02-13T04:03:42.687 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.683+0000 7fadee7906c0 1 --2- 10.20.193.92:0/1191470585 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fade81110a0 0x7fade8111520 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:42.687 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.683+0000 7fadee7906c0 1 --2- 10.20.193.92:0/1191470585 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fade810c480 0x7fade8110a50 unknown :-1 s=CLOSED pgs=282 gs=1 cs=0 l=1 c_cookie=9387959248300999586 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:42.687 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.683+0000 7fadee7906c0 1 --2- 10.20.193.92:0/1191470585 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fade810ba90 0x7fade810be60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:42.688 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.683+0000 7fadee7906c0 1 -- 10.20.193.92:0/1191470585 >> 10.20.193.92:0/1191470585 conn(0x7fade80e9700 msgr2=0x7fade8109b10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:03:42.688 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.683+0000 7fadee7906c0 1 -- 10.20.193.92:0/1191470585 shutdown_connections 2026-02-13T04:03:42.688 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.683+0000 7fadee7906c0 1 -- 10.20.193.92:0/1191470585 wait complete. 2026-02-13T04:03:42.688 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.684+0000 7fadee7906c0 1 Processor -- start 2026-02-13T04:03:42.688 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.684+0000 7fadee7906c0 1 -- start start 2026-02-13T04:03:42.688 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.684+0000 7fadee7906c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fade810ba90 0x7fade81217f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:42.688 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.684+0000 7fadee7906c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fade810c480 0x7fade8121d30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:42.688 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.684+0000 7fadee7906c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fade81110a0 0x7fade81270f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:42.688 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.684+0000 7fadee7906c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fade8127740 con 0x7fade81110a0 2026-02-13T04:03:42.688 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.684+0000 7fadee7906c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fade81278b0 con 0x7fade810ba90 2026-02-13T04:03:42.688 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.684+0000 7fadee7906c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fade8127a70 con 0x7fade810c480 2026-02-13T04:03:42.688 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.685+0000 7fade77fe6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fade810c480 0x7fade8121d30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:42.689 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.685+0000 7fade7fff6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fade810ba90 0x7fade81217f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:42.689 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.685+0000 7fade7fff6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fade810ba90 0x7fade81217f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:44172/0 (socket says 10.20.193.92:44172) 2026-02-13T04:03:42.689 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.685+0000 7fade7fff6c0 1 -- 10.20.193.92:0/4215030815 learned_addr learned my addr 10.20.193.92:0/4215030815 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:03:42.689 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.685+0000 7fadecd026c0 1 --2- 10.20.193.92:0/4215030815 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fade81110a0 0x7fade81270f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:42.690 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.685+0000 7fadecd026c0 1 -- 10.20.193.92:0/4215030815 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fade810c480 msgr2=0x7fade8121d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:42.690 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.685+0000 7fadecd026c0 1 --2- 10.20.193.92:0/4215030815 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fade810c480 0x7fade8121d30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:42.690 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.685+0000 7fadecd026c0 1 -- 10.20.193.92:0/4215030815 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fade810ba90 msgr2=0x7fade81217f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:42.690 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.685+0000 7fadecd026c0 1 --2- 10.20.193.92:0/4215030815 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fade810ba90 0x7fade81217f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:42.690 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.685+0000 7fadecd026c0 1 -- 10.20.193.92:0/4215030815 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadd8009590 con 0x7fade81110a0 2026-02-13T04:03:42.690 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.685+0000 7fade7fff6c0 1 --2- 10.20.193.92:0/4215030815 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fade810ba90 0x7fade81217f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T04:03:42.690 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.685+0000 7fadecd026c0 1 --2- 10.20.193.92:0/4215030815 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fade81110a0 0x7fade81270f0 secure :-1 s=READY pgs=283 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faddc00c6c0 tx=0x7faddc00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:03:42.691 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.685+0000 7fade57fa6c0 1 -- 10.20.193.92:0/4215030815 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faddc005340 con 0x7fade81110a0 2026-02-13T04:03:42.691 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.685+0000 7fadee7906c0 1 -- 10.20.193.92:0/4215030815 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fade8127d50 con 0x7fade81110a0 2026-02-13T04:03:42.691 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.685+0000 7fadee7906c0 1 -- 10.20.193.92:0/4215030815 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fade8168430 con 0x7fade81110a0 2026-02-13T04:03:42.691 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.685+0000 7fade57fa6c0 1 -- 10.20.193.92:0/4215030815 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7faddc003d40 con 0x7fade81110a0 2026-02-13T04:03:42.691 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.685+0000 7fade57fa6c0 1 -- 10.20.193.92:0/4215030815 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7faddc00dd90 con 0x7fade81110a0 2026-02-13T04:03:42.691 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.686+0000 7fadee7906c0 1 -- 10.20.193.92:0/4215030815 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fade805fb90 con 0x7fade81110a0 2026-02-13T04:03:42.691 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.688+0000 7fade57fa6c0 1 -- 10.20.193.92:0/4215030815 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7faddc003810 con 0x7fade81110a0 2026-02-13T04:03:42.692 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.690+0000 7fade57fa6c0 1 --2- 10.20.193.92:0/4215030815 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fadbc0b56d0 0x7fadbc0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:42.692 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.690+0000 7fade57fa6c0 1 -- 10.20.193.92:0/4215030815 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7faddc0e4a60 con 0x7fade81110a0 2026-02-13T04:03:42.693 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.690+0000 7fade7fff6c0 1 --2- 10.20.193.92:0/4215030815 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fadbc0b56d0 0x7fadbc0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:42.693 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.690+0000 7fade57fa6c0 1 -- 10.20.193.92:0/4215030815 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7faddc11d5e0 con 0x7fade81110a0 2026-02-13T04:03:42.693 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.690+0000 7fade7fff6c0 1 --2- 10.20.193.92:0/4215030815 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fadbc0b56d0 0x7fadbc0d5b80 secure :-1 s=READY pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fadd4009260 tx=0x7fadd4009310 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:03:42.816 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.814+0000 7fadee7906c0 1 -- 10.20.193.92:0/4215030815 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fade810be60 con 0x7fade81110a0 2026-02-13T04:03:42.817 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.814+0000 7fade57fa6c0 1 -- 10.20.193.92:0/4215030815 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7faddc0a7400 con 0x7fade81110a0 2026-02-13T04:03:42.817 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:03:42.817 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:03:42.818 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.815+0000 7fadee7906c0 1 -- 10.20.193.92:0/4215030815 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fadbc0b56d0 msgr2=0x7fadbc0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:42.818 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.815+0000 7fadee7906c0 1 --2- 10.20.193.92:0/4215030815 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fadbc0b56d0 0x7fadbc0d5b80 secure :-1 s=READY pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fadd4009260 tx=0x7fadd4009310 comp rx=0 tx=0).stop 2026-02-13T04:03:42.818 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.815+0000 7fadee7906c0 1 -- 10.20.193.92:0/4215030815 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fade81110a0 msgr2=0x7fade81270f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:42.818 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.815+0000 7fadee7906c0 1 --2- 10.20.193.92:0/4215030815 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fade81110a0 0x7fade81270f0 secure :-1 s=READY pgs=283 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faddc00c6c0 tx=0x7faddc00cb90 comp rx=0 tx=0).stop 2026-02-13T04:03:42.818 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.815+0000 7fadee7906c0 1 -- 10.20.193.92:0/4215030815 shutdown_connections 2026-02-13T04:03:42.818 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.815+0000 7fadee7906c0 1 --2- 10.20.193.92:0/4215030815 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fade81110a0 0x7fade81270f0 unknown :-1 s=CLOSED pgs=283 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:42.819 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.815+0000 7fadee7906c0 1 --2- 10.20.193.92:0/4215030815 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fade810c480 0x7fade8121d30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:42.819 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.815+0000 7fadee7906c0 1 --2- 10.20.193.92:0/4215030815 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fadbc0b56d0 0x7fadbc0d5b80 unknown :-1 s=CLOSED pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:42.819 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.815+0000 7fadee7906c0 1 --2- 10.20.193.92:0/4215030815 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fade810ba90 0x7fade81217f0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:42.819 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.815+0000 7fadee7906c0 1 -- 10.20.193.92:0/4215030815 >> 10.20.193.92:0/4215030815 conn(0x7fade80e9700 msgr2=0x7fade8109ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:03:42.819 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.815+0000 7fadee7906c0 1 -- 10.20.193.92:0/4215030815 shutdown_connections 2026-02-13T04:03:42.819 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:42.815+0000 7fadee7906c0 1 -- 10.20.193.92:0/4215030815 wait complete. 2026-02-13T04:03:44.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:43 trial158 ceph-mon[27763]: pgmap v269: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:03:44.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:43 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/4215030815' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:44.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:43 trial099 ceph-mon[27808]: pgmap v269: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:03:44.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:43 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/4215030815' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:44.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:43 trial092 ceph-mon[23047]: pgmap v269: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:03:44.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:43 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/4215030815' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:45.918 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:45 trial099 ceph-mon[27808]: pgmap v270: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:03:45.921 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:03:46.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:45 trial158 ceph-mon[27763]: pgmap v270: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:03:46.105 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:03:46.145 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:45 trial092 ceph-mon[23047]: pgmap v270: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:03:46.291 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.289+0000 7f95bd5846c0 1 -- 10.20.193.92:0/3783833548 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f95b8110ef0 msgr2=0x7f95b8111370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:46.292 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.289+0000 7f95bd5846c0 1 --2- 10.20.193.92:0/3783833548 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f95b8110ef0 0x7f95b8111370 secure :-1 s=READY pgs=284 gs=1 cs=0 l=1 c_cookie=14180191990719564848 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95ac00aa40 tx=0x7f95ac02fdf0 comp rx=0 tx=0).stop 2026-02-13T04:03:46.292 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.289+0000 7f95bd5846c0 1 -- 10.20.193.92:0/3783833548 shutdown_connections 2026-02-13T04:03:46.292 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.289+0000 7f95bd5846c0 1 --2- 10.20.193.92:0/3783833548 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f95b810c2d0 0x7f95b81108a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:46.292 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.289+0000 7f95bd5846c0 1 --2- 10.20.193.92:0/3783833548 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f95b8110ef0 0x7f95b8111370 unknown :-1 s=CLOSED pgs=284 gs=1 cs=0 l=1 c_cookie=14180191990719564848 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:46.292 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.289+0000 7f95bd5846c0 1 --2- 10.20.193.92:0/3783833548 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f95b810b8e0 0x7f95b810bcb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:46.292 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.289+0000 7f95bd5846c0 1 -- 10.20.193.92:0/3783833548 >> 10.20.193.92:0/3783833548 conn(0x7f95b80e9570 msgr2=0x7f95b8109980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:03:46.292 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.289+0000 7f95bd5846c0 1 -- 10.20.193.92:0/3783833548 shutdown_connections 2026-02-13T04:03:46.292 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.289+0000 7f95bd5846c0 1 -- 10.20.193.92:0/3783833548 wait complete. 2026-02-13T04:03:46.294 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.289+0000 7f95bd5846c0 1 Processor -- start 2026-02-13T04:03:46.294 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.290+0000 7f95bd5846c0 1 -- start start 2026-02-13T04:03:46.294 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.290+0000 7f95bd5846c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f95b810b8e0 0x7f95b8121570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:46.295 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.290+0000 7f95bd5846c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f95b810c2d0 0x7f95b8121ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:46.295 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.290+0000 7f95bd5846c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f95b8110ef0 0x7f95b8126e70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:46.295 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.290+0000 7f95bd5846c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f95b81274c0 con 0x7f95b810c2d0 2026-02-13T04:03:46.295 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.290+0000 7f95bd5846c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f95b8127630 con 0x7f95b810b8e0 2026-02-13T04:03:46.295 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.290+0000 7f95bd5846c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f95b81277f0 con 0x7f95b8110ef0 2026-02-13T04:03:46.295 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.290+0000 7f95b77fe6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f95b810c2d0 0x7f95b8121ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:46.295 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.290+0000 7f95b77fe6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f95b810c2d0 0x7f95b8121ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:49400/0 (socket says 10.20.193.92:49400) 2026-02-13T04:03:46.295 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.290+0000 7f95b77fe6c0 1 -- 10.20.193.92:0/1267962860 learned_addr learned my addr 10.20.193.92:0/1267962860 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:03:46.295 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.290+0000 7f95b7fff6c0 1 --2- 10.20.193.92:0/1267962860 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f95b810b8e0 0x7f95b8121570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:46.295 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.290+0000 7f95bcd836c0 1 --2- 10.20.193.92:0/1267962860 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f95b8110ef0 0x7f95b8126e70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:46.295 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.290+0000 7f95b77fe6c0 1 -- 10.20.193.92:0/1267962860 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f95b8110ef0 msgr2=0x7f95b8126e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:46.296 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.290+0000 7f95b77fe6c0 1 --2- 10.20.193.92:0/1267962860 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f95b8110ef0 0x7f95b8126e70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:46.296 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.290+0000 7f95b77fe6c0 1 -- 10.20.193.92:0/1267962860 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f95b810b8e0 msgr2=0x7f95b8121570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:46.296 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.290+0000 7f95b77fe6c0 1 --2- 10.20.193.92:0/1267962860 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f95b810b8e0 0x7f95b8121570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:46.296 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.290+0000 7f95b77fe6c0 1 -- 10.20.193.92:0/1267962860 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95ac00a660 con 0x7f95b810c2d0 2026-02-13T04:03:46.296 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.290+0000 7f95b7fff6c0 1 --2- 10.20.193.92:0/1267962860 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f95b810b8e0 0x7f95b8121570 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T04:03:46.296 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.290+0000 7f95b77fe6c0 1 --2- 10.20.193.92:0/1267962860 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f95b810c2d0 0x7f95b8121ab0 secure :-1 s=READY pgs=285 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95a800b710 tx=0x7f95a800bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:03:46.296 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.291+0000 7f95b57fa6c0 1 -- 10.20.193.92:0/1267962860 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f95a8004250 con 0x7f95b810c2d0 2026-02-13T04:03:46.296 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.291+0000 7f95b57fa6c0 1 -- 10.20.193.92:0/1267962860 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f95a8009070 con 0x7f95b810c2d0 2026-02-13T04:03:46.296 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.291+0000 7f95b57fa6c0 1 -- 10.20.193.92:0/1267962860 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f95a80071c0 con 0x7f95b810c2d0 2026-02-13T04:03:46.296 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.291+0000 7f95bd5846c0 1 -- 10.20.193.92:0/1267962860 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95b8127ad0 con 0x7f95b810c2d0 2026-02-13T04:03:46.296 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.291+0000 7f95bd5846c0 1 -- 10.20.193.92:0/1267962860 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95b81681b0 con 0x7f95b810c2d0 2026-02-13T04:03:46.296 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.291+0000 7f958affd6c0 1 -- 10.20.193.92:0/1267962860 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95b8127cf0 con 0x7f95b810c2d0 2026-02-13T04:03:46.297 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.293+0000 7f95b57fa6c0 1 -- 10.20.193.92:0/1267962860 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f95a80043b0 con 0x7f95b810c2d0 2026-02-13T04:03:46.298 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.295+0000 7f95b57fa6c0 1 --2- 10.20.193.92:0/1267962860 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f958c0b56d0 0x7f958c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:46.298 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.295+0000 7f95b57fa6c0 1 -- 10.20.193.92:0/1267962860 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f95a80e3ba0 con 0x7f95b810c2d0 2026-02-13T04:03:46.298 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.295+0000 7f95b7fff6c0 1 --2- 10.20.193.92:0/1267962860 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f958c0b56d0 0x7f958c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:46.298 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.295+0000 7f95b57fa6c0 1 -- 10.20.193.92:0/1267962860 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f95a811c600 con 0x7f95b810c2d0 2026-02-13T04:03:46.298 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.296+0000 7f95b7fff6c0 1 --2- 10.20.193.92:0/1267962860 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f958c0b56d0 0x7f958c0d5b80 secure :-1 s=READY pgs=229 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95a4004750 tx=0x7f95a4009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:03:46.421 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.418+0000 7f958affd6c0 1 -- 10.20.193.92:0/1267962860 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f95b810bcb0 con 0x7f95b810c2d0 2026-02-13T04:03:46.421 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.418+0000 7f95b57fa6c0 1 -- 10.20.193.92:0/1267962860 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f95a80a6540 con 0x7f95b810c2d0 2026-02-13T04:03:46.422 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:03:46.422 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:03:46.424 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.420+0000 7f958affd6c0 1 -- 10.20.193.92:0/1267962860 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f958c0b56d0 msgr2=0x7f958c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:46.424 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.420+0000 7f958affd6c0 1 --2- 10.20.193.92:0/1267962860 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f958c0b56d0 0x7f958c0d5b80 secure :-1 s=READY pgs=229 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95a4004750 tx=0x7f95a4009260 comp rx=0 tx=0).stop 2026-02-13T04:03:46.424 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.420+0000 7f958affd6c0 1 -- 10.20.193.92:0/1267962860 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f95b810c2d0 msgr2=0x7f95b8121ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:46.424 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.420+0000 7f958affd6c0 1 --2- 10.20.193.92:0/1267962860 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f95b810c2d0 0x7f95b8121ab0 secure :-1 s=READY pgs=285 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95a800b710 tx=0x7f95a800bbe0 comp rx=0 tx=0).stop 2026-02-13T04:03:46.424 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.420+0000 7f958affd6c0 1 -- 10.20.193.92:0/1267962860 shutdown_connections 2026-02-13T04:03:46.424 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.420+0000 7f958affd6c0 1 --2- 10.20.193.92:0/1267962860 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f95b8110ef0 0x7f95b8126e70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:46.424 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.420+0000 7f958affd6c0 1 --2- 10.20.193.92:0/1267962860 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f95b810c2d0 0x7f95b8121ab0 unknown :-1 s=CLOSED pgs=285 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:46.424 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.420+0000 7f958affd6c0 1 --2- 10.20.193.92:0/1267962860 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f958c0b56d0 0x7f958c0d5b80 unknown :-1 s=CLOSED pgs=229 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:46.424 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.420+0000 7f958affd6c0 1 --2- 10.20.193.92:0/1267962860 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f95b810b8e0 0x7f95b8121570 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:46.425 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.420+0000 7f958affd6c0 1 -- 10.20.193.92:0/1267962860 >> 10.20.193.92:0/1267962860 conn(0x7f95b80e9570 msgr2=0x7f95b8109950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:03:46.425 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.421+0000 7f958affd6c0 1 -- 10.20.193.92:0/1267962860 shutdown_connections 2026-02-13T04:03:46.425 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:46.421+0000 7f958affd6c0 1 -- 10.20.193.92:0/1267962860 wait complete. 2026-02-13T04:03:47.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:46 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/1267962860' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:47.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:46 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/1267962860' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:47.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:46 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1267962860' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:48.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:47 trial158 ceph-mon[27763]: pgmap v271: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:03:48.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:47 trial099 ceph-mon[27808]: pgmap v271: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:03:48.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:47 trial092 ceph-mon[23047]: pgmap v271: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:03:49.526 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:03:49.710 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:03:49.840 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:49 trial092 ceph-mon[23047]: pgmap v272: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:03:49.911 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:49.908+0000 7feb408076c0 1 -- 10.20.193.92:0/4061513118 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7feb38114190 msgr2=0x7feb38119140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:49.911 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:49.908+0000 7feb408076c0 1 --2- 10.20.193.92:0/4061513118 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7feb38114190 0x7feb38119140 secure :-1 s=READY pgs=286 gs=1 cs=0 l=1 c_cookie=14961565165265061459 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb24009970 tx=0x7feb2402ed50 comp rx=0 tx=0).stop 2026-02-13T04:03:49.911 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:49.908+0000 7feb408076c0 1 -- 10.20.193.92:0/4061513118 shutdown_connections 2026-02-13T04:03:49.911 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:49.908+0000 7feb408076c0 1 --2- 10.20.193.92:0/4061513118 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7feb381198f0 0x7feb3817a2c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:49.911 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:49.908+0000 7feb408076c0 1 --2- 10.20.193.92:0/4061513118 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7feb38114190 0x7feb38119140 unknown :-1 s=CLOSED pgs=286 gs=1 cs=0 l=1 c_cookie=14961565165265061459 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:49.911 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:49.908+0000 7feb408076c0 1 --2- 10.20.193.92:0/4061513118 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7feb381137a0 0x7feb38113b70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:49.912 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:49.908+0000 7feb408076c0 1 -- 10.20.193.92:0/4061513118 >> 10.20.193.92:0/4061513118 conn(0x7feb38060760 msgr2=0x7feb38060d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:03:49.912 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:49.908+0000 7feb408076c0 1 -- 10.20.193.92:0/4061513118 shutdown_connections 2026-02-13T04:03:49.912 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:49.908+0000 7feb408076c0 1 -- 10.20.193.92:0/4061513118 wait complete. 2026-02-13T04:03:49.913 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:49.909+0000 7feb408076c0 1 Processor -- start 2026-02-13T04:03:49.914 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:49.909+0000 7feb408076c0 1 -- start start 2026-02-13T04:03:49.914 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:49.909+0000 7feb408076c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7feb381137a0 0x7feb38121510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:49.914 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:49.909+0000 7feb408076c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7feb381198f0 0x7feb38121a50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:49.914 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:49.909+0000 7feb408076c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7feb38126e10 0x7feb381272b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:49.914 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:49.909+0000 7feb408076c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7feb38127820 con 0x7feb38126e10 2026-02-13T04:03:49.914 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:49.909+0000 7feb408076c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7feb38127990 con 0x7feb381137a0 2026-02-13T04:03:49.914 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:49.909+0000 7feb408076c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7feb38127b50 con 0x7feb381198f0 2026-02-13T04:03:49.914 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:49.909+0000 7feb3ed796c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7feb38126e10 0x7feb381272b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:49.914 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:49.909+0000 7feb3dd776c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7feb381198f0 0x7feb38121a50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:49.914 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:49.909+0000 7feb3e5786c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7feb381137a0 0x7feb38121510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:49.915 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:49.909+0000 7feb3ed796c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7feb38126e10 0x7feb381272b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:49418/0 (socket says 10.20.193.92:49418) 2026-02-13T04:03:49.915 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:49.909+0000 7feb3ed796c0 1 -- 10.20.193.92:0/77435800 learned_addr learned my addr 10.20.193.92:0/77435800 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:03:49.915 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:49.909+0000 7feb3e5786c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7feb381137a0 0x7feb38121510 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:38892/0 (socket says 10.20.193.92:38892) 2026-02-13T04:03:49.915 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:49.909+0000 7feb3ed796c0 1 -- 10.20.193.92:0/77435800 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7feb381198f0 msgr2=0x7feb38121a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:49.915 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:49.909+0000 7feb3ed796c0 1 --2- 10.20.193.92:0/77435800 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7feb381198f0 0x7feb38121a50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:49.915 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:49.909+0000 7feb3ed796c0 1 -- 10.20.193.92:0/77435800 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7feb381137a0 msgr2=0x7feb38121510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:49.915 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:49.909+0000 7feb3ed796c0 1 --2- 10.20.193.92:0/77435800 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7feb381137a0 0x7feb38121510 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:49.915 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:49.910+0000 7feb3ed796c0 1 -- 10.20.193.92:0/77435800 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb24009590 con 0x7feb38126e10 2026-02-13T04:03:49.915 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:49.910+0000 7feb3e5786c0 1 --2- 10.20.193.92:0/77435800 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7feb381137a0 0x7feb38121510 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T04:03:49.915 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:49.910+0000 7feb3ed796c0 1 --2- 10.20.193.92:0/77435800 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7feb38126e10 0x7feb381272b0 secure :-1 s=READY pgs=287 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb2c006ea0 tx=0x7feb2c00ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:03:49.915 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:49.910+0000 7feb237fe6c0 1 -- 10.20.193.92:0/77435800 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb2c003c40 con 0x7feb38126e10 2026-02-13T04:03:49.915 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:49.910+0000 7feb237fe6c0 1 -- 10.20.193.92:0/77435800 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7feb2c003da0 con 0x7feb38126e10 2026-02-13T04:03:49.916 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:49.910+0000 7feb408076c0 1 -- 10.20.193.92:0/77435800 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb38168000 con 0x7feb38126e10 2026-02-13T04:03:49.916 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:49.910+0000 7feb237fe6c0 1 -- 10.20.193.92:0/77435800 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7feb2c008440 con 0x7feb38126e10 2026-02-13T04:03:49.916 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:49.910+0000 7feb408076c0 1 -- 10.20.193.92:0/77435800 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb381684e0 con 0x7feb38126e10 2026-02-13T04:03:49.916 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:49.910+0000 7feb408076c0 1 -- 10.20.193.92:0/77435800 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb381149e0 con 0x7feb38126e10 2026-02-13T04:03:49.916 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:49.913+0000 7feb237fe6c0 1 -- 10.20.193.92:0/77435800 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7feb2c00d690 con 0x7feb38126e10 2026-02-13T04:03:49.917 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:49.914+0000 7feb237fe6c0 1 --2- 10.20.193.92:0/77435800 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7feb140b56d0 0x7feb140d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:49.917 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:49.915+0000 7feb237fe6c0 1 -- 10.20.193.92:0/77435800 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7feb2c0e4b60 con 0x7feb38126e10 2026-02-13T04:03:49.917 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:49.915+0000 7feb3e5786c0 1 --2- 10.20.193.92:0/77435800 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7feb140b56d0 0x7feb140d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:49.918 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:49.915+0000 7feb237fe6c0 1 -- 10.20.193.92:0/77435800 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7feb2c11d5e0 con 0x7feb38126e10 2026-02-13T04:03:49.918 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:49.915+0000 7feb3e5786c0 1 --2- 10.20.193.92:0/77435800 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7feb140b56d0 0x7feb140d5b80 secure :-1 s=READY pgs=230 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb30004750 tx=0x7feb30009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:03:50.040 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:50.037+0000 7feb408076c0 1 -- 10.20.193.92:0/77435800 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7feb38122690 con 0x7feb38126e10 2026-02-13T04:03:50.040 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:50.037+0000 7feb237fe6c0 1 -- 10.20.193.92:0/77435800 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7feb2c0a7500 con 0x7feb38126e10 2026-02-13T04:03:50.040 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:03:50.041 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:03:50.042 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:50.038+0000 7feb408076c0 1 -- 10.20.193.92:0/77435800 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7feb140b56d0 msgr2=0x7feb140d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:50.042 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:50.038+0000 7feb408076c0 1 --2- 10.20.193.92:0/77435800 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7feb140b56d0 0x7feb140d5b80 secure :-1 s=READY pgs=230 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb30004750 tx=0x7feb30009260 comp rx=0 tx=0).stop 2026-02-13T04:03:50.042 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:50.038+0000 7feb408076c0 1 -- 10.20.193.92:0/77435800 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7feb38126e10 msgr2=0x7feb381272b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:50.042 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:50.038+0000 7feb408076c0 1 --2- 10.20.193.92:0/77435800 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7feb38126e10 0x7feb381272b0 secure :-1 s=READY pgs=287 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb2c006ea0 tx=0x7feb2c00ce50 comp rx=0 tx=0).stop 2026-02-13T04:03:50.042 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:50.039+0000 7feb408076c0 1 -- 10.20.193.92:0/77435800 shutdown_connections 2026-02-13T04:03:50.042 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:50.039+0000 7feb408076c0 1 --2- 10.20.193.92:0/77435800 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7feb38126e10 0x7feb381272b0 unknown :-1 s=CLOSED pgs=287 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:50.042 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:50.039+0000 7feb408076c0 1 --2- 10.20.193.92:0/77435800 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7feb381198f0 0x7feb38121a50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:50.042 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:50.039+0000 7feb408076c0 1 --2- 10.20.193.92:0/77435800 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7feb140b56d0 0x7feb140d5b80 unknown :-1 s=CLOSED pgs=230 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:50.042 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:50.039+0000 7feb408076c0 1 --2- 10.20.193.92:0/77435800 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7feb381137a0 0x7feb38121510 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:50.043 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:50.039+0000 7feb408076c0 1 -- 10.20.193.92:0/77435800 >> 10.20.193.92:0/77435800 conn(0x7feb38060760 msgr2=0x7feb38117740 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:03:50.043 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:50.039+0000 7feb408076c0 1 -- 10.20.193.92:0/77435800 shutdown_connections 2026-02-13T04:03:50.043 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:50.039+0000 7feb408076c0 1 -- 10.20.193.92:0/77435800 wait complete. 2026-02-13T04:03:50.078 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:49 trial158 ceph-mon[27763]: pgmap v272: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:03:50.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:49 trial099 ceph-mon[27808]: pgmap v272: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:03:51.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:50 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/77435800' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:51.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:50 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/77435800' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:51.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:50 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/77435800' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:52.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:51 trial158 ceph-mon[27763]: pgmap v273: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T04:03:52.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:51 trial099 ceph-mon[27808]: pgmap v273: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T04:03:52.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:51 trial092 ceph-mon[23047]: pgmap v273: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T04:03:53.145 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:03:53.330 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:03:53.525 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.521+0000 7f08449c26c0 1 -- 10.20.193.92:0/1201120681 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f084011b3f0 msgr2=0x7f084011b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:53.525 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.521+0000 7f08449c26c0 1 --2- 10.20.193.92:0/1201120681 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f084011b3f0 0x7f084011b7c0 secure :-1 s=READY pgs=288 gs=1 cs=0 l=1 c_cookie=9071717451097656537 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0834009970 tx=0x7f083402ed50 comp rx=0 tx=0).stop 2026-02-13T04:03:53.525 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.522+0000 7f08449c26c0 1 -- 10.20.193.92:0/1201120681 shutdown_connections 2026-02-13T04:03:53.526 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.522+0000 7f08449c26c0 1 --2- 10.20.193.92:0/1201120681 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f08401199a0 0x7f0840116df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:53.526 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.522+0000 7f08449c26c0 1 --2- 10.20.193.92:0/1201120681 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f0840118f30 0x7f0840119380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:53.526 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.522+0000 7f08449c26c0 1 --2- 10.20.193.92:0/1201120681 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f084011b3f0 0x7f084011b7c0 unknown :-1 s=CLOSED pgs=288 gs=1 cs=0 l=1 c_cookie=9071717451097656537 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:53.526 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.522+0000 7f08449c26c0 1 -- 10.20.193.92:0/1201120681 >> 10.20.193.92:0/1201120681 conn(0x7f084005b290 msgr2=0x7f084005b690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:03:53.526 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.522+0000 7f08449c26c0 1 -- 10.20.193.92:0/1201120681 shutdown_connections 2026-02-13T04:03:53.526 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.522+0000 7f08449c26c0 1 -- 10.20.193.92:0/1201120681 wait complete. 2026-02-13T04:03:53.526 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.522+0000 7f08449c26c0 1 Processor -- start 2026-02-13T04:03:53.526 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.522+0000 7f08449c26c0 1 -- start start 2026-02-13T04:03:53.528 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.523+0000 7f08449c26c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f0840118f30 0x7f08400fdae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:53.528 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.523+0000 7f08449c26c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f08401199a0 0x7f08400fe020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:53.528 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.523+0000 7f08449c26c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f084011b3f0 0x7f08401033e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:53.528 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.523+0000 7f08449c26c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0840103a30 con 0x7f08401199a0 2026-02-13T04:03:53.528 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.523+0000 7f08449c26c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0840103ba0 con 0x7f084011b3f0 2026-02-13T04:03:53.528 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.523+0000 7f08449c26c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f0840103d60 con 0x7f0840118f30 2026-02-13T04:03:53.528 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.523+0000 7f083ed766c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f0840118f30 0x7f08400fdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:53.528 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.523+0000 7f083e5756c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f08401199a0 0x7f08400fe020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:53.529 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.523+0000 7f083ed766c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f0840118f30 0x7f08400fdae0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:58542/0 (socket says 10.20.193.92:58542) 2026-02-13T04:03:53.529 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.523+0000 7f083ed766c0 1 -- 10.20.193.92:0/776690781 learned_addr learned my addr 10.20.193.92:0/776690781 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:03:53.529 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.523+0000 7f083f5776c0 1 --2- 10.20.193.92:0/776690781 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f084011b3f0 0x7f08401033e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:53.529 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.523+0000 7f083e5756c0 1 -- 10.20.193.92:0/776690781 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f0840118f30 msgr2=0x7f08400fdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:53.529 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.523+0000 7f083e5756c0 1 --2- 10.20.193.92:0/776690781 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f0840118f30 0x7f08400fdae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:53.529 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.523+0000 7f083e5756c0 1 -- 10.20.193.92:0/776690781 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f084011b3f0 msgr2=0x7f08401033e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:53.529 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.523+0000 7f083e5756c0 1 --2- 10.20.193.92:0/776690781 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f084011b3f0 0x7f08401033e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:53.529 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.523+0000 7f083e5756c0 1 -- 10.20.193.92:0/776690781 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0834009590 con 0x7f08401199a0 2026-02-13T04:03:53.529 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.523+0000 7f083e5756c0 1 --2- 10.20.193.92:0/776690781 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f08401199a0 0x7f08400fe020 secure :-1 s=READY pgs=289 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f082800b6c0 tx=0x7f082800bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:03:53.529 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.524+0000 7f081ffff6c0 1 -- 10.20.193.92:0/776690781 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0828004240 con 0x7f08401199a0 2026-02-13T04:03:53.529 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.524+0000 7f081ffff6c0 1 -- 10.20.193.92:0/776690781 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f0828009030 con 0x7f08401199a0 2026-02-13T04:03:53.529 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.524+0000 7f08449c26c0 1 -- 10.20.193.92:0/776690781 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0840104040 con 0x7f08401199a0 2026-02-13T04:03:53.530 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.524+0000 7f081ffff6c0 1 -- 10.20.193.92:0/776690781 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0828003960 con 0x7f08401199a0 2026-02-13T04:03:53.530 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.524+0000 7f08449c26c0 1 -- 10.20.193.92:0/776690781 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0840104700 con 0x7f08401199a0 2026-02-13T04:03:53.530 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.524+0000 7f08449c26c0 1 -- 10.20.193.92:0/776690781 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f084005e670 con 0x7f08401199a0 2026-02-13T04:03:53.530 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.526+0000 7f081ffff6c0 1 -- 10.20.193.92:0/776690781 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f08280043a0 con 0x7f08401199a0 2026-02-13T04:03:53.531 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.528+0000 7f081ffff6c0 1 --2- 10.20.193.92:0/776690781 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f08100b56d0 0x7f08100d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:53.531 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.528+0000 7f081ffff6c0 1 -- 10.20.193.92:0/776690781 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f08280e3970 con 0x7f08401199a0 2026-02-13T04:03:53.531 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.528+0000 7f083ed766c0 1 --2- 10.20.193.92:0/776690781 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f08100b56d0 0x7f08100d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:53.531 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.528+0000 7f081ffff6c0 1 -- 10.20.193.92:0/776690781 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f08280e3df0 con 0x7f08401199a0 2026-02-13T04:03:53.532 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.529+0000 7f083ed766c0 1 --2- 10.20.193.92:0/776690781 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f08100b56d0 0x7f08100d5b80 secure :-1 s=READY pgs=231 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08340023e0 tx=0x7f0834005910 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:03:53.655 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.652+0000 7f08449c26c0 1 -- 10.20.193.92:0/776690781 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0840186160 con 0x7f08401199a0 2026-02-13T04:03:53.655 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.652+0000 7f081ffff6c0 1 -- 10.20.193.92:0/776690781 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f08280a6310 con 0x7f08401199a0 2026-02-13T04:03:53.655 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:03:53.655 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:03:53.656 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.653+0000 7f08449c26c0 1 -- 10.20.193.92:0/776690781 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f08100b56d0 msgr2=0x7f08100d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:53.656 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.653+0000 7f08449c26c0 1 --2- 10.20.193.92:0/776690781 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f08100b56d0 0x7f08100d5b80 secure :-1 s=READY pgs=231 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08340023e0 tx=0x7f0834005910 comp rx=0 tx=0).stop 2026-02-13T04:03:53.656 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.653+0000 7f08449c26c0 1 -- 10.20.193.92:0/776690781 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f08401199a0 msgr2=0x7f08400fe020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:53.657 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.653+0000 7f08449c26c0 1 --2- 10.20.193.92:0/776690781 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f08401199a0 0x7f08400fe020 secure :-1 s=READY pgs=289 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f082800b6c0 tx=0x7f082800bb90 comp rx=0 tx=0).stop 2026-02-13T04:03:53.657 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.653+0000 7f08449c26c0 1 -- 10.20.193.92:0/776690781 shutdown_connections 2026-02-13T04:03:53.657 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.653+0000 7f08449c26c0 1 --2- 10.20.193.92:0/776690781 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f08100b56d0 0x7f08100d5b80 unknown :-1 s=CLOSED pgs=231 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:53.657 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.653+0000 7f08449c26c0 1 --2- 10.20.193.92:0/776690781 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f084011b3f0 0x7f08401033e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:53.657 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.653+0000 7f08449c26c0 1 --2- 10.20.193.92:0/776690781 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f08401199a0 0x7f08400fe020 unknown :-1 s=CLOSED pgs=289 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:53.657 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.653+0000 7f08449c26c0 1 --2- 10.20.193.92:0/776690781 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f0840118f30 0x7f08400fdae0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:53.657 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.653+0000 7f08449c26c0 1 -- 10.20.193.92:0/776690781 >> 10.20.193.92:0/776690781 conn(0x7f084005b290 msgr2=0x7f08400f4200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:03:53.657 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.653+0000 7f08449c26c0 1 -- 10.20.193.92:0/776690781 shutdown_connections 2026-02-13T04:03:53.657 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:53.653+0000 7f08449c26c0 1 -- 10.20.193.92:0/776690781 wait complete. 2026-02-13T04:03:54.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:53 trial158 ceph-mon[27763]: pgmap v274: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:03:54.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:53 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/776690781' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:54.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:53 trial099 ceph-mon[27808]: pgmap v274: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:03:54.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:53 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/776690781' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:54.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:53 trial092 ceph-mon[23047]: pgmap v274: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:03:54.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:53 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/776690781' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:55.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:54 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:03:55.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:54 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:03:55.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:54 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:03:55.943 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:55 trial158 ceph-mon[27763]: pgmap v275: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:03:55.943 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:55 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:03:55.944 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:55 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:03:55.944 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:55 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:03:55.944 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:55 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:03:55.944 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:55 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:03:55.944 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:55 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:03:56.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:55 trial099 ceph-mon[27808]: pgmap v275: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:03:56.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:55 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:03:56.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:55 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:03:56.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:55 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:03:56.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:55 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:03:56.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:55 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:03:56.117 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:55 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:03:56.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:55 trial092 ceph-mon[23047]: pgmap v275: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:03:56.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:55 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:03:56.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:55 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:03:56.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:55 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:03:56.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:55 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:03:56.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:55 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:03:56.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:55 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:03:56.792 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:03:56.974 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:03:57.018 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:56 trial092 ceph-mon[23047]: pgmap v276: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:03:57.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:56 trial158 ceph-mon[27763]: pgmap v276: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:03:57.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:56 trial099 ceph-mon[27808]: pgmap v276: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:03:57.173 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.170+0000 7fdc3cf7d6c0 1 -- 10.20.193.92:0/3947618710 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdc3810fa50 msgr2=0x7fdc38114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:57.173 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.170+0000 7fdc3cf7d6c0 1 --2- 10.20.193.92:0/3947618710 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdc3810fa50 0x7fdc38114a90 secure :-1 s=READY pgs=290 gs=1 cs=0 l=1 c_cookie=8399722092491340568 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc200099a0 tx=0x7fdc2002ed00 comp rx=0 tx=0).stop 2026-02-13T04:03:57.173 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.170+0000 7fdc3cf7d6c0 1 -- 10.20.193.92:0/3947618710 shutdown_connections 2026-02-13T04:03:57.174 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.170+0000 7fdc3cf7d6c0 1 --2- 10.20.193.92:0/3947618710 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fdc38115270 0x7fdc38175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:57.174 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.170+0000 7fdc3cf7d6c0 1 --2- 10.20.193.92:0/3947618710 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdc3810fa50 0x7fdc38114a90 unknown :-1 s=CLOSED pgs=290 gs=1 cs=0 l=1 c_cookie=8399722092491340568 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:57.174 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.170+0000 7fdc3cf7d6c0 1 --2- 10.20.193.92:0/3947618710 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fdc3810f060 0x7fdc3810f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:57.174 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.170+0000 7fdc3cf7d6c0 1 -- 10.20.193.92:0/3947618710 >> 10.20.193.92:0/3947618710 conn(0x7fdc380ec980 msgr2=0x7fdc3810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:03:57.174 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.170+0000 7fdc3cf7d6c0 1 -- 10.20.193.92:0/3947618710 shutdown_connections 2026-02-13T04:03:57.174 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.170+0000 7fdc3cf7d6c0 1 -- 10.20.193.92:0/3947618710 wait complete. 2026-02-13T04:03:57.174 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.171+0000 7fdc3cf7d6c0 1 Processor -- start 2026-02-13T04:03:57.174 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.171+0000 7fdc3cf7d6c0 1 -- start start 2026-02-13T04:03:57.176 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.171+0000 7fdc3cf7d6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fdc3810f060 0x7fdc380f49b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:57.176 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.171+0000 7fdc3cf7d6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdc38115270 0x7fdc38175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:57.176 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.171+0000 7fdc3cf7d6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fdc380f4fe0 0x7fdc380fa2b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:57.176 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.171+0000 7fdc3cf7d6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdc380f56d0 con 0x7fdc38115270 2026-02-13T04:03:57.176 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.171+0000 7fdc3cf7d6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fdc380fa7f0 con 0x7fdc3810f060 2026-02-13T04:03:57.176 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.171+0000 7fdc3cf7d6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fdc380fa9b0 con 0x7fdc380f4fe0 2026-02-13T04:03:57.176 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.171+0000 7fdc365756c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fdc3810f060 0x7fdc380f49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:57.176 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.171+0000 7fdc35d746c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdc38115270 0x7fdc38175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:57.176 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.171+0000 7fdc365756c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fdc3810f060 0x7fdc380f49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:57526/0 (socket says 10.20.193.92:57526) 2026-02-13T04:03:57.177 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.171+0000 7fdc365756c0 1 -- 10.20.193.92:0/1337563608 learned_addr learned my addr 10.20.193.92:0/1337563608 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:03:57.177 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.171+0000 7fdc36d766c0 1 --2- 10.20.193.92:0/1337563608 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fdc380f4fe0 0x7fdc380fa2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:57.177 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.171+0000 7fdc35d746c0 1 -- 10.20.193.92:0/1337563608 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fdc380f4fe0 msgr2=0x7fdc380fa2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:57.177 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.171+0000 7fdc35d746c0 1 --2- 10.20.193.92:0/1337563608 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fdc380f4fe0 0x7fdc380fa2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:57.177 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.171+0000 7fdc35d746c0 1 -- 10.20.193.92:0/1337563608 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fdc3810f060 msgr2=0x7fdc380f49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:57.177 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.171+0000 7fdc35d746c0 1 --2- 10.20.193.92:0/1337563608 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fdc3810f060 0x7fdc380f49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:57.177 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.171+0000 7fdc35d746c0 1 -- 10.20.193.92:0/1337563608 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc20009590 con 0x7fdc38115270 2026-02-13T04:03:57.177 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.172+0000 7fdc35d746c0 1 --2- 10.20.193.92:0/1337563608 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdc38115270 0x7fdc38175b10 secure :-1 s=READY pgs=291 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc2002f210 tx=0x7fdc2002f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:03:57.177 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.172+0000 7fdc1f7fe6c0 1 -- 10.20.193.92:0/1337563608 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdc200046b0 con 0x7fdc38115270 2026-02-13T04:03:57.177 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.172+0000 7fdc3cf7d6c0 1 -- 10.20.193.92:0/1337563608 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc380fac30 con 0x7fdc38115270 2026-02-13T04:03:57.177 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.172+0000 7fdc1f7fe6c0 1 -- 10.20.193.92:0/1337563608 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fdc20002be0 con 0x7fdc38115270 2026-02-13T04:03:57.177 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.172+0000 7fdc1f7fe6c0 1 -- 10.20.193.92:0/1337563608 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fdc200073f0 con 0x7fdc38115270 2026-02-13T04:03:57.178 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.172+0000 7fdc3cf7d6c0 1 -- 10.20.193.92:0/1337563608 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc380fb100 con 0x7fdc38115270 2026-02-13T04:03:57.178 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.172+0000 7fdc3cf7d6c0 1 -- 10.20.193.92:0/1337563608 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc38110330 con 0x7fdc38115270 2026-02-13T04:03:57.178 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.174+0000 7fdc1f7fe6c0 1 -- 10.20.193.92:0/1337563608 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fdc200026b0 con 0x7fdc38115270 2026-02-13T04:03:57.179 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.176+0000 7fdc1f7fe6c0 1 --2- 10.20.193.92:0/1337563608 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fdc100b56d0 0x7fdc100d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:03:57.179 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.176+0000 7fdc1f7fe6c0 1 -- 10.20.193.92:0/1337563608 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7fdc20107b60 con 0x7fdc38115270 2026-02-13T04:03:57.179 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.176+0000 7fdc1f7fe6c0 1 -- 10.20.193.92:0/1337563608 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fdc201405e0 con 0x7fdc38115270 2026-02-13T04:03:57.179 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.176+0000 7fdc365756c0 1 --2- 10.20.193.92:0/1337563608 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fdc100b56d0 0x7fdc100d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:03:57.180 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.177+0000 7fdc365756c0 1 --2- 10.20.193.92:0/1337563608 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fdc100b56d0 0x7fdc100d5b80 secure :-1 s=READY pgs=232 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc2c00a340 tx=0x7fdc2c00a520 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:03:57.302 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.300+0000 7fdc3cf7d6c0 1 -- 10.20.193.92:0/1337563608 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fdc380f5b00 con 0x7fdc38115270 2026-02-13T04:03:57.303 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.300+0000 7fdc1f7fe6c0 1 -- 10.20.193.92:0/1337563608 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fdc200ca500 con 0x7fdc38115270 2026-02-13T04:03:57.303 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:03:57.303 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:03:57.304 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.301+0000 7fdc3cf7d6c0 1 -- 10.20.193.92:0/1337563608 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fdc100b56d0 msgr2=0x7fdc100d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:57.304 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.301+0000 7fdc3cf7d6c0 1 --2- 10.20.193.92:0/1337563608 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fdc100b56d0 0x7fdc100d5b80 secure :-1 s=READY pgs=232 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc2c00a340 tx=0x7fdc2c00a520 comp rx=0 tx=0).stop 2026-02-13T04:03:57.304 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.301+0000 7fdc3cf7d6c0 1 -- 10.20.193.92:0/1337563608 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdc38115270 msgr2=0x7fdc38175b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:03:57.304 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.301+0000 7fdc3cf7d6c0 1 --2- 10.20.193.92:0/1337563608 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdc38115270 0x7fdc38175b10 secure :-1 s=READY pgs=291 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdc2002f210 tx=0x7fdc2002f810 comp rx=0 tx=0).stop 2026-02-13T04:03:57.305 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.301+0000 7fdc3cf7d6c0 1 -- 10.20.193.92:0/1337563608 shutdown_connections 2026-02-13T04:03:57.305 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.301+0000 7fdc3cf7d6c0 1 --2- 10.20.193.92:0/1337563608 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fdc380f4fe0 0x7fdc380fa2b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:57.305 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.301+0000 7fdc3cf7d6c0 1 --2- 10.20.193.92:0/1337563608 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fdc38115270 0x7fdc38175b10 unknown :-1 s=CLOSED pgs=291 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:57.305 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.301+0000 7fdc3cf7d6c0 1 --2- 10.20.193.92:0/1337563608 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fdc100b56d0 0x7fdc100d5b80 unknown :-1 s=CLOSED pgs=232 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:57.305 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.301+0000 7fdc3cf7d6c0 1 --2- 10.20.193.92:0/1337563608 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fdc3810f060 0x7fdc380f49b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:03:57.305 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.301+0000 7fdc3cf7d6c0 1 -- 10.20.193.92:0/1337563608 >> 10.20.193.92:0/1337563608 conn(0x7fdc380ec980 msgr2=0x7fdc3810d680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:03:57.305 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.301+0000 7fdc3cf7d6c0 1 -- 10.20.193.92:0/1337563608 shutdown_connections 2026-02-13T04:03:57.305 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:03:57.301+0000 7fdc3cf7d6c0 1 -- 10.20.193.92:0/1337563608 wait complete. 2026-02-13T04:03:58.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:57 trial158 ceph-mon[27763]: pgmap v277: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T04:03:58.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:57 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/1337563608' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:58.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:57 trial099 ceph-mon[27808]: pgmap v277: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T04:03:58.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:57 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/1337563608' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:03:58.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:57 trial092 ceph-mon[23047]: pgmap v277: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T04:03:58.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:57 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1337563608' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:00.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:03:59 trial158 ceph-mon[27763]: pgmap v278: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 10 op/s 2026-02-13T04:04:00.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:03:59 trial099 ceph-mon[27808]: pgmap v278: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 10 op/s 2026-02-13T04:04:00.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:03:59 trial092 ceph-mon[23047]: pgmap v278: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 10 op/s 2026-02-13T04:04:00.409 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:04:00.595 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:04:00.804 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.801+0000 7f32308bb6c0 1 -- 10.20.193.92:0/1279733401 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f322c10f060 msgr2=0x7f322c10f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:00.804 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.801+0000 7f32308bb6c0 1 --2- 10.20.193.92:0/1279733401 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f322c10f060 0x7f322c10f430 secure :-1 s=READY pgs=292 gs=1 cs=0 l=1 c_cookie=3298595506992384863 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32180099a0 tx=0x7f321802ed50 comp rx=0 tx=0).stop 2026-02-13T04:04:00.805 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.801+0000 7f32308bb6c0 1 -- 10.20.193.92:0/1279733401 shutdown_connections 2026-02-13T04:04:00.805 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.801+0000 7f32308bb6c0 1 --2- 10.20.193.92:0/1279733401 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f322c10fa50 0x7f322c114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:00.805 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.801+0000 7f32308bb6c0 1 --2- 10.20.193.92:0/1279733401 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f322c115270 0x7f322c175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:00.805 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.801+0000 7f32308bb6c0 1 --2- 10.20.193.92:0/1279733401 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f322c10f060 0x7f322c10f430 unknown :-1 s=CLOSED pgs=292 gs=1 cs=0 l=1 c_cookie=3298595506992384863 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:00.805 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.801+0000 7f32308bb6c0 1 -- 10.20.193.92:0/1279733401 >> 10.20.193.92:0/1279733401 conn(0x7f322c0ec980 msgr2=0x7f322c10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:04:00.805 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.801+0000 7f32308bb6c0 1 -- 10.20.193.92:0/1279733401 shutdown_connections 2026-02-13T04:04:00.805 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.801+0000 7f32308bb6c0 1 -- 10.20.193.92:0/1279733401 wait complete. 2026-02-13T04:04:00.807 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.802+0000 7f32308bb6c0 1 Processor -- start 2026-02-13T04:04:00.807 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.802+0000 7f32308bb6c0 1 -- start start 2026-02-13T04:04:00.807 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.802+0000 7f32308bb6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f322c10f060 0x7f322c11ce10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:00.807 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.802+0000 7f32308bb6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f322c115270 0x7f322c11d350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:00.808 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.802+0000 7f32308bb6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f322c122710 0x7f322c122bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:00.808 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.802+0000 7f32308bb6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f322c123120 con 0x7f322c115270 2026-02-13T04:04:00.808 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.802+0000 7f32308bb6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f322c123290 con 0x7f322c122710 2026-02-13T04:04:00.808 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.802+0000 7f32308bb6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f322c123450 con 0x7f322c10f060 2026-02-13T04:04:00.808 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.803+0000 7f322affd6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f322c115270 0x7f322c11d350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:00.808 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.803+0000 7f322affd6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f322c115270 0x7f322c11d350 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:39238/0 (socket says 10.20.193.92:39238) 2026-02-13T04:04:00.808 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.803+0000 7f322affd6c0 1 -- 10.20.193.92:0/3166877203 learned_addr learned my addr 10.20.193.92:0/3166877203 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:04:00.808 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.803+0000 7f322b7fe6c0 1 --2- 10.20.193.92:0/3166877203 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f322c10f060 0x7f322c11ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:00.808 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.803+0000 7f322bfff6c0 1 --2- 10.20.193.92:0/3166877203 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f322c122710 0x7f322c122bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:00.808 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.803+0000 7f322affd6c0 1 -- 10.20.193.92:0/3166877203 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f322c10f060 msgr2=0x7f322c11ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:00.809 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.803+0000 7f322affd6c0 1 --2- 10.20.193.92:0/3166877203 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f322c10f060 0x7f322c11ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:00.809 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.803+0000 7f322affd6c0 1 -- 10.20.193.92:0/3166877203 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f322c122710 msgr2=0x7f322c122bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:00.809 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.803+0000 7f322affd6c0 1 --2- 10.20.193.92:0/3166877203 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f322c122710 0x7f322c122bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:00.809 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.803+0000 7f322affd6c0 1 -- 10.20.193.92:0/3166877203 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3218009590 con 0x7f322c115270 2026-02-13T04:04:00.809 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.803+0000 7f322affd6c0 1 --2- 10.20.193.92:0/3166877203 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f322c115270 0x7f322c11d350 secure :-1 s=READY pgs=293 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f321c00b6c0 tx=0x7f321c00bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:04:00.809 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.803+0000 7f3228ff96c0 1 -- 10.20.193.92:0/3166877203 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f321c0044a0 con 0x7f322c115270 2026-02-13T04:04:00.809 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.803+0000 7f3228ff96c0 1 -- 10.20.193.92:0/3166877203 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f321c00be50 con 0x7f322c115270 2026-02-13T04:04:00.809 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.803+0000 7f3228ff96c0 1 -- 10.20.193.92:0/3166877203 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f321c00e070 con 0x7f322c115270 2026-02-13T04:04:00.809 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.804+0000 7f32308bb6c0 1 -- 10.20.193.92:0/3166877203 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f322c163900 con 0x7f322c115270 2026-02-13T04:04:00.809 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.804+0000 7f32308bb6c0 1 -- 10.20.193.92:0/3166877203 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f322c163d90 con 0x7f322c115270 2026-02-13T04:04:00.809 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.804+0000 7f32308bb6c0 1 -- 10.20.193.92:0/3166877203 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f322c110330 con 0x7f322c115270 2026-02-13T04:04:00.810 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.806+0000 7f3228ff96c0 1 -- 10.20.193.92:0/3166877203 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f321c00c410 con 0x7f322c115270 2026-02-13T04:04:00.811 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.808+0000 7f3228ff96c0 1 --2- 10.20.193.92:0/3166877203 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f32000b56d0 0x7f32000d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:00.811 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.808+0000 7f3228ff96c0 1 -- 10.20.193.92:0/3166877203 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f321c0e3850 con 0x7f322c115270 2026-02-13T04:04:00.811 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.808+0000 7f322b7fe6c0 1 --2- 10.20.193.92:0/3166877203 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f32000b56d0 0x7f32000d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:00.811 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.808+0000 7f3228ff96c0 1 -- 10.20.193.92:0/3166877203 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f321c0e3cd0 con 0x7f322c115270 2026-02-13T04:04:00.812 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.809+0000 7f322b7fe6c0 1 --2- 10.20.193.92:0/3166877203 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f32000b56d0 0x7f32000d5b80 secure :-1 s=READY pgs=233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3218005b40 tx=0x7f32180023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:04:00.935 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.933+0000 7f32308bb6c0 1 -- 10.20.193.92:0/3166877203 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f322c11dfc0 con 0x7f322c115270 2026-02-13T04:04:00.936 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.933+0000 7f3228ff96c0 1 -- 10.20.193.92:0/3166877203 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f321c0a61f0 con 0x7f322c115270 2026-02-13T04:04:00.936 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:04:00.936 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:04:00.937 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.934+0000 7f32308bb6c0 1 -- 10.20.193.92:0/3166877203 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f32000b56d0 msgr2=0x7f32000d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:00.937 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.934+0000 7f32308bb6c0 1 --2- 10.20.193.92:0/3166877203 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f32000b56d0 0x7f32000d5b80 secure :-1 s=READY pgs=233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3218005b40 tx=0x7f32180023a0 comp rx=0 tx=0).stop 2026-02-13T04:04:00.937 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.934+0000 7f32308bb6c0 1 -- 10.20.193.92:0/3166877203 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f322c115270 msgr2=0x7f322c11d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:00.937 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.934+0000 7f32308bb6c0 1 --2- 10.20.193.92:0/3166877203 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f322c115270 0x7f322c11d350 secure :-1 s=READY pgs=293 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f321c00b6c0 tx=0x7f321c00bb90 comp rx=0 tx=0).stop 2026-02-13T04:04:00.938 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.934+0000 7f32308bb6c0 1 -- 10.20.193.92:0/3166877203 shutdown_connections 2026-02-13T04:04:00.938 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.934+0000 7f32308bb6c0 1 --2- 10.20.193.92:0/3166877203 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f32000b56d0 0x7f32000d5b80 unknown :-1 s=CLOSED pgs=233 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:00.938 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.934+0000 7f32308bb6c0 1 --2- 10.20.193.92:0/3166877203 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f322c122710 0x7f322c122bb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:00.938 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.934+0000 7f32308bb6c0 1 --2- 10.20.193.92:0/3166877203 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f322c115270 0x7f322c11d350 unknown :-1 s=CLOSED pgs=293 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:00.938 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.934+0000 7f32308bb6c0 1 --2- 10.20.193.92:0/3166877203 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f322c10f060 0x7f322c11ce10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:00.938 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.934+0000 7f32308bb6c0 1 -- 10.20.193.92:0/3166877203 >> 10.20.193.92:0/3166877203 conn(0x7f322c0ec980 msgr2=0x7f322c10cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:04:00.938 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.934+0000 7f32308bb6c0 1 -- 10.20.193.92:0/3166877203 shutdown_connections 2026-02-13T04:04:00.938 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:00.934+0000 7f32308bb6c0 1 -- 10.20.193.92:0/3166877203 wait complete. 2026-02-13T04:04:02.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:01 trial158 ceph-mon[27763]: pgmap v279: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T04:04:02.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:01 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/3166877203' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:02.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:01 trial099 ceph-mon[27808]: pgmap v279: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T04:04:02.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:01 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/3166877203' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:02.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:01 trial092 ceph-mon[23047]: pgmap v279: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T04:04:02.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:01 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/3166877203' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:04.040 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:04:04.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:03 trial158 ceph-mon[27763]: pgmap v280: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 10 op/s 2026-02-13T04:04:04.092 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:03 trial092 ceph-mon[23047]: pgmap v280: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 10 op/s 2026-02-13T04:04:04.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:03 trial099 ceph-mon[27808]: pgmap v280: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 10 op/s 2026-02-13T04:04:04.226 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:04:04.423 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.420+0000 7f1a0b0fc6c0 1 -- 10.20.193.92:0/3334841165 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1a04060ce0 msgr2=0x7f1a04061110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:04.423 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.420+0000 7f1a0b0fc6c0 1 --2- 10.20.193.92:0/3334841165 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1a04060ce0 0x7f1a04061110 secure :-1 s=READY pgs=294 gs=1 cs=0 l=1 c_cookie=12612976633055597045 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19ec009970 tx=0x7f19ec02ed10 comp rx=0 tx=0).stop 2026-02-13T04:04:04.423 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.421+0000 7f1a0b0fc6c0 1 -- 10.20.193.92:0/3334841165 shutdown_connections 2026-02-13T04:04:04.423 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.421+0000 7f1a0b0fc6c0 1 --2- 10.20.193.92:0/3334841165 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1a04159ac0 0x7f1a04179ea0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:04.423 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.421+0000 7f1a0b0fc6c0 1 --2- 10.20.193.92:0/3334841165 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1a04060ce0 0x7f1a04061110 unknown :-1 s=CLOSED pgs=294 gs=1 cs=0 l=1 c_cookie=12612976633055597045 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:04.423 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.421+0000 7f1a0b0fc6c0 1 --2- 10.20.193.92:0/3334841165 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1a040622d0 0x7f1a040607a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:04.423 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.421+0000 7f1a0b0fc6c0 1 -- 10.20.193.92:0/3334841165 >> 10.20.193.92:0/3334841165 conn(0x7f1a040ea880 msgr2=0x7f1a0410ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:04:04.423 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.421+0000 7f1a0b0fc6c0 1 -- 10.20.193.92:0/3334841165 shutdown_connections 2026-02-13T04:04:04.423 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.421+0000 7f1a0b0fc6c0 1 -- 10.20.193.92:0/3334841165 wait complete. 2026-02-13T04:04:04.423 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.421+0000 7f1a0b0fc6c0 1 Processor -- start 2026-02-13T04:04:04.424 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.421+0000 7f1a0b0fc6c0 1 -- start start 2026-02-13T04:04:04.424 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.422+0000 7f1a0b0fc6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1a04060ce0 0x7f1a040f20a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:04.424 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.422+0000 7f1a0b0fc6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1a040622d0 0x7f1a040f25e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:04.424 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.422+0000 7f1a0b0fc6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1a04159ac0 0x7f1a040f79a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:04.424 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.422+0000 7f1a0b0fc6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1a040f7ff0 con 0x7f1a04159ac0 2026-02-13T04:04:04.424 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.422+0000 7f1a0b0fc6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f1a040f8160 con 0x7f1a04060ce0 2026-02-13T04:04:04.424 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.422+0000 7f1a0b0fc6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f1a040f8320 con 0x7f1a040622d0 2026-02-13T04:04:04.425 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.422+0000 7f1a096726c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1a04159ac0 0x7f1a040f79a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:04.426 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.422+0000 7f1a096726c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1a04159ac0 0x7f1a040f79a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:39248/0 (socket says 10.20.193.92:39248) 2026-02-13T04:04:04.426 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.422+0000 7f1a096726c0 1 -- 10.20.193.92:0/4089329390 learned_addr learned my addr 10.20.193.92:0/4089329390 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:04:04.426 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.422+0000 7f19fbfff6c0 1 --2- 10.20.193.92:0/4089329390 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1a040622d0 0x7f1a040f25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:04.426 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.422+0000 7f1a08e716c0 1 --2- 10.20.193.92:0/4089329390 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1a04060ce0 0x7f1a040f20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:04.426 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.422+0000 7f1a096726c0 1 -- 10.20.193.92:0/4089329390 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1a040622d0 msgr2=0x7f1a040f25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:04.426 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.422+0000 7f1a096726c0 1 --2- 10.20.193.92:0/4089329390 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1a040622d0 0x7f1a040f25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:04.426 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.422+0000 7f1a096726c0 1 -- 10.20.193.92:0/4089329390 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1a04060ce0 msgr2=0x7f1a040f20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:04.426 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.422+0000 7f1a096726c0 1 --2- 10.20.193.92:0/4089329390 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1a04060ce0 0x7f1a040f20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:04.426 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.422+0000 7f1a096726c0 1 -- 10.20.193.92:0/4089329390 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f40094c0 con 0x7f1a04159ac0 2026-02-13T04:04:04.426 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.422+0000 7f1a096726c0 1 --2- 10.20.193.92:0/4089329390 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1a04159ac0 0x7f1a040f79a0 secure :-1 s=READY pgs=295 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1a00006ea0 tx=0x7f1a0000ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:04:04.427 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.422+0000 7f19f9ffb6c0 1 -- 10.20.193.92:0/4089329390 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1a00003c40 con 0x7f1a04159ac0 2026-02-13T04:04:04.427 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.422+0000 7f19f9ffb6c0 1 -- 10.20.193.92:0/4089329390 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f1a00003da0 con 0x7f1a04159ac0 2026-02-13T04:04:04.427 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.422+0000 7f19f9ffb6c0 1 -- 10.20.193.92:0/4089329390 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f1a00008440 con 0x7f1a04159ac0 2026-02-13T04:04:04.427 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.422+0000 7f1a0b0fc6c0 1 -- 10.20.193.92:0/4089329390 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19ec009590 con 0x7f1a04159ac0 2026-02-13T04:04:04.427 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.422+0000 7f1a0b0fc6c0 1 -- 10.20.193.92:0/4089329390 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a040f8b10 con 0x7f1a04159ac0 2026-02-13T04:04:04.427 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.423+0000 7f1a0b0fc6c0 1 -- 10.20.193.92:0/4089329390 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a04061cb0 con 0x7f1a04159ac0 2026-02-13T04:04:04.429 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.425+0000 7f19f9ffb6c0 1 -- 10.20.193.92:0/4089329390 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f1a0000d690 con 0x7f1a04159ac0 2026-02-13T04:04:04.430 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.427+0000 7f19f9ffb6c0 1 --2- 10.20.193.92:0/4089329390 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f19e00b56d0 0x7f19e00d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:04.430 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.427+0000 7f19f9ffb6c0 1 -- 10.20.193.92:0/4089329390 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f1a000e4d30 con 0x7f1a04159ac0 2026-02-13T04:04:04.430 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.427+0000 7f1a08e716c0 1 --2- 10.20.193.92:0/4089329390 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f19e00b56d0 0x7f19e00d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:04.430 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.427+0000 7f1a08e716c0 1 --2- 10.20.193.92:0/4089329390 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f19e00b56d0 0x7f19e00d5b80 secure :-1 s=READY pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19f4004750 tx=0x7f19f4009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:04:04.430 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.428+0000 7f19f9ffb6c0 1 -- 10.20.193.92:0/4089329390 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f1a000a76d0 con 0x7f1a04159ac0 2026-02-13T04:04:04.555 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.552+0000 7f1a0b0fc6c0 1 -- 10.20.193.92:0/4089329390 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1a040f31f0 con 0x7f1a04159ac0 2026-02-13T04:04:04.555 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.552+0000 7f19f9ffb6c0 1 -- 10.20.193.92:0/4089329390 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f1a000aa880 con 0x7f1a04159ac0 2026-02-13T04:04:04.555 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:04:04.555 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:04:04.556 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.553+0000 7f1a0b0fc6c0 1 -- 10.20.193.92:0/4089329390 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f19e00b56d0 msgr2=0x7f19e00d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:04.557 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.553+0000 7f1a0b0fc6c0 1 --2- 10.20.193.92:0/4089329390 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f19e00b56d0 0x7f19e00d5b80 secure :-1 s=READY pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f19f4004750 tx=0x7f19f4009260 comp rx=0 tx=0).stop 2026-02-13T04:04:04.557 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.553+0000 7f1a0b0fc6c0 1 -- 10.20.193.92:0/4089329390 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1a04159ac0 msgr2=0x7f1a040f79a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:04.557 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.553+0000 7f1a0b0fc6c0 1 --2- 10.20.193.92:0/4089329390 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1a04159ac0 0x7f1a040f79a0 secure :-1 s=READY pgs=295 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1a00006ea0 tx=0x7f1a0000ce50 comp rx=0 tx=0).stop 2026-02-13T04:04:04.557 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.554+0000 7f1a0b0fc6c0 1 -- 10.20.193.92:0/4089329390 shutdown_connections 2026-02-13T04:04:04.557 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.554+0000 7f1a0b0fc6c0 1 --2- 10.20.193.92:0/4089329390 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1a04159ac0 0x7f1a040f79a0 unknown :-1 s=CLOSED pgs=295 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:04.557 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.554+0000 7f1a0b0fc6c0 1 --2- 10.20.193.92:0/4089329390 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f1a040622d0 0x7f1a040f25e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:04.557 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.554+0000 7f1a0b0fc6c0 1 --2- 10.20.193.92:0/4089329390 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f19e00b56d0 0x7f19e00d5b80 unknown :-1 s=CLOSED pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:04.557 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.554+0000 7f1a0b0fc6c0 1 --2- 10.20.193.92:0/4089329390 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1a04060ce0 0x7f1a040f20a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:04.557 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.554+0000 7f1a0b0fc6c0 1 -- 10.20.193.92:0/4089329390 >> 10.20.193.92:0/4089329390 conn(0x7f1a040ea880 msgr2=0x7f1a0410db90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:04:04.557 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.554+0000 7f1a0b0fc6c0 1 -- 10.20.193.92:0/4089329390 shutdown_connections 2026-02-13T04:04:04.557 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:04.554+0000 7f1a0b0fc6c0 1 -- 10.20.193.92:0/4089329390 wait complete. 2026-02-13T04:04:04.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:04 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/4089329390' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:05.078 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:04 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/4089329390' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:05.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:04 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/4089329390' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:06.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:05 trial158 ceph-mon[27763]: pgmap v281: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T04:04:06.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:05 trial099 ceph-mon[27808]: pgmap v281: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T04:04:06.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:05 trial092 ceph-mon[23047]: pgmap v281: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T04:04:07.661 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:04:07.845 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:04:07.975 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:07 trial092 ceph-mon[23047]: pgmap v282: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 9 op/s 2026-02-13T04:04:08.044 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.040+0000 7f2c532306c0 1 -- 10.20.193.92:0/2726312766 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2c4c115410 msgr2=0x7f2c4c175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:08.044 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.040+0000 7f2c532306c0 1 --2- 10.20.193.92:0/2726312766 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2c4c115410 0x7f2c4c175db0 secure :-1 s=READY pgs=296 gs=1 cs=0 l=1 c_cookie=17233315081133741869 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c4800aa70 tx=0x7f2c4802fde0 comp rx=0 tx=0).stop 2026-02-13T04:04:08.044 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.041+0000 7f2c532306c0 1 -- 10.20.193.92:0/2726312766 shutdown_connections 2026-02-13T04:04:08.044 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.041+0000 7f2c532306c0 1 --2- 10.20.193.92:0/2726312766 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2c4c10fbf0 0x7f2c4c114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:08.044 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.041+0000 7f2c532306c0 1 --2- 10.20.193.92:0/2726312766 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2c4c115410 0x7f2c4c175db0 unknown :-1 s=CLOSED pgs=296 gs=1 cs=0 l=1 c_cookie=17233315081133741869 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:08.045 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.041+0000 7f2c532306c0 1 --2- 10.20.193.92:0/2726312766 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2c4c10f200 0x7f2c4c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:08.045 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.041+0000 7f2c532306c0 1 -- 10.20.193.92:0/2726312766 >> 10.20.193.92:0/2726312766 conn(0x7f2c4c0ecb00 msgr2=0x7f2c4c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:04:08.045 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.041+0000 7f2c532306c0 1 -- 10.20.193.92:0/2726312766 shutdown_connections 2026-02-13T04:04:08.045 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.041+0000 7f2c532306c0 1 -- 10.20.193.92:0/2726312766 wait complete. 2026-02-13T04:04:08.045 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.041+0000 7f2c532306c0 1 Processor -- start 2026-02-13T04:04:08.045 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.041+0000 7f2c532306c0 1 -- start start 2026-02-13T04:04:08.047 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.042+0000 7f2c532306c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2c4c10f200 0x7f2c4c11cf30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:08.047 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.042+0000 7f2c532306c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2c4c115410 0x7f2c4c11d470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:08.047 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.042+0000 7f2c532306c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2c4c122830 0x7f2c4c122cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:08.047 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.042+0000 7f2c532306c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4c123240 con 0x7f2c4c115410 2026-02-13T04:04:08.047 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.042+0000 7f2c532306c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4c1233b0 con 0x7f2c4c122830 2026-02-13T04:04:08.047 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.042+0000 7f2c532306c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4c123570 con 0x7f2c4c10f200 2026-02-13T04:04:08.048 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.042+0000 7f2c43fff6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2c4c115410 0x7f2c4c11d470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:08.048 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.042+0000 7f2c50fa56c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2c4c10f200 0x7f2c4c11cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:08.048 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.042+0000 7f2c43fff6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2c4c115410 0x7f2c4c11d470 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:47456/0 (socket says 10.20.193.92:47456) 2026-02-13T04:04:08.048 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.042+0000 7f2c43fff6c0 1 -- 10.20.193.92:0/2008844133 learned_addr learned my addr 10.20.193.92:0/2008844133 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:04:08.048 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.042+0000 7f2c50fa56c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2c4c10f200 0x7f2c4c11cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:54158/0 (socket says 10.20.193.92:54158) 2026-02-13T04:04:08.048 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.042+0000 7f2c517a66c0 1 --2- 10.20.193.92:0/2008844133 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2c4c122830 0x7f2c4c122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:08.048 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.042+0000 7f2c43fff6c0 1 -- 10.20.193.92:0/2008844133 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2c4c10f200 msgr2=0x7f2c4c11cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:08.048 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.042+0000 7f2c43fff6c0 1 --2- 10.20.193.92:0/2008844133 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2c4c10f200 0x7f2c4c11cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:08.048 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.042+0000 7f2c43fff6c0 1 -- 10.20.193.92:0/2008844133 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2c4c122830 msgr2=0x7f2c4c122cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:08.048 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.042+0000 7f2c43fff6c0 1 --2- 10.20.193.92:0/2008844133 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2c4c122830 0x7f2c4c122cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:08.048 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.042+0000 7f2c43fff6c0 1 -- 10.20.193.92:0/2008844133 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c4800a660 con 0x7f2c4c115410 2026-02-13T04:04:08.049 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.042+0000 7f2c43fff6c0 1 --2- 10.20.193.92:0/2008844133 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2c4c115410 0x7f2c4c11d470 secure :-1 s=READY pgs=297 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c3400b800 tx=0x7f2c3400bcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:04:08.049 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.042+0000 7f2c41ffb6c0 1 -- 10.20.193.92:0/2008844133 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2c34004a80 con 0x7f2c4c115410 2026-02-13T04:04:08.049 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.042+0000 7f2c41ffb6c0 1 -- 10.20.193.92:0/2008844133 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f2c34009070 con 0x7f2c4c115410 2026-02-13T04:04:08.049 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.042+0000 7f2c41ffb6c0 1 -- 10.20.193.92:0/2008844133 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2c340071c0 con 0x7f2c4c115410 2026-02-13T04:04:08.049 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.042+0000 7f2c532306c0 1 -- 10.20.193.92:0/2008844133 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c4c163a20 con 0x7f2c4c115410 2026-02-13T04:04:08.049 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.042+0000 7f2c532306c0 1 -- 10.20.193.92:0/2008844133 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c4c163eb0 con 0x7f2c4c115410 2026-02-13T04:04:08.049 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.043+0000 7f2c532306c0 1 -- 10.20.193.92:0/2008844133 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c4c1104d0 con 0x7f2c4c115410 2026-02-13T04:04:08.050 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.045+0000 7f2c41ffb6c0 1 -- 10.20.193.92:0/2008844133 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f2c34005000 con 0x7f2c4c115410 2026-02-13T04:04:08.050 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.047+0000 7f2c41ffb6c0 1 --2- 10.20.193.92:0/2008844133 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f2c280b5750 0x7f2c280d5c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:08.050 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.047+0000 7f2c41ffb6c0 1 -- 10.20.193.92:0/2008844133 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f2c340e3be0 con 0x7f2c4c115410 2026-02-13T04:04:08.050 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.047+0000 7f2c50fa56c0 1 --2- 10.20.193.92:0/2008844133 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f2c280b5750 0x7f2c280d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:08.051 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.047+0000 7f2c41ffb6c0 1 -- 10.20.193.92:0/2008844133 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2c3411c5e0 con 0x7f2c4c115410 2026-02-13T04:04:08.051 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.048+0000 7f2c50fa56c0 1 --2- 10.20.193.92:0/2008844133 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f2c280b5750 0x7f2c280d5c00 secure :-1 s=READY pgs=235 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c3c004750 tx=0x7f2c3c009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:04:08.078 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:07 trial158 ceph-mon[27763]: pgmap v282: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 9 op/s 2026-02-13T04:04:08.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:07 trial099 ceph-mon[27808]: pgmap v282: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 9 op/s 2026-02-13T04:04:08.174 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.171+0000 7f2c532306c0 1 -- 10.20.193.92:0/2008844133 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2c4c10f5d0 con 0x7f2c4c115410 2026-02-13T04:04:08.174 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.171+0000 7f2c41ffb6c0 1 -- 10.20.193.92:0/2008844133 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f2c340a6580 con 0x7f2c4c115410 2026-02-13T04:04:08.174 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:04:08.175 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:04:08.175 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.173+0000 7f2c532306c0 1 -- 10.20.193.92:0/2008844133 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f2c280b5750 msgr2=0x7f2c280d5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:08.175 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.173+0000 7f2c532306c0 1 --2- 10.20.193.92:0/2008844133 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f2c280b5750 0x7f2c280d5c00 secure :-1 s=READY pgs=235 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c3c004750 tx=0x7f2c3c009260 comp rx=0 tx=0).stop 2026-02-13T04:04:08.176 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.173+0000 7f2c532306c0 1 -- 10.20.193.92:0/2008844133 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2c4c115410 msgr2=0x7f2c4c11d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:08.176 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.173+0000 7f2c532306c0 1 --2- 10.20.193.92:0/2008844133 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2c4c115410 0x7f2c4c11d470 secure :-1 s=READY pgs=297 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c3400b800 tx=0x7f2c3400bcd0 comp rx=0 tx=0).stop 2026-02-13T04:04:08.176 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.173+0000 7f2c532306c0 1 -- 10.20.193.92:0/2008844133 shutdown_connections 2026-02-13T04:04:08.176 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.173+0000 7f2c532306c0 1 --2- 10.20.193.92:0/2008844133 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f2c280b5750 0x7f2c280d5c00 unknown :-1 s=CLOSED pgs=235 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:08.176 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.173+0000 7f2c532306c0 1 --2- 10.20.193.92:0/2008844133 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2c4c122830 0x7f2c4c122cd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:08.176 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.173+0000 7f2c532306c0 1 --2- 10.20.193.92:0/2008844133 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2c4c115410 0x7f2c4c11d470 unknown :-1 s=CLOSED pgs=297 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:08.176 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.173+0000 7f2c532306c0 1 --2- 10.20.193.92:0/2008844133 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2c4c10f200 0x7f2c4c11cf30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:08.176 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.173+0000 7f2c532306c0 1 -- 10.20.193.92:0/2008844133 >> 10.20.193.92:0/2008844133 conn(0x7f2c4c0ecb00 msgr2=0x7f2c4c10cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:04:08.176 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.173+0000 7f2c532306c0 1 -- 10.20.193.92:0/2008844133 shutdown_connections 2026-02-13T04:04:08.176 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:08.173+0000 7f2c532306c0 1 -- 10.20.193.92:0/2008844133 wait complete. 2026-02-13T04:04:09.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:08 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/2008844133' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:09.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:08 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/2008844133' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:09.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:08 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/2008844133' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:10.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:09 trial158 ceph-mon[27763]: pgmap v283: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:04:10.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:09 trial099 ceph-mon[27808]: pgmap v283: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:04:10.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:09 trial092 ceph-mon[23047]: pgmap v283: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:04:11.280 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:04:11.464 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:04:11.660 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.656+0000 7f9a822796c0 1 -- 10.20.193.92:0/2662299665 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9a7c060200 msgr2=0x7f9a7c1129d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:11.661 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.656+0000 7f9a822796c0 1 --2- 10.20.193.92:0/2662299665 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9a7c060200 0x7f9a7c1129d0 secure :-1 s=READY pgs=298 gs=1 cs=0 l=1 c_cookie=6330863737318616510 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a6c0099a0 tx=0x7f9a6c02ed00 comp rx=0 tx=0).stop 2026-02-13T04:04:11.661 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.656+0000 7f9a822796c0 1 -- 10.20.193.92:0/2662299665 shutdown_connections 2026-02-13T04:04:11.661 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.656+0000 7f9a822796c0 1 --2- 10.20.193.92:0/2662299665 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f9a7c1131b0 0x7f9a7c173b50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:11.661 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.656+0000 7f9a822796c0 1 --2- 10.20.193.92:0/2662299665 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9a7c060200 0x7f9a7c1129d0 unknown :-1 s=CLOSED pgs=298 gs=1 cs=0 l=1 c_cookie=6330863737318616510 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:11.661 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.656+0000 7f9a822796c0 1 --2- 10.20.193.92:0/2662299665 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9a7c05f810 0x7f9a7c05fbe0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:11.661 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.656+0000 7f9a822796c0 1 -- 10.20.193.92:0/2662299665 >> 10.20.193.92:0/2662299665 conn(0x7f9a7c0e9740 msgr2=0x7f9a7c109b50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:04:11.661 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.656+0000 7f9a822796c0 1 -- 10.20.193.92:0/2662299665 shutdown_connections 2026-02-13T04:04:11.661 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.656+0000 7f9a822796c0 1 -- 10.20.193.92:0/2662299665 wait complete. 2026-02-13T04:04:11.661 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.658+0000 7f9a822796c0 1 Processor -- start 2026-02-13T04:04:11.663 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.658+0000 7f9a822796c0 1 -- start start 2026-02-13T04:04:11.663 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.658+0000 7f9a822796c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f9a7c05f810 0x7f9a7c10d570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:11.663 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.658+0000 7f9a822796c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9a7c1131b0 0x7f9a7c10bae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:11.663 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.658+0000 7f9a822796c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9a7c10c020 0x7f9a7c10c4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:11.663 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.658+0000 7f9a822796c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c167a10 con 0x7f9a7c1131b0 2026-02-13T04:04:11.663 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.658+0000 7f9a822796c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c167b80 con 0x7f9a7c10c020 2026-02-13T04:04:11.663 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.658+0000 7f9a822796c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c167d40 con 0x7f9a7c05f810 2026-02-13T04:04:11.663 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.659+0000 7f9a7affd6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9a7c1131b0 0x7f9a7c10bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:11.663 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.659+0000 7f9a7affd6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9a7c1131b0 0x7f9a7c10bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:47470/0 (socket says 10.20.193.92:47470) 2026-02-13T04:04:11.664 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.659+0000 7f9a7affd6c0 1 -- 10.20.193.92:0/1231752643 learned_addr learned my addr 10.20.193.92:0/1231752643 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:04:11.664 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.659+0000 7f9a7b7fe6c0 1 --2- 10.20.193.92:0/1231752643 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f9a7c05f810 0x7f9a7c10d570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:11.664 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.659+0000 7f9a7bfff6c0 1 --2- 10.20.193.92:0/1231752643 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9a7c10c020 0x7f9a7c10c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:11.664 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.659+0000 7f9a7affd6c0 1 -- 10.20.193.92:0/1231752643 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f9a7c05f810 msgr2=0x7f9a7c10d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:11.664 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.659+0000 7f9a7affd6c0 1 --2- 10.20.193.92:0/1231752643 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f9a7c05f810 0x7f9a7c10d570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:11.664 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.659+0000 7f9a7affd6c0 1 -- 10.20.193.92:0/1231752643 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9a7c10c020 msgr2=0x7f9a7c10c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:11.664 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.659+0000 7f9a7affd6c0 1 --2- 10.20.193.92:0/1231752643 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9a7c10c020 0x7f9a7c10c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:11.664 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.659+0000 7f9a7affd6c0 1 -- 10.20.193.92:0/1231752643 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a6c009590 con 0x7f9a7c1131b0 2026-02-13T04:04:11.664 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.659+0000 7f9a7bfff6c0 1 --2- 10.20.193.92:0/1231752643 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9a7c10c020 0x7f9a7c10c4c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T04:04:11.664 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.659+0000 7f9a7affd6c0 1 --2- 10.20.193.92:0/1231752643 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9a7c1131b0 0x7f9a7c10bae0 secure :-1 s=READY pgs=299 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a6c0072f0 tx=0x7f9a6c02f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:04:11.664 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.659+0000 7f9a78ff96c0 1 -- 10.20.193.92:0/1231752643 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9a6c0046b0 con 0x7f9a7c1131b0 2026-02-13T04:04:11.665 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.659+0000 7f9a822796c0 1 -- 10.20.193.92:0/1231752643 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a7c167fc0 con 0x7f9a7c1131b0 2026-02-13T04:04:11.665 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.659+0000 7f9a78ff96c0 1 -- 10.20.193.92:0/1231752643 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f9a6c007920 con 0x7f9a7c1131b0 2026-02-13T04:04:11.665 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.659+0000 7f9a78ff96c0 1 -- 10.20.193.92:0/1231752643 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9a6c037a60 con 0x7f9a7c1131b0 2026-02-13T04:04:11.665 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.659+0000 7f9a822796c0 1 -- 10.20.193.92:0/1231752643 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a7c168490 con 0x7f9a7c1131b0 2026-02-13T04:04:11.665 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.659+0000 7f9a822796c0 1 -- 10.20.193.92:0/1231752643 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a7c10e270 con 0x7f9a7c1131b0 2026-02-13T04:04:11.665 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.661+0000 7f9a78ff96c0 1 -- 10.20.193.92:0/1231752643 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f9a6c037060 con 0x7f9a7c1131b0 2026-02-13T04:04:11.666 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.663+0000 7f9a78ff96c0 1 --2- 10.20.193.92:0/1231752643 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f9a500b56d0 0x7f9a500d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:11.667 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.663+0000 7f9a78ff96c0 1 -- 10.20.193.92:0/1231752643 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f9a6c107d10 con 0x7f9a7c1131b0 2026-02-13T04:04:11.667 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.663+0000 7f9a78ff96c0 1 -- 10.20.193.92:0/1231752643 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f9a6c108190 con 0x7f9a7c1131b0 2026-02-13T04:04:11.667 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.663+0000 7f9a7b7fe6c0 1 --2- 10.20.193.92:0/1231752643 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f9a500b56d0 0x7f9a500d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:11.667 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.663+0000 7f9a7b7fe6c0 1 --2- 10.20.193.92:0/1231752643 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f9a500b56d0 0x7f9a500d5b80 secure :-1 s=READY pgs=236 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a68005980 tx=0x7f9a68005910 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:04:11.792 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.789+0000 7f9a822796c0 1 -- 10.20.193.92:0/1231752643 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9a7c05fbe0 con 0x7f9a7c1131b0 2026-02-13T04:04:11.792 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.789+0000 7f9a78ff96c0 1 -- 10.20.193.92:0/1231752643 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f9a6c0ca6b0 con 0x7f9a7c1131b0 2026-02-13T04:04:11.792 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:04:11.793 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:04:11.793 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.791+0000 7f9a822796c0 1 -- 10.20.193.92:0/1231752643 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f9a500b56d0 msgr2=0x7f9a500d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:11.794 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.791+0000 7f9a822796c0 1 --2- 10.20.193.92:0/1231752643 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f9a500b56d0 0x7f9a500d5b80 secure :-1 s=READY pgs=236 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a68005980 tx=0x7f9a68005910 comp rx=0 tx=0).stop 2026-02-13T04:04:11.794 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.791+0000 7f9a822796c0 1 -- 10.20.193.92:0/1231752643 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9a7c1131b0 msgr2=0x7f9a7c10bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:11.794 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.791+0000 7f9a822796c0 1 --2- 10.20.193.92:0/1231752643 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9a7c1131b0 0x7f9a7c10bae0 secure :-1 s=READY pgs=299 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9a6c0072f0 tx=0x7f9a6c02f810 comp rx=0 tx=0).stop 2026-02-13T04:04:11.794 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.791+0000 7f9a822796c0 1 -- 10.20.193.92:0/1231752643 shutdown_connections 2026-02-13T04:04:11.794 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.791+0000 7f9a822796c0 1 --2- 10.20.193.92:0/1231752643 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f9a500b56d0 0x7f9a500d5b80 unknown :-1 s=CLOSED pgs=236 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:11.794 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.791+0000 7f9a822796c0 1 --2- 10.20.193.92:0/1231752643 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9a7c10c020 0x7f9a7c10c4c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:11.794 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.791+0000 7f9a822796c0 1 --2- 10.20.193.92:0/1231752643 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9a7c1131b0 0x7f9a7c10bae0 unknown :-1 s=CLOSED pgs=299 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:11.794 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.791+0000 7f9a822796c0 1 --2- 10.20.193.92:0/1231752643 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f9a7c05f810 0x7f9a7c10d570 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:11.794 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.791+0000 7f9a822796c0 1 -- 10.20.193.92:0/1231752643 >> 10.20.193.92:0/1231752643 conn(0x7f9a7c0e9740 msgr2=0x7f9a7c109b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:04:11.794 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.791+0000 7f9a822796c0 1 -- 10.20.193.92:0/1231752643 shutdown_connections 2026-02-13T04:04:11.795 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:11.791+0000 7f9a822796c0 1 -- 10.20.193.92:0/1231752643 wait complete. 2026-02-13T04:04:11.855 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:11 trial092 ceph-mon[23047]: pgmap v284: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:04:12.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:11 trial158 ceph-mon[27763]: pgmap v284: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:04:12.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:11 trial099 ceph-mon[27808]: pgmap v284: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:04:13.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:12 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/1231752643' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:13.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:12 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/1231752643' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:13.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:12 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1231752643' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:14.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:13 trial158 ceph-mon[27763]: pgmap v285: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:04:14.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:13 trial099 ceph-mon[27808]: pgmap v285: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:04:14.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:13 trial092 ceph-mon[23047]: pgmap v285: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:04:14.897 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:04:15.083 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:04:15.274 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.271+0000 7f4776e416c0 1 -- 10.20.193.92:0/935810809 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f477010fbf0 msgr2=0x7f4770114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:15.274 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.271+0000 7f4776e416c0 1 --2- 10.20.193.92:0/935810809 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f477010fbf0 0x7f4770114c30 secure :-1 s=READY pgs=300 gs=1 cs=0 l=1 c_cookie=13865712999328190834 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f47580099a0 tx=0x7f475802ed50 comp rx=0 tx=0).stop 2026-02-13T04:04:15.275 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.271+0000 7f4776e416c0 1 -- 10.20.193.92:0/935810809 shutdown_connections 2026-02-13T04:04:15.275 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.271+0000 7f4776e416c0 1 --2- 10.20.193.92:0/935810809 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4770115410 0x7f4770175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:15.275 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.271+0000 7f4776e416c0 1 --2- 10.20.193.92:0/935810809 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f477010fbf0 0x7f4770114c30 unknown :-1 s=CLOSED pgs=300 gs=1 cs=0 l=1 c_cookie=13865712999328190834 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:15.275 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.271+0000 7f4776e416c0 1 --2- 10.20.193.92:0/935810809 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f477010f200 0x7f477010f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:15.275 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.271+0000 7f4776e416c0 1 -- 10.20.193.92:0/935810809 >> 10.20.193.92:0/935810809 conn(0x7f47700ecb00 msgr2=0x7f477010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:04:15.275 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.271+0000 7f4776e416c0 1 -- 10.20.193.92:0/935810809 shutdown_connections 2026-02-13T04:04:15.275 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.271+0000 7f4776e416c0 1 -- 10.20.193.92:0/935810809 wait complete. 2026-02-13T04:04:15.277 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.272+0000 7f4776e416c0 1 Processor -- start 2026-02-13T04:04:15.277 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.272+0000 7f4776e416c0 1 -- start start 2026-02-13T04:04:15.277 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.272+0000 7f4776e416c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f477010f200 0x7f47700f49d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:15.277 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.272+0000 7f4776e416c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4770115410 0x7f4770175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:15.278 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.273+0000 7f4776e416c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f47700f5000 0x7f47700fa2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:15.278 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.273+0000 7f4776e416c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f47700f5660 con 0x7f4770115410 2026-02-13T04:04:15.278 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.273+0000 7f4776e416c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f47700fa810 con 0x7f47700f5000 2026-02-13T04:04:15.278 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.273+0000 7f4776e416c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f47700fa9d0 con 0x7f477010f200 2026-02-13T04:04:15.278 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.273+0000 7f4767fff6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4770115410 0x7f4770175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:15.278 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.273+0000 7f4774bb26c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f477010f200 0x7f47700f49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:15.278 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.273+0000 7f4767fff6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4770115410 0x7f4770175cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:46922/0 (socket says 10.20.193.92:46922) 2026-02-13T04:04:15.278 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.273+0000 7f4767fff6c0 1 -- 10.20.193.92:0/2870818547 learned_addr learned my addr 10.20.193.92:0/2870818547 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:04:15.278 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.273+0000 7f47753b36c0 1 --2- 10.20.193.92:0/2870818547 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f47700f5000 0x7f47700fa2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:15.278 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.273+0000 7f4767fff6c0 1 -- 10.20.193.92:0/2870818547 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f477010f200 msgr2=0x7f47700f49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:15.278 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.273+0000 7f4767fff6c0 1 --2- 10.20.193.92:0/2870818547 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f477010f200 0x7f47700f49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:15.278 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.273+0000 7f4767fff6c0 1 -- 10.20.193.92:0/2870818547 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f47700f5000 msgr2=0x7f47700fa2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:15.279 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.273+0000 7f4767fff6c0 1 --2- 10.20.193.92:0/2870818547 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f47700f5000 0x7f47700fa2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:15.279 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.273+0000 7f4767fff6c0 1 -- 10.20.193.92:0/2870818547 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4758009590 con 0x7f4770115410 2026-02-13T04:04:15.279 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.273+0000 7f4767fff6c0 1 --2- 10.20.193.92:0/2870818547 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4770115410 0x7f4770175cb0 secure :-1 s=READY pgs=301 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f47580092e0 tx=0x7f475802f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:04:15.279 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.273+0000 7f4765ffb6c0 1 -- 10.20.193.92:0/2870818547 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f475802fda0 con 0x7f4770115410 2026-02-13T04:04:15.279 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.273+0000 7f4765ffb6c0 1 -- 10.20.193.92:0/2870818547 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f4758002be0 con 0x7f4770115410 2026-02-13T04:04:15.279 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.273+0000 7f4765ffb6c0 1 -- 10.20.193.92:0/2870818547 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f47580073f0 con 0x7f4770115410 2026-02-13T04:04:15.279 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.274+0000 7f4776e416c0 1 -- 10.20.193.92:0/2870818547 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47700fabf0 con 0x7f4770115410 2026-02-13T04:04:15.279 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.274+0000 7f4776e416c0 1 -- 10.20.193.92:0/2870818547 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47700fb0c0 con 0x7f4770115410 2026-02-13T04:04:15.279 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.274+0000 7f4776e416c0 1 -- 10.20.193.92:0/2870818547 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47701104d0 con 0x7f4770115410 2026-02-13T04:04:15.280 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.276+0000 7f4765ffb6c0 1 -- 10.20.193.92:0/2870818547 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f47580311e0 con 0x7f4770115410 2026-02-13T04:04:15.280 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.278+0000 7f4765ffb6c0 1 --2- 10.20.193.92:0/2870818547 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f474c0b56d0 0x7f474c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:15.281 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.278+0000 7f4765ffb6c0 1 -- 10.20.193.92:0/2870818547 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f4758107c20 con 0x7f4770115410 2026-02-13T04:04:15.281 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.278+0000 7f4774bb26c0 1 --2- 10.20.193.92:0/2870818547 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f474c0b56d0 0x7f474c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:15.281 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.278+0000 7f4765ffb6c0 1 -- 10.20.193.92:0/2870818547 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4758108110 con 0x7f4770115410 2026-02-13T04:04:15.281 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.278+0000 7f4774bb26c0 1 --2- 10.20.193.92:0/2870818547 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f474c0b56d0 0x7f474c0d5b80 secure :-1 s=READY pgs=237 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4760004750 tx=0x7f4760009390 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:04:15.403 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.400+0000 7f4776e416c0 1 -- 10.20.193.92:0/2870818547 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f47700f5b50 con 0x7f4770115410 2026-02-13T04:04:15.404 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.401+0000 7f4765ffb6c0 1 -- 10.20.193.92:0/2870818547 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f47580ca600 con 0x7f4770115410 2026-02-13T04:04:15.404 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:04:15.404 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:04:15.405 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.402+0000 7f4776e416c0 1 -- 10.20.193.92:0/2870818547 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f474c0b56d0 msgr2=0x7f474c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:15.405 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.402+0000 7f4776e416c0 1 --2- 10.20.193.92:0/2870818547 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f474c0b56d0 0x7f474c0d5b80 secure :-1 s=READY pgs=237 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4760004750 tx=0x7f4760009390 comp rx=0 tx=0).stop 2026-02-13T04:04:15.405 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.402+0000 7f4776e416c0 1 -- 10.20.193.92:0/2870818547 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4770115410 msgr2=0x7f4770175cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:15.405 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.402+0000 7f4776e416c0 1 --2- 10.20.193.92:0/2870818547 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4770115410 0x7f4770175cb0 secure :-1 s=READY pgs=301 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f47580092e0 tx=0x7f475802f610 comp rx=0 tx=0).stop 2026-02-13T04:04:15.405 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.402+0000 7f4776e416c0 1 -- 10.20.193.92:0/2870818547 shutdown_connections 2026-02-13T04:04:15.405 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.402+0000 7f4776e416c0 1 --2- 10.20.193.92:0/2870818547 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f474c0b56d0 0x7f474c0d5b80 unknown :-1 s=CLOSED pgs=237 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:15.406 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.402+0000 7f4776e416c0 1 --2- 10.20.193.92:0/2870818547 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f47700f5000 0x7f47700fa2d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:15.406 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.402+0000 7f4776e416c0 1 --2- 10.20.193.92:0/2870818547 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4770115410 0x7f4770175cb0 unknown :-1 s=CLOSED pgs=301 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:15.406 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.402+0000 7f4776e416c0 1 --2- 10.20.193.92:0/2870818547 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f477010f200 0x7f47700f49d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:15.406 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.402+0000 7f4776e416c0 1 -- 10.20.193.92:0/2870818547 >> 10.20.193.92:0/2870818547 conn(0x7f47700ecb00 msgr2=0x7f477010d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:04:15.406 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.402+0000 7f4776e416c0 1 -- 10.20.193.92:0/2870818547 shutdown_connections 2026-02-13T04:04:15.406 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:15.402+0000 7f4776e416c0 1 -- 10.20.193.92:0/2870818547 wait complete. 2026-02-13T04:04:15.784 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:15 trial092 ceph-mon[23047]: pgmap v286: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:04:15.784 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:15 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/2870818547' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:16.078 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:15 trial158 ceph-mon[27763]: pgmap v286: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:04:16.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:15 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/2870818547' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:16.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:15 trial099 ceph-mon[27808]: pgmap v286: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:04:16.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:15 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/2870818547' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:18.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:17 trial158 ceph-mon[27763]: pgmap v287: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 8 op/s 2026-02-13T04:04:18.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:17 trial099 ceph-mon[27808]: pgmap v287: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 8 op/s 2026-02-13T04:04:18.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:17 trial092 ceph-mon[23047]: pgmap v287: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 8 op/s 2026-02-13T04:04:18.508 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:04:18.692 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:04:18.902 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:18.899+0000 7f20612b86c0 1 -- 10.20.193.92:0/1783366227 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f205c1149c0 msgr2=0x7f205c114ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:18.902 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:18.899+0000 7f20612b86c0 1 --2- 10.20.193.92:0/1783366227 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f205c1149c0 0x7f205c114ee0 secure :-1 s=READY pgs=302 gs=1 cs=0 l=1 c_cookie=11379360219237398133 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f204c00aa40 tx=0x7f204c02fe00 comp rx=0 tx=0).stop 2026-02-13T04:04:18.903 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:18.899+0000 7f20612b86c0 1 -- 10.20.193.92:0/1783366227 shutdown_connections 2026-02-13T04:04:18.903 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:18.899+0000 7f20612b86c0 1 --2- 10.20.193.92:0/1783366227 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f205c113dc0 0x7f205c114210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:18.903 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:18.899+0000 7f20612b86c0 1 --2- 10.20.193.92:0/1783366227 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f205c1149c0 0x7f205c114ee0 unknown :-1 s=CLOSED pgs=302 gs=1 cs=0 l=1 c_cookie=11379360219237398133 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:18.903 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:18.899+0000 7f20612b86c0 1 --2- 10.20.193.92:0/1783366227 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f205c11b510 0x7f205c11b8e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:18.903 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:18.899+0000 7f20612b86c0 1 -- 10.20.193.92:0/1783366227 >> 10.20.193.92:0/1783366227 conn(0x7f205c058a50 msgr2=0x7f205c058e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:04:18.903 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:18.899+0000 7f20612b86c0 1 -- 10.20.193.92:0/1783366227 shutdown_connections 2026-02-13T04:04:18.903 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:18.899+0000 7f20612b86c0 1 -- 10.20.193.92:0/1783366227 wait complete. 2026-02-13T04:04:18.905 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:18.900+0000 7f20612b86c0 1 Processor -- start 2026-02-13T04:04:18.905 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:18.900+0000 7f20612b86c0 1 -- start start 2026-02-13T04:04:18.905 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:18.901+0000 7f20612b86c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f205c113dc0 0x7f205c12b5b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:18.905 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:18.901+0000 7f20612b86c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f205c1149c0 0x7f205c12baf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:18.905 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:18.901+0000 7f20612b86c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f205c11b510 0x7f205c130eb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:18.905 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:18.901+0000 7f20612b86c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f205c131500 con 0x7f205c1149c0 2026-02-13T04:04:18.905 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:18.901+0000 7f20612b86c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f205c131670 con 0x7f205c113dc0 2026-02-13T04:04:18.906 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:18.901+0000 7f20612b86c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f205c131830 con 0x7f205c11b510 2026-02-13T04:04:18.906 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:18.901+0000 7f205a7fc6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f205c1149c0 0x7f205c12baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:18.906 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:18.901+0000 7f205affd6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f205c113dc0 0x7f205c12b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:18.906 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:18.901+0000 7f205affd6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f205c113dc0 0x7f205c12b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:41938/0 (socket says 10.20.193.92:41938) 2026-02-13T04:04:18.906 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:18.901+0000 7f205affd6c0 1 -- 10.20.193.92:0/4221096564 learned_addr learned my addr 10.20.193.92:0/4221096564 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:04:18.906 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:18.901+0000 7f205b7fe6c0 1 --2- 10.20.193.92:0/4221096564 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f205c11b510 0x7f205c130eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:18.906 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:18.901+0000 7f205a7fc6c0 1 -- 10.20.193.92:0/4221096564 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f205c11b510 msgr2=0x7f205c130eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:18.906 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:18.901+0000 7f205a7fc6c0 1 --2- 10.20.193.92:0/4221096564 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f205c11b510 0x7f205c130eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:18.906 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:18.901+0000 7f205a7fc6c0 1 -- 10.20.193.92:0/4221096564 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f205c113dc0 msgr2=0x7f205c12b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:18.906 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:18.901+0000 7f205a7fc6c0 1 --2- 10.20.193.92:0/4221096564 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f205c113dc0 0x7f205c12b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:18.906 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:18.901+0000 7f205a7fc6c0 1 -- 10.20.193.92:0/4221096564 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f204c00a660 con 0x7f205c1149c0 2026-02-13T04:04:18.906 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:18.901+0000 7f205a7fc6c0 1 --2- 10.20.193.92:0/4221096564 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f205c1149c0 0x7f205c12baf0 secure :-1 s=READY pgs=303 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f204400b640 tx=0x7f204400bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:04:18.907 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:18.901+0000 7f203bfff6c0 1 -- 10.20.193.92:0/4221096564 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f20440044a0 con 0x7f205c1149c0 2026-02-13T04:04:18.907 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:18.901+0000 7f20612b86c0 1 -- 10.20.193.92:0/4221096564 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f205c131b10 con 0x7f205c1149c0 2026-02-13T04:04:18.907 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:18.902+0000 7f20612b86c0 1 -- 10.20.193.92:0/4221096564 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f205c1721f0 con 0x7f205c1149c0 2026-02-13T04:04:18.907 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:18.902+0000 7f203bfff6c0 1 -- 10.20.193.92:0/4221096564 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f2044009030 con 0x7f205c1149c0 2026-02-13T04:04:18.907 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:18.902+0000 7f203bfff6c0 1 -- 10.20.193.92:0/4221096564 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f204400ce60 con 0x7f205c1149c0 2026-02-13T04:04:18.907 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:18.902+0000 7f20612b86c0 1 -- 10.20.193.92:0/4221096564 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f205c05b000 con 0x7f205c1149c0 2026-02-13T04:04:18.907 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:18.904+0000 7f203bfff6c0 1 -- 10.20.193.92:0/4221096564 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f204400c410 con 0x7f205c1149c0 2026-02-13T04:04:18.909 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:18.906+0000 7f203bfff6c0 1 --2- 10.20.193.92:0/4221096564 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f20300b56c0 0x7f20300d5b70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:18.909 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:18.906+0000 7f203bfff6c0 1 -- 10.20.193.92:0/4221096564 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f20440e3a90 con 0x7f205c1149c0 2026-02-13T04:04:18.909 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:18.906+0000 7f205affd6c0 1 --2- 10.20.193.92:0/4221096564 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f20300b56c0 0x7f20300d5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:18.909 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:18.906+0000 7f203bfff6c0 1 -- 10.20.193.92:0/4221096564 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f204411c5e0 con 0x7f205c1149c0 2026-02-13T04:04:18.909 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:18.907+0000 7f205affd6c0 1 --2- 10.20.193.92:0/4221096564 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f20300b56c0 0x7f20300d5b70 secure :-1 s=READY pgs=238 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2050009240 tx=0x7f2050009420 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:04:19.032 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:19.030+0000 7f20612b86c0 1 -- 10.20.193.92:0/4221096564 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f205c12c700 con 0x7f205c1149c0 2026-02-13T04:04:19.033 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:19.030+0000 7f203bfff6c0 1 -- 10.20.193.92:0/4221096564 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f20440a6430 con 0x7f205c1149c0 2026-02-13T04:04:19.033 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:04:19.033 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:04:19.034 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:19.031+0000 7f20612b86c0 1 -- 10.20.193.92:0/4221096564 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f20300b56c0 msgr2=0x7f20300d5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:19.035 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:19.031+0000 7f20612b86c0 1 --2- 10.20.193.92:0/4221096564 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f20300b56c0 0x7f20300d5b70 secure :-1 s=READY pgs=238 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2050009240 tx=0x7f2050009420 comp rx=0 tx=0).stop 2026-02-13T04:04:19.035 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:19.031+0000 7f20612b86c0 1 -- 10.20.193.92:0/4221096564 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f205c1149c0 msgr2=0x7f205c12baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:19.035 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:19.031+0000 7f20612b86c0 1 --2- 10.20.193.92:0/4221096564 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f205c1149c0 0x7f205c12baf0 secure :-1 s=READY pgs=303 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f204400b640 tx=0x7f204400bb10 comp rx=0 tx=0).stop 2026-02-13T04:04:19.035 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:19.031+0000 7f20612b86c0 1 -- 10.20.193.92:0/4221096564 shutdown_connections 2026-02-13T04:04:19.035 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:19.031+0000 7f20612b86c0 1 --2- 10.20.193.92:0/4221096564 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f205c11b510 0x7f205c130eb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:19.035 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:19.031+0000 7f20612b86c0 1 --2- 10.20.193.92:0/4221096564 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f205c1149c0 0x7f205c12baf0 unknown :-1 s=CLOSED pgs=303 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:19.035 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:19.031+0000 7f20612b86c0 1 --2- 10.20.193.92:0/4221096564 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f20300b56c0 0x7f20300d5b70 unknown :-1 s=CLOSED pgs=238 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:19.035 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:19.031+0000 7f20612b86c0 1 --2- 10.20.193.92:0/4221096564 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f205c113dc0 0x7f205c12b5b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:19.035 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:19.031+0000 7f20612b86c0 1 -- 10.20.193.92:0/4221096564 >> 10.20.193.92:0/4221096564 conn(0x7f205c058a50 msgr2=0x7f205c1181d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:04:19.035 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:19.032+0000 7f20612b86c0 1 -- 10.20.193.92:0/4221096564 shutdown_connections 2026-02-13T04:04:19.035 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:19.032+0000 7f20612b86c0 1 -- 10.20.193.92:0/4221096564 wait complete. 2026-02-13T04:04:20.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:19 trial158 ceph-mon[27763]: pgmap v288: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:04:20.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:19 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/4221096564' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:20.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:19 trial099 ceph-mon[27808]: pgmap v288: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:04:20.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:19 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/4221096564' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:20.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:19 trial092 ceph-mon[23047]: pgmap v288: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:04:20.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:19 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/4221096564' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:22.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:21 trial158 ceph-mon[27763]: pgmap v289: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:04:22.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:21 trial099 ceph-mon[27808]: pgmap v289: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:04:22.138 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:04:22.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:21 trial092 ceph-mon[23047]: pgmap v289: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:04:22.322 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:04:22.533 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.530+0000 7fa76b5776c0 1 -- 10.20.193.92:0/2396561537 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa76c10f060 msgr2=0x7fa76c10f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:22.533 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.530+0000 7fa76b5776c0 1 --2- 10.20.193.92:0/2396561537 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa76c10f060 0x7fa76c10f430 secure :-1 s=READY pgs=304 gs=1 cs=0 l=1 c_cookie=3440968413253662673 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa7600099a0 tx=0x7fa76002ed00 comp rx=0 tx=0).stop 2026-02-13T04:04:22.533 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.530+0000 7fa76b5776c0 1 -- 10.20.193.92:0/2396561537 shutdown_connections 2026-02-13T04:04:22.533 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.530+0000 7fa76b5776c0 1 --2- 10.20.193.92:0/2396561537 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa76c115270 0x7fa76c175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:22.534 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.530+0000 7fa76b5776c0 1 --2- 10.20.193.92:0/2396561537 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa76c10fa50 0x7fa76c114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:22.534 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.530+0000 7fa76b5776c0 1 --2- 10.20.193.92:0/2396561537 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa76c10f060 0x7fa76c10f430 unknown :-1 s=CLOSED pgs=304 gs=1 cs=0 l=1 c_cookie=3440968413253662673 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:22.534 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.530+0000 7fa76b5776c0 1 -- 10.20.193.92:0/2396561537 >> 10.20.193.92:0/2396561537 conn(0x7fa76c0ec980 msgr2=0x7fa76c10cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:04:22.534 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.530+0000 7fa76b5776c0 1 -- 10.20.193.92:0/2396561537 shutdown_connections 2026-02-13T04:04:22.534 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.530+0000 7fa76b5776c0 1 -- 10.20.193.92:0/2396561537 wait complete. 2026-02-13T04:04:22.536 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.531+0000 7fa76b5776c0 1 Processor -- start 2026-02-13T04:04:22.536 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.531+0000 7fa76b5776c0 1 -- start start 2026-02-13T04:04:22.536 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.531+0000 7fa76b5776c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa76c10f060 0x7fa76c11cf30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:22.536 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.531+0000 7fa76b5776c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa76c115270 0x7fa76c11d470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:22.536 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.531+0000 7fa76b5776c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa76c122830 0x7fa76c122cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:22.536 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.531+0000 7fa76b5776c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c123240 con 0x7fa76c10f060 2026-02-13T04:04:22.536 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.531+0000 7fa76b5776c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c1233b0 con 0x7fa76c122830 2026-02-13T04:04:22.536 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.531+0000 7fa76b5776c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c123570 con 0x7fa76c115270 2026-02-13T04:04:22.536 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.532+0000 7fa76a5756c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa76c10f060 0x7fa76c11cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:22.536 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.532+0000 7fa76a5756c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa76c10f060 0x7fa76c11cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:46948/0 (socket says 10.20.193.92:46948) 2026-02-13T04:04:22.537 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.532+0000 7fa76a5756c0 1 -- 10.20.193.92:0/2797500661 learned_addr learned my addr 10.20.193.92:0/2797500661 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:04:22.537 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.532+0000 7fa769d746c0 1 --2- 10.20.193.92:0/2797500661 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa76c115270 0x7fa76c11d470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:22.537 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.532+0000 7fa76ad766c0 1 --2- 10.20.193.92:0/2797500661 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa76c122830 0x7fa76c122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:22.537 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.532+0000 7fa76a5756c0 1 -- 10.20.193.92:0/2797500661 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa76c115270 msgr2=0x7fa76c11d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:22.537 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.532+0000 7fa76a5756c0 1 --2- 10.20.193.92:0/2797500661 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa76c115270 0x7fa76c11d470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:22.537 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.532+0000 7fa76a5756c0 1 -- 10.20.193.92:0/2797500661 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa76c122830 msgr2=0x7fa76c122cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:22.537 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.532+0000 7fa76a5756c0 1 --2- 10.20.193.92:0/2797500661 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa76c122830 0x7fa76c122cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:22.537 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.532+0000 7fa76a5756c0 1 -- 10.20.193.92:0/2797500661 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa760009590 con 0x7fa76c10f060 2026-02-13T04:04:22.537 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.532+0000 7fa76a5756c0 1 --2- 10.20.193.92:0/2797500661 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa76c10f060 0x7fa76c11cf30 secure :-1 s=READY pgs=305 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa760031fd0 tx=0x7fa76002f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:04:22.537 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.532+0000 7fa7537fe6c0 1 -- 10.20.193.92:0/2797500661 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa7600026b0 con 0x7fa76c10f060 2026-02-13T04:04:22.537 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.532+0000 7fa7537fe6c0 1 -- 10.20.193.92:0/2797500661 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fa760002d40 con 0x7fa76c10f060 2026-02-13T04:04:22.537 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.532+0000 7fa7537fe6c0 1 -- 10.20.193.92:0/2797500661 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fa760007670 con 0x7fa76c10f060 2026-02-13T04:04:22.538 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.532+0000 7fa76b5776c0 1 -- 10.20.193.92:0/2797500661 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa76c1639c0 con 0x7fa76c10f060 2026-02-13T04:04:22.538 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.532+0000 7fa76b5776c0 1 -- 10.20.193.92:0/2797500661 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa76c163df0 con 0x7fa76c10f060 2026-02-13T04:04:22.538 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.533+0000 7fa76b5776c0 1 -- 10.20.193.92:0/2797500661 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa76c110330 con 0x7fa76c10f060 2026-02-13T04:04:22.538 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.535+0000 7fa7537fe6c0 1 -- 10.20.193.92:0/2797500661 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fa760002810 con 0x7fa76c10f060 2026-02-13T04:04:22.540 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.537+0000 7fa7537fe6c0 1 --2- 10.20.193.92:0/2797500661 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa7440b5650 0x7fa7440d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:22.540 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.537+0000 7fa7537fe6c0 1 -- 10.20.193.92:0/2797500661 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7fa760107e30 con 0x7fa76c10f060 2026-02-13T04:04:22.540 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.537+0000 7fa7537fe6c0 1 -- 10.20.193.92:0/2797500661 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fa7601082b0 con 0x7fa76c10f060 2026-02-13T04:04:22.540 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.537+0000 7fa769d746c0 1 --2- 10.20.193.92:0/2797500661 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa7440b5650 0x7fa7440d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:22.540 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.538+0000 7fa769d746c0 1 --2- 10.20.193.92:0/2797500661 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa7440b5650 0x7fa7440d5b00 secure :-1 s=READY pgs=239 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa754005980 tx=0x7fa754005910 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:04:22.663 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.660+0000 7fa76b5776c0 1 -- 10.20.193.92:0/2797500661 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fa76c10f430 con 0x7fa76c10f060 2026-02-13T04:04:22.663 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.660+0000 7fa7537fe6c0 1 -- 10.20.193.92:0/2797500661 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fa7600ca7d0 con 0x7fa76c10f060 2026-02-13T04:04:22.664 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:04:22.664 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:04:22.664 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.662+0000 7fa76b5776c0 1 -- 10.20.193.92:0/2797500661 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa7440b5650 msgr2=0x7fa7440d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:22.665 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.662+0000 7fa76b5776c0 1 --2- 10.20.193.92:0/2797500661 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa7440b5650 0x7fa7440d5b00 secure :-1 s=READY pgs=239 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa754005980 tx=0x7fa754005910 comp rx=0 tx=0).stop 2026-02-13T04:04:22.665 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.662+0000 7fa76b5776c0 1 -- 10.20.193.92:0/2797500661 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa76c10f060 msgr2=0x7fa76c11cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:22.665 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.662+0000 7fa76b5776c0 1 --2- 10.20.193.92:0/2797500661 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa76c10f060 0x7fa76c11cf30 secure :-1 s=READY pgs=305 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa760031fd0 tx=0x7fa76002f810 comp rx=0 tx=0).stop 2026-02-13T04:04:22.665 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.662+0000 7fa76b5776c0 1 -- 10.20.193.92:0/2797500661 shutdown_connections 2026-02-13T04:04:22.665 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.662+0000 7fa76b5776c0 1 --2- 10.20.193.92:0/2797500661 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fa7440b5650 0x7fa7440d5b00 unknown :-1 s=CLOSED pgs=239 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:22.665 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.662+0000 7fa76b5776c0 1 --2- 10.20.193.92:0/2797500661 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fa76c122830 0x7fa76c122cd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:22.665 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.662+0000 7fa76b5776c0 1 --2- 10.20.193.92:0/2797500661 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fa76c115270 0x7fa76c11d470 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:22.665 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.662+0000 7fa76b5776c0 1 --2- 10.20.193.92:0/2797500661 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fa76c10f060 0x7fa76c11cf30 unknown :-1 s=CLOSED pgs=305 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:22.665 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.662+0000 7fa76b5776c0 1 -- 10.20.193.92:0/2797500661 >> 10.20.193.92:0/2797500661 conn(0x7fa76c0ec980 msgr2=0x7fa76c10cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:04:22.666 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.662+0000 7fa76b5776c0 1 -- 10.20.193.92:0/2797500661 shutdown_connections 2026-02-13T04:04:22.666 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:22.662+0000 7fa76b5776c0 1 -- 10.20.193.92:0/2797500661 wait complete. 2026-02-13T04:04:23.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:22 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/2797500661' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:23.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:22 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/2797500661' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:23.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:22 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/2797500661' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:24.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:23 trial158 ceph-mon[27763]: pgmap v290: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:04:24.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:23 trial099 ceph-mon[27808]: pgmap v290: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:04:24.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:23 trial092 ceph-mon[23047]: pgmap v290: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:04:25.768 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:04:25.954 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:04:26.050 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:25 trial092 ceph-mon[23047]: pgmap v291: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:04:26.078 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:25 trial158 ceph-mon[27763]: pgmap v291: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:04:26.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:25 trial099 ceph-mon[27808]: pgmap v291: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:04:26.159 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.156+0000 7f9b4ffff6c0 1 -- 10.20.193.92:0/3757288511 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9b50115270 msgr2=0x7f9b50175c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:26.159 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.156+0000 7f9b4ffff6c0 1 --2- 10.20.193.92:0/3757288511 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9b50115270 0x7f9b50175c10 secure :-1 s=READY pgs=306 gs=2 cs=0 l=1 c_cookie=555209503629025042 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b4000aa70 tx=0x7f9b4002fde0 comp rx=0 tx=0).stop 2026-02-13T04:04:26.160 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.156+0000 7f9b4ffff6c0 1 -- 10.20.193.92:0/3757288511 shutdown_connections 2026-02-13T04:04:26.160 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.156+0000 7f9b4ffff6c0 1 --2- 10.20.193.92:0/3757288511 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9b5010fa50 0x7f9b50114a90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:26.160 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.156+0000 7f9b4ffff6c0 1 --2- 10.20.193.92:0/3757288511 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9b50115270 0x7f9b50175c10 unknown :-1 s=CLOSED pgs=306 gs=2 cs=0 l=1 c_cookie=555209503629025042 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:26.160 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.156+0000 7f9b4ffff6c0 1 --2- 10.20.193.92:0/3757288511 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f9b5010f060 0x7f9b5010f430 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:26.160 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.156+0000 7f9b4ffff6c0 1 -- 10.20.193.92:0/3757288511 >> 10.20.193.92:0/3757288511 conn(0x7f9b500ec980 msgr2=0x7f9b5010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:04:26.160 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.156+0000 7f9b4ffff6c0 1 -- 10.20.193.92:0/3757288511 shutdown_connections 2026-02-13T04:04:26.160 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.157+0000 7f9b4ffff6c0 1 -- 10.20.193.92:0/3757288511 wait complete. 2026-02-13T04:04:26.162 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.157+0000 7f9b4ffff6c0 1 Processor -- start 2026-02-13T04:04:26.162 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.157+0000 7f9b4ffff6c0 1 -- start start 2026-02-13T04:04:26.162 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.158+0000 7f9b4ffff6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f9b5010f060 0x7f9b5011cd90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:26.162 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.158+0000 7f9b4ffff6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9b50115270 0x7f9b5011d2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:26.162 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.158+0000 7f9b4ffff6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9b50122690 0x7f9b50122b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:26.162 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.158+0000 7f9b4ffff6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9b501230a0 con 0x7f9b50122690 2026-02-13T04:04:26.162 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.158+0000 7f9b4ffff6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f9b50123210 con 0x7f9b50115270 2026-02-13T04:04:26.162 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.158+0000 7f9b4ffff6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f9b501233d0 con 0x7f9b5010f060 2026-02-13T04:04:26.163 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.158+0000 7f9b4f7fe6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9b50122690 0x7f9b50122b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:26.163 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.158+0000 7f9b4f7fe6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9b50122690 0x7f9b50122b30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:46928/0 (socket says 10.20.193.92:46928) 2026-02-13T04:04:26.163 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.158+0000 7f9b4f7fe6c0 1 -- 10.20.193.92:0/1288000162 learned_addr learned my addr 10.20.193.92:0/1288000162 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:04:26.163 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.158+0000 7f9b4e7fc6c0 1 --2- 10.20.193.92:0/1288000162 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9b50115270 0x7f9b5011d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:26.163 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.158+0000 7f9b4effd6c0 1 --2- 10.20.193.92:0/1288000162 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f9b5010f060 0x7f9b5011cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:26.163 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.158+0000 7f9b4f7fe6c0 1 -- 10.20.193.92:0/1288000162 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f9b5010f060 msgr2=0x7f9b5011cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:26.163 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.158+0000 7f9b4f7fe6c0 1 --2- 10.20.193.92:0/1288000162 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f9b5010f060 0x7f9b5011cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:26.163 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.158+0000 7f9b4f7fe6c0 1 -- 10.20.193.92:0/1288000162 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9b50115270 msgr2=0x7f9b5011d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:26.163 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.158+0000 7f9b4f7fe6c0 1 --2- 10.20.193.92:0/1288000162 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9b50115270 0x7f9b5011d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:26.163 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.158+0000 7f9b4f7fe6c0 1 -- 10.20.193.92:0/1288000162 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b4000a660 con 0x7f9b50122690 2026-02-13T04:04:26.163 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.158+0000 7f9b4f7fe6c0 1 --2- 10.20.193.92:0/1288000162 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9b50122690 0x7f9b50122b30 secure :-1 s=READY pgs=307 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b4000ab70 tx=0x7f9b40032f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:04:26.163 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.158+0000 7f9b2ffff6c0 1 -- 10.20.193.92:0/1288000162 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9b400054a0 con 0x7f9b50122690 2026-02-13T04:04:26.164 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.159+0000 7f9b2ffff6c0 1 -- 10.20.193.92:0/1288000162 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f9b40003d40 con 0x7f9b50122690 2026-02-13T04:04:26.164 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.159+0000 7f9b2ffff6c0 1 -- 10.20.193.92:0/1288000162 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f9b40032030 con 0x7f9b50122690 2026-02-13T04:04:26.164 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.159+0000 7f9b4ffff6c0 1 -- 10.20.193.92:0/1288000162 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b50163820 con 0x7f9b50122690 2026-02-13T04:04:26.164 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.159+0000 7f9b4ffff6c0 1 -- 10.20.193.92:0/1288000162 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b50163c50 con 0x7f9b50122690 2026-02-13T04:04:26.164 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.159+0000 7f9b4ffff6c0 1 -- 10.20.193.92:0/1288000162 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b14005310 con 0x7f9b50122690 2026-02-13T04:04:26.164 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.162+0000 7f9b2ffff6c0 1 -- 10.20.193.92:0/1288000162 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f9b40005600 con 0x7f9b50122690 2026-02-13T04:04:26.166 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.163+0000 7f9b2ffff6c0 1 --2- 10.20.193.92:0/1288000162 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f9b240b56d0 0x7f9b240d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:26.166 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.163+0000 7f9b2ffff6c0 1 -- 10.20.193.92:0/1288000162 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f9b40108d80 con 0x7f9b50122690 2026-02-13T04:04:26.166 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.163+0000 7f9b4effd6c0 1 --2- 10.20.193.92:0/1288000162 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f9b240b56d0 0x7f9b240d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:26.166 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.163+0000 7f9b2ffff6c0 1 -- 10.20.193.92:0/1288000162 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f9b40109200 con 0x7f9b50122690 2026-02-13T04:04:26.167 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.164+0000 7f9b4effd6c0 1 --2- 10.20.193.92:0/1288000162 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f9b240b56d0 0x7f9b240d5b80 secure :-1 s=READY pgs=240 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b44004750 tx=0x7f9b44009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:04:26.289 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.286+0000 7f9b4ffff6c0 1 -- 10.20.193.92:0/1288000162 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9b14005960 con 0x7f9b50122690 2026-02-13T04:04:26.289 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.287+0000 7f9b2ffff6c0 1 -- 10.20.193.92:0/1288000162 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f9b400cb720 con 0x7f9b50122690 2026-02-13T04:04:26.290 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:04:26.290 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:04:26.291 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.288+0000 7f9b4ffff6c0 1 -- 10.20.193.92:0/1288000162 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f9b240b56d0 msgr2=0x7f9b240d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:26.291 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.288+0000 7f9b4ffff6c0 1 --2- 10.20.193.92:0/1288000162 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f9b240b56d0 0x7f9b240d5b80 secure :-1 s=READY pgs=240 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b44004750 tx=0x7f9b44009260 comp rx=0 tx=0).stop 2026-02-13T04:04:26.291 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.288+0000 7f9b4ffff6c0 1 -- 10.20.193.92:0/1288000162 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9b50122690 msgr2=0x7f9b50122b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:26.291 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.288+0000 7f9b4ffff6c0 1 --2- 10.20.193.92:0/1288000162 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9b50122690 0x7f9b50122b30 secure :-1 s=READY pgs=307 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b4000ab70 tx=0x7f9b40032f60 comp rx=0 tx=0).stop 2026-02-13T04:04:26.291 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.288+0000 7f9b4ffff6c0 1 -- 10.20.193.92:0/1288000162 shutdown_connections 2026-02-13T04:04:26.291 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.288+0000 7f9b4ffff6c0 1 --2- 10.20.193.92:0/1288000162 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f9b240b56d0 0x7f9b240d5b80 unknown :-1 s=CLOSED pgs=240 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:26.291 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.288+0000 7f9b4ffff6c0 1 --2- 10.20.193.92:0/1288000162 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f9b50115270 0x7f9b5011d2d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:26.291 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.288+0000 7f9b4ffff6c0 1 --2- 10.20.193.92:0/1288000162 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f9b50122690 0x7f9b50122b30 unknown :-1 s=CLOSED pgs=307 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:26.292 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.288+0000 7f9b4ffff6c0 1 --2- 10.20.193.92:0/1288000162 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f9b5010f060 0x7f9b5011cd90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:26.292 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.288+0000 7f9b4ffff6c0 1 -- 10.20.193.92:0/1288000162 >> 10.20.193.92:0/1288000162 conn(0x7f9b500ec980 msgr2=0x7f9b5010cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:04:26.292 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.288+0000 7f9b4ffff6c0 1 -- 10.20.193.92:0/1288000162 shutdown_connections 2026-02-13T04:04:26.292 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:26.288+0000 7f9b4ffff6c0 1 -- 10.20.193.92:0/1288000162 wait complete. 2026-02-13T04:04:27.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:26 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/1288000162' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:27.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:26 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/1288000162' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:27.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:26 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1288000162' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:28.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:27 trial158 ceph-mon[27763]: pgmap v292: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 8 op/s 2026-02-13T04:04:28.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:27 trial099 ceph-mon[27808]: pgmap v292: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 8 op/s 2026-02-13T04:04:28.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:27 trial092 ceph-mon[23047]: pgmap v292: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 8 op/s 2026-02-13T04:04:29.395 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:04:29.579 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:04:29.768 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.765+0000 7fe4049ac6c0 1 -- 10.20.193.92:0/3472317678 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe3fc115410 msgr2=0x7fe3fc175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:29.768 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.765+0000 7fe4049ac6c0 1 --2- 10.20.193.92:0/3472317678 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe3fc115410 0x7fe3fc175db0 secure :-1 s=READY pgs=308 gs=3 cs=0 l=1 c_cookie=16483862482173630740 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3f000a9b0 tx=0x7fe3f002fd20 comp rx=0 tx=0).stop 2026-02-13T04:04:29.768 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.765+0000 7fe4049ac6c0 1 -- 10.20.193.92:0/3472317678 shutdown_connections 2026-02-13T04:04:29.768 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.765+0000 7fe4049ac6c0 1 --2- 10.20.193.92:0/3472317678 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe3fc115410 0x7fe3fc175db0 unknown :-1 s=CLOSED pgs=308 gs=3 cs=0 l=1 c_cookie=16483862482173630740 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:29.769 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.765+0000 7fe4049ac6c0 1 --2- 10.20.193.92:0/3472317678 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe3fc10fbf0 0x7fe3fc114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:29.769 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.765+0000 7fe4049ac6c0 1 --2- 10.20.193.92:0/3472317678 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe3fc10f200 0x7fe3fc10f5d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:29.769 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.765+0000 7fe4049ac6c0 1 -- 10.20.193.92:0/3472317678 >> 10.20.193.92:0/3472317678 conn(0x7fe3fc0ecb00 msgr2=0x7fe3fc10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:04:29.769 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.765+0000 7fe4049ac6c0 1 -- 10.20.193.92:0/3472317678 shutdown_connections 2026-02-13T04:04:29.769 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.765+0000 7fe4049ac6c0 1 -- 10.20.193.92:0/3472317678 wait complete. 2026-02-13T04:04:29.769 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.766+0000 7fe4049ac6c0 1 Processor -- start 2026-02-13T04:04:29.770 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.766+0000 7fe4049ac6c0 1 -- start start 2026-02-13T04:04:29.771 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.766+0000 7fe4049ac6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe3fc10f200 0x7fe3fc11cf00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:29.771 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.766+0000 7fe4049ac6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe3fc115410 0x7fe3fc11d440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:29.771 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.766+0000 7fe4049ac6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe3fc122800 0x7fe3fc122ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:29.771 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.766+0000 7fe4049ac6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe3fc123210 con 0x7fe3fc10f200 2026-02-13T04:04:29.771 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.766+0000 7fe4049ac6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fe3fc123380 con 0x7fe3fc122800 2026-02-13T04:04:29.771 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.766+0000 7fe4049ac6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fe3fc123540 con 0x7fe3fc115410 2026-02-13T04:04:29.771 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.766+0000 7fe40271d6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe3fc10f200 0x7fe3fc11cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:29.771 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.766+0000 7fe401f1c6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe3fc115410 0x7fe3fc11d440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:29.771 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.766+0000 7fe401f1c6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe3fc115410 0x7fe3fc11d440 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:56100/0 (socket says 10.20.193.92:56100) 2026-02-13T04:04:29.771 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.766+0000 7fe401f1c6c0 1 -- 10.20.193.92:0/3252621272 learned_addr learned my addr 10.20.193.92:0/3252621272 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:04:29.771 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.766+0000 7fe402f1e6c0 1 --2- 10.20.193.92:0/3252621272 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe3fc122800 0x7fe3fc122ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:29.772 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.766+0000 7fe40271d6c0 1 -- 10.20.193.92:0/3252621272 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe3fc115410 msgr2=0x7fe3fc11d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:29.772 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.766+0000 7fe40271d6c0 1 --2- 10.20.193.92:0/3252621272 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe3fc115410 0x7fe3fc11d440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:29.772 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.766+0000 7fe40271d6c0 1 -- 10.20.193.92:0/3252621272 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe3fc122800 msgr2=0x7fe3fc122ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:29.772 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.766+0000 7fe40271d6c0 1 --2- 10.20.193.92:0/3252621272 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe3fc122800 0x7fe3fc122ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:29.772 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.766+0000 7fe40271d6c0 1 -- 10.20.193.92:0/3252621272 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3f000a5b0 con 0x7fe3fc10f200 2026-02-13T04:04:29.772 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.767+0000 7fe40271d6c0 1 --2- 10.20.193.92:0/3252621272 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe3fc10f200 0x7fe3fc11cf00 secure :-1 s=READY pgs=309 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3f4004750 tx=0x7fe3f400bbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:04:29.772 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.767+0000 7fe3e77fe6c0 1 -- 10.20.193.92:0/3252621272 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3f4004a80 con 0x7fe3fc10f200 2026-02-13T04:04:29.772 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.767+0000 7fe3e77fe6c0 1 -- 10.20.193.92:0/3252621272 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fe3f4009030 con 0x7fe3fc10f200 2026-02-13T04:04:29.772 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.767+0000 7fe3e77fe6c0 1 -- 10.20.193.92:0/3252621272 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fe3f40071c0 con 0x7fe3fc10f200 2026-02-13T04:04:29.772 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.767+0000 7fe4049ac6c0 1 -- 10.20.193.92:0/3252621272 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3fc1639f0 con 0x7fe3fc10f200 2026-02-13T04:04:29.772 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.767+0000 7fe4049ac6c0 1 -- 10.20.193.92:0/3252621272 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3fc163ed0 con 0x7fe3fc10f200 2026-02-13T04:04:29.772 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.768+0000 7fe3e57fa6c0 1 -- 10.20.193.92:0/3252621272 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3fc1104d0 con 0x7fe3fc10f200 2026-02-13T04:04:29.774 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.770+0000 7fe3e77fe6c0 1 -- 10.20.193.92:0/3252621272 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fe3f4004d70 con 0x7fe3fc10f200 2026-02-13T04:04:29.774 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.772+0000 7fe3e77fe6c0 1 --2- 10.20.193.92:0/3252621272 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fe3d80b56d0 0x7fe3d80d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:29.775 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.772+0000 7fe3e77fe6c0 1 -- 10.20.193.92:0/3252621272 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7fe3f40e3b50 con 0x7fe3fc10f200 2026-02-13T04:04:29.775 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.772+0000 7fe401f1c6c0 1 --2- 10.20.193.92:0/3252621272 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fe3d80b56d0 0x7fe3d80d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:29.775 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.772+0000 7fe3e77fe6c0 1 -- 10.20.193.92:0/3252621272 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fe3f40a6530 con 0x7fe3fc10f200 2026-02-13T04:04:29.775 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.772+0000 7fe401f1c6c0 1 --2- 10.20.193.92:0/3252621272 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fe3d80b56d0 0x7fe3d80d5b80 secure :-1 s=READY pgs=241 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3fc123890 tx=0x7fe3e80094a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:04:29.899 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.896+0000 7fe3e57fa6c0 1 -- 10.20.193.92:0/3252621272 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fe3fc10fbf0 con 0x7fe3fc10f200 2026-02-13T04:04:29.899 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.897+0000 7fe3e77fe6c0 1 -- 10.20.193.92:0/3252621272 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fe3f40a96e0 con 0x7fe3fc10f200 2026-02-13T04:04:29.900 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:04:29.900 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:04:29.901 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.898+0000 7fe3e57fa6c0 1 -- 10.20.193.92:0/3252621272 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fe3d80b56d0 msgr2=0x7fe3d80d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:29.901 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.898+0000 7fe3e57fa6c0 1 --2- 10.20.193.92:0/3252621272 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fe3d80b56d0 0x7fe3d80d5b80 secure :-1 s=READY pgs=241 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3fc123890 tx=0x7fe3e80094a0 comp rx=0 tx=0).stop 2026-02-13T04:04:29.901 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.898+0000 7fe3e57fa6c0 1 -- 10.20.193.92:0/3252621272 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe3fc10f200 msgr2=0x7fe3fc11cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:29.901 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.898+0000 7fe3e57fa6c0 1 --2- 10.20.193.92:0/3252621272 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe3fc10f200 0x7fe3fc11cf00 secure :-1 s=READY pgs=309 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe3f4004750 tx=0x7fe3f400bbf0 comp rx=0 tx=0).stop 2026-02-13T04:04:29.901 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.898+0000 7fe3e57fa6c0 1 -- 10.20.193.92:0/3252621272 shutdown_connections 2026-02-13T04:04:29.901 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.898+0000 7fe3e57fa6c0 1 --2- 10.20.193.92:0/3252621272 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fe3d80b56d0 0x7fe3d80d5b80 unknown :-1 s=CLOSED pgs=241 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:29.901 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.898+0000 7fe3e57fa6c0 1 --2- 10.20.193.92:0/3252621272 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fe3fc122800 0x7fe3fc122ca0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:29.902 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.898+0000 7fe3e57fa6c0 1 --2- 10.20.193.92:0/3252621272 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fe3fc115410 0x7fe3fc11d440 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:29.902 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.898+0000 7fe3e57fa6c0 1 --2- 10.20.193.92:0/3252621272 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fe3fc10f200 0x7fe3fc11cf00 unknown :-1 s=CLOSED pgs=309 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:29.902 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.898+0000 7fe3e57fa6c0 1 -- 10.20.193.92:0/3252621272 >> 10.20.193.92:0/3252621272 conn(0x7fe3fc0ecb00 msgr2=0x7fe3fc10cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:04:29.902 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.898+0000 7fe3e57fa6c0 1 -- 10.20.193.92:0/3252621272 shutdown_connections 2026-02-13T04:04:29.902 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:29.898+0000 7fe3e57fa6c0 1 -- 10.20.193.92:0/3252621272 wait complete. 2026-02-13T04:04:29.962 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:29 trial092 ceph-mon[23047]: pgmap v293: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:04:30.078 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:29 trial158 ceph-mon[27763]: pgmap v293: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:04:30.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:29 trial099 ceph-mon[27808]: pgmap v293: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:04:31.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:30 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/3252621272' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:31.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:30 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/3252621272' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:31.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:30 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/3252621272' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:32.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:31 trial158 ceph-mon[27763]: pgmap v294: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:04:32.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:31 trial099 ceph-mon[27808]: pgmap v294: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:04:32.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:31 trial092 ceph-mon[23047]: pgmap v294: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:04:33.007 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:04:33.191 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:04:33.407 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.402+0000 7f11075776c0 1 -- 10.20.193.92:0/4211284479 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f110810fa50 msgr2=0x7f1108114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:33.407 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.402+0000 7f11075776c0 1 --2- 10.20.193.92:0/4211284479 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f110810fa50 0x7f1108114a90 secure :-1 s=READY pgs=310 gs=1 cs=0 l=1 c_cookie=15172797499608465882 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f10f00099a0 tx=0x7f10f002ed00 comp rx=0 tx=0).stop 2026-02-13T04:04:33.407 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.402+0000 7f11075776c0 1 -- 10.20.193.92:0/4211284479 shutdown_connections 2026-02-13T04:04:33.407 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.402+0000 7f11075776c0 1 --2- 10.20.193.92:0/4211284479 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f1108115270 0x7f1108175c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:33.408 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.402+0000 7f11075776c0 1 --2- 10.20.193.92:0/4211284479 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f110810fa50 0x7f1108114a90 unknown :-1 s=CLOSED pgs=310 gs=1 cs=0 l=1 c_cookie=15172797499608465882 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:33.408 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.402+0000 7f11075776c0 1 --2- 10.20.193.92:0/4211284479 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f110810f060 0x7f110810f430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:33.408 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.402+0000 7f11075776c0 1 -- 10.20.193.92:0/4211284479 >> 10.20.193.92:0/4211284479 conn(0x7f11080ec980 msgr2=0x7f110810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:04:33.408 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.402+0000 7f11075776c0 1 -- 10.20.193.92:0/4211284479 shutdown_connections 2026-02-13T04:04:33.408 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.402+0000 7f11075776c0 1 -- 10.20.193.92:0/4211284479 wait complete. 2026-02-13T04:04:33.408 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.403+0000 7f11075776c0 1 Processor -- start 2026-02-13T04:04:33.408 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.403+0000 7f11075776c0 1 -- start start 2026-02-13T04:04:33.408 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.404+0000 7f11075776c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f110810f060 0x7f11080f8e60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:33.408 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.404+0000 7f11075776c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1108115270 0x7f1108175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:33.408 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.404+0000 7f11075776c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f11080f9490 0x7f11080fe760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:33.408 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.404+0000 7f11075776c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f11080f9b80 con 0x7f1108115270 2026-02-13T04:04:33.409 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.404+0000 7f11075776c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f11080feca0 con 0x7f110810f060 2026-02-13T04:04:33.409 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.404+0000 7f11075776c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f11080fee60 con 0x7f11080f9490 2026-02-13T04:04:33.409 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.404+0000 7f1105d746c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1108115270 0x7f1108175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:33.409 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.404+0000 7f1105d746c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1108115270 0x7f1108175b10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:46976/0 (socket says 10.20.193.92:46976) 2026-02-13T04:04:33.409 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.404+0000 7f1105d746c0 1 -- 10.20.193.92:0/640119987 learned_addr learned my addr 10.20.193.92:0/640119987 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:04:33.409 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.404+0000 7f11065756c0 1 --2- 10.20.193.92:0/640119987 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f110810f060 0x7f11080f8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:33.409 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.404+0000 7f1106d766c0 1 --2- 10.20.193.92:0/640119987 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f11080f9490 0x7f11080fe760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:33.409 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.404+0000 7f1105d746c0 1 -- 10.20.193.92:0/640119987 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f11080f9490 msgr2=0x7f11080fe760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:33.409 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.404+0000 7f1105d746c0 1 --2- 10.20.193.92:0/640119987 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f11080f9490 0x7f11080fe760 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:33.409 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.404+0000 7f1105d746c0 1 -- 10.20.193.92:0/640119987 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f110810f060 msgr2=0x7f11080f8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:33.409 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.404+0000 7f1105d746c0 1 --2- 10.20.193.92:0/640119987 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f110810f060 0x7f11080f8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:33.409 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.404+0000 7f1105d746c0 1 -- 10.20.193.92:0/640119987 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10f0009590 con 0x7f1108115270 2026-02-13T04:04:33.410 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.404+0000 7f11065756c0 1 --2- 10.20.193.92:0/640119987 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f110810f060 0x7f11080f8e60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T04:04:33.410 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.404+0000 7f1106d766c0 1 --2- 10.20.193.92:0/640119987 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f11080f9490 0x7f11080fe760 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T04:04:33.410 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.404+0000 7f1105d746c0 1 --2- 10.20.193.92:0/640119987 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1108115270 0x7f1108175b10 secure :-1 s=READY pgs=311 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f10f00072f0 tx=0x7f10f002f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:04:33.410 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.405+0000 7f10ef7fe6c0 1 -- 10.20.193.92:0/640119987 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f10f00046b0 con 0x7f1108115270 2026-02-13T04:04:33.410 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.405+0000 7f10ef7fe6c0 1 -- 10.20.193.92:0/640119987 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f10f0002be0 con 0x7f1108115270 2026-02-13T04:04:33.410 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.405+0000 7f10ef7fe6c0 1 -- 10.20.193.92:0/640119987 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f10f0007670 con 0x7f1108115270 2026-02-13T04:04:33.410 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.405+0000 7f11075776c0 1 -- 10.20.193.92:0/640119987 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11080ff0e0 con 0x7f1108115270 2026-02-13T04:04:33.411 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.405+0000 7f11075776c0 1 -- 10.20.193.92:0/640119987 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11080ff560 con 0x7f1108115270 2026-02-13T04:04:33.411 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.405+0000 7f10ed7fa6c0 1 -- 10.20.193.92:0/640119987 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1108110330 con 0x7f1108115270 2026-02-13T04:04:33.411 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.407+0000 7f10ef7fe6c0 1 -- 10.20.193.92:0/640119987 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f10f00312e0 con 0x7f1108115270 2026-02-13T04:04:33.412 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.409+0000 7f10ef7fe6c0 1 --2- 10.20.193.92:0/640119987 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f10e00b5650 0x7f10e00d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:33.412 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.409+0000 7f10ef7fe6c0 1 -- 10.20.193.92:0/640119987 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f10f0107d70 con 0x7f1108115270 2026-02-13T04:04:33.412 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.409+0000 7f11065756c0 1 --2- 10.20.193.92:0/640119987 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f10e00b5650 0x7f10e00d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:33.412 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.409+0000 7f10ef7fe6c0 1 -- 10.20.193.92:0/640119987 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f10f01081f0 con 0x7f1108115270 2026-02-13T04:04:33.412 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.410+0000 7f11065756c0 1 --2- 10.20.193.92:0/640119987 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f10e00b5650 0x7f10e00d5b00 secure :-1 s=READY pgs=242 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f10fc004750 tx=0x7f10fc009390 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:04:33.539 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.536+0000 7f10ed7fa6c0 1 -- 10.20.193.92:0/640119987 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f110810f430 con 0x7f1108115270 2026-02-13T04:04:33.539 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.537+0000 7f10ef7fe6c0 1 -- 10.20.193.92:0/640119987 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f10f00ca710 con 0x7f1108115270 2026-02-13T04:04:33.540 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:04:33.540 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:04:33.541 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.538+0000 7f10ed7fa6c0 1 -- 10.20.193.92:0/640119987 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f10e00b5650 msgr2=0x7f10e00d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:33.541 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.538+0000 7f10ed7fa6c0 1 --2- 10.20.193.92:0/640119987 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f10e00b5650 0x7f10e00d5b00 secure :-1 s=READY pgs=242 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f10fc004750 tx=0x7f10fc009390 comp rx=0 tx=0).stop 2026-02-13T04:04:33.541 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.538+0000 7f10ed7fa6c0 1 -- 10.20.193.92:0/640119987 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1108115270 msgr2=0x7f1108175b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:33.541 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.538+0000 7f10ed7fa6c0 1 --2- 10.20.193.92:0/640119987 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1108115270 0x7f1108175b10 secure :-1 s=READY pgs=311 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f10f00072f0 tx=0x7f10f002f810 comp rx=0 tx=0).stop 2026-02-13T04:04:33.541 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.538+0000 7f10ed7fa6c0 1 -- 10.20.193.92:0/640119987 shutdown_connections 2026-02-13T04:04:33.541 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.538+0000 7f10ed7fa6c0 1 --2- 10.20.193.92:0/640119987 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f11080f9490 0x7f11080fe760 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:33.541 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.538+0000 7f10ed7fa6c0 1 --2- 10.20.193.92:0/640119987 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f1108115270 0x7f1108175b10 unknown :-1 s=CLOSED pgs=311 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:33.542 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.538+0000 7f10ed7fa6c0 1 --2- 10.20.193.92:0/640119987 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f10e00b5650 0x7f10e00d5b00 unknown :-1 s=CLOSED pgs=242 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:33.542 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.538+0000 7f10ed7fa6c0 1 --2- 10.20.193.92:0/640119987 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f110810f060 0x7f11080f8e60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:33.542 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.538+0000 7f10ed7fa6c0 1 -- 10.20.193.92:0/640119987 >> 10.20.193.92:0/640119987 conn(0x7f11080ec980 msgr2=0x7f110810d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:04:33.542 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.538+0000 7f10ed7fa6c0 1 -- 10.20.193.92:0/640119987 shutdown_connections 2026-02-13T04:04:33.542 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:33.538+0000 7f10ed7fa6c0 1 -- 10.20.193.92:0/640119987 wait complete. 2026-02-13T04:04:33.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:33 trial092 ceph-mon[23047]: pgmap v295: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:04:33.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:33 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/640119987' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:34.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:33 trial158 ceph-mon[27763]: pgmap v295: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:04:34.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:33 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/640119987' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:34.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:33 trial099 ceph-mon[27808]: pgmap v295: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:04:34.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:33 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/640119987' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:36.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:35 trial158 ceph-mon[27763]: pgmap v296: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:04:36.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:35 trial099 ceph-mon[27808]: pgmap v296: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:04:36.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:35 trial092 ceph-mon[23047]: pgmap v296: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:04:36.645 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:04:36.831 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:04:37.025 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.022+0000 7f5df439c6c0 1 -- 10.20.193.92:0/1076938918 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5dec115410 msgr2=0x7f5dec175db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:37.026 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.022+0000 7f5df439c6c0 1 --2- 10.20.193.92:0/1076938918 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5dec115410 0x7f5dec175db0 secure :-1 s=READY pgs=312 gs=1 cs=0 l=1 c_cookie=5820426051139145220 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5de800aa70 tx=0x7f5de802fde0 comp rx=0 tx=0).stop 2026-02-13T04:04:37.026 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.022+0000 7f5df439c6c0 1 -- 10.20.193.92:0/1076938918 shutdown_connections 2026-02-13T04:04:37.026 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.022+0000 7f5df439c6c0 1 --2- 10.20.193.92:0/1076938918 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5dec115410 0x7f5dec175db0 unknown :-1 s=CLOSED pgs=312 gs=1 cs=0 l=1 c_cookie=5820426051139145220 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:37.026 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.022+0000 7f5df439c6c0 1 --2- 10.20.193.92:0/1076938918 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f5dec10fbf0 0x7f5dec114c30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:37.026 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.022+0000 7f5df439c6c0 1 --2- 10.20.193.92:0/1076938918 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5dec10f200 0x7f5dec10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:37.026 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.022+0000 7f5df439c6c0 1 -- 10.20.193.92:0/1076938918 >> 10.20.193.92:0/1076938918 conn(0x7f5dec0ecb00 msgr2=0x7f5dec10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:04:37.026 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.022+0000 7f5df439c6c0 1 -- 10.20.193.92:0/1076938918 shutdown_connections 2026-02-13T04:04:37.026 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.022+0000 7f5df439c6c0 1 -- 10.20.193.92:0/1076938918 wait complete. 2026-02-13T04:04:37.028 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.023+0000 7f5df439c6c0 1 Processor -- start 2026-02-13T04:04:37.028 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.023+0000 7f5df439c6c0 1 -- start start 2026-02-13T04:04:37.028 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.024+0000 7f5df439c6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f5dec10f200 0x7f5dec11cf50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:37.029 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.024+0000 7f5df439c6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5dec115410 0x7f5dec11d490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:37.029 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.024+0000 7f5df439c6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5dec122850 0x7f5dec122cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:37.029 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.024+0000 7f5df439c6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec123260 con 0x7f5dec115410 2026-02-13T04:04:37.029 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.024+0000 7f5df439c6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec1233d0 con 0x7f5dec122850 2026-02-13T04:04:37.029 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.024+0000 7f5df439c6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f5dec123590 con 0x7f5dec10f200 2026-02-13T04:04:37.029 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.024+0000 7f5df19106c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5dec115410 0x7f5dec11d490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:37.029 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.024+0000 7f5df19106c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5dec115410 0x7f5dec11d490 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:33870/0 (socket says 10.20.193.92:33870) 2026-02-13T04:04:37.029 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.024+0000 7f5df19106c0 1 -- 10.20.193.92:0/3308573201 learned_addr learned my addr 10.20.193.92:0/3308573201 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:04:37.029 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.024+0000 7f5df21116c0 1 --2- 10.20.193.92:0/3308573201 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f5dec10f200 0x7f5dec11cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:37.029 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.024+0000 7f5df19106c0 1 -- 10.20.193.92:0/3308573201 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f5dec10f200 msgr2=0x7f5dec11cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:37.029 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.024+0000 7f5df19106c0 1 --2- 10.20.193.92:0/3308573201 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f5dec10f200 0x7f5dec11cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:37.030 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.024+0000 7f5df19106c0 1 -- 10.20.193.92:0/3308573201 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5dec122850 msgr2=0x7f5dec122cf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2026-02-13T04:04:37.030 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.024+0000 7f5df29126c0 1 --2- 10.20.193.92:0/3308573201 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5dec122850 0x7f5dec122cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:37.030 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.024+0000 7f5df19106c0 1 --2- 10.20.193.92:0/3308573201 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5dec122850 0x7f5dec122cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:37.030 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.024+0000 7f5df19106c0 1 -- 10.20.193.92:0/3308573201 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5de800a660 con 0x7f5dec115410 2026-02-13T04:04:37.030 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.024+0000 7f5df21116c0 1 --2- 10.20.193.92:0/3308573201 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f5dec10f200 0x7f5dec11cf50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-13T04:04:37.030 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.024+0000 7f5df19106c0 1 --2- 10.20.193.92:0/3308573201 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5dec115410 0x7f5dec11d490 secure :-1 s=READY pgs=313 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5de000b6c0 tx=0x7f5de000bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:04:37.030 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.024+0000 7f5dd37fe6c0 1 -- 10.20.193.92:0/3308573201 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5de0004250 con 0x7f5dec115410 2026-02-13T04:04:37.030 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.024+0000 7f5dd37fe6c0 1 -- 10.20.193.92:0/3308573201 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f5de0009070 con 0x7f5dec115410 2026-02-13T04:04:37.030 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.024+0000 7f5dd37fe6c0 1 -- 10.20.193.92:0/3308573201 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5de00071c0 con 0x7f5dec115410 2026-02-13T04:04:37.030 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.024+0000 7f5df439c6c0 1 -- 10.20.193.92:0/3308573201 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dec163a40 con 0x7f5dec115410 2026-02-13T04:04:37.030 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.025+0000 7f5df439c6c0 1 -- 10.20.193.92:0/3308573201 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dec163ed0 con 0x7f5dec115410 2026-02-13T04:04:37.031 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.025+0000 7f5df439c6c0 1 -- 10.20.193.92:0/3308573201 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dec1104d0 con 0x7f5dec115410 2026-02-13T04:04:37.031 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.027+0000 7f5dd37fe6c0 1 -- 10.20.193.92:0/3308573201 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f5de00043b0 con 0x7f5dec115410 2026-02-13T04:04:37.032 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.029+0000 7f5dd37fe6c0 1 --2- 10.20.193.92:0/3308573201 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f5dc80b56d0 0x7f5dc80d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:37.032 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.029+0000 7f5dd37fe6c0 1 -- 10.20.193.92:0/3308573201 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f5de00e3c20 con 0x7f5dec115410 2026-02-13T04:04:37.032 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.029+0000 7f5df21116c0 1 --2- 10.20.193.92:0/3308573201 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f5dc80b56d0 0x7f5dc80d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:37.032 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.029+0000 7f5dd37fe6c0 1 -- 10.20.193.92:0/3308573201 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f5de011c680 con 0x7f5dec115410 2026-02-13T04:04:37.032 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.030+0000 7f5df21116c0 1 --2- 10.20.193.92:0/3308573201 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f5dc80b56d0 0x7f5dc80d5b80 secure :-1 s=READY pgs=243 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ddc004750 tx=0x7f5ddc005f10 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:04:37.156 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.153+0000 7f5df439c6c0 1 -- 10.20.193.92:0/3308573201 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5dec10f5d0 con 0x7f5dec115410 2026-02-13T04:04:37.156 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.153+0000 7f5dd37fe6c0 1 -- 10.20.193.92:0/3308573201 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f5de00a65c0 con 0x7f5dec115410 2026-02-13T04:04:37.157 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:04:37.157 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:04:37.157 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.154+0000 7f5df439c6c0 1 -- 10.20.193.92:0/3308573201 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f5dc80b56d0 msgr2=0x7f5dc80d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:37.158 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.154+0000 7f5df439c6c0 1 --2- 10.20.193.92:0/3308573201 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f5dc80b56d0 0x7f5dc80d5b80 secure :-1 s=READY pgs=243 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ddc004750 tx=0x7f5ddc005f10 comp rx=0 tx=0).stop 2026-02-13T04:04:37.158 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.154+0000 7f5df439c6c0 1 -- 10.20.193.92:0/3308573201 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5dec115410 msgr2=0x7f5dec11d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:37.158 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.154+0000 7f5df439c6c0 1 --2- 10.20.193.92:0/3308573201 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5dec115410 0x7f5dec11d490 secure :-1 s=READY pgs=313 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5de000b6c0 tx=0x7f5de000bb90 comp rx=0 tx=0).stop 2026-02-13T04:04:37.158 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.155+0000 7f5df439c6c0 1 -- 10.20.193.92:0/3308573201 shutdown_connections 2026-02-13T04:04:37.158 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.155+0000 7f5df439c6c0 1 --2- 10.20.193.92:0/3308573201 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f5dc80b56d0 0x7f5dc80d5b80 unknown :-1 s=CLOSED pgs=243 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:37.158 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.155+0000 7f5df439c6c0 1 --2- 10.20.193.92:0/3308573201 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5dec122850 0x7f5dec122cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:37.158 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.155+0000 7f5df439c6c0 1 --2- 10.20.193.92:0/3308573201 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5dec115410 0x7f5dec11d490 unknown :-1 s=CLOSED pgs=313 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:37.158 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.155+0000 7f5df439c6c0 1 --2- 10.20.193.92:0/3308573201 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f5dec10f200 0x7f5dec11cf50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:37.158 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.155+0000 7f5df439c6c0 1 -- 10.20.193.92:0/3308573201 >> 10.20.193.92:0/3308573201 conn(0x7f5dec0ecb00 msgr2=0x7f5dec10cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:04:37.159 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.155+0000 7f5df439c6c0 1 -- 10.20.193.92:0/3308573201 shutdown_connections 2026-02-13T04:04:37.159 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:37.155+0000 7f5df439c6c0 1 -- 10.20.193.92:0/3308573201 wait complete. 2026-02-13T04:04:38.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:37 trial158 ceph-mon[27763]: pgmap v297: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 8 op/s 2026-02-13T04:04:38.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:37 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/3308573201' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:38.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:37 trial099 ceph-mon[27808]: pgmap v297: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 8 op/s 2026-02-13T04:04:38.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:37 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/3308573201' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:38.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:37 trial092 ceph-mon[23047]: pgmap v297: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 8 op/s 2026-02-13T04:04:38.184 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:37 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/3308573201' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:40.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:39 trial158 ceph-mon[27763]: pgmap v298: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:04:40.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:39 trial099 ceph-mon[27808]: pgmap v298: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:04:40.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:39 trial092 ceph-mon[23047]: pgmap v298: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:04:40.260 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:04:40.444 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:04:40.634 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.631+0000 7f75c2af76c0 1 -- 10.20.193.92:0/2075968088 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f75bc10ba00 msgr2=0x7f75bc10bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:40.634 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.631+0000 7f75c2af76c0 1 --2- 10.20.193.92:0/2075968088 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f75bc10ba00 0x7f75bc10bdd0 secure :-1 s=READY pgs=314 gs=1 cs=0 l=1 c_cookie=12643537993326664854 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f75ac009970 tx=0x7f75ac02ed20 comp rx=0 tx=0).stop 2026-02-13T04:04:40.634 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.631+0000 7f75c2af76c0 1 -- 10.20.193.92:0/2075968088 shutdown_connections 2026-02-13T04:04:40.634 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.631+0000 7f75c2af76c0 1 --2- 10.20.193.92:0/2075968088 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f75bc155730 0x7f75bc175b10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:40.635 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.631+0000 7f75c2af76c0 1 --2- 10.20.193.92:0/2075968088 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f75bc10c310 0x7f75bc1551f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:40.635 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.631+0000 7f75c2af76c0 1 --2- 10.20.193.92:0/2075968088 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f75bc10ba00 0x7f75bc10bdd0 unknown :-1 s=CLOSED pgs=314 gs=1 cs=0 l=1 c_cookie=12643537993326664854 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:40.635 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.631+0000 7f75c2af76c0 1 -- 10.20.193.92:0/2075968088 >> 10.20.193.92:0/2075968088 conn(0x7f75bc0e9700 msgr2=0x7f75bc109b10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:04:40.635 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.631+0000 7f75c2af76c0 1 -- 10.20.193.92:0/2075968088 shutdown_connections 2026-02-13T04:04:40.635 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.631+0000 7f75c2af76c0 1 -- 10.20.193.92:0/2075968088 wait complete. 2026-02-13T04:04:40.636 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.632+0000 7f75c2af76c0 1 Processor -- start 2026-02-13T04:04:40.637 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.632+0000 7f75c2af76c0 1 -- start start 2026-02-13T04:04:40.637 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.632+0000 7f75c2af76c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f75bc10ba00 0x7f75bc160280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:40.637 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.632+0000 7f75c2af76c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f75bc10c310 0x7f75bc1607c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:40.637 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.632+0000 7f75c2af76c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f75bc155730 0x7f75bc165b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:40.637 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.632+0000 7f75c2af76c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f75bc1661d0 con 0x7f75bc155730 2026-02-13T04:04:40.637 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.632+0000 7f75c2af76c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f75bc166340 con 0x7f75bc10ba00 2026-02-13T04:04:40.637 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.632+0000 7f75c2af76c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f75bc166500 con 0x7f75bc10c310 2026-02-13T04:04:40.637 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.632+0000 7f75c08686c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f75bc10ba00 0x7f75bc160280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:40.637 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.632+0000 7f75c10696c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f75bc155730 0x7f75bc165b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:40.637 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.632+0000 7f75c08686c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f75bc10ba00 0x7f75bc160280 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:58698/0 (socket says 10.20.193.92:58698) 2026-02-13T04:04:40.638 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.632+0000 7f75c08686c0 1 -- 10.20.193.92:0/3227741808 learned_addr learned my addr 10.20.193.92:0/3227741808 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:04:40.638 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.632+0000 7f75b3fff6c0 1 --2- 10.20.193.92:0/3227741808 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f75bc10c310 0x7f75bc1607c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:40.638 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.633+0000 7f75c10696c0 1 -- 10.20.193.92:0/3227741808 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f75bc10c310 msgr2=0x7f75bc1607c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:40.638 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.633+0000 7f75c10696c0 1 --2- 10.20.193.92:0/3227741808 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f75bc10c310 0x7f75bc1607c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:40.638 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.633+0000 7f75c10696c0 1 -- 10.20.193.92:0/3227741808 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f75bc10ba00 msgr2=0x7f75bc160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:40.638 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.633+0000 7f75c10696c0 1 --2- 10.20.193.92:0/3227741808 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f75bc10ba00 0x7f75bc160280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:40.638 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.633+0000 7f75c10696c0 1 -- 10.20.193.92:0/3227741808 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75ac009590 con 0x7f75bc155730 2026-02-13T04:04:40.638 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.633+0000 7f75c08686c0 1 --2- 10.20.193.92:0/3227741808 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f75bc10ba00 0x7f75bc160280 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T04:04:40.638 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.633+0000 7f75c10696c0 1 --2- 10.20.193.92:0/3227741808 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f75bc155730 0x7f75bc165b80 secure :-1 s=READY pgs=315 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f75b8006fd0 tx=0x7f75b800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:04:40.638 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.633+0000 7f75b1ffb6c0 1 -- 10.20.193.92:0/3227741808 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f75b8003c40 con 0x7f75bc155730 2026-02-13T04:04:40.638 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.633+0000 7f75b1ffb6c0 1 -- 10.20.193.92:0/3227741808 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f75b800a070 con 0x7f75bc155730 2026-02-13T04:04:40.638 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.633+0000 7f75c2af76c0 1 -- 10.20.193.92:0/3227741808 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75bc1667e0 con 0x7f75bc155730 2026-02-13T04:04:40.639 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.633+0000 7f75c2af76c0 1 -- 10.20.193.92:0/3227741808 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75bc152370 con 0x7f75bc155730 2026-02-13T04:04:40.639 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.633+0000 7f75b1ffb6c0 1 -- 10.20.193.92:0/3227741808 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f75b80081c0 con 0x7f75bc155730 2026-02-13T04:04:40.639 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.633+0000 7f75c2af76c0 1 -- 10.20.193.92:0/3227741808 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75bc05fb90 con 0x7f75bc155730 2026-02-13T04:04:40.639 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.636+0000 7f75b1ffb6c0 1 -- 10.20.193.92:0/3227741808 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f75b8005860 con 0x7f75bc155730 2026-02-13T04:04:40.641 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.638+0000 7f75b1ffb6c0 1 --2- 10.20.193.92:0/3227741808 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f75980b56d0 0x7f75980d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:40.641 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.638+0000 7f75b1ffb6c0 1 -- 10.20.193.92:0/3227741808 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f75b80e4a80 con 0x7f75bc155730 2026-02-13T04:04:40.641 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.638+0000 7f75c08686c0 1 --2- 10.20.193.92:0/3227741808 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f75980b56d0 0x7f75980d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:40.641 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.638+0000 7f75b1ffb6c0 1 -- 10.20.193.92:0/3227741808 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f75b811d5e0 con 0x7f75bc155730 2026-02-13T04:04:40.641 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.638+0000 7f75c08686c0 1 --2- 10.20.193.92:0/3227741808 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f75980b56d0 0x7f75980d5b80 secure :-1 s=READY pgs=244 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f75ac0023e0 tx=0x7f75ac005910 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:04:40.766 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.763+0000 7f75c2af76c0 1 -- 10.20.193.92:0/3227741808 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f75bc1613d0 con 0x7f75bc155730 2026-02-13T04:04:40.766 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.763+0000 7f75b1ffb6c0 1 -- 10.20.193.92:0/3227741808 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f75b80a7420 con 0x7f75bc155730 2026-02-13T04:04:40.767 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:04:40.767 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:04:40.768 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.765+0000 7f75c2af76c0 1 -- 10.20.193.92:0/3227741808 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f75980b56d0 msgr2=0x7f75980d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:40.768 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.765+0000 7f75c2af76c0 1 --2- 10.20.193.92:0/3227741808 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f75980b56d0 0x7f75980d5b80 secure :-1 s=READY pgs=244 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f75ac0023e0 tx=0x7f75ac005910 comp rx=0 tx=0).stop 2026-02-13T04:04:40.768 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.765+0000 7f75c2af76c0 1 -- 10.20.193.92:0/3227741808 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f75bc155730 msgr2=0x7f75bc165b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:40.768 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.765+0000 7f75c2af76c0 1 --2- 10.20.193.92:0/3227741808 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f75bc155730 0x7f75bc165b80 secure :-1 s=READY pgs=315 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f75b8006fd0 tx=0x7f75b800cc00 comp rx=0 tx=0).stop 2026-02-13T04:04:40.768 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.765+0000 7f75c2af76c0 1 -- 10.20.193.92:0/3227741808 shutdown_connections 2026-02-13T04:04:40.768 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.765+0000 7f75c2af76c0 1 --2- 10.20.193.92:0/3227741808 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f75bc155730 0x7f75bc165b80 unknown :-1 s=CLOSED pgs=315 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:40.768 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.765+0000 7f75c2af76c0 1 --2- 10.20.193.92:0/3227741808 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f75bc10c310 0x7f75bc1607c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:40.768 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.765+0000 7f75c2af76c0 1 --2- 10.20.193.92:0/3227741808 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f75980b56d0 0x7f75980d5b80 unknown :-1 s=CLOSED pgs=244 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:40.769 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.765+0000 7f75c2af76c0 1 --2- 10.20.193.92:0/3227741808 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f75bc10ba00 0x7f75bc160280 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:40.769 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.765+0000 7f75c2af76c0 1 -- 10.20.193.92:0/3227741808 >> 10.20.193.92:0/3227741808 conn(0x7f75bc0e9700 msgr2=0x7f75bc109ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:04:40.769 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.765+0000 7f75c2af76c0 1 -- 10.20.193.92:0/3227741808 shutdown_connections 2026-02-13T04:04:40.769 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:40.765+0000 7f75c2af76c0 1 -- 10.20.193.92:0/3227741808 wait complete. 2026-02-13T04:04:40.826 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:40 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/3227741808' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:41.078 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:40 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/3227741808' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:41.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:40 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/3227741808' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:42.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:41 trial158 ceph-mon[27763]: pgmap v299: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:04:42.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:41 trial099 ceph-mon[27808]: pgmap v299: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:04:42.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:41 trial092 ceph-mon[23047]: pgmap v299: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:04:43.905 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:04:44.078 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:43 trial158 ceph-mon[27763]: pgmap v300: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:04:44.091 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:04:44.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:43 trial099 ceph-mon[27808]: pgmap v300: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:04:44.133 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:43 trial092 ceph-mon[23047]: pgmap v300: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:04:44.289 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.286+0000 7f73aae366c0 1 -- 10.20.193.92:0/2876397336 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f73a41137a0 msgr2=0x7f73a4113b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:44.290 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.286+0000 7f73aae366c0 1 --2- 10.20.193.92:0/2876397336 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f73a41137a0 0x7f73a4113b70 secure :-1 s=READY pgs=316 gs=1 cs=0 l=1 c_cookie=4257873737304082359 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f73940099a0 tx=0x7f739402ed50 comp rx=0 tx=0).stop 2026-02-13T04:04:44.290 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.287+0000 7f73aae366c0 1 -- 10.20.193.92:0/2876397336 shutdown_connections 2026-02-13T04:04:44.290 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.287+0000 7f73aae366c0 1 --2- 10.20.193.92:0/2876397336 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f73a4114190 0x7f73a4115d40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:44.290 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.287+0000 7f73aae366c0 1 --2- 10.20.193.92:0/2876397336 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f73a4116520 0x7f73a417a100 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:44.290 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.287+0000 7f73aae366c0 1 --2- 10.20.193.92:0/2876397336 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f73a41137a0 0x7f73a4113b70 unknown :-1 s=CLOSED pgs=316 gs=1 cs=0 l=1 c_cookie=4257873737304082359 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:44.290 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.287+0000 7f73aae366c0 1 -- 10.20.193.92:0/2876397336 >> 10.20.193.92:0/2876397336 conn(0x7f73a4061510 msgr2=0x7f73a4061910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:04:44.290 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.287+0000 7f73aae366c0 1 -- 10.20.193.92:0/2876397336 shutdown_connections 2026-02-13T04:04:44.290 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.287+0000 7f73aae366c0 1 -- 10.20.193.92:0/2876397336 wait complete. 2026-02-13T04:04:44.292 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.287+0000 7f73aae366c0 1 Processor -- start 2026-02-13T04:04:44.292 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.287+0000 7f73aae366c0 1 -- start start 2026-02-13T04:04:44.292 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.288+0000 7f73aae366c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f73a41137a0 0x7f73a4121450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:44.292 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.288+0000 7f73aae366c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f73a4116520 0x7f73a4121990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:44.293 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.288+0000 7f73aae366c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f73a4126d50 0x7f73a41271f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:44.293 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.288+0000 7f73aae366c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f73a4127760 con 0x7f73a4126d50 2026-02-13T04:04:44.293 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.288+0000 7f73aae366c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f73a41278d0 con 0x7f73a41137a0 2026-02-13T04:04:44.293 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.288+0000 7f73aae366c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f73a4127a90 con 0x7f73a4116520 2026-02-13T04:04:44.293 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.288+0000 7f73aa6356c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f73a4126d50 0x7f73a41271f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:44.293 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.288+0000 7f73aa6356c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f73a4126d50 0x7f73a41271f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:33910/0 (socket says 10.20.193.92:33910) 2026-02-13T04:04:44.293 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.288+0000 7f73aa6356c0 1 -- 10.20.193.92:0/2734094631 learned_addr learned my addr 10.20.193.92:0/2734094631 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:04:44.293 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.288+0000 7f73a96336c0 1 --2- 10.20.193.92:0/2734094631 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f73a4116520 0x7f73a4121990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:44.293 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.288+0000 7f73a9e346c0 1 --2- 10.20.193.92:0/2734094631 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f73a41137a0 0x7f73a4121450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:44.293 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.288+0000 7f73aa6356c0 1 -- 10.20.193.92:0/2734094631 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f73a4116520 msgr2=0x7f73a4121990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:44.294 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.288+0000 7f73aa6356c0 1 --2- 10.20.193.92:0/2734094631 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f73a4116520 0x7f73a4121990 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:44.294 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.288+0000 7f73aa6356c0 1 -- 10.20.193.92:0/2734094631 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f73a41137a0 msgr2=0x7f73a4121450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:44.294 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.288+0000 7f73aa6356c0 1 --2- 10.20.193.92:0/2734094631 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f73a41137a0 0x7f73a4121450 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:44.294 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.288+0000 7f73aa6356c0 1 -- 10.20.193.92:0/2734094631 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7394009590 con 0x7f73a4126d50 2026-02-13T04:04:44.294 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.288+0000 7f73a96336c0 1 --2- 10.20.193.92:0/2734094631 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f73a4116520 0x7f73a4121990 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T04:04:44.294 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.288+0000 7f73a9e346c0 1 --2- 10.20.193.92:0/2734094631 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f73a41137a0 0x7f73a4121450 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T04:04:44.294 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.288+0000 7f73aa6356c0 1 --2- 10.20.193.92:0/2734094631 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f73a4126d50 0x7f73a41271f0 secure :-1 s=READY pgs=317 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f73a0006ea0 tx=0x7f73a000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:04:44.294 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.288+0000 7f7392ffd6c0 1 -- 10.20.193.92:0/2734094631 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f73a0003a30 con 0x7f73a4126d50 2026-02-13T04:04:44.294 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.288+0000 7f73aae366c0 1 -- 10.20.193.92:0/2734094631 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73a4167f40 con 0x7f73a4126d50 2026-02-13T04:04:44.294 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.288+0000 7f73aae366c0 1 -- 10.20.193.92:0/2734094631 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73a41683d0 con 0x7f73a4126d50 2026-02-13T04:04:44.294 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.289+0000 7f7392ffd6c0 1 -- 10.20.193.92:0/2734094631 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f73a0005560 con 0x7f73a4126d50 2026-02-13T04:04:44.294 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.289+0000 7f7392ffd6c0 1 -- 10.20.193.92:0/2734094631 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f73a000de50 con 0x7f73a4126d50 2026-02-13T04:04:44.294 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.289+0000 7f73aae366c0 1 -- 10.20.193.92:0/2734094631 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73a4114840 con 0x7f73a4126d50 2026-02-13T04:04:44.295 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.291+0000 7f7392ffd6c0 1 -- 10.20.193.92:0/2734094631 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f73a0003b90 con 0x7f73a4126d50 2026-02-13T04:04:44.296 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.293+0000 7f7392ffd6c0 1 --2- 10.20.193.92:0/2734094631 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f73800b56d0 0x7f73800d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:44.296 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.293+0000 7f7392ffd6c0 1 -- 10.20.193.92:0/2734094631 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f73a00e4c70 con 0x7f73a4126d50 2026-02-13T04:04:44.296 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.293+0000 7f7392ffd6c0 1 -- 10.20.193.92:0/2734094631 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f73a00e50f0 con 0x7f73a4126d50 2026-02-13T04:04:44.296 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.293+0000 7f73a9e346c0 1 --2- 10.20.193.92:0/2734094631 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f73800b56d0 0x7f73800d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:44.297 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.294+0000 7f73a9e346c0 1 --2- 10.20.193.92:0/2734094631 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f73800b56d0 0x7f73800d5b80 secure :-1 s=READY pgs=245 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7394005b40 tx=0x7f7394009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:04:44.421 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.419+0000 7f73aae366c0 1 -- 10.20.193.92:0/2734094631 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f73a4113b70 con 0x7f73a4126d50 2026-02-13T04:04:44.422 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.419+0000 7f7392ffd6c0 1 -- 10.20.193.92:0/2734094631 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f73a00a7610 con 0x7f73a4126d50 2026-02-13T04:04:44.422 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:04:44.422 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:04:44.423 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.421+0000 7f73aae366c0 1 -- 10.20.193.92:0/2734094631 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f73800b56d0 msgr2=0x7f73800d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:44.423 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.421+0000 7f73aae366c0 1 --2- 10.20.193.92:0/2734094631 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f73800b56d0 0x7f73800d5b80 secure :-1 s=READY pgs=245 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7394005b40 tx=0x7f7394009260 comp rx=0 tx=0).stop 2026-02-13T04:04:44.423 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.421+0000 7f73aae366c0 1 -- 10.20.193.92:0/2734094631 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f73a4126d50 msgr2=0x7f73a41271f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:44.423 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.421+0000 7f73aae366c0 1 --2- 10.20.193.92:0/2734094631 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f73a4126d50 0x7f73a41271f0 secure :-1 s=READY pgs=317 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f73a0006ea0 tx=0x7f73a000cca0 comp rx=0 tx=0).stop 2026-02-13T04:04:44.423 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.421+0000 7f73aae366c0 1 -- 10.20.193.92:0/2734094631 shutdown_connections 2026-02-13T04:04:44.423 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.421+0000 7f73aae366c0 1 --2- 10.20.193.92:0/2734094631 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f73a4126d50 0x7f73a41271f0 unknown :-1 s=CLOSED pgs=317 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:44.423 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.421+0000 7f73aae366c0 1 --2- 10.20.193.92:0/2734094631 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f73a4116520 0x7f73a4121990 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:44.423 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.421+0000 7f73aae366c0 1 --2- 10.20.193.92:0/2734094631 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f73800b56d0 0x7f73800d5b80 unknown :-1 s=CLOSED pgs=245 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:44.423 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.421+0000 7f73aae366c0 1 --2- 10.20.193.92:0/2734094631 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f73a41137a0 0x7f73a4121450 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:44.423 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.421+0000 7f73aae366c0 1 -- 10.20.193.92:0/2734094631 >> 10.20.193.92:0/2734094631 conn(0x7f73a4061510 msgr2=0x7f73a4116d50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:04:44.423 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.421+0000 7f73aae366c0 1 -- 10.20.193.92:0/2734094631 shutdown_connections 2026-02-13T04:04:44.423 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:44.421+0000 7f73aae366c0 1 -- 10.20.193.92:0/2734094631 wait complete. 2026-02-13T04:04:45.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:44 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/2734094631' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:45.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:44 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/2734094631' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:45.328 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:44 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/2734094631' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:46.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:45 trial099 ceph-mon[27808]: pgmap v301: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:04:46.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:45 trial092 ceph-mon[23047]: pgmap v301: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:04:46.328 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:45 trial158 ceph-mon[27763]: pgmap v301: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:04:47.527 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:04:47.711 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:04:47.912 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:47.910+0000 7f61822586c0 1 -- 10.20.193.92:0/2316999830 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f617c10d9a0 msgr2=0x7f617c1129e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:47.912 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:47.910+0000 7f61822586c0 1 --2- 10.20.193.92:0/2316999830 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f617c10d9a0 0x7f617c1129e0 secure :-1 s=READY pgs=318 gs=1 cs=0 l=1 c_cookie=6419259339950453906 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f616c0099a0 tx=0x7f616c02ed00 comp rx=0 tx=0).stop 2026-02-13T04:04:47.912 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:47.910+0000 7f61822586c0 1 -- 10.20.193.92:0/2316999830 shutdown_connections 2026-02-13T04:04:47.912 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:47.910+0000 7f61822586c0 1 --2- 10.20.193.92:0/2316999830 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f617c1131c0 0x7f617c173b60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:47.912 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:47.910+0000 7f61822586c0 1 --2- 10.20.193.92:0/2316999830 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f617c10d9a0 0x7f617c1129e0 unknown :-1 s=CLOSED pgs=318 gs=1 cs=0 l=1 c_cookie=6419259339950453906 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:47.912 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:47.910+0000 7f61822586c0 1 --2- 10.20.193.92:0/2316999830 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f617c10cfb0 0x7f617c10d380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:47.912 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:47.910+0000 7f61822586c0 1 -- 10.20.193.92:0/2316999830 >> 10.20.193.92:0/2316999830 conn(0x7f617c0ea8b0 msgr2=0x7f617c10acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:04:47.912 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:47.910+0000 7f61822586c0 1 -- 10.20.193.92:0/2316999830 shutdown_connections 2026-02-13T04:04:47.912 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:47.910+0000 7f61822586c0 1 -- 10.20.193.92:0/2316999830 wait complete. 2026-02-13T04:04:47.913 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:47.911+0000 7f61822586c0 1 Processor -- start 2026-02-13T04:04:47.913 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:47.911+0000 7f61822586c0 1 -- start start 2026-02-13T04:04:47.913 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:47.911+0000 7f61822586c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f617c10cfb0 0x7f617c0f2810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:47.913 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:47.911+0000 7f61822586c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f617c1131c0 0x7f617c173a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:47.913 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:47.911+0000 7f61822586c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f617c0f2e40 0x7f617c0f8110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:47.913 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:47.911+0000 7f61822586c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f617c0f3530 con 0x7f617c0f2e40 2026-02-13T04:04:47.913 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:47.911+0000 7f61822586c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f617c0f8650 con 0x7f617c1131c0 2026-02-13T04:04:47.913 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:47.911+0000 7f61822586c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f617c0f8810 con 0x7f617c10cfb0 2026-02-13T04:04:47.913 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:47.911+0000 7f617bfff6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f617c0f2e40 0x7f617c0f8110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:47.914 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:47.911+0000 7f617bfff6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f617c0f2e40 0x7f617c0f8110 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:36402/0 (socket says 10.20.193.92:36402) 2026-02-13T04:04:47.914 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:47.911+0000 7f617bfff6c0 1 -- 10.20.193.92:0/1683090234 learned_addr learned my addr 10.20.193.92:0/1683090234 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:04:47.914 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:47.911+0000 7f617b7fe6c0 1 --2- 10.20.193.92:0/1683090234 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f617c10cfb0 0x7f617c0f2810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:47.914 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:47.911+0000 7f617affd6c0 1 --2- 10.20.193.92:0/1683090234 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f617c1131c0 0x7f617c173a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:47.914 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:47.911+0000 7f617bfff6c0 1 -- 10.20.193.92:0/1683090234 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f617c10cfb0 msgr2=0x7f617c0f2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:47.914 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:47.911+0000 7f617bfff6c0 1 --2- 10.20.193.92:0/1683090234 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f617c10cfb0 0x7f617c0f2810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:47.914 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:47.911+0000 7f617bfff6c0 1 -- 10.20.193.92:0/1683090234 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f617c1131c0 msgr2=0x7f617c173a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:47.914 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:47.911+0000 7f617bfff6c0 1 --2- 10.20.193.92:0/1683090234 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f617c1131c0 0x7f617c173a60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:47.914 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:47.912+0000 7f617bfff6c0 1 -- 10.20.193.92:0/1683090234 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f616c009590 con 0x7f617c0f2e40 2026-02-13T04:04:47.914 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:47.912+0000 7f617bfff6c0 1 --2- 10.20.193.92:0/1683090234 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f617c0f2e40 0x7f617c0f8110 secure :-1 s=READY pgs=319 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f617000c6c0 tx=0x7f617000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:04:47.914 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:47.912+0000 7f6178ff96c0 1 -- 10.20.193.92:0/1683090234 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6170003c40 con 0x7f617c0f2e40 2026-02-13T04:04:47.914 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:47.912+0000 7f6178ff96c0 1 -- 10.20.193.92:0/1683090234 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f617000a030 con 0x7f617c0f2e40 2026-02-13T04:04:47.914 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:47.912+0000 7f61822586c0 1 -- 10.20.193.92:0/1683090234 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f617c0f8af0 con 0x7f617c0f2e40 2026-02-13T04:04:47.914 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:47.912+0000 7f61822586c0 1 -- 10.20.193.92:0/1683090234 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f617c0f9280 con 0x7f617c0f2e40 2026-02-13T04:04:47.914 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:47.912+0000 7f6178ff96c0 1 -- 10.20.193.92:0/1683090234 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f617000ddc0 con 0x7f617c0f2e40 2026-02-13T04:04:47.915 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:47.912+0000 7f61822586c0 1 -- 10.20.193.92:0/1683090234 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f617c10e280 con 0x7f617c0f2e40 2026-02-13T04:04:47.917 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:47.915+0000 7f6178ff96c0 1 -- 10.20.193.92:0/1683090234 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f6170005030 con 0x7f617c0f2e40 2026-02-13T04:04:47.919 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:47.917+0000 7f6178ff96c0 1 --2- 10.20.193.92:0/1683090234 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f61500b56d0 0x7f61500d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:47.919 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:47.917+0000 7f6178ff96c0 1 -- 10.20.193.92:0/1683090234 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f61700e4980 con 0x7f617c0f2e40 2026-02-13T04:04:47.919 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:47.917+0000 7f617b7fe6c0 1 --2- 10.20.193.92:0/1683090234 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f61500b56d0 0x7f61500d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:47.919 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:47.917+0000 7f6178ff96c0 1 -- 10.20.193.92:0/1683090234 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f61700e4e00 con 0x7f617c0f2e40 2026-02-13T04:04:47.920 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:47.918+0000 7f617b7fe6c0 1 --2- 10.20.193.92:0/1683090234 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f61500b56d0 0x7f61500d5b80 secure :-1 s=READY pgs=246 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6168005980 tx=0x7f61680094b0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:04:48.043 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:48.040+0000 7f61822586c0 1 -- 10.20.193.92:0/1683090234 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f617c0f3960 con 0x7f617c0f2e40 2026-02-13T04:04:48.043 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:48.041+0000 7f6178ff96c0 1 -- 10.20.193.92:0/1683090234 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f61700a7320 con 0x7f617c0f2e40 2026-02-13T04:04:48.043 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:04:48.043 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:04:48.044 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:48.042+0000 7f61822586c0 1 -- 10.20.193.92:0/1683090234 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f61500b56d0 msgr2=0x7f61500d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:48.044 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:48.042+0000 7f61822586c0 1 --2- 10.20.193.92:0/1683090234 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f61500b56d0 0x7f61500d5b80 secure :-1 s=READY pgs=246 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6168005980 tx=0x7f61680094b0 comp rx=0 tx=0).stop 2026-02-13T04:04:48.044 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:48.042+0000 7f61822586c0 1 -- 10.20.193.92:0/1683090234 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f617c0f2e40 msgr2=0x7f617c0f8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:48.044 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:48.042+0000 7f61822586c0 1 --2- 10.20.193.92:0/1683090234 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f617c0f2e40 0x7f617c0f8110 secure :-1 s=READY pgs=319 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f617000c6c0 tx=0x7f617000cb90 comp rx=0 tx=0).stop 2026-02-13T04:04:48.044 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:48.042+0000 7f61822586c0 1 -- 10.20.193.92:0/1683090234 shutdown_connections 2026-02-13T04:04:48.044 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:48.042+0000 7f61822586c0 1 --2- 10.20.193.92:0/1683090234 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f61500b56d0 0x7f61500d5b80 unknown :-1 s=CLOSED pgs=246 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:48.044 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:48.042+0000 7f61822586c0 1 --2- 10.20.193.92:0/1683090234 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f617c1131c0 0x7f617c173a60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:48.044 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:48.042+0000 7f61822586c0 1 --2- 10.20.193.92:0/1683090234 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f617c0f2e40 0x7f617c0f8110 unknown :-1 s=CLOSED pgs=319 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:48.044 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:48.042+0000 7f61822586c0 1 --2- 10.20.193.92:0/1683090234 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f617c10cfb0 0x7f617c0f2810 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:48.044 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:48.042+0000 7f61822586c0 1 -- 10.20.193.92:0/1683090234 >> 10.20.193.92:0/1683090234 conn(0x7f617c0ea8b0 msgr2=0x7f617c10b470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:04:48.045 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:48.042+0000 7f61822586c0 1 -- 10.20.193.92:0/1683090234 shutdown_connections 2026-02-13T04:04:48.045 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:48.042+0000 7f61822586c0 1 -- 10.20.193.92:0/1683090234 wait complete. 2026-02-13T04:04:48.078 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:47 trial158 ceph-mon[27763]: pgmap v302: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 8 op/s 2026-02-13T04:04:48.091 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:47 trial092 ceph-mon[23047]: pgmap v302: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 8 op/s 2026-02-13T04:04:48.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:47 trial099 ceph-mon[27808]: pgmap v302: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 8 op/s 2026-02-13T04:04:49.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:48 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/1683090234' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:49.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:48 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1683090234' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:49.328 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:48 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/1683090234' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:50.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:49 trial099 ceph-mon[27808]: pgmap v303: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:04:50.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:49 trial092 ceph-mon[23047]: pgmap v303: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:04:50.328 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:49 trial158 ceph-mon[27763]: pgmap v303: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:04:51.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:50 trial099 ceph-mon[27808]: pgmap v304: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:04:51.181 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:04:51.185 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:50 trial092 ceph-mon[23047]: pgmap v304: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:04:51.328 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:50 trial158 ceph-mon[27763]: pgmap v304: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:04:51.366 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:04:51.569 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.567+0000 7fae831c86c0 1 -- 10.20.193.92:0/2172400982 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fae7c10fbf0 msgr2=0x7fae7c114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:51.569 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.567+0000 7fae831c86c0 1 --2- 10.20.193.92:0/2172400982 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fae7c10fbf0 0x7fae7c114c30 secure :-1 s=READY pgs=320 gs=1 cs=0 l=1 c_cookie=5400349695016285236 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae640099a0 tx=0x7fae6402ed00 comp rx=0 tx=0).stop 2026-02-13T04:04:51.569 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.567+0000 7fae831c86c0 1 -- 10.20.193.92:0/2172400982 shutdown_connections 2026-02-13T04:04:51.569 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.567+0000 7fae831c86c0 1 --2- 10.20.193.92:0/2172400982 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fae7c115410 0x7fae7c175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:51.570 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.567+0000 7fae831c86c0 1 --2- 10.20.193.92:0/2172400982 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fae7c10fbf0 0x7fae7c114c30 unknown :-1 s=CLOSED pgs=320 gs=1 cs=0 l=1 c_cookie=5400349695016285236 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:51.570 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.567+0000 7fae831c86c0 1 --2- 10.20.193.92:0/2172400982 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fae7c10f200 0x7fae7c10f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:51.570 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.567+0000 7fae831c86c0 1 -- 10.20.193.92:0/2172400982 >> 10.20.193.92:0/2172400982 conn(0x7fae7c0ecb00 msgr2=0x7fae7c10cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:04:51.570 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.567+0000 7fae831c86c0 1 -- 10.20.193.92:0/2172400982 shutdown_connections 2026-02-13T04:04:51.570 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.567+0000 7fae831c86c0 1 -- 10.20.193.92:0/2172400982 wait complete. 2026-02-13T04:04:51.570 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.568+0000 7fae831c86c0 1 Processor -- start 2026-02-13T04:04:51.570 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.568+0000 7fae831c86c0 1 -- start start 2026-02-13T04:04:51.570 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.568+0000 7fae831c86c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fae7c10f200 0x7fae7c0f49d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:51.570 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.568+0000 7fae831c86c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fae7c115410 0x7fae7c175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:51.570 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.568+0000 7fae831c86c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fae7c0f5000 0x7fae7c0fa2d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:51.570 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.568+0000 7fae831c86c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fae7c0f56f0 con 0x7fae7c0f5000 2026-02-13T04:04:51.570 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.568+0000 7fae831c86c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fae7c0fa810 con 0x7fae7c10f200 2026-02-13T04:04:51.570 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.568+0000 7fae831c86c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fae7c0fa9d0 con 0x7fae7c115410 2026-02-13T04:04:51.571 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.568+0000 7fae80f3d6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fae7c10f200 0x7fae7c0f49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:51.571 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.568+0000 7fae8173e6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fae7c0f5000 0x7fae7c0fa2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:51.571 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.568+0000 7fae8173e6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fae7c0f5000 0x7fae7c0fa2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:36430/0 (socket says 10.20.193.92:36430) 2026-02-13T04:04:51.571 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.568+0000 7fae8173e6c0 1 -- 10.20.193.92:0/4838058 learned_addr learned my addr 10.20.193.92:0/4838058 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:04:51.571 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.568+0000 7fae73fff6c0 1 --2- 10.20.193.92:0/4838058 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fae7c115410 0x7fae7c175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:51.571 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.569+0000 7fae8173e6c0 1 -- 10.20.193.92:0/4838058 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fae7c115410 msgr2=0x7fae7c175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:51.571 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.569+0000 7fae8173e6c0 1 --2- 10.20.193.92:0/4838058 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fae7c115410 0x7fae7c175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:51.571 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.569+0000 7fae8173e6c0 1 -- 10.20.193.92:0/4838058 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fae7c10f200 msgr2=0x7fae7c0f49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:51.571 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.569+0000 7fae8173e6c0 1 --2- 10.20.193.92:0/4838058 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fae7c10f200 0x7fae7c0f49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:51.571 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.569+0000 7fae8173e6c0 1 -- 10.20.193.92:0/4838058 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae64009590 con 0x7fae7c0f5000 2026-02-13T04:04:51.571 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.569+0000 7fae73fff6c0 1 --2- 10.20.193.92:0/4838058 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fae7c115410 0x7fae7c175cb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T04:04:51.571 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.569+0000 7fae8173e6c0 1 --2- 10.20.193.92:0/4838058 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fae7c0f5000 0x7fae7c0fa2d0 secure :-1 s=READY pgs=321 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae78006ea0 tx=0x7fae7800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:04:51.571 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.569+0000 7fae71ffb6c0 1 -- 10.20.193.92:0/4838058 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fae78003a30 con 0x7fae7c0f5000 2026-02-13T04:04:51.571 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.569+0000 7fae71ffb6c0 1 -- 10.20.193.92:0/4838058 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fae78005560 con 0x7fae7c0f5000 2026-02-13T04:04:51.571 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.569+0000 7fae831c86c0 1 -- 10.20.193.92:0/4838058 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae7c0facb0 con 0x7fae7c0f5000 2026-02-13T04:04:51.571 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.569+0000 7fae71ffb6c0 1 -- 10.20.193.92:0/4838058 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fae780082a0 con 0x7fae7c0f5000 2026-02-13T04:04:51.571 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.569+0000 7fae831c86c0 1 -- 10.20.193.92:0/4838058 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae7c0fb140 con 0x7fae7c0f5000 2026-02-13T04:04:51.572 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.569+0000 7fae831c86c0 1 -- 10.20.193.92:0/4838058 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae7c1104d0 con 0x7fae7c0f5000 2026-02-13T04:04:51.574 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.572+0000 7fae71ffb6c0 1 -- 10.20.193.92:0/4838058 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fae7800d4d0 con 0x7fae7c0f5000 2026-02-13T04:04:51.576 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.573+0000 7fae71ffb6c0 1 --2- 10.20.193.92:0/4838058 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fae580b5650 0x7fae580d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:51.576 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.573+0000 7fae71ffb6c0 1 -- 10.20.193.92:0/4838058 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7fae780e49e0 con 0x7fae7c0f5000 2026-02-13T04:04:51.576 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.574+0000 7fae71ffb6c0 1 -- 10.20.193.92:0/4838058 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fae780e4e60 con 0x7fae7c0f5000 2026-02-13T04:04:51.576 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.574+0000 7fae80f3d6c0 1 --2- 10.20.193.92:0/4838058 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fae580b5650 0x7fae580d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:51.576 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.574+0000 7fae80f3d6c0 1 --2- 10.20.193.92:0/4838058 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fae580b5650 0x7fae580d5b00 secure :-1 s=READY pgs=247 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae6c004750 tx=0x7fae6c009390 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:04:51.699 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.697+0000 7fae831c86c0 1 -- 10.20.193.92:0/4838058 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fae7c0f5b50 con 0x7fae7c0f5000 2026-02-13T04:04:51.700 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.697+0000 7fae71ffb6c0 1 -- 10.20.193.92:0/4838058 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fae780a7380 con 0x7fae7c0f5000 2026-02-13T04:04:51.700 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:04:51.700 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:04:51.701 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.699+0000 7fae831c86c0 1 -- 10.20.193.92:0/4838058 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fae580b5650 msgr2=0x7fae580d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:51.701 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.699+0000 7fae831c86c0 1 --2- 10.20.193.92:0/4838058 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fae580b5650 0x7fae580d5b00 secure :-1 s=READY pgs=247 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae6c004750 tx=0x7fae6c009390 comp rx=0 tx=0).stop 2026-02-13T04:04:51.701 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.699+0000 7fae831c86c0 1 -- 10.20.193.92:0/4838058 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fae7c0f5000 msgr2=0x7fae7c0fa2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:51.701 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.699+0000 7fae831c86c0 1 --2- 10.20.193.92:0/4838058 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fae7c0f5000 0x7fae7c0fa2d0 secure :-1 s=READY pgs=321 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae78006ea0 tx=0x7fae7800cca0 comp rx=0 tx=0).stop 2026-02-13T04:04:51.701 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.699+0000 7fae831c86c0 1 -- 10.20.193.92:0/4838058 shutdown_connections 2026-02-13T04:04:51.701 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.699+0000 7fae831c86c0 1 --2- 10.20.193.92:0/4838058 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fae7c0f5000 0x7fae7c0fa2d0 unknown :-1 s=CLOSED pgs=321 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:51.701 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.699+0000 7fae831c86c0 1 --2- 10.20.193.92:0/4838058 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fae7c115410 0x7fae7c175cb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:51.701 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.699+0000 7fae831c86c0 1 --2- 10.20.193.92:0/4838058 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fae580b5650 0x7fae580d5b00 unknown :-1 s=CLOSED pgs=247 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:51.701 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.699+0000 7fae831c86c0 1 --2- 10.20.193.92:0/4838058 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fae7c10f200 0x7fae7c0f49d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:51.701 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.699+0000 7fae831c86c0 1 -- 10.20.193.92:0/4838058 >> 10.20.193.92:0/4838058 conn(0x7fae7c0ecb00 msgr2=0x7fae7c10d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:04:51.701 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.699+0000 7fae831c86c0 1 -- 10.20.193.92:0/4838058 shutdown_connections 2026-02-13T04:04:51.701 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:51.699+0000 7fae831c86c0 1 -- 10.20.193.92:0/4838058 wait complete. 2026-02-13T04:04:52.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:51 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/4838058' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:52.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:51 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/4838058' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:52.328 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:51 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/4838058' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:53.116 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:52 trial099 ceph-mon[27808]: pgmap v305: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:04:53.183 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:52 trial092 ceph-mon[23047]: pgmap v305: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:04:53.328 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:52 trial158 ceph-mon[27763]: pgmap v305: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:04:54.837 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:04:55.020 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:04:55.150 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:55 trial092 ceph-mon[23047]: pgmap v306: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:04:55.216 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.214+0000 7f432834c6c0 1 -- 10.20.193.92:0/3205896641 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f432010fbf0 msgr2=0x7f4320114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:55.216 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.214+0000 7f432834c6c0 1 --2- 10.20.193.92:0/3205896641 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f432010fbf0 0x7f4320114c30 secure :-1 s=READY pgs=322 gs=1 cs=0 l=1 c_cookie=17455902888915691977 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f43140099a0 tx=0x7f431402ed00 comp rx=0 tx=0).stop 2026-02-13T04:04:55.217 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.214+0000 7f432834c6c0 1 -- 10.20.193.92:0/3205896641 shutdown_connections 2026-02-13T04:04:55.217 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.214+0000 7f432834c6c0 1 --2- 10.20.193.92:0/3205896641 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4320115410 0x7f4320175db0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:55.217 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.214+0000 7f432834c6c0 1 --2- 10.20.193.92:0/3205896641 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f432010fbf0 0x7f4320114c30 unknown :-1 s=CLOSED pgs=322 gs=1 cs=0 l=1 c_cookie=17455902888915691977 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:55.217 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.214+0000 7f432834c6c0 1 --2- 10.20.193.92:0/3205896641 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f432010f200 0x7f432010f5d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:55.217 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.214+0000 7f432834c6c0 1 -- 10.20.193.92:0/3205896641 >> 10.20.193.92:0/3205896641 conn(0x7f43200ecb00 msgr2=0x7f432010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:04:55.217 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.214+0000 7f432834c6c0 1 -- 10.20.193.92:0/3205896641 shutdown_connections 2026-02-13T04:04:55.217 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.214+0000 7f432834c6c0 1 -- 10.20.193.92:0/3205896641 wait complete. 2026-02-13T04:04:55.217 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.215+0000 7f432834c6c0 1 Processor -- start 2026-02-13T04:04:55.217 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.215+0000 7f432834c6c0 1 -- start start 2026-02-13T04:04:55.217 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.215+0000 7f432834c6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f432010f200 0x7f43200f4990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:55.217 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.215+0000 7f432834c6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4320115410 0x7f4320175cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:55.217 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.215+0000 7f432834c6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f43200f4fc0 0x7f43200fa240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:55.217 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.215+0000 7f432834c6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f43200f56b0 con 0x7f43200f4fc0 2026-02-13T04:04:55.217 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.215+0000 7f432834c6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f43200fa780 con 0x7f432010f200 2026-02-13T04:04:55.217 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.215+0000 7f432834c6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f43200fa940 con 0x7f4320115410 2026-02-13T04:04:55.218 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.215+0000 7f43260bd6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f432010f200 0x7f43200f4990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:55.218 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.215+0000 7f43268be6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f43200f4fc0 0x7f43200fa240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:55.218 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.215+0000 7f43268be6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f43200f4fc0 0x7f43200fa240 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:33574/0 (socket says 10.20.193.92:33574) 2026-02-13T04:04:55.218 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.215+0000 7f43268be6c0 1 -- 10.20.193.92:0/2747739494 learned_addr learned my addr 10.20.193.92:0/2747739494 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:04:55.218 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.215+0000 7f43260bd6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f432010f200 0x7f43200f4990 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:44084/0 (socket says 10.20.193.92:44084) 2026-02-13T04:04:55.218 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.215+0000 7f43258bc6c0 1 --2- 10.20.193.92:0/2747739494 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4320115410 0x7f4320175cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:55.218 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.216+0000 7f43268be6c0 1 -- 10.20.193.92:0/2747739494 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4320115410 msgr2=0x7f4320175cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:55.218 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.216+0000 7f43268be6c0 1 --2- 10.20.193.92:0/2747739494 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4320115410 0x7f4320175cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:55.218 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.216+0000 7f43268be6c0 1 -- 10.20.193.92:0/2747739494 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f432010f200 msgr2=0x7f43200f4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:55.218 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.216+0000 7f43268be6c0 1 --2- 10.20.193.92:0/2747739494 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f432010f200 0x7f43200f4990 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:55.218 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.216+0000 7f43268be6c0 1 -- 10.20.193.92:0/2747739494 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4314009590 con 0x7f43200f4fc0 2026-02-13T04:04:55.218 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.216+0000 7f43268be6c0 1 --2- 10.20.193.92:0/2747739494 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f43200f4fc0 0x7f43200fa240 secure :-1 s=READY pgs=323 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f431c006ea0 tx=0x7f431c00ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:04:55.218 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.216+0000 7f43077fe6c0 1 -- 10.20.193.92:0/2747739494 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f431c003c40 con 0x7f43200f4fc0 2026-02-13T04:04:55.218 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.216+0000 7f43077fe6c0 1 -- 10.20.193.92:0/2747739494 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f431c003da0 con 0x7f43200f4fc0 2026-02-13T04:04:55.218 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.216+0000 7f432834c6c0 1 -- 10.20.193.92:0/2747739494 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43200fac20 con 0x7f43200f4fc0 2026-02-13T04:04:55.219 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.216+0000 7f43077fe6c0 1 -- 10.20.193.92:0/2747739494 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f431c008440 con 0x7f43200f4fc0 2026-02-13T04:04:55.219 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.216+0000 7f432834c6c0 1 -- 10.20.193.92:0/2747739494 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43200fb3b0 con 0x7f43200f4fc0 2026-02-13T04:04:55.219 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.217+0000 7f432834c6c0 1 -- 10.20.193.92:0/2747739494 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43200fb100 con 0x7f43200f4fc0 2026-02-13T04:04:55.221 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.219+0000 7f43077fe6c0 1 -- 10.20.193.92:0/2747739494 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f431c00d690 con 0x7f43200f4fc0 2026-02-13T04:04:55.223 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.220+0000 7f43077fe6c0 1 --2- 10.20.193.92:0/2747739494 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f42fc0b56d0 0x7f42fc0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:55.223 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.221+0000 7f43077fe6c0 1 -- 10.20.193.92:0/2747739494 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f431c0e4c40 con 0x7f43200f4fc0 2026-02-13T04:04:55.223 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.221+0000 7f43260bd6c0 1 --2- 10.20.193.92:0/2747739494 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f42fc0b56d0 0x7f42fc0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:55.223 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.221+0000 7f43077fe6c0 1 -- 10.20.193.92:0/2747739494 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f431c0e50c0 con 0x7f43200f4fc0 2026-02-13T04:04:55.223 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.221+0000 7f43260bd6c0 1 --2- 10.20.193.92:0/2747739494 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f42fc0b56d0 0x7f42fc0d5b80 secure :-1 s=READY pgs=248 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4310004750 tx=0x7f4310009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:04:55.328 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:55 trial158 ceph-mon[27763]: pgmap v306: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:04:55.351 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.348+0000 7f432834c6c0 1 -- 10.20.193.92:0/2747739494 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f43201104d0 con 0x7f43200f4fc0 2026-02-13T04:04:55.351 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.349+0000 7f43077fe6c0 1 -- 10.20.193.92:0/2747739494 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f431c0a75e0 con 0x7f43200f4fc0 2026-02-13T04:04:55.351 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:04:55.351 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:04:55.352 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.350+0000 7f432834c6c0 1 -- 10.20.193.92:0/2747739494 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f42fc0b56d0 msgr2=0x7f42fc0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:55.352 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.350+0000 7f432834c6c0 1 --2- 10.20.193.92:0/2747739494 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f42fc0b56d0 0x7f42fc0d5b80 secure :-1 s=READY pgs=248 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4310004750 tx=0x7f4310009260 comp rx=0 tx=0).stop 2026-02-13T04:04:55.352 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.350+0000 7f432834c6c0 1 -- 10.20.193.92:0/2747739494 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f43200f4fc0 msgr2=0x7f43200fa240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:55.352 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.350+0000 7f432834c6c0 1 --2- 10.20.193.92:0/2747739494 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f43200f4fc0 0x7f43200fa240 secure :-1 s=READY pgs=323 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f431c006ea0 tx=0x7f431c00ce50 comp rx=0 tx=0).stop 2026-02-13T04:04:55.353 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.350+0000 7f432834c6c0 1 -- 10.20.193.92:0/2747739494 shutdown_connections 2026-02-13T04:04:55.353 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.350+0000 7f432834c6c0 1 --2- 10.20.193.92:0/2747739494 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f43200f4fc0 0x7f43200fa240 unknown :-1 s=CLOSED pgs=323 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:55.353 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.350+0000 7f432834c6c0 1 --2- 10.20.193.92:0/2747739494 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4320115410 0x7f4320175cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:55.353 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.350+0000 7f432834c6c0 1 --2- 10.20.193.92:0/2747739494 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f42fc0b56d0 0x7f42fc0d5b80 unknown :-1 s=CLOSED pgs=248 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:55.353 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.350+0000 7f432834c6c0 1 --2- 10.20.193.92:0/2747739494 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f432010f200 0x7f43200f4990 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:55.353 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.350+0000 7f432834c6c0 1 -- 10.20.193.92:0/2747739494 >> 10.20.193.92:0/2747739494 conn(0x7f43200ecb00 msgr2=0x7f432010d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:04:55.353 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.350+0000 7f432834c6c0 1 -- 10.20.193.92:0/2747739494 shutdown_connections 2026-02-13T04:04:55.353 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:55.350+0000 7f432834c6c0 1 -- 10.20.193.92:0/2747739494 wait complete. 2026-02-13T04:04:55.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:55 trial099 ceph-mon[27808]: pgmap v306: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:04:56.328 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:56 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/2747739494' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:56.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:56 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/2747739494' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:56.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:56 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/2747739494' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:57.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:57 trial158 ceph-mon[27763]: pgmap v307: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 8 op/s 2026-02-13T04:04:57.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:57 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:04:57.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:57 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:04:57.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:57 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:04:57.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:57 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:04:57.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:57 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:04:57.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:57 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:04:57.330 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:57 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:04:57.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:57 trial099 ceph-mon[27808]: pgmap v307: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 8 op/s 2026-02-13T04:04:57.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:57 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:04:57.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:57 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:04:57.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:57 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:04:57.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:57 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:04:57.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:57 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:04:57.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:57 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:04:57.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:57 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:04:57.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:57 trial092 ceph-mon[23047]: pgmap v307: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 8 op/s 2026-02-13T04:04:57.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:57 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:04:57.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:57 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:04:57.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:57 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:04:57.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:57 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:04:57.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:57 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:04:57.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:57 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:04:57.434 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:57 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:04:58.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:58 trial158 ceph-mon[27763]: pgmap v308: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.0 KiB/s rd, 11 op/s 2026-02-13T04:04:58.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:58 trial158 ceph-mon[27763]: pgmap v309: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T04:04:58.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:58 trial099 ceph-mon[27808]: pgmap v308: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.0 KiB/s rd, 11 op/s 2026-02-13T04:04:58.367 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:58 trial099 ceph-mon[27808]: pgmap v309: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T04:04:58.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:58 trial092 ceph-mon[23047]: pgmap v308: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 6.0 KiB/s rd, 11 op/s 2026-02-13T04:04:58.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:58 trial092 ceph-mon[23047]: pgmap v309: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T04:04:58.454 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:04:58.637 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:04:58.831 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.828+0000 7f26c7fff6c0 1 -- 10.20.193.92:0/4293555694 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f26c81142d0 msgr2=0x7f26c81146a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:58.831 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.828+0000 7f26c7fff6c0 1 --2- 10.20.193.92:0/4293555694 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f26c81142d0 0x7f26c81146a0 secure :-1 s=READY pgs=324 gs=1 cs=0 l=1 c_cookie=6859570579222962718 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26bc0098a0 tx=0x7f26bc02ec50 comp rx=0 tx=0).stop 2026-02-13T04:04:58.832 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.828+0000 7f26c7fff6c0 1 -- 10.20.193.92:0/4293555694 shutdown_connections 2026-02-13T04:04:58.832 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.828+0000 7f26c7fff6c0 1 --2- 10.20.193.92:0/4293555694 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f26c815e000 0x7f26c817e3e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:58.832 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.828+0000 7f26c7fff6c0 1 --2- 10.20.193.92:0/4293555694 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f26c8114be0 0x7f26c815dac0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:58.832 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.828+0000 7f26c7fff6c0 1 --2- 10.20.193.92:0/4293555694 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f26c81142d0 0x7f26c81146a0 unknown :-1 s=CLOSED pgs=324 gs=1 cs=0 l=1 c_cookie=6859570579222962718 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:58.832 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.828+0000 7f26c7fff6c0 1 -- 10.20.193.92:0/4293555694 >> 10.20.193.92:0/4293555694 conn(0x7f26c805cd80 msgr2=0x7f26c805d180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:04:58.834 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.829+0000 7f26c7fff6c0 1 -- 10.20.193.92:0/4293555694 shutdown_connections 2026-02-13T04:04:58.835 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.829+0000 7f26c7fff6c0 1 -- 10.20.193.92:0/4293555694 wait complete. 2026-02-13T04:04:58.835 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.830+0000 7f26c7fff6c0 1 Processor -- start 2026-02-13T04:04:58.835 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.830+0000 7f26c7fff6c0 1 -- start start 2026-02-13T04:04:58.835 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.830+0000 7f26c7fff6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f26c81142d0 0x7f26c80fdff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:58.835 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.830+0000 7f26c7fff6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f26c8114be0 0x7f26c80fe530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:58.835 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.830+0000 7f26c7fff6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f26c815e000 0x7f26c81038f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:58.835 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.830+0000 7f26c7fff6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f26c8103f40 con 0x7f26c8114be0 2026-02-13T04:04:58.835 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.830+0000 7f26c7fff6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f26c81040b0 con 0x7f26c815e000 2026-02-13T04:04:58.835 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.830+0000 7f26c7fff6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f26c8104270 con 0x7f26c81142d0 2026-02-13T04:04:58.835 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.830+0000 7f26c6ffd6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f26c81142d0 0x7f26c80fdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:58.835 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.830+0000 7f26c67fc6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f26c8114be0 0x7f26c80fe530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:58.836 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.830+0000 7f26c67fc6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f26c8114be0 0x7f26c80fe530 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:33602/0 (socket says 10.20.193.92:33602) 2026-02-13T04:04:58.836 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.830+0000 7f26c67fc6c0 1 -- 10.20.193.92:0/2658482185 learned_addr learned my addr 10.20.193.92:0/2658482185 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:04:58.836 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.830+0000 7f26c77fe6c0 1 --2- 10.20.193.92:0/2658482185 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f26c815e000 0x7f26c81038f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:58.836 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.830+0000 7f26c67fc6c0 1 -- 10.20.193.92:0/2658482185 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f26c81142d0 msgr2=0x7f26c80fdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:58.836 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.830+0000 7f26c67fc6c0 1 --2- 10.20.193.92:0/2658482185 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f26c81142d0 0x7f26c80fdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:58.836 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.830+0000 7f26c67fc6c0 1 -- 10.20.193.92:0/2658482185 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f26c815e000 msgr2=0x7f26c81038f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:58.836 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.830+0000 7f26c67fc6c0 1 --2- 10.20.193.92:0/2658482185 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f26c815e000 0x7f26c81038f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:58.836 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.830+0000 7f26c67fc6c0 1 -- 10.20.193.92:0/2658482185 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26b800a5b0 con 0x7f26c8114be0 2026-02-13T04:04:58.836 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.831+0000 7f26c67fc6c0 1 --2- 10.20.193.92:0/2658482185 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f26c8114be0 0x7f26c80fe530 secure :-1 s=READY pgs=325 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26b0005950 tx=0x7f26b000bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:04:58.836 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.831+0000 7f26a7fff6c0 1 -- 10.20.193.92:0/2658482185 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26b0004460 con 0x7f26c8114be0 2026-02-13T04:04:58.836 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.831+0000 7f26a7fff6c0 1 -- 10.20.193.92:0/2658482185 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f26b00045c0 con 0x7f26c8114be0 2026-02-13T04:04:58.837 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.831+0000 7f26a7fff6c0 1 -- 10.20.193.92:0/2658482185 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f26b0003af0 con 0x7f26c8114be0 2026-02-13T04:04:58.837 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.831+0000 7f26c7fff6c0 1 -- 10.20.193.92:0/2658482185 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26bc0094c0 con 0x7f26c8114be0 2026-02-13T04:04:58.837 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.831+0000 7f26c7fff6c0 1 -- 10.20.193.92:0/2658482185 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26c815aa90 con 0x7f26c8114be0 2026-02-13T04:04:58.837 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.831+0000 7f26c7fff6c0 1 -- 10.20.193.92:0/2658482185 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26c8056bd0 con 0x7f26c8114be0 2026-02-13T04:04:58.837 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.834+0000 7f26a7fff6c0 1 -- 10.20.193.92:0/2658482185 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f26b0005240 con 0x7f26c8114be0 2026-02-13T04:04:58.838 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.835+0000 7f26a7fff6c0 1 --2- 10.20.193.92:0/2658482185 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f269c0b56d0 0x7f269c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:04:58.838 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.835+0000 7f26a7fff6c0 1 -- 10.20.193.92:0/2658482185 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f26b00e3a40 con 0x7f26c8114be0 2026-02-13T04:04:58.838 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.836+0000 7f26a7fff6c0 1 -- 10.20.193.92:0/2658482185 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f26b011c5e0 con 0x7f26c8114be0 2026-02-13T04:04:58.839 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.836+0000 7f26c6ffd6c0 1 --2- 10.20.193.92:0/2658482185 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f269c0b56d0 0x7f269c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:04:58.839 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.836+0000 7f26c6ffd6c0 1 --2- 10.20.193.92:0/2658482185 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f269c0b56d0 0x7f269c0d5b80 secure :-1 s=READY pgs=249 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26bc0097f0 tx=0x7f26bc0023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:04:58.962 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.960+0000 7f26c7fff6c0 1 -- 10.20.193.92:0/2658482185 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f26c81146a0 con 0x7f26c8114be0 2026-02-13T04:04:58.963 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.960+0000 7f26a7fff6c0 1 -- 10.20.193.92:0/2658482185 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f26b00a63e0 con 0x7f26c8114be0 2026-02-13T04:04:58.963 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:04:58.963 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:04:58.964 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.961+0000 7f26c7fff6c0 1 -- 10.20.193.92:0/2658482185 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f269c0b56d0 msgr2=0x7f269c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:58.964 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.961+0000 7f26c7fff6c0 1 --2- 10.20.193.92:0/2658482185 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f269c0b56d0 0x7f269c0d5b80 secure :-1 s=READY pgs=249 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26bc0097f0 tx=0x7f26bc0023a0 comp rx=0 tx=0).stop 2026-02-13T04:04:58.964 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.961+0000 7f26c7fff6c0 1 -- 10.20.193.92:0/2658482185 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f26c8114be0 msgr2=0x7f26c80fe530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:04:58.964 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.961+0000 7f26c7fff6c0 1 --2- 10.20.193.92:0/2658482185 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f26c8114be0 0x7f26c80fe530 secure :-1 s=READY pgs=325 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26b0005950 tx=0x7f26b000bca0 comp rx=0 tx=0).stop 2026-02-13T04:04:58.964 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.961+0000 7f26c7fff6c0 1 -- 10.20.193.92:0/2658482185 shutdown_connections 2026-02-13T04:04:58.964 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.961+0000 7f26c7fff6c0 1 --2- 10.20.193.92:0/2658482185 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f269c0b56d0 0x7f269c0d5b80 unknown :-1 s=CLOSED pgs=249 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:58.964 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.961+0000 7f26c7fff6c0 1 --2- 10.20.193.92:0/2658482185 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f26c815e000 0x7f26c81038f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:58.964 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.961+0000 7f26c7fff6c0 1 --2- 10.20.193.92:0/2658482185 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f26c8114be0 0x7f26c80fe530 unknown :-1 s=CLOSED pgs=325 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:58.965 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.961+0000 7f26c7fff6c0 1 --2- 10.20.193.92:0/2658482185 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f26c81142d0 0x7f26c80fdff0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:04:58.965 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.961+0000 7f26c7fff6c0 1 -- 10.20.193.92:0/2658482185 >> 10.20.193.92:0/2658482185 conn(0x7f26c805cd80 msgr2=0x7f26c80f4b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:04:58.965 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.961+0000 7f26c7fff6c0 1 -- 10.20.193.92:0/2658482185 shutdown_connections 2026-02-13T04:04:58.965 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:04:58.961+0000 7f26c7fff6c0 1 -- 10.20.193.92:0/2658482185 wait complete. 2026-02-13T04:04:59.328 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:04:59 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/2658482185' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:59.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:04:59 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/2658482185' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:04:59.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:04:59 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/2658482185' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:00.329 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:00 trial158 ceph-mon[27763]: pgmap v310: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T04:05:00.366 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:00 trial099 ceph-mon[27808]: pgmap v310: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T04:05:00.433 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:00 trial092 ceph-mon[23047]: pgmap v310: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T04:05:02.067 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:05:02.253 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:05:02.445 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.442+0000 7f002a3fb6c0 1 -- 10.20.193.92:0/1839019667 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f002410ba80 msgr2=0x7f002410e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:02.445 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.442+0000 7f002a3fb6c0 1 --2- 10.20.193.92:0/1839019667 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f002410ba80 0x7f002410e450 secure :-1 s=READY pgs=130 gs=2 cs=0 l=1 c_cookie=2122034991175718894 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f00180098a0 tx=0x7f001802ec40 comp rx=0 tx=0).stop 2026-02-13T04:05:02.445 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.442+0000 7f002a3fb6c0 1 -- 10.20.193.92:0/1839019667 shutdown_connections 2026-02-13T04:05:02.446 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.442+0000 7f002a3fb6c0 1 --2- 10.20.193.92:0/1839019667 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f002410ba80 0x7f002410e450 unknown :-1 s=CLOSED pgs=130 gs=2 cs=0 l=1 c_cookie=2122034991175718894 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:02.446 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.442+0000 7f002a3fb6c0 1 --2- 10.20.193.92:0/1839019667 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f002410eb20 0x7f002410efc0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:02.446 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.442+0000 7f002a3fb6c0 1 --2- 10.20.193.92:0/1839019667 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f002410b170 0x7f002410b540 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:02.446 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.442+0000 7f002a3fb6c0 1 -- 10.20.193.92:0/1839019667 >> 10.20.193.92:0/1839019667 conn(0x7f0024063d50 msgr2=0x7f0024109470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:05:02.446 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.442+0000 7f002a3fb6c0 1 -- 10.20.193.92:0/1839019667 shutdown_connections 2026-02-13T04:05:02.446 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.442+0000 7f002a3fb6c0 1 -- 10.20.193.92:0/1839019667 wait complete. 2026-02-13T04:05:02.448 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.443+0000 7f002a3fb6c0 1 Processor -- start 2026-02-13T04:05:02.448 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.443+0000 7f002a3fb6c0 1 -- start start 2026-02-13T04:05:02.448 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.443+0000 7f002a3fb6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f002410b170 0x7f0024121ec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:02.448 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.443+0000 7f002a3fb6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f002410ba80 0x7f0024122400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:02.448 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.443+0000 7f002a3fb6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f002410eb20 0x7f00241277c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:02.448 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.443+0000 7f002a3fb6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0024127e10 con 0x7f002410eb20 2026-02-13T04:05:02.448 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.443+0000 7f002a3fb6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0024127f80 con 0x7f002410ba80 2026-02-13T04:05:02.448 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.443+0000 7f002a3fb6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f0024128140 con 0x7f002410b170 2026-02-13T04:05:02.448 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.444+0000 7f0028bf86c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f002410ba80 0x7f0024122400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:02.449 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.444+0000 7f00293f96c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f002410b170 0x7f0024121ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:02.449 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.444+0000 7f0028bf86c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f002410ba80 0x7f0024122400 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:44116/0 (socket says 10.20.193.92:44116) 2026-02-13T04:05:02.449 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.444+0000 7f0028bf86c0 1 -- 10.20.193.92:0/919258735 learned_addr learned my addr 10.20.193.92:0/919258735 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:05:02.449 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.444+0000 7f0029bfa6c0 1 --2- 10.20.193.92:0/919258735 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f002410eb20 0x7f00241277c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:02.449 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.444+0000 7f00293f96c0 1 -- 10.20.193.92:0/919258735 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f002410ba80 msgr2=0x7f0024122400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:02.449 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.444+0000 7f00293f96c0 1 --2- 10.20.193.92:0/919258735 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f002410ba80 0x7f0024122400 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:02.449 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.444+0000 7f00293f96c0 1 -- 10.20.193.92:0/919258735 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f002410eb20 msgr2=0x7f00241277c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:02.449 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.444+0000 7f00293f96c0 1 --2- 10.20.193.92:0/919258735 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f002410eb20 0x7f00241277c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:02.449 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.444+0000 7f00293f96c0 1 -- 10.20.193.92:0/919258735 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00140094c0 con 0x7f002410b170 2026-02-13T04:05:02.449 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.444+0000 7f00293f96c0 1 --2- 10.20.193.92:0/919258735 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f002410b170 0x7f0024121ec0 secure :-1 s=READY pgs=117 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f001400ba30 tx=0x7f001400bf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:05:02.449 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.444+0000 7f00127fc6c0 1 -- 10.20.193.92:0/919258735 <== mon.1 v2:10.20.193.158:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0014004250 con 0x7f002410b170 2026-02-13T04:05:02.449 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.444+0000 7f00127fc6c0 1 -- 10.20.193.92:0/919258735 <== mon.1 v2:10.20.193.158:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f0014009030 con 0x7f002410b170 2026-02-13T04:05:02.450 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.444+0000 7f00127fc6c0 1 -- 10.20.193.92:0/919258735 <== mon.1 v2:10.20.193.158:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f00140071e0 con 0x7f002410b170 2026-02-13T04:05:02.450 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.445+0000 7f002a3fb6c0 1 -- 10.20.193.92:0/919258735 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00180094c0 con 0x7f002410b170 2026-02-13T04:05:02.450 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.445+0000 7f002a3fb6c0 1 -- 10.20.193.92:0/919258735 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0024168950 con 0x7f002410b170 2026-02-13T04:05:02.450 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.445+0000 7f002a3fb6c0 1 -- 10.20.193.92:0/919258735 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f002410bf40 con 0x7f002410b170 2026-02-13T04:05:02.450 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.447+0000 7f00127fc6c0 1 -- 10.20.193.92:0/919258735 <== mon.1 v2:10.20.193.158:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f00140043b0 con 0x7f002410b170 2026-02-13T04:05:02.452 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.449+0000 7f00127fc6c0 1 --2- 10.20.193.92:0/919258735 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f00000b56d0 0x7f00000d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:02.452 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.449+0000 7f00127fc6c0 1 -- 10.20.193.92:0/919258735 <== mon.1 v2:10.20.193.158:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f00140e3b70 con 0x7f002410b170 2026-02-13T04:05:02.452 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.449+0000 7f0028bf86c0 1 --2- 10.20.193.92:0/919258735 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f00000b56d0 0x7f00000d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:02.452 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.449+0000 7f00127fc6c0 1 -- 10.20.193.92:0/919258735 <== mon.1 v2:10.20.193.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f001411c5e0 con 0x7f002410b170 2026-02-13T04:05:02.452 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.450+0000 7f0028bf86c0 1 --2- 10.20.193.92:0/919258735 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f00000b56d0 0x7f00000d5b80 secure :-1 s=READY pgs=250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0024128850 tx=0x7f0018005940 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:05:02.576 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.573+0000 7f002a3fb6c0 1 -- 10.20.193.92:0/919258735 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0024123010 con 0x7f002410b170 2026-02-13T04:05:02.576 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.573+0000 7f00127fc6c0 1 -- 10.20.193.92:0/919258735 <== mon.1 v2:10.20.193.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f00140a6510 con 0x7f002410b170 2026-02-13T04:05:02.576 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:05:02.576 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:05:02.577 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.574+0000 7f002a3fb6c0 1 -- 10.20.193.92:0/919258735 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f00000b56d0 msgr2=0x7f00000d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:02.577 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.574+0000 7f002a3fb6c0 1 --2- 10.20.193.92:0/919258735 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f00000b56d0 0x7f00000d5b80 secure :-1 s=READY pgs=250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0024128850 tx=0x7f0018005940 comp rx=0 tx=0).stop 2026-02-13T04:05:02.577 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.574+0000 7f002a3fb6c0 1 -- 10.20.193.92:0/919258735 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f002410b170 msgr2=0x7f0024121ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:02.578 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.574+0000 7f002a3fb6c0 1 --2- 10.20.193.92:0/919258735 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f002410b170 0x7f0024121ec0 secure :-1 s=READY pgs=117 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f001400ba30 tx=0x7f001400bf00 comp rx=0 tx=0).stop 2026-02-13T04:05:02.578 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.574+0000 7f002a3fb6c0 1 -- 10.20.193.92:0/919258735 shutdown_connections 2026-02-13T04:05:02.578 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.574+0000 7f002a3fb6c0 1 --2- 10.20.193.92:0/919258735 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f00000b56d0 0x7f00000d5b80 unknown :-1 s=CLOSED pgs=250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:02.578 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.574+0000 7f002a3fb6c0 1 --2- 10.20.193.92:0/919258735 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f002410ba80 0x7f0024122400 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:02.578 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.574+0000 7f002a3fb6c0 1 --2- 10.20.193.92:0/919258735 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f002410eb20 0x7f00241277c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:02.578 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.574+0000 7f002a3fb6c0 1 --2- 10.20.193.92:0/919258735 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f002410b170 0x7f0024121ec0 unknown :-1 s=CLOSED pgs=117 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:02.578 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.574+0000 7f002a3fb6c0 1 -- 10.20.193.92:0/919258735 >> 10.20.193.92:0/919258735 conn(0x7f0024063d50 msgr2=0x7f002410ccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:05:02.578 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.574+0000 7f002a3fb6c0 1 -- 10.20.193.92:0/919258735 shutdown_connections 2026-02-13T04:05:02.578 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:02.574+0000 7f002a3fb6c0 1 -- 10.20.193.92:0/919258735 wait complete. 2026-02-13T04:05:02.636 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:02 trial092 ceph-mon[23047]: pgmap v311: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T04:05:02.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:02 trial158 ceph-mon[27763]: pgmap v311: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T04:05:02.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:02 trial099 ceph-mon[27808]: pgmap v311: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T04:05:03.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:03 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/919258735' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:03.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:03 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/919258735' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:03.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:03 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/919258735' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:04.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:04 trial158 ceph-mon[27763]: pgmap v312: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 9 op/s 2026-02-13T04:05:04.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:04 trial099 ceph-mon[27808]: pgmap v312: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 9 op/s 2026-02-13T04:05:04.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:04 trial092 ceph-mon[23047]: pgmap v312: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 9 op/s 2026-02-13T04:05:05.714 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:05:05.900 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:05:06.088 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.085+0000 7f4da4ce66c0 1 -- 10.20.193.92:0/2911756454 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4da010fa50 msgr2=0x7f4da0114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:06.088 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.085+0000 7f4da4ce66c0 1 --2- 10.20.193.92:0/2911756454 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4da010fa50 0x7f4da0114a90 secure :-1 s=READY pgs=326 gs=1 cs=0 l=1 c_cookie=1989017110140888755 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d900099a0 tx=0x7f4d9002ed20 comp rx=0 tx=0).stop 2026-02-13T04:05:06.088 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.085+0000 7f4da4ce66c0 1 -- 10.20.193.92:0/2911756454 shutdown_connections 2026-02-13T04:05:06.089 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.085+0000 7f4da4ce66c0 1 --2- 10.20.193.92:0/2911756454 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4da0115270 0x7f4da0175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:06.089 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.085+0000 7f4da4ce66c0 1 --2- 10.20.193.92:0/2911756454 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4da010fa50 0x7f4da0114a90 unknown :-1 s=CLOSED pgs=326 gs=1 cs=0 l=1 c_cookie=1989017110140888755 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:06.089 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.085+0000 7f4da4ce66c0 1 --2- 10.20.193.92:0/2911756454 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4da010f060 0x7f4da010f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:06.089 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.085+0000 7f4da4ce66c0 1 -- 10.20.193.92:0/2911756454 >> 10.20.193.92:0/2911756454 conn(0x7f4da00ec980 msgr2=0x7f4da010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:05:06.089 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.085+0000 7f4da4ce66c0 1 -- 10.20.193.92:0/2911756454 shutdown_connections 2026-02-13T04:05:06.089 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.085+0000 7f4da4ce66c0 1 -- 10.20.193.92:0/2911756454 wait complete. 2026-02-13T04:05:06.089 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.086+0000 7f4da4ce66c0 1 Processor -- start 2026-02-13T04:05:06.089 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.086+0000 7f4da4ce66c0 1 -- start start 2026-02-13T04:05:06.091 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.086+0000 7f4da4ce66c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4da010f060 0x7f4da00f4860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:06.091 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.086+0000 7f4da4ce66c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4da0115270 0x7f4da0175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:06.091 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.086+0000 7f4da4ce66c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4da00f4e90 0x7f4da00fa160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:06.091 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.086+0000 7f4da4ce66c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4da00f5580 con 0x7f4da010f060 2026-02-13T04:05:06.091 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.086+0000 7f4da4ce66c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4da00fa6a0 con 0x7f4da0115270 2026-02-13T04:05:06.091 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.086+0000 7f4da4ce66c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f4da00fa860 con 0x7f4da00f4e90 2026-02-13T04:05:06.091 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.086+0000 7f4d9f7fe6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4da010f060 0x7f4da00f4860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:06.091 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.086+0000 7f4d9f7fe6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4da010f060 0x7f4da00f4860 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:58856/0 (socket says 10.20.193.92:58856) 2026-02-13T04:05:06.091 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.086+0000 7f4d9f7fe6c0 1 -- 10.20.193.92:0/2671593391 learned_addr learned my addr 10.20.193.92:0/2671593391 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:05:06.091 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.086+0000 7f4d9effd6c0 1 --2- 10.20.193.92:0/2671593391 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4da0115270 0x7f4da0175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:06.092 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.086+0000 7f4d9ffff6c0 1 --2- 10.20.193.92:0/2671593391 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4da00f4e90 0x7f4da00fa160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:06.092 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.086+0000 7f4d9f7fe6c0 1 -- 10.20.193.92:0/2671593391 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4da00f4e90 msgr2=0x7f4da00fa160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:06.092 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.086+0000 7f4d9f7fe6c0 1 --2- 10.20.193.92:0/2671593391 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4da00f4e90 0x7f4da00fa160 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:06.092 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.086+0000 7f4d9f7fe6c0 1 -- 10.20.193.92:0/2671593391 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4da0115270 msgr2=0x7f4da0175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:06.092 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.086+0000 7f4d9f7fe6c0 1 --2- 10.20.193.92:0/2671593391 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4da0115270 0x7f4da0175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:06.092 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.086+0000 7f4d9f7fe6c0 1 -- 10.20.193.92:0/2671593391 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d90009590 con 0x7f4da010f060 2026-02-13T04:05:06.092 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.086+0000 7f4d9effd6c0 1 --2- 10.20.193.92:0/2671593391 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4da0115270 0x7f4da0175b10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T04:05:06.092 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.087+0000 7f4d9f7fe6c0 1 --2- 10.20.193.92:0/2671593391 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4da010f060 0x7f4da00f4860 secure :-1 s=READY pgs=327 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d8c009490 tx=0x7f4d8c00bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:05:06.092 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.087+0000 7f4d9cff96c0 1 -- 10.20.193.92:0/2671593391 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4d8c004a80 con 0x7f4da010f060 2026-02-13T04:05:06.092 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.087+0000 7f4d9cff96c0 1 -- 10.20.193.92:0/2671593391 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f4d8c009030 con 0x7f4da010f060 2026-02-13T04:05:06.092 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.087+0000 7f4d9cff96c0 1 -- 10.20.193.92:0/2671593391 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4d8c007bd0 con 0x7f4da010f060 2026-02-13T04:05:06.092 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.087+0000 7f4da4ce66c0 1 -- 10.20.193.92:0/2671593391 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4da00fab40 con 0x7f4da010f060 2026-02-13T04:05:06.093 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.087+0000 7f4da4ce66c0 1 -- 10.20.193.92:0/2671593391 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4da0062870 con 0x7f4da010f060 2026-02-13T04:05:06.093 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.088+0000 7f4d7a7fc6c0 1 -- 10.20.193.92:0/2671593391 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4da0110330 con 0x7f4da010f060 2026-02-13T04:05:06.093 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.090+0000 7f4d9cff96c0 1 -- 10.20.193.92:0/2671593391 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f4d8c004060 con 0x7f4da010f060 2026-02-13T04:05:06.094 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.092+0000 7f4d9cff96c0 1 --2- 10.20.193.92:0/2671593391 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f4d740b56d0 0x7f4d740d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:06.095 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.092+0000 7f4d9cff96c0 1 -- 10.20.193.92:0/2671593391 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f4d8c0ec5f0 con 0x7f4da010f060 2026-02-13T04:05:06.095 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.092+0000 7f4d9cff96c0 1 -- 10.20.193.92:0/2671593391 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4d8c0ecae0 con 0x7f4da010f060 2026-02-13T04:05:06.095 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.092+0000 7f4d9effd6c0 1 --2- 10.20.193.92:0/2671593391 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f4d740b56d0 0x7f4d740d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:06.095 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.093+0000 7f4d9effd6c0 1 --2- 10.20.193.92:0/2671593391 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f4d740b56d0 0x7f4d740d5b80 secure :-1 s=READY pgs=251 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d900023e0 tx=0x7f4d90009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:05:06.217 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.215+0000 7f4d7a7fc6c0 1 -- 10.20.193.92:0/2671593391 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4da00f59b0 con 0x7f4da010f060 2026-02-13T04:05:06.218 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.215+0000 7f4d9cff96c0 1 -- 10.20.193.92:0/2671593391 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f4d8c0aefd0 con 0x7f4da010f060 2026-02-13T04:05:06.218 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:05:06.218 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:05:06.219 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.216+0000 7f4d7a7fc6c0 1 -- 10.20.193.92:0/2671593391 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f4d740b56d0 msgr2=0x7f4d740d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:06.219 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.216+0000 7f4d7a7fc6c0 1 --2- 10.20.193.92:0/2671593391 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f4d740b56d0 0x7f4d740d5b80 secure :-1 s=READY pgs=251 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d900023e0 tx=0x7f4d90009260 comp rx=0 tx=0).stop 2026-02-13T04:05:06.219 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.216+0000 7f4d7a7fc6c0 1 -- 10.20.193.92:0/2671593391 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4da010f060 msgr2=0x7f4da00f4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:06.219 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.216+0000 7f4d7a7fc6c0 1 --2- 10.20.193.92:0/2671593391 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4da010f060 0x7f4da00f4860 secure :-1 s=READY pgs=327 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d8c009490 tx=0x7f4d8c00bca0 comp rx=0 tx=0).stop 2026-02-13T04:05:06.219 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.216+0000 7f4d7a7fc6c0 1 -- 10.20.193.92:0/2671593391 shutdown_connections 2026-02-13T04:05:06.220 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.216+0000 7f4d7a7fc6c0 1 --2- 10.20.193.92:0/2671593391 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f4d740b56d0 0x7f4d740d5b80 unknown :-1 s=CLOSED pgs=251 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:06.220 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.216+0000 7f4d7a7fc6c0 1 --2- 10.20.193.92:0/2671593391 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4da0115270 0x7f4da0175b10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:06.220 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.216+0000 7f4d7a7fc6c0 1 --2- 10.20.193.92:0/2671593391 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4da00f4e90 0x7f4da00fa160 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:06.220 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.216+0000 7f4d7a7fc6c0 1 --2- 10.20.193.92:0/2671593391 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4da010f060 0x7f4da00f4860 unknown :-1 s=CLOSED pgs=327 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:06.220 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.216+0000 7f4d7a7fc6c0 1 -- 10.20.193.92:0/2671593391 >> 10.20.193.92:0/2671593391 conn(0x7f4da00ec980 msgr2=0x7f4da010d540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:05:06.220 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.217+0000 7f4d7a7fc6c0 1 -- 10.20.193.92:0/2671593391 shutdown_connections 2026-02-13T04:05:06.220 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:06.217+0000 7f4d7a7fc6c0 1 -- 10.20.193.92:0/2671593391 wait complete. 2026-02-13T04:05:06.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:06 trial092 ceph-mon[23047]: pgmap v313: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T04:05:06.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:06 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/2671593391' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:06.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:06 trial158 ceph-mon[27763]: pgmap v313: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T04:05:06.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:06 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/2671593391' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:06.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:06 trial099 ceph-mon[27808]: pgmap v313: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T04:05:06.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:06 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/2671593391' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:08.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:08 trial158 ceph-mon[27763]: pgmap v314: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 9 op/s 2026-02-13T04:05:08.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:08 trial099 ceph-mon[27808]: pgmap v314: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 9 op/s 2026-02-13T04:05:08.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:08 trial092 ceph-mon[23047]: pgmap v314: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 9 op/s 2026-02-13T04:05:09.325 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:05:09.508 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:05:09.708 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.705+0000 7effdd7866c0 1 -- 10.20.193.92:0/2814742710 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7effd810b8e0 msgr2=0x7effd810bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:09.708 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.705+0000 7effdd7866c0 1 --2- 10.20.193.92:0/2814742710 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7effd810b8e0 0x7effd810bcb0 secure :-1 s=READY pgs=328 gs=2 cs=0 l=1 c_cookie=16058635490096461293 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7effc4009970 tx=0x7effc402ed20 comp rx=0 tx=0).stop 2026-02-13T04:05:09.708 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.705+0000 7effdd7866c0 1 -- 10.20.193.92:0/2814742710 shutdown_connections 2026-02-13T04:05:09.708 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.705+0000 7effdd7866c0 1 --2- 10.20.193.92:0/2814742710 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7effd8110ef0 0x7effd8111370 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:09.708 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.705+0000 7effdd7866c0 1 --2- 10.20.193.92:0/2814742710 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7effd810c2d0 0x7effd81108a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:09.708 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.705+0000 7effdd7866c0 1 --2- 10.20.193.92:0/2814742710 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7effd810b8e0 0x7effd810bcb0 unknown :-1 s=CLOSED pgs=328 gs=2 cs=0 l=1 c_cookie=16058635490096461293 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:09.709 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.705+0000 7effdd7866c0 1 -- 10.20.193.92:0/2814742710 >> 10.20.193.92:0/2814742710 conn(0x7effd80e9570 msgr2=0x7effd8109980 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:05:09.709 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.705+0000 7effdd7866c0 1 -- 10.20.193.92:0/2814742710 shutdown_connections 2026-02-13T04:05:09.709 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.705+0000 7effdd7866c0 1 -- 10.20.193.92:0/2814742710 wait complete. 2026-02-13T04:05:09.709 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.705+0000 7effdd7866c0 1 Processor -- start 2026-02-13T04:05:09.709 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.706+0000 7effdd7866c0 1 -- start start 2026-02-13T04:05:09.711 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.706+0000 7effdd7866c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7effd810b8e0 0x7effd8121590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:09.711 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.706+0000 7effdd7866c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7effd810c2d0 0x7effd8121ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:09.711 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.706+0000 7effdd7866c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7effd8110ef0 0x7effd8126e90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:09.711 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.706+0000 7effdd7866c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7effd81274e0 con 0x7effd810b8e0 2026-02-13T04:05:09.711 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.706+0000 7effdd7866c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7effd8127650 con 0x7effd810c2d0 2026-02-13T04:05:09.711 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.706+0000 7effdd7866c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7effd8127810 con 0x7effd8110ef0 2026-02-13T04:05:09.711 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.706+0000 7effd7fff6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7effd810b8e0 0x7effd8121590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:09.711 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.706+0000 7effd77fe6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7effd810c2d0 0x7effd8121ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:09.711 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.706+0000 7effd77fe6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7effd810c2d0 0x7effd8121ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:51464/0 (socket says 10.20.193.92:51464) 2026-02-13T04:05:09.711 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.706+0000 7effd77fe6c0 1 -- 10.20.193.92:0/4191010065 learned_addr learned my addr 10.20.193.92:0/4191010065 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:05:09.711 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.706+0000 7effdcf856c0 1 --2- 10.20.193.92:0/4191010065 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7effd8110ef0 0x7effd8126e90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:09.712 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.706+0000 7effd77fe6c0 1 -- 10.20.193.92:0/4191010065 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7effd8110ef0 msgr2=0x7effd8126e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:09.712 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.706+0000 7effd77fe6c0 1 --2- 10.20.193.92:0/4191010065 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7effd8110ef0 0x7effd8126e90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:09.712 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.706+0000 7effd77fe6c0 1 -- 10.20.193.92:0/4191010065 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7effd810b8e0 msgr2=0x7effd8121590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:09.712 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.706+0000 7effd77fe6c0 1 --2- 10.20.193.92:0/4191010065 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7effd810b8e0 0x7effd8121590 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:09.712 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.706+0000 7effd77fe6c0 1 -- 10.20.193.92:0/4191010065 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effc4009590 con 0x7effd810c2d0 2026-02-13T04:05:09.712 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.706+0000 7effd7fff6c0 1 --2- 10.20.193.92:0/4191010065 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7effd810b8e0 0x7effd8121590 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T04:05:09.712 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.707+0000 7effd77fe6c0 1 --2- 10.20.193.92:0/4191010065 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7effd810c2d0 0x7effd8121ad0 secure :-1 s=READY pgs=131 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7effc8009490 tx=0x7effc800bca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:05:09.712 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.707+0000 7effd57fa6c0 1 -- 10.20.193.92:0/4191010065 <== mon.2 v2:10.20.193.99:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7effc8004a80 con 0x7effd810c2d0 2026-02-13T04:05:09.712 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.707+0000 7effd57fa6c0 1 -- 10.20.193.92:0/4191010065 <== mon.2 v2:10.20.193.99:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7effc8009030 con 0x7effd810c2d0 2026-02-13T04:05:09.712 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.707+0000 7effdd7866c0 1 -- 10.20.193.92:0/4191010065 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effd8127af0 con 0x7effd810c2d0 2026-02-13T04:05:09.712 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.707+0000 7effdd7866c0 1 -- 10.20.193.92:0/4191010065 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effd81681d0 con 0x7effd810c2d0 2026-02-13T04:05:09.712 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.707+0000 7effd57fa6c0 1 -- 10.20.193.92:0/4191010065 <== mon.2 v2:10.20.193.99:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7effc8005020 con 0x7effd810c2d0 2026-02-13T04:05:09.713 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.707+0000 7effdd7866c0 1 -- 10.20.193.92:0/4191010065 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effd805fb90 con 0x7effd810c2d0 2026-02-13T04:05:09.713 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.710+0000 7effd57fa6c0 1 -- 10.20.193.92:0/4191010065 <== mon.2 v2:10.20.193.99:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7effc8005180 con 0x7effd810c2d0 2026-02-13T04:05:09.714 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.712+0000 7effd57fa6c0 1 --2- 10.20.193.92:0/4191010065 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7effac0b5650 0x7effac0d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:09.714 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.712+0000 7effd57fa6c0 1 -- 10.20.193.92:0/4191010065 <== mon.2 v2:10.20.193.99:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7effc80e3bb0 con 0x7effd810c2d0 2026-02-13T04:05:09.715 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.712+0000 7effd7fff6c0 1 --2- 10.20.193.92:0/4191010065 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7effac0b5650 0x7effac0d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:09.715 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.712+0000 7effd57fa6c0 1 -- 10.20.193.92:0/4191010065 <== mon.2 v2:10.20.193.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7effc811c620 con 0x7effd810c2d0 2026-02-13T04:05:09.715 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.712+0000 7effd7fff6c0 1 --2- 10.20.193.92:0/4191010065 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7effac0b5650 0x7effac0d5b00 secure :-1 s=READY pgs=252 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7effc402fa10 tx=0x7effc40023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:05:09.838 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.835+0000 7effdd7866c0 1 -- 10.20.193.92:0/4191010065 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7effd81226e0 con 0x7effd810c2d0 2026-02-13T04:05:09.838 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.835+0000 7effd57fa6c0 1 -- 10.20.193.92:0/4191010065 <== mon.2 v2:10.20.193.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7effc80a6550 con 0x7effd810c2d0 2026-02-13T04:05:09.838 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:05:09.838 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:05:09.839 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.836+0000 7effdd7866c0 1 -- 10.20.193.92:0/4191010065 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7effac0b5650 msgr2=0x7effac0d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:09.839 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.836+0000 7effdd7866c0 1 --2- 10.20.193.92:0/4191010065 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7effac0b5650 0x7effac0d5b00 secure :-1 s=READY pgs=252 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7effc402fa10 tx=0x7effc40023a0 comp rx=0 tx=0).stop 2026-02-13T04:05:09.839 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.836+0000 7effdd7866c0 1 -- 10.20.193.92:0/4191010065 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7effd810c2d0 msgr2=0x7effd8121ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:09.839 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.836+0000 7effdd7866c0 1 --2- 10.20.193.92:0/4191010065 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7effd810c2d0 0x7effd8121ad0 secure :-1 s=READY pgs=131 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7effc8009490 tx=0x7effc800bca0 comp rx=0 tx=0).stop 2026-02-13T04:05:09.840 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.836+0000 7effdd7866c0 1 -- 10.20.193.92:0/4191010065 shutdown_connections 2026-02-13T04:05:09.840 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.836+0000 7effdd7866c0 1 --2- 10.20.193.92:0/4191010065 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7effac0b5650 0x7effac0d5b00 unknown :-1 s=CLOSED pgs=252 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:09.840 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.836+0000 7effdd7866c0 1 --2- 10.20.193.92:0/4191010065 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7effd810c2d0 0x7effd8121ad0 unknown :-1 s=CLOSED pgs=131 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:09.840 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.836+0000 7effdd7866c0 1 --2- 10.20.193.92:0/4191010065 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7effd8110ef0 0x7effd8126e90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:09.840 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.836+0000 7effdd7866c0 1 --2- 10.20.193.92:0/4191010065 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7effd810b8e0 0x7effd8121590 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:09.840 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.836+0000 7effdd7866c0 1 -- 10.20.193.92:0/4191010065 >> 10.20.193.92:0/4191010065 conn(0x7effd80e9570 msgr2=0x7effd8109950 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:05:09.840 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.836+0000 7effdd7866c0 1 -- 10.20.193.92:0/4191010065 shutdown_connections 2026-02-13T04:05:09.840 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:09.836+0000 7effdd7866c0 1 -- 10.20.193.92:0/4191010065 wait complete. 2026-02-13T04:05:10.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:10 trial158 ceph-mon[27763]: pgmap v315: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:05:10.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:10 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/4191010065' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:10.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:10 trial099 ceph-mon[27808]: pgmap v315: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:05:10.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:10 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/4191010065' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:10.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:10 trial092 ceph-mon[23047]: pgmap v315: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:05:10.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:10 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/4191010065' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:12.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:12 trial158 ceph-mon[27763]: pgmap v316: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:05:12.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:12 trial099 ceph-mon[27808]: pgmap v316: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:05:12.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:12 trial092 ceph-mon[23047]: pgmap v316: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:05:12.942 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:05:13.127 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:05:13.319 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.314+0000 7fbf552846c0 1 -- 10.20.193.92:0/3720767789 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbf5010f200 msgr2=0x7fbf5010f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:13.319 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.314+0000 7fbf552846c0 1 --2- 10.20.193.92:0/3720767789 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbf5010f200 0x7fbf5010f5d0 secure :-1 s=READY pgs=329 gs=1 cs=0 l=1 c_cookie=8303736052870383719 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf440099a0 tx=0x7fbf4402ed20 comp rx=0 tx=0).stop 2026-02-13T04:05:13.319 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.315+0000 7fbf552846c0 1 -- 10.20.193.92:0/3720767789 shutdown_connections 2026-02-13T04:05:13.319 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.315+0000 7fbf552846c0 1 --2- 10.20.193.92:0/3720767789 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fbf5010fbf0 0x7fbf50114c30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:13.319 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.315+0000 7fbf552846c0 1 --2- 10.20.193.92:0/3720767789 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fbf50115410 0x7fbf50175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:13.320 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.315+0000 7fbf552846c0 1 --2- 10.20.193.92:0/3720767789 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbf5010f200 0x7fbf5010f5d0 unknown :-1 s=CLOSED pgs=329 gs=1 cs=0 l=1 c_cookie=8303736052870383719 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:13.320 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.315+0000 7fbf552846c0 1 -- 10.20.193.92:0/3720767789 >> 10.20.193.92:0/3720767789 conn(0x7fbf500ecb00 msgr2=0x7fbf5010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:05:13.320 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.315+0000 7fbf552846c0 1 -- 10.20.193.92:0/3720767789 shutdown_connections 2026-02-13T04:05:13.320 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.315+0000 7fbf552846c0 1 -- 10.20.193.92:0/3720767789 wait complete. 2026-02-13T04:05:13.320 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.315+0000 7fbf552846c0 1 Processor -- start 2026-02-13T04:05:13.320 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.315+0000 7fbf552846c0 1 -- start start 2026-02-13T04:05:13.320 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.316+0000 7fbf552846c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fbf5010f200 0x7fbf5011d060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:13.320 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.316+0000 7fbf552846c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fbf50115410 0x7fbf5011d5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:13.320 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.316+0000 7fbf552846c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbf50122960 0x7fbf50122e00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:13.320 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.316+0000 7fbf552846c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbf50123370 con 0x7fbf50122960 2026-02-13T04:05:13.320 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.316+0000 7fbf552846c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fbf501234e0 con 0x7fbf5010f200 2026-02-13T04:05:13.320 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.316+0000 7fbf552846c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fbf501236a0 con 0x7fbf50115410 2026-02-13T04:05:13.321 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.316+0000 7fbf4f5776c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbf50122960 0x7fbf50122e00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:13.321 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.316+0000 7fbf4f5776c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbf50122960 0x7fbf50122e00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:58912/0 (socket says 10.20.193.92:58912) 2026-02-13T04:05:13.321 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.316+0000 7fbf4f5776c0 1 -- 10.20.193.92:0/3621015148 learned_addr learned my addr 10.20.193.92:0/3621015148 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:05:13.321 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.316+0000 7fbf4ed766c0 1 --2- 10.20.193.92:0/3621015148 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fbf5010f200 0x7fbf5011d060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:13.321 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.316+0000 7fbf4e5756c0 1 --2- 10.20.193.92:0/3621015148 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fbf50115410 0x7fbf5011d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:13.321 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.316+0000 7fbf4f5776c0 1 -- 10.20.193.92:0/3621015148 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fbf50115410 msgr2=0x7fbf5011d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:13.321 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.316+0000 7fbf4f5776c0 1 --2- 10.20.193.92:0/3621015148 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fbf50115410 0x7fbf5011d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:13.321 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.316+0000 7fbf4f5776c0 1 -- 10.20.193.92:0/3621015148 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fbf5010f200 msgr2=0x7fbf5011d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:13.321 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.316+0000 7fbf4f5776c0 1 --2- 10.20.193.92:0/3621015148 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fbf5010f200 0x7fbf5011d060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:13.321 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.316+0000 7fbf4f5776c0 1 -- 10.20.193.92:0/3621015148 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf44009590 con 0x7fbf50122960 2026-02-13T04:05:13.321 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.317+0000 7fbf4f5776c0 1 --2- 10.20.193.92:0/3621015148 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbf50122960 0x7fbf50122e00 secure :-1 s=READY pgs=330 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf40006ea0 tx=0x7fbf4000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:05:13.322 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.317+0000 7fbf2ffff6c0 1 -- 10.20.193.92:0/3621015148 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf40003a30 con 0x7fbf50122960 2026-02-13T04:05:13.322 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.317+0000 7fbf2ffff6c0 1 -- 10.20.193.92:0/3621015148 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fbf40005560 con 0x7fbf50122960 2026-02-13T04:05:13.322 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.317+0000 7fbf2ffff6c0 1 -- 10.20.193.92:0/3621015148 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fbf400082a0 con 0x7fbf50122960 2026-02-13T04:05:13.323 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.317+0000 7fbf552846c0 1 -- 10.20.193.92:0/3621015148 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf50163b50 con 0x7fbf50122960 2026-02-13T04:05:13.323 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.317+0000 7fbf552846c0 1 -- 10.20.193.92:0/3621015148 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf50163fe0 con 0x7fbf50122960 2026-02-13T04:05:13.323 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.317+0000 7fbf552846c0 1 -- 10.20.193.92:0/3621015148 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf501104d0 con 0x7fbf50122960 2026-02-13T04:05:13.323 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.320+0000 7fbf2ffff6c0 1 -- 10.20.193.92:0/3621015148 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fbf4000d4d0 con 0x7fbf50122960 2026-02-13T04:05:13.324 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.321+0000 7fbf2ffff6c0 1 --2- 10.20.193.92:0/3621015148 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fbf240b56d0 0x7fbf240d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:13.324 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.321+0000 7fbf2ffff6c0 1 -- 10.20.193.92:0/3621015148 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7fbf400e4b10 con 0x7fbf50122960 2026-02-13T04:05:13.324 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.321+0000 7fbf2ffff6c0 1 -- 10.20.193.92:0/3621015148 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fbf4011d5e0 con 0x7fbf50122960 2026-02-13T04:05:13.324 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.321+0000 7fbf4ed766c0 1 --2- 10.20.193.92:0/3621015148 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fbf240b56d0 0x7fbf240d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:13.325 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.322+0000 7fbf4ed766c0 1 --2- 10.20.193.92:0/3621015148 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fbf240b56d0 0x7fbf240d5b80 secure :-1 s=READY pgs=253 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf44005b40 tx=0x7fbf440023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:05:13.447 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.445+0000 7fbf552846c0 1 -- 10.20.193.92:0/3621015148 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbf5010f5d0 con 0x7fbf50122960 2026-02-13T04:05:13.448 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.445+0000 7fbf2ffff6c0 1 -- 10.20.193.92:0/3621015148 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fbf400a74b0 con 0x7fbf50122960 2026-02-13T04:05:13.448 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:05:13.448 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:05:13.449 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.446+0000 7fbf552846c0 1 -- 10.20.193.92:0/3621015148 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fbf240b56d0 msgr2=0x7fbf240d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:13.449 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.446+0000 7fbf552846c0 1 --2- 10.20.193.92:0/3621015148 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fbf240b56d0 0x7fbf240d5b80 secure :-1 s=READY pgs=253 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf44005b40 tx=0x7fbf440023a0 comp rx=0 tx=0).stop 2026-02-13T04:05:13.449 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.446+0000 7fbf552846c0 1 -- 10.20.193.92:0/3621015148 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbf50122960 msgr2=0x7fbf50122e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:13.449 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.446+0000 7fbf552846c0 1 --2- 10.20.193.92:0/3621015148 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbf50122960 0x7fbf50122e00 secure :-1 s=READY pgs=330 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbf40006ea0 tx=0x7fbf4000cca0 comp rx=0 tx=0).stop 2026-02-13T04:05:13.449 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.446+0000 7fbf552846c0 1 -- 10.20.193.92:0/3621015148 shutdown_connections 2026-02-13T04:05:13.450 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.446+0000 7fbf552846c0 1 --2- 10.20.193.92:0/3621015148 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fbf50122960 0x7fbf50122e00 unknown :-1 s=CLOSED pgs=330 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:13.450 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.446+0000 7fbf552846c0 1 --2- 10.20.193.92:0/3621015148 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fbf50115410 0x7fbf5011d5a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:13.450 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.446+0000 7fbf552846c0 1 --2- 10.20.193.92:0/3621015148 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fbf240b56d0 0x7fbf240d5b80 unknown :-1 s=CLOSED pgs=253 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:13.450 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.446+0000 7fbf552846c0 1 --2- 10.20.193.92:0/3621015148 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fbf5010f200 0x7fbf5011d060 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:13.450 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.446+0000 7fbf552846c0 1 -- 10.20.193.92:0/3621015148 >> 10.20.193.92:0/3621015148 conn(0x7fbf500ecb00 msgr2=0x7fbf5010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:05:13.450 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.446+0000 7fbf552846c0 1 -- 10.20.193.92:0/3621015148 shutdown_connections 2026-02-13T04:05:13.450 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:13.446+0000 7fbf552846c0 1 -- 10.20.193.92:0/3621015148 wait complete. 2026-02-13T04:05:13.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:13 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/3621015148' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:13.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:13 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/3621015148' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:13.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:13 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/3621015148' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:14.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:14 trial158 ceph-mon[27763]: pgmap v317: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:05:14.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:14 trial099 ceph-mon[27808]: pgmap v317: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:05:14.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:14 trial092 ceph-mon[23047]: pgmap v317: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:05:16.553 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:05:16.737 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:05:16.782 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:16 trial092 ceph-mon[23047]: pgmap v318: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T04:05:16.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:16 trial158 ceph-mon[27763]: pgmap v318: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T04:05:16.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:16 trial099 ceph-mon[27808]: pgmap v318: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T04:05:16.940 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:16.937+0000 7f10af5776c0 1 -- 10.20.193.92:0/2568798716 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f10b0115260 msgr2=0x7f10b0175c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:16.940 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:16.937+0000 7f10af5776c0 1 --2- 10.20.193.92:0/2568798716 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f10b0115260 0x7f10b0175c00 secure :-1 s=READY pgs=331 gs=1 cs=0 l=1 c_cookie=4520970073768506773 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f10a000aa70 tx=0x7f10a002fde0 comp rx=0 tx=0).stop 2026-02-13T04:05:16.940 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:16.937+0000 7f10af5776c0 1 -- 10.20.193.92:0/2568798716 shutdown_connections 2026-02-13T04:05:16.940 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:16.937+0000 7f10af5776c0 1 --2- 10.20.193.92:0/2568798716 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f10b010fa40 0x7f10b0114a80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:16.940 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:16.937+0000 7f10af5776c0 1 --2- 10.20.193.92:0/2568798716 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f10b0115260 0x7f10b0175c00 unknown :-1 s=CLOSED pgs=331 gs=1 cs=0 l=1 c_cookie=4520970073768506773 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:16.941 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:16.937+0000 7f10af5776c0 1 --2- 10.20.193.92:0/2568798716 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f10b010f050 0x7f10b010f420 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:16.941 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:16.937+0000 7f10af5776c0 1 -- 10.20.193.92:0/2568798716 >> 10.20.193.92:0/2568798716 conn(0x7f10b00ec950 msgr2=0x7f10b010cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:05:16.941 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:16.937+0000 7f10af5776c0 1 -- 10.20.193.92:0/2568798716 shutdown_connections 2026-02-13T04:05:16.942 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:16.938+0000 7f10af5776c0 1 -- 10.20.193.92:0/2568798716 wait complete. 2026-02-13T04:05:16.942 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:16.939+0000 7f10af5776c0 1 Processor -- start 2026-02-13T04:05:16.942 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:16.939+0000 7f10af5776c0 1 -- start start 2026-02-13T04:05:16.943 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:16.939+0000 7f10af5776c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f10b010f050 0x7f10b011cdb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:16.943 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:16.939+0000 7f10af5776c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f10b0115260 0x7f10b011d2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:16.943 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:16.939+0000 7f10af5776c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f10b0122660 0x7f10b0122b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:16.943 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:16.939+0000 7f10af5776c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f10b0123070 con 0x7f10b010f050 2026-02-13T04:05:16.943 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:16.939+0000 7f10af5776c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f10b01231e0 con 0x7f10b0115260 2026-02-13T04:05:16.943 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:16.939+0000 7f10af5776c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f10b01233a0 con 0x7f10b0122660 2026-02-13T04:05:16.943 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:16.939+0000 7f10ae5756c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f10b010f050 0x7f10b011cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:16.943 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:16.939+0000 7f10add746c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f10b0115260 0x7f10b011d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:16.943 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:16.939+0000 7f10ae5756c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f10b010f050 0x7f10b011cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:57866/0 (socket says 10.20.193.92:57866) 2026-02-13T04:05:16.943 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:16.939+0000 7f10ae5756c0 1 -- 10.20.193.92:0/2412242241 learned_addr learned my addr 10.20.193.92:0/2412242241 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:05:16.943 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:16.939+0000 7f10add746c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f10b0115260 0x7f10b011d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:60580/0 (socket says 10.20.193.92:60580) 2026-02-13T04:05:16.943 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:16.939+0000 7f10aed766c0 1 --2- 10.20.193.92:0/2412242241 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f10b0122660 0x7f10b0122b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:16.944 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:16.940+0000 7f10ae5756c0 1 -- 10.20.193.92:0/2412242241 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f10b0122660 msgr2=0x7f10b0122b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:16.944 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:16.940+0000 7f10ae5756c0 1 --2- 10.20.193.92:0/2412242241 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f10b0122660 0x7f10b0122b00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:16.944 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:16.940+0000 7f10ae5756c0 1 -- 10.20.193.92:0/2412242241 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f10b0115260 msgr2=0x7f10b011d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:16.944 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:16.940+0000 7f10ae5756c0 1 --2- 10.20.193.92:0/2412242241 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f10b0115260 0x7f10b011d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:16.944 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:16.940+0000 7f10ae5756c0 1 -- 10.20.193.92:0/2412242241 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a000a660 con 0x7f10b010f050 2026-02-13T04:05:16.944 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:16.940+0000 7f10aed766c0 1 --2- 10.20.193.92:0/2412242241 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f10b0122660 0x7f10b0122b00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T04:05:16.944 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:16.940+0000 7f10ae5756c0 1 --2- 10.20.193.92:0/2412242241 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f10b010f050 0x7f10b011cdb0 secure :-1 s=READY pgs=332 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f10a4009490 tx=0x7f10a400bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:05:16.945 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:16.940+0000 7f10977fe6c0 1 -- 10.20.193.92:0/2412242241 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f10a4004a80 con 0x7f10b010f050 2026-02-13T04:05:16.945 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:16.940+0000 7f10977fe6c0 1 -- 10.20.193.92:0/2412242241 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f10a4009030 con 0x7f10b010f050 2026-02-13T04:05:16.945 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:16.940+0000 7f10af5776c0 1 -- 10.20.193.92:0/2412242241 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10b0163850 con 0x7f10b010f050 2026-02-13T04:05:16.945 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:16.940+0000 7f10977fe6c0 1 -- 10.20.193.92:0/2412242241 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f10a40071c0 con 0x7f10b010f050 2026-02-13T04:05:16.945 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:16.940+0000 7f10af5776c0 1 -- 10.20.193.92:0/2412242241 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10b0163ce0 con 0x7f10b010f050 2026-02-13T04:05:16.946 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:16.941+0000 7f10af5776c0 1 -- 10.20.193.92:0/2412242241 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10b0110320 con 0x7f10b010f050 2026-02-13T04:05:16.946 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:16.943+0000 7f10977fe6c0 1 -- 10.20.193.92:0/2412242241 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f10a4004e90 con 0x7f10b010f050 2026-02-13T04:05:16.947 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:16.944+0000 7f10977fe6c0 1 --2- 10.20.193.92:0/2412242241 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f10880b5650 0x7f10880d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:16.947 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:16.944+0000 7f10977fe6c0 1 -- 10.20.193.92:0/2412242241 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f10a40e3c60 con 0x7f10b010f050 2026-02-13T04:05:16.947 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:16.944+0000 7f10add746c0 1 --2- 10.20.193.92:0/2412242241 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f10880b5650 0x7f10880d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:16.947 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:16.945+0000 7f10977fe6c0 1 -- 10.20.193.92:0/2412242241 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f10a40e40e0 con 0x7f10b010f050 2026-02-13T04:05:16.948 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:16.945+0000 7f10add746c0 1 --2- 10.20.193.92:0/2412242241 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f10880b5650 0x7f10880d5b00 secure :-1 s=READY pgs=254 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f10b01236f0 tx=0x7f1098009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:05:17.070 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:17.068+0000 7f10af5776c0 1 -- 10.20.193.92:0/2412242241 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f10b010f420 con 0x7f10b010f050 2026-02-13T04:05:17.071 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:17.068+0000 7f10977fe6c0 1 -- 10.20.193.92:0/2412242241 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f10a40a6600 con 0x7f10b010f050 2026-02-13T04:05:17.071 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:05:17.071 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:05:17.072 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:17.069+0000 7f10af5776c0 1 -- 10.20.193.92:0/2412242241 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f10880b5650 msgr2=0x7f10880d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:17.072 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:17.069+0000 7f10af5776c0 1 --2- 10.20.193.92:0/2412242241 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f10880b5650 0x7f10880d5b00 secure :-1 s=READY pgs=254 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f10b01236f0 tx=0x7f1098009260 comp rx=0 tx=0).stop 2026-02-13T04:05:17.073 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:17.069+0000 7f10af5776c0 1 -- 10.20.193.92:0/2412242241 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f10b010f050 msgr2=0x7f10b011cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:17.073 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:17.069+0000 7f10af5776c0 1 --2- 10.20.193.92:0/2412242241 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f10b010f050 0x7f10b011cdb0 secure :-1 s=READY pgs=332 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f10a4009490 tx=0x7f10a400bc50 comp rx=0 tx=0).stop 2026-02-13T04:05:17.073 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:17.070+0000 7f10af5776c0 1 -- 10.20.193.92:0/2412242241 shutdown_connections 2026-02-13T04:05:17.073 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:17.070+0000 7f10af5776c0 1 --2- 10.20.193.92:0/2412242241 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f10880b5650 0x7f10880d5b00 unknown :-1 s=CLOSED pgs=254 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:17.073 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:17.070+0000 7f10af5776c0 1 --2- 10.20.193.92:0/2412242241 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f10b0115260 0x7f10b011d2f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:17.073 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:17.070+0000 7f10af5776c0 1 --2- 10.20.193.92:0/2412242241 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f10b0122660 0x7f10b0122b00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:17.073 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:17.070+0000 7f10af5776c0 1 --2- 10.20.193.92:0/2412242241 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f10b010f050 0x7f10b011cdb0 unknown :-1 s=CLOSED pgs=332 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:17.073 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:17.070+0000 7f10af5776c0 1 -- 10.20.193.92:0/2412242241 >> 10.20.193.92:0/2412242241 conn(0x7f10b00ec950 msgr2=0x7f10b010cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:05:17.073 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:17.070+0000 7f10af5776c0 1 -- 10.20.193.92:0/2412242241 shutdown_connections 2026-02-13T04:05:17.073 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:17.070+0000 7f10af5776c0 1 -- 10.20.193.92:0/2412242241 wait complete. 2026-02-13T04:05:17.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:17 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/2412242241' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:17.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:17 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/2412242241' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:17.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:17 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/2412242241' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:18.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:18 trial158 ceph-mon[27763]: pgmap v319: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:05:18.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:18 trial099 ceph-mon[27808]: pgmap v319: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:05:18.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:18 trial092 ceph-mon[23047]: pgmap v319: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:05:20.177 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:05:20.362 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:05:20.556 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.553+0000 7f0ada1ba6c0 1 -- 10.20.193.92:0/2980696739 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0ad410fa50 msgr2=0x7f0ad4114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:20.556 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.553+0000 7f0ada1ba6c0 1 --2- 10.20.193.92:0/2980696739 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0ad410fa50 0x7f0ad4114a90 secure :-1 s=READY pgs=333 gs=1 cs=0 l=1 c_cookie=13940352985377538106 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ac80099a0 tx=0x7f0ac802ed00 comp rx=0 tx=0).stop 2026-02-13T04:05:20.557 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.553+0000 7f0ada1ba6c0 1 -- 10.20.193.92:0/2980696739 shutdown_connections 2026-02-13T04:05:20.557 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.553+0000 7f0ada1ba6c0 1 --2- 10.20.193.92:0/2980696739 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0ad4115270 0x7f0ad4175c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:20.557 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.553+0000 7f0ada1ba6c0 1 --2- 10.20.193.92:0/2980696739 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0ad410fa50 0x7f0ad4114a90 unknown :-1 s=CLOSED pgs=333 gs=1 cs=0 l=1 c_cookie=13940352985377538106 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:20.557 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.553+0000 7f0ada1ba6c0 1 --2- 10.20.193.92:0/2980696739 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f0ad410f060 0x7f0ad410f430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:20.557 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.553+0000 7f0ada1ba6c0 1 -- 10.20.193.92:0/2980696739 >> 10.20.193.92:0/2980696739 conn(0x7f0ad40ec980 msgr2=0x7f0ad410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:05:20.557 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.553+0000 7f0ada1ba6c0 1 -- 10.20.193.92:0/2980696739 shutdown_connections 2026-02-13T04:05:20.559 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.554+0000 7f0ada1ba6c0 1 -- 10.20.193.92:0/2980696739 wait complete. 2026-02-13T04:05:20.559 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.555+0000 7f0ada1ba6c0 1 Processor -- start 2026-02-13T04:05:20.559 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.555+0000 7f0ada1ba6c0 1 -- start start 2026-02-13T04:05:20.559 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.555+0000 7f0ada1ba6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0ad410f060 0x7f0ad411ce70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:20.559 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.555+0000 7f0ada1ba6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f0ad4115270 0x7f0ad411d3b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:20.559 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.555+0000 7f0ada1ba6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0ad4122770 0x7f0ad4122c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:20.560 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.555+0000 7f0ada1ba6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad4123180 con 0x7f0ad410f060 2026-02-13T04:05:20.560 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.555+0000 7f0ada1ba6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad41232f0 con 0x7f0ad4122770 2026-02-13T04:05:20.560 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.555+0000 7f0ada1ba6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad41234b0 con 0x7f0ad4115270 2026-02-13T04:05:20.560 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.555+0000 7f0ad91b86c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0ad410f060 0x7f0ad411ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:20.560 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.555+0000 7f0ad89b76c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f0ad4115270 0x7f0ad411d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:20.560 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.555+0000 7f0ad91b86c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0ad410f060 0x7f0ad411ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:57882/0 (socket says 10.20.193.92:57882) 2026-02-13T04:05:20.560 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.555+0000 7f0ad91b86c0 1 -- 10.20.193.92:0/1606521164 learned_addr learned my addr 10.20.193.92:0/1606521164 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:05:20.560 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.555+0000 7f0ad99b96c0 1 --2- 10.20.193.92:0/1606521164 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0ad4122770 0x7f0ad4122c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:20.560 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.555+0000 7f0ad91b86c0 1 -- 10.20.193.92:0/1606521164 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f0ad4115270 msgr2=0x7f0ad411d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:20.560 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.555+0000 7f0ad91b86c0 1 --2- 10.20.193.92:0/1606521164 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f0ad4115270 0x7f0ad411d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:20.560 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.555+0000 7f0ad91b86c0 1 -- 10.20.193.92:0/1606521164 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0ad4122770 msgr2=0x7f0ad4122c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:20.560 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.555+0000 7f0ad91b86c0 1 --2- 10.20.193.92:0/1606521164 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0ad4122770 0x7f0ad4122c10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:20.561 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.555+0000 7f0ad91b86c0 1 -- 10.20.193.92:0/1606521164 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ac8009590 con 0x7f0ad410f060 2026-02-13T04:05:20.561 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.556+0000 7f0ad89b76c0 1 --2- 10.20.193.92:0/1606521164 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f0ad4115270 0x7f0ad411d3b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T04:05:20.561 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.556+0000 7f0ad91b86c0 1 --2- 10.20.193.92:0/1606521164 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0ad410f060 0x7f0ad411ce70 secure :-1 s=READY pgs=334 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ac4005dc0 tx=0x7f0ac400bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:05:20.561 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.556+0000 7f0ac27fc6c0 1 -- 10.20.193.92:0/1606521164 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0ac4004250 con 0x7f0ad410f060 2026-02-13T04:05:20.561 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.556+0000 7f0ada1ba6c0 1 -- 10.20.193.92:0/1606521164 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ad4163960 con 0x7f0ad410f060 2026-02-13T04:05:20.561 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.556+0000 7f0ada1ba6c0 1 -- 10.20.193.92:0/1606521164 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ad4163df0 con 0x7f0ad410f060 2026-02-13T04:05:20.561 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.556+0000 7f0ada1ba6c0 1 -- 10.20.193.92:0/1606521164 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ad4110330 con 0x7f0ad410f060 2026-02-13T04:05:20.561 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.556+0000 7f0ac27fc6c0 1 -- 10.20.193.92:0/1606521164 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f0ac4009070 con 0x7f0ad410f060 2026-02-13T04:05:20.561 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.556+0000 7f0ac27fc6c0 1 -- 10.20.193.92:0/1606521164 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f0ac40071c0 con 0x7f0ad410f060 2026-02-13T04:05:20.562 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.559+0000 7f0ac27fc6c0 1 -- 10.20.193.92:0/1606521164 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f0ac40043b0 con 0x7f0ad410f060 2026-02-13T04:05:20.563 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.560+0000 7f0ac27fc6c0 1 --2- 10.20.193.92:0/1606521164 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f0ab00b56d0 0x7f0ab00d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:20.563 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.560+0000 7f0ac27fc6c0 1 -- 10.20.193.92:0/1606521164 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f0ac40e3c90 con 0x7f0ad410f060 2026-02-13T04:05:20.564 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.561+0000 7f0ad89b76c0 1 --2- 10.20.193.92:0/1606521164 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f0ab00b56d0 0x7f0ab00d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:20.564 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.561+0000 7f0ac27fc6c0 1 -- 10.20.193.92:0/1606521164 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f0ac40a6630 con 0x7f0ad410f060 2026-02-13T04:05:20.564 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.561+0000 7f0ad89b76c0 1 --2- 10.20.193.92:0/1606521164 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f0ab00b56d0 0x7f0ab00d5b80 secure :-1 s=READY pgs=255 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ac8005b40 tx=0x7f0ac8005f00 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:05:20.687 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.684+0000 7f0ada1ba6c0 1 -- 10.20.193.92:0/1606521164 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f0ad410f430 con 0x7f0ad410f060 2026-02-13T04:05:20.687 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.685+0000 7f0ac27fc6c0 1 -- 10.20.193.92:0/1606521164 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f0ac400c560 con 0x7f0ad410f060 2026-02-13T04:05:20.688 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:05:20.688 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:05:20.689 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.685+0000 7f0ada1ba6c0 1 -- 10.20.193.92:0/1606521164 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f0ab00b56d0 msgr2=0x7f0ab00d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:20.689 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.685+0000 7f0ada1ba6c0 1 --2- 10.20.193.92:0/1606521164 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f0ab00b56d0 0x7f0ab00d5b80 secure :-1 s=READY pgs=255 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ac8005b40 tx=0x7f0ac8005f00 comp rx=0 tx=0).stop 2026-02-13T04:05:20.689 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.685+0000 7f0ada1ba6c0 1 -- 10.20.193.92:0/1606521164 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0ad410f060 msgr2=0x7f0ad411ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:20.689 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.685+0000 7f0ada1ba6c0 1 --2- 10.20.193.92:0/1606521164 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0ad410f060 0x7f0ad411ce70 secure :-1 s=READY pgs=334 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0ac4005dc0 tx=0x7f0ac400bbb0 comp rx=0 tx=0).stop 2026-02-13T04:05:20.689 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.686+0000 7f0ada1ba6c0 1 -- 10.20.193.92:0/1606521164 shutdown_connections 2026-02-13T04:05:20.689 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.686+0000 7f0ada1ba6c0 1 --2- 10.20.193.92:0/1606521164 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f0ab00b56d0 0x7f0ab00d5b80 unknown :-1 s=CLOSED pgs=255 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:20.689 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.686+0000 7f0ada1ba6c0 1 --2- 10.20.193.92:0/1606521164 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f0ad4122770 0x7f0ad4122c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:20.689 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.686+0000 7f0ada1ba6c0 1 --2- 10.20.193.92:0/1606521164 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f0ad4115270 0x7f0ad411d3b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:20.689 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.686+0000 7f0ada1ba6c0 1 --2- 10.20.193.92:0/1606521164 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f0ad410f060 0x7f0ad411ce70 unknown :-1 s=CLOSED pgs=334 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:20.690 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.686+0000 7f0ada1ba6c0 1 -- 10.20.193.92:0/1606521164 >> 10.20.193.92:0/1606521164 conn(0x7f0ad40ec980 msgr2=0x7f0ad410cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:05:20.690 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.686+0000 7f0ada1ba6c0 1 -- 10.20.193.92:0/1606521164 shutdown_connections 2026-02-13T04:05:20.690 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:20.686+0000 7f0ada1ba6c0 1 -- 10.20.193.92:0/1606521164 wait complete. 2026-02-13T04:05:20.748 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:20 trial092 ceph-mon[23047]: pgmap v320: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:05:20.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:20 trial158 ceph-mon[27763]: pgmap v320: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:05:20.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:20 trial099 ceph-mon[27808]: pgmap v320: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:05:21.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:21 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/1606521164' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:21.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:21 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/1606521164' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:21.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:21 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1606521164' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:22.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:22 trial158 ceph-mon[27763]: pgmap v321: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:05:22.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:22 trial099 ceph-mon[27808]: pgmap v321: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:05:22.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:22 trial092 ceph-mon[23047]: pgmap v321: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:05:23.790 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:05:23.975 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:05:24.169 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.166+0000 7f4b64b196c0 1 -- 10.20.193.92:0/2687260093 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4b6011b510 msgr2=0x7f4b6011b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:24.169 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.166+0000 7f4b64b196c0 1 --2- 10.20.193.92:0/2687260093 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4b6011b510 0x7f4b6011b8e0 secure :-1 s=READY pgs=335 gs=1 cs=0 l=1 c_cookie=17510774222753772145 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4b54009970 tx=0x7f4b5402ed10 comp rx=0 tx=0).stop 2026-02-13T04:05:24.169 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.166+0000 7f4b64b196c0 1 -- 10.20.193.92:0/2687260093 shutdown_connections 2026-02-13T04:05:24.169 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.166+0000 7f4b64b196c0 1 --2- 10.20.193.92:0/2687260093 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4b60113dc0 0x7f4b60114210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:24.169 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.166+0000 7f4b64b196c0 1 --2- 10.20.193.92:0/2687260093 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4b601149c0 0x7f4b60114ee0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:24.169 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.166+0000 7f4b64b196c0 1 --2- 10.20.193.92:0/2687260093 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4b6011b510 0x7f4b6011b8e0 unknown :-1 s=CLOSED pgs=335 gs=1 cs=0 l=1 c_cookie=17510774222753772145 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:24.169 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.166+0000 7f4b64b196c0 1 -- 10.20.193.92:0/2687260093 >> 10.20.193.92:0/2687260093 conn(0x7f4b60058a50 msgr2=0x7f4b60058e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:05:24.169 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.166+0000 7f4b64b196c0 1 -- 10.20.193.92:0/2687260093 shutdown_connections 2026-02-13T04:05:24.169 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.166+0000 7f4b64b196c0 1 -- 10.20.193.92:0/2687260093 wait complete. 2026-02-13T04:05:24.171 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.166+0000 7f4b64b196c0 1 Processor -- start 2026-02-13T04:05:24.172 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.167+0000 7f4b64b196c0 1 -- start start 2026-02-13T04:05:24.172 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.167+0000 7f4b64b196c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4b60113dc0 0x7f4b6012b710 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:24.172 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.167+0000 7f4b64b196c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4b601149c0 0x7f4b6012bc50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:24.172 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.167+0000 7f4b64b196c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4b6011b510 0x7f4b60131010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:24.172 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.167+0000 7f4b64b196c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4b60131660 con 0x7f4b601149c0 2026-02-13T04:05:24.172 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.167+0000 7f4b64b196c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4b601317d0 con 0x7f4b60113dc0 2026-02-13T04:05:24.172 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.167+0000 7f4b64b196c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f4b60131990 con 0x7f4b6011b510 2026-02-13T04:05:24.172 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.167+0000 7f4b5dd746c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4b601149c0 0x7f4b6012bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:24.172 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.167+0000 7f4b5e5756c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4b60113dc0 0x7f4b6012b710 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:24.172 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.167+0000 7f4b5e5756c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4b60113dc0 0x7f4b6012b710 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:60606/0 (socket says 10.20.193.92:60606) 2026-02-13T04:05:24.173 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.167+0000 7f4b5e5756c0 1 -- 10.20.193.92:0/223086410 learned_addr learned my addr 10.20.193.92:0/223086410 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:05:24.173 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.167+0000 7f4b5ed766c0 1 --2- 10.20.193.92:0/223086410 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4b6011b510 0x7f4b60131010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:24.173 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.167+0000 7f4b5dd746c0 1 -- 10.20.193.92:0/223086410 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4b6011b510 msgr2=0x7f4b60131010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:24.173 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.167+0000 7f4b5dd746c0 1 --2- 10.20.193.92:0/223086410 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4b6011b510 0x7f4b60131010 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:24.173 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.167+0000 7f4b5dd746c0 1 -- 10.20.193.92:0/223086410 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4b60113dc0 msgr2=0x7f4b6012b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:24.173 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.167+0000 7f4b5dd746c0 1 --2- 10.20.193.92:0/223086410 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4b60113dc0 0x7f4b6012b710 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:24.173 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.167+0000 7f4b5dd746c0 1 -- 10.20.193.92:0/223086410 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b54009590 con 0x7f4b601149c0 2026-02-13T04:05:24.173 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.168+0000 7f4b5dd746c0 1 --2- 10.20.193.92:0/223086410 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4b601149c0 0x7f4b6012bc50 secure :-1 s=READY pgs=336 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4b4800b640 tx=0x7f4b4800bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:05:24.173 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.168+0000 7f4b477fe6c0 1 -- 10.20.193.92:0/223086410 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4b480044a0 con 0x7f4b601149c0 2026-02-13T04:05:24.173 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.168+0000 7f4b64b196c0 1 -- 10.20.193.92:0/223086410 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b60131c70 con 0x7f4b601149c0 2026-02-13T04:05:24.173 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.168+0000 7f4b64b196c0 1 -- 10.20.193.92:0/223086410 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b60172350 con 0x7f4b601149c0 2026-02-13T04:05:24.173 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.168+0000 7f4b477fe6c0 1 -- 10.20.193.92:0/223086410 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f4b48009030 con 0x7f4b601149c0 2026-02-13T04:05:24.174 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.168+0000 7f4b477fe6c0 1 -- 10.20.193.92:0/223086410 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4b4800ce60 con 0x7f4b601149c0 2026-02-13T04:05:24.174 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.169+0000 7f4b457fa6c0 1 -- 10.20.193.92:0/223086410 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b6005b000 con 0x7f4b601149c0 2026-02-13T04:05:24.174 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.171+0000 7f4b477fe6c0 1 -- 10.20.193.92:0/223086410 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f4b4800c410 con 0x7f4b601149c0 2026-02-13T04:05:24.175 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.172+0000 7f4b477fe6c0 1 --2- 10.20.193.92:0/223086410 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f4b380b56c0 0x7f4b380d5b70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:24.175 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.172+0000 7f4b477fe6c0 1 -- 10.20.193.92:0/223086410 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f4b480e3ac0 con 0x7f4b601149c0 2026-02-13T04:05:24.175 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.172+0000 7f4b5e5756c0 1 --2- 10.20.193.92:0/223086410 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f4b380b56c0 0x7f4b380d5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:24.175 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.173+0000 7f4b5e5756c0 1 --2- 10.20.193.92:0/223086410 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f4b380b56c0 0x7f4b380d5b70 secure :-1 s=READY pgs=256 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4b540023e0 tx=0x7f4b54005910 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:05:24.176 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.173+0000 7f4b477fe6c0 1 -- 10.20.193.92:0/223086410 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4b480a6460 con 0x7f4b601149c0 2026-02-13T04:05:24.299 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.296+0000 7f4b457fa6c0 1 -- 10.20.193.92:0/223086410 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4b6012c860 con 0x7f4b601149c0 2026-02-13T04:05:24.299 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.296+0000 7f4b477fe6c0 1 -- 10.20.193.92:0/223086410 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f4b480a9610 con 0x7f4b601149c0 2026-02-13T04:05:24.300 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:05:24.300 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:05:24.301 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.298+0000 7f4b457fa6c0 1 -- 10.20.193.92:0/223086410 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f4b380b56c0 msgr2=0x7f4b380d5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:24.301 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.298+0000 7f4b457fa6c0 1 --2- 10.20.193.92:0/223086410 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f4b380b56c0 0x7f4b380d5b70 secure :-1 s=READY pgs=256 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4b540023e0 tx=0x7f4b54005910 comp rx=0 tx=0).stop 2026-02-13T04:05:24.301 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.298+0000 7f4b457fa6c0 1 -- 10.20.193.92:0/223086410 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4b601149c0 msgr2=0x7f4b6012bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:24.301 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.298+0000 7f4b457fa6c0 1 --2- 10.20.193.92:0/223086410 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4b601149c0 0x7f4b6012bc50 secure :-1 s=READY pgs=336 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4b4800b640 tx=0x7f4b4800bb10 comp rx=0 tx=0).stop 2026-02-13T04:05:24.301 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.298+0000 7f4b457fa6c0 1 -- 10.20.193.92:0/223086410 shutdown_connections 2026-02-13T04:05:24.301 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.298+0000 7f4b457fa6c0 1 --2- 10.20.193.92:0/223086410 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4b6011b510 0x7f4b60131010 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:24.301 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.298+0000 7f4b457fa6c0 1 --2- 10.20.193.92:0/223086410 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4b601149c0 0x7f4b6012bc50 unknown :-1 s=CLOSED pgs=336 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:24.301 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.298+0000 7f4b457fa6c0 1 --2- 10.20.193.92:0/223086410 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f4b380b56c0 0x7f4b380d5b70 unknown :-1 s=CLOSED pgs=256 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:24.301 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.298+0000 7f4b457fa6c0 1 --2- 10.20.193.92:0/223086410 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4b60113dc0 0x7f4b6012b710 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:24.301 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.298+0000 7f4b457fa6c0 1 -- 10.20.193.92:0/223086410 >> 10.20.193.92:0/223086410 conn(0x7f4b60058a50 msgr2=0x7f4b6011a420 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:05:24.302 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.298+0000 7f4b457fa6c0 1 -- 10.20.193.92:0/223086410 shutdown_connections 2026-02-13T04:05:24.302 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:24.298+0000 7f4b457fa6c0 1 -- 10.20.193.92:0/223086410 wait complete. 2026-02-13T04:05:24.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:24 trial092 ceph-mon[23047]: pgmap v322: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 9 op/s 2026-02-13T04:05:24.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:24 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/223086410' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:24.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:24 trial158 ceph-mon[27763]: pgmap v322: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 9 op/s 2026-02-13T04:05:24.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:24 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/223086410' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:24.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:24 trial099 ceph-mon[27808]: pgmap v322: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.9 KiB/s rd, 9 op/s 2026-02-13T04:05:24.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:24 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/223086410' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:26.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:26 trial158 ceph-mon[27763]: pgmap v323: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 9 op/s 2026-02-13T04:05:26.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:26 trial099 ceph-mon[27808]: pgmap v323: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 9 op/s 2026-02-13T04:05:26.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:26 trial092 ceph-mon[23047]: pgmap v323: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 9 op/s 2026-02-13T04:05:27.405 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:05:27.590 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:05:27.780 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.777+0000 7f2ba35776c0 1 -- 10.20.193.92:0/2914272241 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2ba410fa50 msgr2=0x7f2ba4114a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:27.780 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.777+0000 7f2ba35776c0 1 --2- 10.20.193.92:0/2914272241 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2ba410fa50 0x7f2ba4114a90 secure :-1 s=READY pgs=118 gs=1 cs=0 l=1 c_cookie=16707761710499799747 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b8c0099a0 tx=0x7f2b8c02ed00 comp rx=0 tx=0).stop 2026-02-13T04:05:27.780 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.777+0000 7f2ba35776c0 1 -- 10.20.193.92:0/2914272241 shutdown_connections 2026-02-13T04:05:27.781 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.777+0000 7f2ba35776c0 1 --2- 10.20.193.92:0/2914272241 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2ba4115270 0x7f2ba4175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:27.781 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.777+0000 7f2ba35776c0 1 --2- 10.20.193.92:0/2914272241 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2ba410fa50 0x7f2ba4114a90 unknown :-1 s=CLOSED pgs=118 gs=1 cs=0 l=1 c_cookie=16707761710499799747 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:27.781 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.777+0000 7f2ba35776c0 1 --2- 10.20.193.92:0/2914272241 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2ba410f060 0x7f2ba410f430 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:27.781 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.777+0000 7f2ba35776c0 1 -- 10.20.193.92:0/2914272241 >> 10.20.193.92:0/2914272241 conn(0x7f2ba40ec980 msgr2=0x7f2ba410cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:05:27.781 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.777+0000 7f2ba35776c0 1 -- 10.20.193.92:0/2914272241 shutdown_connections 2026-02-13T04:05:27.781 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.777+0000 7f2ba35776c0 1 -- 10.20.193.92:0/2914272241 wait complete. 2026-02-13T04:05:27.781 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.778+0000 7f2ba35776c0 1 Processor -- start 2026-02-13T04:05:27.782 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.778+0000 7f2ba35776c0 1 -- start start 2026-02-13T04:05:27.783 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.778+0000 7f2ba35776c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2ba410f060 0x7f2ba40f4790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:27.783 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.778+0000 7f2ba35776c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2ba4115270 0x7f2ba4175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:27.783 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.778+0000 7f2ba35776c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2ba40f4dc0 0x7f2ba40fa090 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:27.783 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.778+0000 7f2ba35776c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba40f54b0 con 0x7f2ba40f4dc0 2026-02-13T04:05:27.783 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.778+0000 7f2ba35776c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba40fa5d0 con 0x7f2ba410f060 2026-02-13T04:05:27.783 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.778+0000 7f2ba35776c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba40fa790 con 0x7f2ba4115270 2026-02-13T04:05:27.783 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.778+0000 7f2ba25756c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2ba410f060 0x7f2ba40f4790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:27.783 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.778+0000 7f2ba1d746c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2ba4115270 0x7f2ba4175b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:27.783 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.778+0000 7f2ba2d766c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2ba40f4dc0 0x7f2ba40fa090 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:27.783 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.778+0000 7f2ba2d766c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2ba40f4dc0 0x7f2ba40fa090 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:49932/0 (socket says 10.20.193.92:49932) 2026-02-13T04:05:27.784 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.778+0000 7f2ba2d766c0 1 -- 10.20.193.92:0/1960723177 learned_addr learned my addr 10.20.193.92:0/1960723177 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:05:27.784 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.778+0000 7f2ba1d746c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2ba4115270 0x7f2ba4175b10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:59196/0 (socket says 10.20.193.92:59196) 2026-02-13T04:05:27.784 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.778+0000 7f2ba25756c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2ba410f060 0x7f2ba40f4790 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:53834/0 (socket says 10.20.193.92:53834) 2026-02-13T04:05:27.784 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.779+0000 7f2ba2d766c0 1 -- 10.20.193.92:0/1960723177 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2ba4115270 msgr2=0x7f2ba4175b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:27.784 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.779+0000 7f2ba2d766c0 1 --2- 10.20.193.92:0/1960723177 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2ba4115270 0x7f2ba4175b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:27.784 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.779+0000 7f2ba2d766c0 1 -- 10.20.193.92:0/1960723177 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2ba410f060 msgr2=0x7f2ba40f4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:27.784 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.779+0000 7f2ba2d766c0 1 --2- 10.20.193.92:0/1960723177 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2ba410f060 0x7f2ba40f4790 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:27.784 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.779+0000 7f2ba2d766c0 1 -- 10.20.193.92:0/1960723177 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b8c009590 con 0x7f2ba40f4dc0 2026-02-13T04:05:27.784 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.779+0000 7f2ba2d766c0 1 --2- 10.20.193.92:0/1960723177 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2ba40f4dc0 0x7f2ba40fa090 secure :-1 s=READY pgs=337 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b94006ea0 tx=0x7f2b9400ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:05:27.784 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.779+0000 7f2b8b7fe6c0 1 -- 10.20.193.92:0/1960723177 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2b94003c40 con 0x7f2ba40f4dc0 2026-02-13T04:05:27.784 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.779+0000 7f2b8b7fe6c0 1 -- 10.20.193.92:0/1960723177 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f2b94003da0 con 0x7f2ba40f4dc0 2026-02-13T04:05:27.785 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.779+0000 7f2ba35776c0 1 -- 10.20.193.92:0/1960723177 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ba40faa70 con 0x7f2ba40f4dc0 2026-02-13T04:05:27.785 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.779+0000 7f2ba35776c0 1 -- 10.20.193.92:0/1960723177 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ba40fb200 con 0x7f2ba40f4dc0 2026-02-13T04:05:27.785 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.779+0000 7f2b8b7fe6c0 1 -- 10.20.193.92:0/1960723177 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f2b94008440 con 0x7f2ba40f4dc0 2026-02-13T04:05:27.785 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.780+0000 7f2ba35776c0 1 -- 10.20.193.92:0/1960723177 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ba40faf50 con 0x7f2ba40f4dc0 2026-02-13T04:05:27.785 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.782+0000 7f2b8b7fe6c0 1 -- 10.20.193.92:0/1960723177 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f2b9400d690 con 0x7f2ba40f4dc0 2026-02-13T04:05:27.786 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.784+0000 7f2b8b7fe6c0 1 --2- 10.20.193.92:0/1960723177 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f2b7c0b56d0 0x7f2b7c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:27.786 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.784+0000 7f2b8b7fe6c0 1 -- 10.20.193.92:0/1960723177 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f2b940e4b50 con 0x7f2ba40f4dc0 2026-02-13T04:05:27.787 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.784+0000 7f2b8b7fe6c0 1 -- 10.20.193.92:0/1960723177 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f2b9411d620 con 0x7f2ba40f4dc0 2026-02-13T04:05:27.787 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.784+0000 7f2ba25756c0 1 --2- 10.20.193.92:0/1960723177 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f2b7c0b56d0 0x7f2b7c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:27.787 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.784+0000 7f2ba25756c0 1 --2- 10.20.193.92:0/1960723177 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f2b7c0b56d0 0x7f2b7c0d5b80 secure :-1 s=READY pgs=257 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b98004750 tx=0x7f2b98009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:05:27.910 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.907+0000 7f2ba35776c0 1 -- 10.20.193.92:0/1960723177 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2ba40f58e0 con 0x7f2ba40f4dc0 2026-02-13T04:05:27.910 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.907+0000 7f2b8b7fe6c0 1 -- 10.20.193.92:0/1960723177 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f2b940a7530 con 0x7f2ba40f4dc0 2026-02-13T04:05:27.910 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:05:27.910 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:05:27.911 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.908+0000 7f2ba35776c0 1 -- 10.20.193.92:0/1960723177 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f2b7c0b56d0 msgr2=0x7f2b7c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:27.911 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.908+0000 7f2ba35776c0 1 --2- 10.20.193.92:0/1960723177 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f2b7c0b56d0 0x7f2b7c0d5b80 secure :-1 s=READY pgs=257 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b98004750 tx=0x7f2b98009260 comp rx=0 tx=0).stop 2026-02-13T04:05:27.911 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.908+0000 7f2ba35776c0 1 -- 10.20.193.92:0/1960723177 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2ba40f4dc0 msgr2=0x7f2ba40fa090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:27.912 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.908+0000 7f2ba35776c0 1 --2- 10.20.193.92:0/1960723177 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2ba40f4dc0 0x7f2ba40fa090 secure :-1 s=READY pgs=337 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2b94006ea0 tx=0x7f2b9400ce50 comp rx=0 tx=0).stop 2026-02-13T04:05:27.912 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.909+0000 7f2ba35776c0 1 -- 10.20.193.92:0/1960723177 shutdown_connections 2026-02-13T04:05:27.912 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.909+0000 7f2ba35776c0 1 --2- 10.20.193.92:0/1960723177 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f2ba40f4dc0 0x7f2ba40fa090 unknown :-1 s=CLOSED pgs=337 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:27.912 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.909+0000 7f2ba35776c0 1 --2- 10.20.193.92:0/1960723177 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f2ba4115270 0x7f2ba4175b10 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:27.912 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.909+0000 7f2ba35776c0 1 --2- 10.20.193.92:0/1960723177 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f2b7c0b56d0 0x7f2b7c0d5b80 unknown :-1 s=CLOSED pgs=257 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:27.912 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.909+0000 7f2ba35776c0 1 --2- 10.20.193.92:0/1960723177 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f2ba410f060 0x7f2ba40f4790 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:27.912 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.909+0000 7f2ba35776c0 1 -- 10.20.193.92:0/1960723177 >> 10.20.193.92:0/1960723177 conn(0x7f2ba40ec980 msgr2=0x7f2ba410d540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:05:27.912 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.909+0000 7f2ba35776c0 1 -- 10.20.193.92:0/1960723177 shutdown_connections 2026-02-13T04:05:27.912 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:27.909+0000 7f2ba35776c0 1 -- 10.20.193.92:0/1960723177 wait complete. 2026-02-13T04:05:28.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:28 trial158 ceph-mon[27763]: pgmap v324: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 10 op/s 2026-02-13T04:05:28.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:28 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/1960723177' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:28.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:28 trial099 ceph-mon[27808]: pgmap v324: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 10 op/s 2026-02-13T04:05:28.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:28 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/1960723177' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:28.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:28 trial092 ceph-mon[23047]: pgmap v324: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 10 op/s 2026-02-13T04:05:28.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:28 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1960723177' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:30.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:30 trial158 ceph-mon[27763]: pgmap v325: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.4 KiB/s rd, 9 op/s 2026-02-13T04:05:30.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:30 trial099 ceph-mon[27808]: pgmap v325: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.4 KiB/s rd, 9 op/s 2026-02-13T04:05:30.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:30 trial092 ceph-mon[23047]: pgmap v325: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.4 KiB/s rd, 9 op/s 2026-02-13T04:05:31.015 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:05:31.200 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:05:31.393 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.390+0000 7f24f8bf76c0 1 -- 10.20.193.92:0/2471508590 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f24f410b730 msgr2=0x7f24f4110590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:31.393 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.390+0000 7f24f8bf76c0 1 --2- 10.20.193.92:0/2471508590 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f24f410b730 0x7f24f4110590 secure :-1 s=READY pgs=338 gs=1 cs=0 l=1 c_cookie=14772069811180746633 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f24e40098a0 tx=0x7f24e402ec50 comp rx=0 tx=0).stop 2026-02-13T04:05:31.393 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.390+0000 7f24f8bf76c0 1 -- 10.20.193.92:0/2471508590 shutdown_connections 2026-02-13T04:05:31.393 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.390+0000 7f24f8bf76c0 1 --2- 10.20.193.92:0/2471508590 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f24f4110d40 0x7f24f4111700 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:31.394 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.390+0000 7f24f8bf76c0 1 --2- 10.20.193.92:0/2471508590 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f24f410b730 0x7f24f4110590 unknown :-1 s=CLOSED pgs=338 gs=1 cs=0 l=1 c_cookie=14772069811180746633 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:31.394 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.390+0000 7f24f8bf76c0 1 --2- 10.20.193.92:0/2471508590 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f24f410ad40 0x7f24f410b110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:31.394 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.390+0000 7f24f8bf76c0 1 -- 10.20.193.92:0/2471508590 >> 10.20.193.92:0/2471508590 conn(0x7f24f40638a0 msgr2=0x7f24f4109040 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:05:31.394 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.390+0000 7f24f8bf76c0 1 -- 10.20.193.92:0/2471508590 shutdown_connections 2026-02-13T04:05:31.395 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.391+0000 7f24f8bf76c0 1 -- 10.20.193.92:0/2471508590 wait complete. 2026-02-13T04:05:31.395 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.392+0000 7f24f8bf76c0 1 Processor -- start 2026-02-13T04:05:31.395 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.392+0000 7f24f8bf76c0 1 -- start start 2026-02-13T04:05:31.396 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.392+0000 7f24f8bf76c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f24f410ad40 0x7f24f4122430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:31.396 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.392+0000 7f24f8bf76c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f24f4110d40 0x7f24f4122970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:31.396 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.392+0000 7f24f8bf76c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f24f4127d30 0x7f24f41281d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:31.396 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.392+0000 7f24f8bf76c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f24f4128740 con 0x7f24f4110d40 2026-02-13T04:05:31.396 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.392+0000 7f24f8bf76c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f24f41288b0 con 0x7f24f410ad40 2026-02-13T04:05:31.396 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.392+0000 7f24f8bf76c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f24f4128a70 con 0x7f24f4127d30 2026-02-13T04:05:31.396 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.392+0000 7f24f37fe6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f24f410ad40 0x7f24f4122430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:31.396 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.392+0000 7f24f37fe6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f24f410ad40 0x7f24f4122430 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:53856/0 (socket says 10.20.193.92:53856) 2026-02-13T04:05:31.396 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.392+0000 7f24f37fe6c0 1 -- 10.20.193.92:0/2454753633 learned_addr learned my addr 10.20.193.92:0/2454753633 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:05:31.396 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.392+0000 7f24f3fff6c0 1 --2- 10.20.193.92:0/2454753633 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f24f4127d30 0x7f24f41281d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:31.396 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.392+0000 7f24f2ffd6c0 1 --2- 10.20.193.92:0/2454753633 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f24f4110d40 0x7f24f4122970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:31.397 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.393+0000 7f24f37fe6c0 1 -- 10.20.193.92:0/2454753633 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f24f4127d30 msgr2=0x7f24f41281d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:31.397 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.393+0000 7f24f37fe6c0 1 --2- 10.20.193.92:0/2454753633 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f24f4127d30 0x7f24f41281d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:31.397 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.393+0000 7f24f37fe6c0 1 -- 10.20.193.92:0/2454753633 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f24f4110d40 msgr2=0x7f24f4122970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:31.397 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.393+0000 7f24f37fe6c0 1 --2- 10.20.193.92:0/2454753633 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f24f4110d40 0x7f24f4122970 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:31.397 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.393+0000 7f24f37fe6c0 1 -- 10.20.193.92:0/2454753633 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24e40094c0 con 0x7f24f410ad40 2026-02-13T04:05:31.397 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.393+0000 7f24f3fff6c0 1 --2- 10.20.193.92:0/2454753633 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f24f4127d30 0x7f24f41281d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T04:05:31.397 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.393+0000 7f24f37fe6c0 1 --2- 10.20.193.92:0/2454753633 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f24f410ad40 0x7f24f4122430 secure :-1 s=READY pgs=132 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f24e000b800 tx=0x7f24e000bcd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:05:31.398 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.393+0000 7f24f0ff96c0 1 -- 10.20.193.92:0/2454753633 <== mon.2 v2:10.20.193.99:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f24e0004a80 con 0x7f24f410ad40 2026-02-13T04:05:31.398 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.393+0000 7f24f8bf76c0 1 -- 10.20.193.92:0/2454753633 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24f4168f20 con 0x7f24f410ad40 2026-02-13T04:05:31.398 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.393+0000 7f24f0ff96c0 1 -- 10.20.193.92:0/2454753633 <== mon.2 v2:10.20.193.99:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f24e0009030 con 0x7f24f410ad40 2026-02-13T04:05:31.398 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.393+0000 7f24f0ff96c0 1 -- 10.20.193.92:0/2454753633 <== mon.2 v2:10.20.193.99:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f24e0007440 con 0x7f24f410ad40 2026-02-13T04:05:31.398 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.393+0000 7f24f8bf76c0 1 -- 10.20.193.92:0/2454753633 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24f4169400 con 0x7f24f410ad40 2026-02-13T04:05:31.398 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.394+0000 7f24ce7fc6c0 1 -- 10.20.193.92:0/2454753633 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24f410be30 con 0x7f24f410ad40 2026-02-13T04:05:31.399 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.396+0000 7f24f0ff96c0 1 -- 10.20.193.92:0/2454753633 <== mon.2 v2:10.20.193.99:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f24e0004e90 con 0x7f24f410ad40 2026-02-13T04:05:31.401 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.398+0000 7f24f0ff96c0 1 --2- 10.20.193.92:0/2454753633 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f24c80b56d0 0x7f24c80d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:31.401 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.398+0000 7f24f0ff96c0 1 -- 10.20.193.92:0/2454753633 <== mon.2 v2:10.20.193.99:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f24e00e3bb0 con 0x7f24f410ad40 2026-02-13T04:05:31.401 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.398+0000 7f24f2ffd6c0 1 --2- 10.20.193.92:0/2454753633 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f24c80b56d0 0x7f24c80d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:31.401 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.398+0000 7f24f0ff96c0 1 -- 10.20.193.92:0/2454753633 <== mon.2 v2:10.20.193.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f24e011c620 con 0x7f24f410ad40 2026-02-13T04:05:31.401 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.399+0000 7f24f2ffd6c0 1 --2- 10.20.193.92:0/2454753633 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f24c80b56d0 0x7f24c80d5b80 secure :-1 s=READY pgs=258 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f24f4128dc0 tx=0x7f24e40023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:05:31.523 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.521+0000 7f24ce7fc6c0 1 -- 10.20.193.92:0/2454753633 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f24f4110590 con 0x7f24f410ad40 2026-02-13T04:05:31.524 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.521+0000 7f24f0ff96c0 1 -- 10.20.193.92:0/2454753633 <== mon.2 v2:10.20.193.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f24e00a6550 con 0x7f24f410ad40 2026-02-13T04:05:31.524 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:05:31.524 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:05:31.525 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.522+0000 7f24ce7fc6c0 1 -- 10.20.193.92:0/2454753633 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f24c80b56d0 msgr2=0x7f24c80d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:31.525 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.522+0000 7f24ce7fc6c0 1 --2- 10.20.193.92:0/2454753633 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f24c80b56d0 0x7f24c80d5b80 secure :-1 s=READY pgs=258 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f24f4128dc0 tx=0x7f24e40023a0 comp rx=0 tx=0).stop 2026-02-13T04:05:31.525 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.522+0000 7f24ce7fc6c0 1 -- 10.20.193.92:0/2454753633 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f24f410ad40 msgr2=0x7f24f4122430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:31.525 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.522+0000 7f24ce7fc6c0 1 --2- 10.20.193.92:0/2454753633 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f24f410ad40 0x7f24f4122430 secure :-1 s=READY pgs=132 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f24e000b800 tx=0x7f24e000bcd0 comp rx=0 tx=0).stop 2026-02-13T04:05:31.525 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.522+0000 7f24ce7fc6c0 1 -- 10.20.193.92:0/2454753633 shutdown_connections 2026-02-13T04:05:31.526 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.522+0000 7f24ce7fc6c0 1 --2- 10.20.193.92:0/2454753633 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f24f4127d30 0x7f24f41281d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:31.526 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.522+0000 7f24ce7fc6c0 1 --2- 10.20.193.92:0/2454753633 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f24f4110d40 0x7f24f4122970 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:31.526 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.522+0000 7f24ce7fc6c0 1 --2- 10.20.193.92:0/2454753633 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f24c80b56d0 0x7f24c80d5b80 unknown :-1 s=CLOSED pgs=258 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:31.526 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.522+0000 7f24ce7fc6c0 1 --2- 10.20.193.92:0/2454753633 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f24f410ad40 0x7f24f4122430 unknown :-1 s=CLOSED pgs=132 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:31.526 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.522+0000 7f24ce7fc6c0 1 -- 10.20.193.92:0/2454753633 >> 10.20.193.92:0/2454753633 conn(0x7f24f40638a0 msgr2=0x7f24f410ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:05:31.526 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.522+0000 7f24ce7fc6c0 1 -- 10.20.193.92:0/2454753633 shutdown_connections 2026-02-13T04:05:31.526 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:31.522+0000 7f24ce7fc6c0 1 -- 10.20.193.92:0/2454753633 wait complete. 2026-02-13T04:05:31.584 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:31 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/2454753633' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:31.829 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:31 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/2454753633' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:31.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:31 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/2454753633' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:32.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:32 trial158 ceph-mon[27763]: pgmap v326: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 10 op/s 2026-02-13T04:05:32.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:32 trial099 ceph-mon[27808]: pgmap v326: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 10 op/s 2026-02-13T04:05:32.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:32 trial092 ceph-mon[23047]: pgmap v326: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.2 KiB/s rd, 10 op/s 2026-02-13T04:05:34.628 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:05:34.813 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:05:34.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:34 trial158 ceph-mon[27763]: pgmap v327: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 8 op/s 2026-02-13T04:05:34.856 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:34 trial092 ceph-mon[23047]: pgmap v327: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 8 op/s 2026-02-13T04:05:34.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:34 trial099 ceph-mon[27808]: pgmap v327: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 8 op/s 2026-02-13T04:05:35.004 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.001+0000 7f837a4786c0 1 -- 10.20.193.92:0/4073789138 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f837410f200 msgr2=0x7f837410f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:35.004 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.001+0000 7f837a4786c0 1 --2- 10.20.193.92:0/4073789138 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f837410f200 0x7f837410f5d0 secure :-1 s=READY pgs=133 gs=2 cs=0 l=1 c_cookie=1962234549649667261 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f83600098a0 tx=0x7f836002ec40 comp rx=0 tx=0).stop 2026-02-13T04:05:35.004 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.001+0000 7f837a4786c0 1 -- 10.20.193.92:0/4073789138 shutdown_connections 2026-02-13T04:05:35.004 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.001+0000 7f837a4786c0 1 --2- 10.20.193.92:0/4073789138 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8374115410 0x7f8374175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:35.004 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.001+0000 7f837a4786c0 1 --2- 10.20.193.92:0/4073789138 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f837410fbf0 0x7f8374114c30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:35.004 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.001+0000 7f837a4786c0 1 --2- 10.20.193.92:0/4073789138 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f837410f200 0x7f837410f5d0 unknown :-1 s=CLOSED pgs=133 gs=2 cs=0 l=1 c_cookie=1962234549649667261 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:35.004 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.001+0000 7f837a4786c0 1 -- 10.20.193.92:0/4073789138 >> 10.20.193.92:0/4073789138 conn(0x7f83740ecb00 msgr2=0x7f837410cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:05:35.004 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.001+0000 7f837a4786c0 1 -- 10.20.193.92:0/4073789138 shutdown_connections 2026-02-13T04:05:35.004 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.001+0000 7f837a4786c0 1 -- 10.20.193.92:0/4073789138 wait complete. 2026-02-13T04:05:35.004 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.002+0000 7f837a4786c0 1 Processor -- start 2026-02-13T04:05:35.004 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.002+0000 7f837a4786c0 1 -- start start 2026-02-13T04:05:35.004 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.002+0000 7f837a4786c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f837410f200 0x7f837411d010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:35.004 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.002+0000 7f837a4786c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8374115410 0x7f837411d550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:35.005 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.002+0000 7f837a4786c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8374122910 0x7f8374122db0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:35.005 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.002+0000 7f837a4786c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8374123320 con 0x7f8374122910 2026-02-13T04:05:35.005 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.002+0000 7f837a4786c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8374123490 con 0x7f8374115410 2026-02-13T04:05:35.005 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.002+0000 7f837a4786c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f8374123650 con 0x7f837410f200 2026-02-13T04:05:35.005 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.002+0000 7f83737fe6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8374115410 0x7f837411d550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:35.005 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.002+0000 7f83737fe6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8374115410 0x7f837411d550 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:37002/0 (socket says 10.20.193.92:37002) 2026-02-13T04:05:35.005 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.002+0000 7f83737fe6c0 1 -- 10.20.193.92:0/1898116621 learned_addr learned my addr 10.20.193.92:0/1898116621 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:05:35.005 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.003+0000 7f8373fff6c0 1 --2- 10.20.193.92:0/1898116621 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f837410f200 0x7f837411d010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:35.005 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.003+0000 7f83789ee6c0 1 --2- 10.20.193.92:0/1898116621 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8374122910 0x7f8374122db0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:35.005 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.003+0000 7f83737fe6c0 1 -- 10.20.193.92:0/1898116621 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f837410f200 msgr2=0x7f837411d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:35.005 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.003+0000 7f83737fe6c0 1 --2- 10.20.193.92:0/1898116621 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f837410f200 0x7f837411d010 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:35.005 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.003+0000 7f83737fe6c0 1 -- 10.20.193.92:0/1898116621 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8374122910 msgr2=0x7f8374122db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:35.005 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.003+0000 7f83737fe6c0 1 --2- 10.20.193.92:0/1898116621 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8374122910 0x7f8374122db0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:35.005 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.003+0000 7f83737fe6c0 1 -- 10.20.193.92:0/1898116621 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83600094c0 con 0x7f8374115410 2026-02-13T04:05:35.005 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.003+0000 7f83737fe6c0 1 --2- 10.20.193.92:0/1898116621 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8374115410 0x7f837411d550 secure :-1 s=READY pgs=134 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8364005930 tx=0x7f836400bca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:05:35.005 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.003+0000 7f83717fa6c0 1 -- 10.20.193.92:0/1898116621 <== mon.2 v2:10.20.193.99:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8364004460 con 0x7f8374115410 2026-02-13T04:05:35.005 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.003+0000 7f83717fa6c0 1 -- 10.20.193.92:0/1898116621 <== mon.2 v2:10.20.193.99:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f83640045c0 con 0x7f8374115410 2026-02-13T04:05:35.005 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.003+0000 7f837a4786c0 1 -- 10.20.193.92:0/1898116621 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8374163b00 con 0x7f8374115410 2026-02-13T04:05:35.006 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.003+0000 7f83717fa6c0 1 -- 10.20.193.92:0/1898116621 <== mon.2 v2:10.20.193.99:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8364003a80 con 0x7f8374115410 2026-02-13T04:05:35.006 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.003+0000 7f837a4786c0 1 -- 10.20.193.92:0/1898116621 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8374163f90 con 0x7f8374115410 2026-02-13T04:05:35.006 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.004+0000 7f837a4786c0 1 -- 10.20.193.92:0/1898116621 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83741104d0 con 0x7f8374115410 2026-02-13T04:05:35.009 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.006+0000 7f83717fa6c0 1 -- 10.20.193.92:0/1898116621 <== mon.2 v2:10.20.193.99:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f8364005220 con 0x7f8374115410 2026-02-13T04:05:35.010 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.008+0000 7f83717fa6c0 1 --2- 10.20.193.92:0/1898116621 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f83480b5650 0x7f83480d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:35.010 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.008+0000 7f83717fa6c0 1 -- 10.20.193.92:0/1898116621 <== mon.2 v2:10.20.193.99:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f83640e3b70 con 0x7f8374115410 2026-02-13T04:05:35.010 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.008+0000 7f8373fff6c0 1 --2- 10.20.193.92:0/1898116621 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f83480b5650 0x7f83480d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:35.010 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.008+0000 7f83717fa6c0 1 -- 10.20.193.92:0/1898116621 <== mon.2 v2:10.20.193.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f836411c5e0 con 0x7f8374115410 2026-02-13T04:05:35.011 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.009+0000 7f8373fff6c0 1 --2- 10.20.193.92:0/1898116621 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f83480b5650 0x7f83480d5b00 secure :-1 s=READY pgs=259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f83600097f0 tx=0x7f83600023a0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:05:35.136 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.133+0000 7f837a4786c0 1 -- 10.20.193.92:0/1898116621 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f837411e1c0 con 0x7f8374115410 2026-02-13T04:05:35.136 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.134+0000 7f83717fa6c0 1 -- 10.20.193.92:0/1898116621 <== mon.2 v2:10.20.193.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f83640a6510 con 0x7f8374115410 2026-02-13T04:05:35.136 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:05:35.136 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:05:35.137 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.135+0000 7f837a4786c0 1 -- 10.20.193.92:0/1898116621 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f83480b5650 msgr2=0x7f83480d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:35.137 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.135+0000 7f837a4786c0 1 --2- 10.20.193.92:0/1898116621 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f83480b5650 0x7f83480d5b00 secure :-1 s=READY pgs=259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f83600097f0 tx=0x7f83600023a0 comp rx=0 tx=0).stop 2026-02-13T04:05:35.137 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.135+0000 7f837a4786c0 1 -- 10.20.193.92:0/1898116621 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8374115410 msgr2=0x7f837411d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:35.137 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.135+0000 7f837a4786c0 1 --2- 10.20.193.92:0/1898116621 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8374115410 0x7f837411d550 secure :-1 s=READY pgs=134 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8364005930 tx=0x7f836400bca0 comp rx=0 tx=0).stop 2026-02-13T04:05:35.137 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.135+0000 7f837a4786c0 1 -- 10.20.193.92:0/1898116621 shutdown_connections 2026-02-13T04:05:35.137 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.135+0000 7f837a4786c0 1 --2- 10.20.193.92:0/1898116621 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f83480b5650 0x7f83480d5b00 unknown :-1 s=CLOSED pgs=259 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:35.137 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.135+0000 7f837a4786c0 1 --2- 10.20.193.92:0/1898116621 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8374115410 0x7f837411d550 unknown :-1 s=CLOSED pgs=134 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:35.137 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.135+0000 7f837a4786c0 1 --2- 10.20.193.92:0/1898116621 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8374122910 0x7f8374122db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:35.137 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.135+0000 7f837a4786c0 1 --2- 10.20.193.92:0/1898116621 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f837410f200 0x7f837411d010 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:35.138 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.135+0000 7f837a4786c0 1 -- 10.20.193.92:0/1898116621 >> 10.20.193.92:0/1898116621 conn(0x7f83740ecb00 msgr2=0x7f837410cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:05:35.138 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.135+0000 7f837a4786c0 1 -- 10.20.193.92:0/1898116621 shutdown_connections 2026-02-13T04:05:35.138 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:35.135+0000 7f837a4786c0 1 -- 10.20.193.92:0/1898116621 wait complete. 2026-02-13T04:05:35.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:35 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/1898116621' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:35.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:35 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/1898116621' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:35.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:35 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1898116621' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:36.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:36 trial158 ceph-mon[27763]: pgmap v328: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 9 op/s 2026-02-13T04:05:36.835 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:36 trial092 ceph-mon[23047]: pgmap v328: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 9 op/s 2026-02-13T04:05:36.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:36 trial099 ceph-mon[27808]: pgmap v328: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.1 KiB/s rd, 9 op/s 2026-02-13T04:05:38.239 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:05:38.422 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:05:38.618 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.615+0000 7f94fe1306c0 1 -- 10.20.193.92:0/1811609337 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f94f8113dc0 msgr2=0x7f94f8114210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:38.618 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.615+0000 7f94fe1306c0 1 --2- 10.20.193.92:0/1811609337 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f94f8113dc0 0x7f94f8114210 secure :-1 s=READY pgs=339 gs=1 cs=0 l=1 c_cookie=2501131667754201831 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94e8009970 tx=0x7f94e802ed10 comp rx=0 tx=0).stop 2026-02-13T04:05:38.618 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.615+0000 7f94fe1306c0 1 -- 10.20.193.92:0/1811609337 shutdown_connections 2026-02-13T04:05:38.618 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.615+0000 7f94fe1306c0 1 --2- 10.20.193.92:0/1811609337 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f94f81149c0 0x7f94f8114ee0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:38.618 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.615+0000 7f94fe1306c0 1 --2- 10.20.193.92:0/1811609337 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f94f8113dc0 0x7f94f8114210 unknown :-1 s=CLOSED pgs=339 gs=1 cs=0 l=1 c_cookie=2501131667754201831 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:38.618 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.615+0000 7f94fe1306c0 1 --2- 10.20.193.92:0/1811609337 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f94f811b510 0x7f94f811b8e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:38.618 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.615+0000 7f94fe1306c0 1 -- 10.20.193.92:0/1811609337 >> 10.20.193.92:0/1811609337 conn(0x7f94f8058a50 msgr2=0x7f94f8058e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:05:38.618 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.615+0000 7f94fe1306c0 1 -- 10.20.193.92:0/1811609337 shutdown_connections 2026-02-13T04:05:38.618 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.615+0000 7f94fe1306c0 1 -- 10.20.193.92:0/1811609337 wait complete. 2026-02-13T04:05:38.618 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.616+0000 7f94fe1306c0 1 Processor -- start 2026-02-13T04:05:38.618 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.616+0000 7f94fe1306c0 1 -- start start 2026-02-13T04:05:38.619 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.616+0000 7f94fe1306c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f94f8113dc0 0x7f94f812b720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:38.619 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.616+0000 7f94fe1306c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f94f81149c0 0x7f94f812bc60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:38.619 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.616+0000 7f94fe1306c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f94f811b510 0x7f94f8131020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:38.619 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.616+0000 7f94fe1306c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f94f8131670 con 0x7f94f81149c0 2026-02-13T04:05:38.619 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.616+0000 7f94fe1306c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f94f81317e0 con 0x7f94f811b510 2026-02-13T04:05:38.619 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.616+0000 7f94fe1306c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f94f81319a0 con 0x7f94f8113dc0 2026-02-13T04:05:38.619 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.617+0000 7f94f6ffd6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f94f81149c0 0x7f94f812bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:38.619 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.617+0000 7f94f7fff6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f94f811b510 0x7f94f8131020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:38.619 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.617+0000 7f94f7fff6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f94f811b510 0x7f94f8131020 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:37018/0 (socket says 10.20.193.92:37018) 2026-02-13T04:05:38.619 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.617+0000 7f94f7fff6c0 1 -- 10.20.193.92:0/3143394191 learned_addr learned my addr 10.20.193.92:0/3143394191 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:05:38.619 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.617+0000 7f94f77fe6c0 1 --2- 10.20.193.92:0/3143394191 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f94f8113dc0 0x7f94f812b720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:38.619 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.617+0000 7f94f7fff6c0 1 -- 10.20.193.92:0/3143394191 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f94f8113dc0 msgr2=0x7f94f812b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:38.620 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.617+0000 7f94f7fff6c0 1 --2- 10.20.193.92:0/3143394191 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f94f8113dc0 0x7f94f812b720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:38.620 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.617+0000 7f94f7fff6c0 1 -- 10.20.193.92:0/3143394191 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f94f81149c0 msgr2=0x7f94f812bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:38.620 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.617+0000 7f94f7fff6c0 1 --2- 10.20.193.92:0/3143394191 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f94f81149c0 0x7f94f812bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:38.620 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.617+0000 7f94f7fff6c0 1 -- 10.20.193.92:0/3143394191 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94e8009590 con 0x7f94f811b510 2026-02-13T04:05:38.620 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.617+0000 7f94f7fff6c0 1 --2- 10.20.193.92:0/3143394191 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f94f811b510 0x7f94f8131020 secure :-1 s=READY pgs=135 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94ec006ea0 tx=0x7f94ec00cca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:05:38.620 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.617+0000 7f94f4ff96c0 1 -- 10.20.193.92:0/3143394191 <== mon.2 v2:10.20.193.99:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f94ec003a30 con 0x7f94f811b510 2026-02-13T04:05:38.620 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.617+0000 7f94f4ff96c0 1 -- 10.20.193.92:0/3143394191 <== mon.2 v2:10.20.193.99:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f94ec005560 con 0x7f94f811b510 2026-02-13T04:05:38.620 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.617+0000 7f94fe1306c0 1 -- 10.20.193.92:0/3143394191 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94f8131c80 con 0x7f94f811b510 2026-02-13T04:05:38.620 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.617+0000 7f94f4ff96c0 1 -- 10.20.193.92:0/3143394191 <== mon.2 v2:10.20.193.99:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f94ec0082a0 con 0x7f94f811b510 2026-02-13T04:05:38.620 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.617+0000 7f94fe1306c0 1 -- 10.20.193.92:0/3143394191 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94f8172360 con 0x7f94f811b510 2026-02-13T04:05:38.621 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.618+0000 7f94fe1306c0 1 -- 10.20.193.92:0/3143394191 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94f805b000 con 0x7f94f811b510 2026-02-13T04:05:38.623 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.620+0000 7f94f4ff96c0 1 -- 10.20.193.92:0/3143394191 <== mon.2 v2:10.20.193.99:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f94ec00d4d0 con 0x7f94f811b510 2026-02-13T04:05:38.624 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.622+0000 7f94f4ff96c0 1 --2- 10.20.193.92:0/3143394191 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f94cc0b5650 0x7f94cc0d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:38.624 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.622+0000 7f94f4ff96c0 1 -- 10.20.193.92:0/3143394191 <== mon.2 v2:10.20.193.99:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f94ec0e4c20 con 0x7f94f811b510 2026-02-13T04:05:38.624 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.622+0000 7f94f77fe6c0 1 --2- 10.20.193.92:0/3143394191 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f94cc0b5650 0x7f94cc0d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:38.625 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.622+0000 7f94f4ff96c0 1 -- 10.20.193.92:0/3143394191 <== mon.2 v2:10.20.193.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f94ec11d680 con 0x7f94f811b510 2026-02-13T04:05:38.625 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.623+0000 7f94f77fe6c0 1 --2- 10.20.193.92:0/3143394191 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f94cc0b5650 0x7f94cc0d5b00 secure :-1 s=READY pgs=260 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94e4004750 tx=0x7f94e4009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:05:38.749 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.747+0000 7f94fe1306c0 1 -- 10.20.193.92:0/3143394191 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f94f8114ee0 con 0x7f94f811b510 2026-02-13T04:05:38.750 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.747+0000 7f94f4ff96c0 1 -- 10.20.193.92:0/3143394191 <== mon.2 v2:10.20.193.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f94ec0a75c0 con 0x7f94f811b510 2026-02-13T04:05:38.750 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:05:38.750 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:05:38.751 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.749+0000 7f94fe1306c0 1 -- 10.20.193.92:0/3143394191 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f94cc0b5650 msgr2=0x7f94cc0d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:38.751 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.749+0000 7f94fe1306c0 1 --2- 10.20.193.92:0/3143394191 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f94cc0b5650 0x7f94cc0d5b00 secure :-1 s=READY pgs=260 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94e4004750 tx=0x7f94e4009260 comp rx=0 tx=0).stop 2026-02-13T04:05:38.751 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.749+0000 7f94fe1306c0 1 -- 10.20.193.92:0/3143394191 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f94f811b510 msgr2=0x7f94f8131020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:38.751 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.749+0000 7f94fe1306c0 1 --2- 10.20.193.92:0/3143394191 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f94f811b510 0x7f94f8131020 secure :-1 s=READY pgs=135 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94ec006ea0 tx=0x7f94ec00cca0 comp rx=0 tx=0).stop 2026-02-13T04:05:38.751 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.749+0000 7f94fe1306c0 1 -- 10.20.193.92:0/3143394191 shutdown_connections 2026-02-13T04:05:38.751 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.749+0000 7f94fe1306c0 1 --2- 10.20.193.92:0/3143394191 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f94cc0b5650 0x7f94cc0d5b00 unknown :-1 s=CLOSED pgs=260 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:38.751 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.749+0000 7f94fe1306c0 1 --2- 10.20.193.92:0/3143394191 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f94f811b510 0x7f94f8131020 unknown :-1 s=CLOSED pgs=135 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:38.751 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.749+0000 7f94fe1306c0 1 --2- 10.20.193.92:0/3143394191 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f94f81149c0 0x7f94f812bc60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:38.751 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.749+0000 7f94fe1306c0 1 --2- 10.20.193.92:0/3143394191 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f94f8113dc0 0x7f94f812b720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:38.751 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.749+0000 7f94fe1306c0 1 -- 10.20.193.92:0/3143394191 >> 10.20.193.92:0/3143394191 conn(0x7f94f8058a50 msgr2=0x7f94f811a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:05:38.751 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.749+0000 7f94fe1306c0 1 -- 10.20.193.92:0/3143394191 shutdown_connections 2026-02-13T04:05:38.751 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:38.749+0000 7f94fe1306c0 1 -- 10.20.193.92:0/3143394191 wait complete. 2026-02-13T04:05:38.812 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:38 trial092 ceph-mon[23047]: pgmap v329: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 10 op/s 2026-02-13T04:05:38.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:38 trial158 ceph-mon[27763]: pgmap v329: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 10 op/s 2026-02-13T04:05:38.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:38 trial099 ceph-mon[27808]: pgmap v329: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.7 KiB/s rd, 10 op/s 2026-02-13T04:05:39.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:39 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/3143394191' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:39.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:39 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/3143394191' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:39.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:39 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/3143394191' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:40.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:40 trial158 ceph-mon[27763]: pgmap v330: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:05:40.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:40 trial099 ceph-mon[27808]: pgmap v330: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:05:40.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:40 trial092 ceph-mon[23047]: pgmap v330: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:05:41.890 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:05:42.076 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:05:42.265 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.262+0000 7f8edb90b6c0 1 -- 10.20.193.92:0/3125517262 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8ed411b510 msgr2=0x7f8ed411b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:42.265 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.262+0000 7f8edb90b6c0 1 --2- 10.20.193.92:0/3125517262 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8ed411b510 0x7f8ed411b8e0 secure :-1 s=READY pgs=340 gs=1 cs=0 l=1 c_cookie=12937864687993327867 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ec4009970 tx=0x7f8ec402ed10 comp rx=0 tx=0).stop 2026-02-13T04:05:42.265 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.262+0000 7f8edb90b6c0 1 -- 10.20.193.92:0/3125517262 shutdown_connections 2026-02-13T04:05:42.265 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.262+0000 7f8edb90b6c0 1 --2- 10.20.193.92:0/3125517262 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8ed41149c0 0x7f8ed4114ee0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:42.265 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.262+0000 7f8edb90b6c0 1 --2- 10.20.193.92:0/3125517262 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f8ed4113dc0 0x7f8ed4114210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:42.265 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.262+0000 7f8edb90b6c0 1 --2- 10.20.193.92:0/3125517262 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8ed411b510 0x7f8ed411b8e0 unknown :-1 s=CLOSED pgs=340 gs=1 cs=0 l=1 c_cookie=12937864687993327867 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:42.266 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.262+0000 7f8edb90b6c0 1 -- 10.20.193.92:0/3125517262 >> 10.20.193.92:0/3125517262 conn(0x7f8ed4058a50 msgr2=0x7f8ed4058e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:05:42.266 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.262+0000 7f8edb90b6c0 1 -- 10.20.193.92:0/3125517262 shutdown_connections 2026-02-13T04:05:42.266 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.262+0000 7f8edb90b6c0 1 -- 10.20.193.92:0/3125517262 wait complete. 2026-02-13T04:05:42.267 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.263+0000 7f8edb90b6c0 1 Processor -- start 2026-02-13T04:05:42.268 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.263+0000 7f8edb90b6c0 1 -- start start 2026-02-13T04:05:42.268 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.263+0000 7f8edb90b6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8ed4113dc0 0x7f8ed412b5c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:42.268 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.263+0000 7f8edb90b6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8ed41149c0 0x7f8ed412bb00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:42.268 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.263+0000 7f8edb90b6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f8ed411b510 0x7f8ed4130ec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:42.268 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.263+0000 7f8edb90b6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed4131510 con 0x7f8ed41149c0 2026-02-13T04:05:42.268 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.263+0000 7f8edb90b6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed4131680 con 0x7f8ed4113dc0 2026-02-13T04:05:42.268 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.263+0000 7f8edb90b6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f8ed4131840 con 0x7f8ed411b510 2026-02-13T04:05:42.268 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.263+0000 7f8ed8e7b6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8ed41149c0 0x7f8ed412bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:42.268 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.263+0000 7f8ed967c6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8ed4113dc0 0x7f8ed412b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:42.268 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.263+0000 7f8ed967c6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8ed4113dc0 0x7f8ed412b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:37032/0 (socket says 10.20.193.92:37032) 2026-02-13T04:05:42.268 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.263+0000 7f8ed967c6c0 1 -- 10.20.193.92:0/1053149238 learned_addr learned my addr 10.20.193.92:0/1053149238 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:05:42.269 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.263+0000 7f8ed8e7b6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8ed41149c0 0x7f8ed412bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:53838/0 (socket says 10.20.193.92:53838) 2026-02-13T04:05:42.269 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.263+0000 7f8ed9e7d6c0 1 --2- 10.20.193.92:0/1053149238 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f8ed411b510 0x7f8ed4130ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:42.269 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.264+0000 7f8ed967c6c0 1 -- 10.20.193.92:0/1053149238 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f8ed411b510 msgr2=0x7f8ed4130ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:42.269 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.264+0000 7f8ed967c6c0 1 --2- 10.20.193.92:0/1053149238 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f8ed411b510 0x7f8ed4130ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:42.269 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.264+0000 7f8ed967c6c0 1 -- 10.20.193.92:0/1053149238 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8ed41149c0 msgr2=0x7f8ed412bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:42.269 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.264+0000 7f8ed967c6c0 1 --2- 10.20.193.92:0/1053149238 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8ed41149c0 0x7f8ed412bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:42.269 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.264+0000 7f8ed967c6c0 1 -- 10.20.193.92:0/1053149238 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ec4009590 con 0x7f8ed4113dc0 2026-02-13T04:05:42.269 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.264+0000 7f8ed9e7d6c0 1 --2- 10.20.193.92:0/1053149238 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f8ed411b510 0x7f8ed4130ec0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T04:05:42.269 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.264+0000 7f8ed967c6c0 1 --2- 10.20.193.92:0/1053149238 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8ed4113dc0 0x7f8ed412b5c0 secure :-1 s=READY pgs=136 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ec402f220 tx=0x7f8ec402f820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:05:42.269 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.264+0000 7f8ec27fc6c0 1 -- 10.20.193.92:0/1053149238 <== mon.2 v2:10.20.193.99:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8ec4002ae0 con 0x7f8ed4113dc0 2026-02-13T04:05:42.269 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.264+0000 7f8edb90b6c0 1 -- 10.20.193.92:0/1053149238 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ed4131ac0 con 0x7f8ed4113dc0 2026-02-13T04:05:42.270 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.264+0000 7f8edb90b6c0 1 -- 10.20.193.92:0/1053149238 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ed4172200 con 0x7f8ed4113dc0 2026-02-13T04:05:42.270 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.264+0000 7f8ec27fc6c0 1 -- 10.20.193.92:0/1053149238 <== mon.2 v2:10.20.193.99:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f8ec402fe20 con 0x7f8ed4113dc0 2026-02-13T04:05:42.270 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.264+0000 7f8ec27fc6c0 1 -- 10.20.193.92:0/1053149238 <== mon.2 v2:10.20.193.99:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f8ec40312b0 con 0x7f8ed4113dc0 2026-02-13T04:05:42.270 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.265+0000 7f8edb90b6c0 1 -- 10.20.193.92:0/1053149238 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ed405b000 con 0x7f8ed4113dc0 2026-02-13T04:05:42.270 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.267+0000 7f8ec27fc6c0 1 -- 10.20.193.92:0/1053149238 <== mon.2 v2:10.20.193.99:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f8ec4002c40 con 0x7f8ed4113dc0 2026-02-13T04:05:42.271 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.268+0000 7f8ec27fc6c0 1 --2- 10.20.193.92:0/1053149238 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f8eb00b56d0 0x7f8eb00d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:42.271 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.268+0000 7f8ec27fc6c0 1 -- 10.20.193.92:0/1053149238 <== mon.2 v2:10.20.193.99:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f8ec4107c70 con 0x7f8ed4113dc0 2026-02-13T04:05:42.271 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.268+0000 7f8ec27fc6c0 1 -- 10.20.193.92:0/1053149238 <== mon.2 v2:10.20.193.99:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f8ec41080f0 con 0x7f8ed4113dc0 2026-02-13T04:05:42.271 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.268+0000 7f8ed8e7b6c0 1 --2- 10.20.193.92:0/1053149238 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f8eb00b56d0 0x7f8eb00d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:42.272 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.269+0000 7f8ed8e7b6c0 1 --2- 10.20.193.92:0/1053149238 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f8eb00b56d0 0x7f8eb00d5b80 secure :-1 s=READY pgs=261 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ed4131f50 tx=0x7f8ec8009390 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:05:42.395 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.392+0000 7f8edb90b6c0 1 -- 10.20.193.92:0/1053149238 --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8ed4114ee0 con 0x7f8ed4113dc0 2026-02-13T04:05:42.395 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.393+0000 7f8ec27fc6c0 1 -- 10.20.193.92:0/1053149238 <== mon.2 v2:10.20.193.99:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f8ec40ca610 con 0x7f8ed4113dc0 2026-02-13T04:05:42.395 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:05:42.395 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:05:42.396 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.394+0000 7f8edb90b6c0 1 -- 10.20.193.92:0/1053149238 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f8eb00b56d0 msgr2=0x7f8eb00d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:42.396 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.394+0000 7f8edb90b6c0 1 --2- 10.20.193.92:0/1053149238 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f8eb00b56d0 0x7f8eb00d5b80 secure :-1 s=READY pgs=261 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ed4131f50 tx=0x7f8ec8009390 comp rx=0 tx=0).stop 2026-02-13T04:05:42.396 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.394+0000 7f8edb90b6c0 1 -- 10.20.193.92:0/1053149238 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8ed4113dc0 msgr2=0x7f8ed412b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:42.396 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.394+0000 7f8edb90b6c0 1 --2- 10.20.193.92:0/1053149238 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8ed4113dc0 0x7f8ed412b5c0 secure :-1 s=READY pgs=136 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ec402f220 tx=0x7f8ec402f820 comp rx=0 tx=0).stop 2026-02-13T04:05:42.396 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.394+0000 7f8edb90b6c0 1 -- 10.20.193.92:0/1053149238 shutdown_connections 2026-02-13T04:05:42.396 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.394+0000 7f8edb90b6c0 1 --2- 10.20.193.92:0/1053149238 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f8ed411b510 0x7f8ed4130ec0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:42.396 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.394+0000 7f8edb90b6c0 1 --2- 10.20.193.92:0/1053149238 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f8ed41149c0 0x7f8ed412bb00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:42.396 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.394+0000 7f8edb90b6c0 1 --2- 10.20.193.92:0/1053149238 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f8eb00b56d0 0x7f8eb00d5b80 unknown :-1 s=CLOSED pgs=261 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:42.396 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.394+0000 7f8edb90b6c0 1 --2- 10.20.193.92:0/1053149238 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f8ed4113dc0 0x7f8ed412b5c0 unknown :-1 s=CLOSED pgs=136 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:42.396 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.394+0000 7f8edb90b6c0 1 -- 10.20.193.92:0/1053149238 >> 10.20.193.92:0/1053149238 conn(0x7f8ed4058a50 msgr2=0x7f8ed4118170 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:05:42.396 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.394+0000 7f8edb90b6c0 1 -- 10.20.193.92:0/1053149238 shutdown_connections 2026-02-13T04:05:42.397 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:42.394+0000 7f8edb90b6c0 1 -- 10.20.193.92:0/1053149238 wait complete. 2026-02-13T04:05:42.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:42 trial158 ceph-mon[27763]: pgmap v331: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:05:42.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:42 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/1053149238' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:42.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:42 trial099 ceph-mon[27808]: pgmap v331: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:05:42.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:42 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/1053149238' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:42.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:42 trial092 ceph-mon[23047]: pgmap v331: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:05:42.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:42 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1053149238' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:44.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:44 trial158 ceph-mon[27763]: pgmap v332: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:05:44.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:44 trial099 ceph-mon[27808]: pgmap v332: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:05:44.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:44 trial092 ceph-mon[23047]: pgmap v332: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:05:45.504 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:05:45.689 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:05:45.881 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:45.877+0000 7f516e3626c0 1 -- 10.20.193.92:0/1584553101 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5168116520 msgr2=0x7f516817a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:45.881 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:45.877+0000 7f516e3626c0 1 --2- 10.20.193.92:0/1584553101 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5168116520 0x7f516817a100 secure :-1 s=READY pgs=137 gs=2 cs=0 l=1 c_cookie=2275233258241185274 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5164006fd0 tx=0x7f516402fd20 comp rx=0 tx=0).stop 2026-02-13T04:05:45.881 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:45.877+0000 7f516e3626c0 1 -- 10.20.193.92:0/1584553101 shutdown_connections 2026-02-13T04:05:45.881 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:45.877+0000 7f516e3626c0 1 --2- 10.20.193.92:0/1584553101 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5168116520 0x7f516817a100 unknown :-1 s=CLOSED pgs=137 gs=2 cs=0 l=1 c_cookie=2275233258241185274 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:45.881 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:45.877+0000 7f516e3626c0 1 --2- 10.20.193.92:0/1584553101 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f5168114190 0x7f5168115d40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:45.881 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:45.877+0000 7f516e3626c0 1 --2- 10.20.193.92:0/1584553101 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f51681137a0 0x7f5168113b70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:45.881 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:45.877+0000 7f516e3626c0 1 -- 10.20.193.92:0/1584553101 >> 10.20.193.92:0/1584553101 conn(0x7f5168061510 msgr2=0x7f5168061910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:05:45.881 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:45.877+0000 7f516e3626c0 1 -- 10.20.193.92:0/1584553101 shutdown_connections 2026-02-13T04:05:45.881 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:45.877+0000 7f516e3626c0 1 -- 10.20.193.92:0/1584553101 wait complete. 2026-02-13T04:05:45.881 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:45.878+0000 7f516e3626c0 1 Processor -- start 2026-02-13T04:05:45.881 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:45.878+0000 7f516e3626c0 1 -- start start 2026-02-13T04:05:45.882 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:45.878+0000 7f516e3626c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f51681137a0 0x7f5168121270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:45.882 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:45.878+0000 7f516e3626c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5168116520 0x7f51681217b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:45.882 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:45.878+0000 7f516e3626c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5168126b20 0x7f5168126fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:45.882 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:45.878+0000 7f516e3626c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5168127530 con 0x7f5168126b20 2026-02-13T04:05:45.882 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:45.878+0000 7f516e3626c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f51681276a0 con 0x7f5168116520 2026-02-13T04:05:45.882 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:45.878+0000 7f516e3626c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f5168127860 con 0x7f51681137a0 2026-02-13T04:05:45.882 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:45.879+0000 7f516cb5f6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5168116520 0x7f51681217b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:45.882 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:45.879+0000 7f516d3606c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f51681137a0 0x7f5168121270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:45.882 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:45.879+0000 7f516d3606c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f51681137a0 0x7f5168121270 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:51180/0 (socket says 10.20.193.92:51180) 2026-02-13T04:05:45.882 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:45.879+0000 7f516d3606c0 1 -- 10.20.193.92:0/1895395053 learned_addr learned my addr 10.20.193.92:0/1895395053 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:05:45.882 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:45.879+0000 7f516db616c0 1 --2- 10.20.193.92:0/1895395053 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5168126b20 0x7f5168126fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:45.882 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:45.879+0000 7f516db616c0 1 -- 10.20.193.92:0/1895395053 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f51681137a0 msgr2=0x7f5168121270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:45.882 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:45.879+0000 7f516db616c0 1 --2- 10.20.193.92:0/1895395053 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f51681137a0 0x7f5168121270 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:45.882 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:45.879+0000 7f516db616c0 1 -- 10.20.193.92:0/1895395053 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5168116520 msgr2=0x7f51681217b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:45.882 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:45.879+0000 7f516db616c0 1 --2- 10.20.193.92:0/1895395053 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5168116520 0x7f51681217b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:45.882 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:45.879+0000 7f516db616c0 1 -- 10.20.193.92:0/1895395053 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51580094c0 con 0x7f5168126b20 2026-02-13T04:05:45.882 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:45.879+0000 7f516d3606c0 1 --2- 10.20.193.92:0/1895395053 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f51681137a0 0x7f5168121270 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T04:05:45.882 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:45.879+0000 7f516cb5f6c0 1 --2- 10.20.193.92:0/1895395053 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5168116520 0x7f51681217b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-13T04:05:45.883 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:45.879+0000 7f516db616c0 1 --2- 10.20.193.92:0/1895395053 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5168126b20 0x7f5168126fc0 secure :-1 s=READY pgs=341 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5164031e90 tx=0x7f5164031ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:05:45.883 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:45.879+0000 7f51567fc6c0 1 -- 10.20.193.92:0/1895395053 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f51640081c0 con 0x7f5168126b20 2026-02-13T04:05:45.883 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:45.879+0000 7f516e3626c0 1 -- 10.20.193.92:0/1895395053 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f516400a5b0 con 0x7f5168126b20 2026-02-13T04:05:45.883 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:45.879+0000 7f51567fc6c0 1 -- 10.20.193.92:0/1895395053 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f516400a050 con 0x7f5168126b20 2026-02-13T04:05:45.883 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:45.879+0000 7f51567fc6c0 1 -- 10.20.193.92:0/1895395053 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5164036380 con 0x7f5168126b20 2026-02-13T04:05:45.883 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:45.879+0000 7f516e3626c0 1 -- 10.20.193.92:0/1895395053 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5168167f70 con 0x7f5168126b20 2026-02-13T04:05:45.883 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:45.880+0000 7f5137fff6c0 1 -- 10.20.193.92:0/1895395053 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5168114840 con 0x7f5168126b20 2026-02-13T04:05:45.885 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:45.882+0000 7f51567fc6c0 1 -- 10.20.193.92:0/1895395053 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f5164003c40 con 0x7f5168126b20 2026-02-13T04:05:45.887 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:45.884+0000 7f51567fc6c0 1 --2- 10.20.193.92:0/1895395053 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f51440b56d0 0x7f51440d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:45.887 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:45.884+0000 7f51567fc6c0 1 -- 10.20.193.92:0/1895395053 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f5164108bf0 con 0x7f5168126b20 2026-02-13T04:05:45.887 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:45.884+0000 7f516d3606c0 1 --2- 10.20.193.92:0/1895395053 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f51440b56d0 0x7f51440d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:45.887 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:45.884+0000 7f51567fc6c0 1 -- 10.20.193.92:0/1895395053 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f5164141660 con 0x7f5168126b20 2026-02-13T04:05:45.888 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:45.884+0000 7f516d3606c0 1 --2- 10.20.193.92:0/1895395053 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f51440b56d0 0x7f51440d5b80 secure :-1 s=READY pgs=262 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5158005c80 tx=0x7f5158009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:05:46.018 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:46.015+0000 7f5137fff6c0 1 -- 10.20.193.92:0/1895395053 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5168113b70 con 0x7f5168126b20 2026-02-13T04:05:46.018 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:46.015+0000 7f51567fc6c0 1 -- 10.20.193.92:0/1895395053 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f51640cb590 con 0x7f5168126b20 2026-02-13T04:05:46.018 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:05:46.018 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:05:46.019 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:46.015+0000 7f5137fff6c0 1 -- 10.20.193.92:0/1895395053 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f51440b56d0 msgr2=0x7f51440d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:46.019 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:46.015+0000 7f5137fff6c0 1 --2- 10.20.193.92:0/1895395053 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f51440b56d0 0x7f51440d5b80 secure :-1 s=READY pgs=262 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5158005c80 tx=0x7f5158009260 comp rx=0 tx=0).stop 2026-02-13T04:05:46.019 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:46.015+0000 7f5137fff6c0 1 -- 10.20.193.92:0/1895395053 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5168126b20 msgr2=0x7f5168126fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:46.019 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:46.015+0000 7f5137fff6c0 1 --2- 10.20.193.92:0/1895395053 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5168126b20 0x7f5168126fc0 secure :-1 s=READY pgs=341 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5164031e90 tx=0x7f5164031ec0 comp rx=0 tx=0).stop 2026-02-13T04:05:46.019 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:46.016+0000 7f5137fff6c0 1 -- 10.20.193.92:0/1895395053 shutdown_connections 2026-02-13T04:05:46.019 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:46.016+0000 7f5137fff6c0 1 --2- 10.20.193.92:0/1895395053 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f51440b56d0 0x7f51440d5b80 unknown :-1 s=CLOSED pgs=262 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:46.019 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:46.016+0000 7f5137fff6c0 1 --2- 10.20.193.92:0/1895395053 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5168116520 0x7f51681217b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:46.019 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:46.016+0000 7f5137fff6c0 1 --2- 10.20.193.92:0/1895395053 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5168126b20 0x7f5168126fc0 unknown :-1 s=CLOSED pgs=341 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:46.019 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:46.016+0000 7f5137fff6c0 1 --2- 10.20.193.92:0/1895395053 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f51681137a0 0x7f5168121270 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:46.019 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:46.016+0000 7f5137fff6c0 1 -- 10.20.193.92:0/1895395053 >> 10.20.193.92:0/1895395053 conn(0x7f5168061510 msgr2=0x7f5168115520 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:05:46.019 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:46.016+0000 7f5137fff6c0 1 -- 10.20.193.92:0/1895395053 shutdown_connections 2026-02-13T04:05:46.019 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:46.016+0000 7f5137fff6c0 1 -- 10.20.193.92:0/1895395053 wait complete. 2026-02-13T04:05:46.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:46 trial158 ceph-mon[27763]: pgmap v333: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T04:05:46.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:46 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/1895395053' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:46.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:46 trial099 ceph-mon[27808]: pgmap v333: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T04:05:46.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:46 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/1895395053' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:46.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:46 trial092 ceph-mon[23047]: pgmap v333: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T04:05:46.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:46 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1895395053' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:48.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:48 trial158 ceph-mon[27763]: pgmap v334: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:05:48.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:48 trial099 ceph-mon[27808]: pgmap v334: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:05:48.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:48 trial092 ceph-mon[23047]: pgmap v334: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:05:49.124 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:05:49.312 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:05:49.507 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.504+0000 7f5a1c82f6c0 1 -- 10.20.193.92:0/2085747866 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5a1810f060 msgr2=0x7f5a1810f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:49.507 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.504+0000 7f5a1c82f6c0 1 --2- 10.20.193.92:0/2085747866 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5a1810f060 0x7f5a1810f430 secure :-1 s=READY pgs=342 gs=1 cs=0 l=1 c_cookie=17257823402137611020 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a040099a0 tx=0x7f5a0402ed20 comp rx=0 tx=0).stop 2026-02-13T04:05:49.507 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.504+0000 7f5a1c82f6c0 1 -- 10.20.193.92:0/2085747866 shutdown_connections 2026-02-13T04:05:49.507 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.504+0000 7f5a1c82f6c0 1 --2- 10.20.193.92:0/2085747866 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5a18115270 0x7f5a18175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:49.507 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.504+0000 7f5a1c82f6c0 1 --2- 10.20.193.92:0/2085747866 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f5a1810fa50 0x7f5a18114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:49.507 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.504+0000 7f5a1c82f6c0 1 --2- 10.20.193.92:0/2085747866 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5a1810f060 0x7f5a1810f430 unknown :-1 s=CLOSED pgs=342 gs=1 cs=0 l=1 c_cookie=17257823402137611020 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:49.507 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.504+0000 7f5a1c82f6c0 1 -- 10.20.193.92:0/2085747866 >> 10.20.193.92:0/2085747866 conn(0x7f5a180ec980 msgr2=0x7f5a1810cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:05:49.507 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.504+0000 7f5a1c82f6c0 1 -- 10.20.193.92:0/2085747866 shutdown_connections 2026-02-13T04:05:49.507 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.504+0000 7f5a1c82f6c0 1 -- 10.20.193.92:0/2085747866 wait complete. 2026-02-13T04:05:49.507 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.505+0000 7f5a1c82f6c0 1 Processor -- start 2026-02-13T04:05:49.507 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.505+0000 7f5a1c82f6c0 1 -- start start 2026-02-13T04:05:49.508 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.505+0000 7f5a1c82f6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5a1810f060 0x7f5a1811cf30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:49.508 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.505+0000 7f5a1c82f6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f5a18115270 0x7f5a1811d470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:49.508 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.505+0000 7f5a1c82f6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5a18122830 0x7f5a18122cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:49.508 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.505+0000 7f5a1c82f6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5a18123240 con 0x7f5a1810f060 2026-02-13T04:05:49.508 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.505+0000 7f5a1c82f6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f5a181233b0 con 0x7f5a18122830 2026-02-13T04:05:49.508 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.505+0000 7f5a1c82f6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f5a18123570 con 0x7f5a18115270 2026-02-13T04:05:49.508 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.506+0000 7f5a16ffd6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f5a18115270 0x7f5a1811d470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:49.508 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.506+0000 7f5a177fe6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5a1810f060 0x7f5a1811cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:49.508 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.506+0000 7f5a177fe6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5a1810f060 0x7f5a1811cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:38340/0 (socket says 10.20.193.92:38340) 2026-02-13T04:05:49.508 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.506+0000 7f5a177fe6c0 1 -- 10.20.193.92:0/1679470094 learned_addr learned my addr 10.20.193.92:0/1679470094 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:05:49.508 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.506+0000 7f5a17fff6c0 1 --2- 10.20.193.92:0/1679470094 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5a18122830 0x7f5a18122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:49.508 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.506+0000 7f5a177fe6c0 1 -- 10.20.193.92:0/1679470094 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f5a18115270 msgr2=0x7f5a1811d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:49.508 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.506+0000 7f5a177fe6c0 1 --2- 10.20.193.92:0/1679470094 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f5a18115270 0x7f5a1811d470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:49.508 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.506+0000 7f5a177fe6c0 1 -- 10.20.193.92:0/1679470094 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5a18122830 msgr2=0x7f5a18122cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:49.508 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.506+0000 7f5a177fe6c0 1 --2- 10.20.193.92:0/1679470094 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5a18122830 0x7f5a18122cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:49.508 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.506+0000 7f5a177fe6c0 1 -- 10.20.193.92:0/1679470094 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a04009590 con 0x7f5a1810f060 2026-02-13T04:05:49.508 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.506+0000 7f5a177fe6c0 1 --2- 10.20.193.92:0/1679470094 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5a1810f060 0x7f5a1811cf30 secure :-1 s=READY pgs=343 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a040098c0 tx=0x7f5a0402f7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:05:49.509 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.506+0000 7f5a14ff96c0 1 -- 10.20.193.92:0/1679470094 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5a040046b0 con 0x7f5a1810f060 2026-02-13T04:05:49.509 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.506+0000 7f5a14ff96c0 1 -- 10.20.193.92:0/1679470094 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f5a04002be0 con 0x7f5a1810f060 2026-02-13T04:05:49.509 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.506+0000 7f5a14ff96c0 1 -- 10.20.193.92:0/1679470094 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f5a04007670 con 0x7f5a1810f060 2026-02-13T04:05:49.509 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.506+0000 7f5a1c82f6c0 1 -- 10.20.193.92:0/1679470094 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a181639c0 con 0x7f5a1810f060 2026-02-13T04:05:49.509 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.506+0000 7f5a1c82f6c0 1 -- 10.20.193.92:0/1679470094 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a18163e40 con 0x7f5a1810f060 2026-02-13T04:05:49.510 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.507+0000 7f5a1c82f6c0 1 -- 10.20.193.92:0/1679470094 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a18110330 con 0x7f5a1810f060 2026-02-13T04:05:49.511 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.509+0000 7f5a14ff96c0 1 -- 10.20.193.92:0/1679470094 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f5a040026b0 con 0x7f5a1810f060 2026-02-13T04:05:49.513 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.511+0000 7f5a14ff96c0 1 --2- 10.20.193.92:0/1679470094 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f59ec0b56d0 0x7f59ec0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:49.514 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.511+0000 7f5a14ff96c0 1 -- 10.20.193.92:0/1679470094 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f5a04107d40 con 0x7f5a1810f060 2026-02-13T04:05:49.514 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.511+0000 7f5a16ffd6c0 1 --2- 10.20.193.92:0/1679470094 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f59ec0b56d0 0x7f59ec0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:49.514 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.512+0000 7f5a16ffd6c0 1 --2- 10.20.193.92:0/1679470094 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f59ec0b56d0 0x7f59ec0d5b80 secure :-1 s=READY pgs=263 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a181238c0 tx=0x7f5a08009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:05:49.514 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.512+0000 7f5a14ff96c0 1 -- 10.20.193.92:0/1679470094 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f5a040ca6e0 con 0x7f5a1810f060 2026-02-13T04:05:49.643 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.641+0000 7f5a1c82f6c0 1 -- 10.20.193.92:0/1679470094 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f5a1810f430 con 0x7f5a1810f060 2026-02-13T04:05:49.644 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.641+0000 7f5a14ff96c0 1 -- 10.20.193.92:0/1679470094 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f5a04031270 con 0x7f5a1810f060 2026-02-13T04:05:49.644 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:05:49.644 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:05:49.645 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.643+0000 7f5a1c82f6c0 1 -- 10.20.193.92:0/1679470094 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f59ec0b56d0 msgr2=0x7f59ec0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:49.645 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.643+0000 7f5a1c82f6c0 1 --2- 10.20.193.92:0/1679470094 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f59ec0b56d0 0x7f59ec0d5b80 secure :-1 s=READY pgs=263 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a181238c0 tx=0x7f5a08009260 comp rx=0 tx=0).stop 2026-02-13T04:05:49.645 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.643+0000 7f5a1c82f6c0 1 -- 10.20.193.92:0/1679470094 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5a1810f060 msgr2=0x7f5a1811cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:49.645 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.643+0000 7f5a1c82f6c0 1 --2- 10.20.193.92:0/1679470094 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5a1810f060 0x7f5a1811cf30 secure :-1 s=READY pgs=343 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a040098c0 tx=0x7f5a0402f7b0 comp rx=0 tx=0).stop 2026-02-13T04:05:49.645 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.643+0000 7f5a1c82f6c0 1 -- 10.20.193.92:0/1679470094 shutdown_connections 2026-02-13T04:05:49.645 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.643+0000 7f5a1c82f6c0 1 --2- 10.20.193.92:0/1679470094 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f59ec0b56d0 0x7f59ec0d5b80 unknown :-1 s=CLOSED pgs=263 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:49.645 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.643+0000 7f5a1c82f6c0 1 --2- 10.20.193.92:0/1679470094 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f5a18122830 0x7f5a18122cd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:49.645 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.643+0000 7f5a1c82f6c0 1 --2- 10.20.193.92:0/1679470094 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f5a18115270 0x7f5a1811d470 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:49.645 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.643+0000 7f5a1c82f6c0 1 --2- 10.20.193.92:0/1679470094 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f5a1810f060 0x7f5a1811cf30 unknown :-1 s=CLOSED pgs=343 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:49.645 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.643+0000 7f5a1c82f6c0 1 -- 10.20.193.92:0/1679470094 >> 10.20.193.92:0/1679470094 conn(0x7f5a180ec980 msgr2=0x7f5a1810cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:05:49.645 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.643+0000 7f5a1c82f6c0 1 -- 10.20.193.92:0/1679470094 shutdown_connections 2026-02-13T04:05:49.645 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:49.643+0000 7f5a1c82f6c0 1 -- 10.20.193.92:0/1679470094 wait complete. 2026-02-13T04:05:50.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:50 trial158 ceph-mon[27763]: pgmap v335: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:05:50.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:50 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/1679470094' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:50.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:50 trial099 ceph-mon[27808]: pgmap v335: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:05:50.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:50 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/1679470094' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:50.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:50 trial092 ceph-mon[23047]: pgmap v335: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.6 KiB/s rd, 9 op/s 2026-02-13T04:05:50.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:50 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1679470094' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:52.749 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:05:52.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:52 trial158 ceph-mon[27763]: pgmap v336: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:05:52.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:52 trial099 ceph-mon[27808]: pgmap v336: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:05:52.932 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:05:52.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:52 trial092 ceph-mon[23047]: pgmap v336: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.4 KiB/s rd, 10 op/s 2026-02-13T04:05:53.123 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.121+0000 7f6bb753b6c0 1 -- 10.20.193.92:0/216797891 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6bb010fbf0 msgr2=0x7f6bb0114c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:53.123 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.121+0000 7f6bb753b6c0 1 --2- 10.20.193.92:0/216797891 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6bb010fbf0 0x7f6bb0114c30 secure :-1 s=READY pgs=344 gs=1 cs=0 l=1 c_cookie=1435399475582774854 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ba40099a0 tx=0x7f6ba402ed00 comp rx=0 tx=0).stop 2026-02-13T04:05:53.123 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.121+0000 7f6bb753b6c0 1 -- 10.20.193.92:0/216797891 shutdown_connections 2026-02-13T04:05:53.123 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.121+0000 7f6bb753b6c0 1 --2- 10.20.193.92:0/216797891 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f6bb0115410 0x7f6bb0175db0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:53.123 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.121+0000 7f6bb753b6c0 1 --2- 10.20.193.92:0/216797891 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6bb010fbf0 0x7f6bb0114c30 unknown :-1 s=CLOSED pgs=344 gs=1 cs=0 l=1 c_cookie=1435399475582774854 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:53.123 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.121+0000 7f6bb753b6c0 1 --2- 10.20.193.92:0/216797891 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f6bb010f200 0x7f6bb010f5d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:53.123 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.121+0000 7f6bb753b6c0 1 -- 10.20.193.92:0/216797891 >> 10.20.193.92:0/216797891 conn(0x7f6bb00ecb00 msgr2=0x7f6bb010cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:05:53.123 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.121+0000 7f6bb753b6c0 1 -- 10.20.193.92:0/216797891 shutdown_connections 2026-02-13T04:05:53.123 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.121+0000 7f6bb753b6c0 1 -- 10.20.193.92:0/216797891 wait complete. 2026-02-13T04:05:53.124 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.121+0000 7f6bb753b6c0 1 Processor -- start 2026-02-13T04:05:53.124 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.122+0000 7f6bb753b6c0 1 -- start start 2026-02-13T04:05:53.124 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.122+0000 7f6bb753b6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f6bb010f200 0x7f6bb011d130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:53.124 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.122+0000 7f6bb753b6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f6bb0115410 0x7f6bb011d670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:53.124 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.122+0000 7f6bb753b6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6bb0122a30 0x7f6bb0122ed0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:53.124 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.122+0000 7f6bb753b6c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb0123440 con 0x7f6bb0122a30 2026-02-13T04:05:53.124 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.122+0000 7f6bb753b6c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb01235b0 con 0x7f6bb010f200 2026-02-13T04:05:53.124 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.122+0000 7f6bb753b6c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb0123770 con 0x7f6bb0115410 2026-02-13T04:05:53.124 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.122+0000 7f6bb4aab6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f6bb0115410 0x7f6bb011d670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:53.124 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.122+0000 7f6bb5aad6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6bb0122a30 0x7f6bb0122ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:53.124 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.122+0000 7f6bb4aab6c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f6bb0115410 0x7f6bb011d670 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:51210/0 (socket says 10.20.193.92:51210) 2026-02-13T04:05:53.124 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.122+0000 7f6bb4aab6c0 1 -- 10.20.193.92:0/576064982 learned_addr learned my addr 10.20.193.92:0/576064982 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:05:53.124 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.122+0000 7f6bb52ac6c0 1 --2- 10.20.193.92:0/576064982 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f6bb010f200 0x7f6bb011d130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:53.125 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.122+0000 7f6bb5aad6c0 1 -- 10.20.193.92:0/576064982 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f6bb0115410 msgr2=0x7f6bb011d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:53.125 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.122+0000 7f6bb5aad6c0 1 --2- 10.20.193.92:0/576064982 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f6bb0115410 0x7f6bb011d670 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:53.125 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.122+0000 7f6bb5aad6c0 1 -- 10.20.193.92:0/576064982 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f6bb010f200 msgr2=0x7f6bb011d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:53.125 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.122+0000 7f6bb5aad6c0 1 --2- 10.20.193.92:0/576064982 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f6bb010f200 0x7f6bb011d130 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:53.125 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.122+0000 7f6bb5aad6c0 1 -- 10.20.193.92:0/576064982 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ba4009590 con 0x7f6bb0122a30 2026-02-13T04:05:53.125 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.122+0000 7f6bb5aad6c0 1 --2- 10.20.193.92:0/576064982 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6bb0122a30 0x7f6bb0122ed0 secure :-1 s=READY pgs=345 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6bac00c6c0 tx=0x7f6bac00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:05:53.125 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.122+0000 7f6b9e7fc6c0 1 -- 10.20.193.92:0/576064982 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6bac005340 con 0x7f6bb0122a30 2026-02-13T04:05:53.125 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.122+0000 7f6b9e7fc6c0 1 -- 10.20.193.92:0/576064982 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f6bac003d40 con 0x7f6bb0122a30 2026-02-13T04:05:53.125 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.122+0000 7f6b9e7fc6c0 1 -- 10.20.193.92:0/576064982 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f6bac00de30 con 0x7f6bb0122a30 2026-02-13T04:05:53.125 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.123+0000 7f6bb753b6c0 1 -- 10.20.193.92:0/576064982 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bb0163c20 con 0x7f6bb0122a30 2026-02-13T04:05:53.125 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.123+0000 7f6bb753b6c0 1 -- 10.20.193.92:0/576064982 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bb01640b0 con 0x7f6bb0122a30 2026-02-13T04:05:53.125 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.123+0000 7f6bb753b6c0 1 -- 10.20.193.92:0/576064982 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bb01104d0 con 0x7f6bb0122a30 2026-02-13T04:05:53.128 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.126+0000 7f6b9e7fc6c0 1 -- 10.20.193.92:0/576064982 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f6bac00d410 con 0x7f6bb0122a30 2026-02-13T04:05:53.129 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.127+0000 7f6b9e7fc6c0 1 --2- 10.20.193.92:0/576064982 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f6b8c0b56d0 0x7f6b8c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:53.129 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.127+0000 7f6b9e7fc6c0 1 -- 10.20.193.92:0/576064982 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f6bac0e4a70 con 0x7f6bb0122a30 2026-02-13T04:05:53.130 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.127+0000 7f6bb52ac6c0 1 --2- 10.20.193.92:0/576064982 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f6b8c0b56d0 0x7f6b8c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:53.130 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.127+0000 7f6b9e7fc6c0 1 -- 10.20.193.92:0/576064982 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6bac11d5e0 con 0x7f6bb0122a30 2026-02-13T04:05:53.130 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.128+0000 7f6bb52ac6c0 1 --2- 10.20.193.92:0/576064982 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f6b8c0b56d0 0x7f6b8c0d5b80 secure :-1 s=READY pgs=264 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ba0005980 tx=0x7f6ba0005910 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:05:53.253 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.250+0000 7f6bb753b6c0 1 -- 10.20.193.92:0/576064982 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6bb010f5d0 con 0x7f6bb0122a30 2026-02-13T04:05:53.253 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.250+0000 7f6b9e7fc6c0 1 -- 10.20.193.92:0/576064982 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f6bac0a7410 con 0x7f6bb0122a30 2026-02-13T04:05:53.254 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:05:53.254 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:05:53.254 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.252+0000 7f6bb753b6c0 1 -- 10.20.193.92:0/576064982 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f6b8c0b56d0 msgr2=0x7f6b8c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:53.254 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.252+0000 7f6bb753b6c0 1 --2- 10.20.193.92:0/576064982 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f6b8c0b56d0 0x7f6b8c0d5b80 secure :-1 s=READY pgs=264 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ba0005980 tx=0x7f6ba0005910 comp rx=0 tx=0).stop 2026-02-13T04:05:53.255 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.252+0000 7f6bb753b6c0 1 -- 10.20.193.92:0/576064982 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6bb0122a30 msgr2=0x7f6bb0122ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:53.255 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.252+0000 7f6bb753b6c0 1 --2- 10.20.193.92:0/576064982 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6bb0122a30 0x7f6bb0122ed0 secure :-1 s=READY pgs=345 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6bac00c6c0 tx=0x7f6bac00cb90 comp rx=0 tx=0).stop 2026-02-13T04:05:53.255 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.252+0000 7f6bb753b6c0 1 -- 10.20.193.92:0/576064982 shutdown_connections 2026-02-13T04:05:53.255 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.252+0000 7f6bb753b6c0 1 --2- 10.20.193.92:0/576064982 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f6bb0122a30 0x7f6bb0122ed0 unknown :-1 s=CLOSED pgs=345 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:53.255 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.252+0000 7f6bb753b6c0 1 --2- 10.20.193.92:0/576064982 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f6bb0115410 0x7f6bb011d670 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:53.255 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.252+0000 7f6bb753b6c0 1 --2- 10.20.193.92:0/576064982 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f6b8c0b56d0 0x7f6b8c0d5b80 unknown :-1 s=CLOSED pgs=264 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:53.255 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.252+0000 7f6bb753b6c0 1 --2- 10.20.193.92:0/576064982 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f6bb010f200 0x7f6bb011d130 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:53.256 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.252+0000 7f6bb753b6c0 1 -- 10.20.193.92:0/576064982 >> 10.20.193.92:0/576064982 conn(0x7f6bb00ecb00 msgr2=0x7f6bb010cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:05:53.256 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.252+0000 7f6bb753b6c0 1 -- 10.20.193.92:0/576064982 shutdown_connections 2026-02-13T04:05:53.256 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:53.252+0000 7f6bb753b6c0 1 -- 10.20.193.92:0/576064982 wait complete. 2026-02-13T04:05:53.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:53 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/576064982' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:53.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:53 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/576064982' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:53.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:53 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/576064982' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:54.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:54 trial158 ceph-mon[27763]: pgmap v337: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:05:54.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:54 trial099 ceph-mon[27808]: pgmap v337: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:05:54.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:54 trial092 ceph-mon[23047]: pgmap v337: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.0 KiB/s rd, 9 op/s 2026-02-13T04:05:56.357 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:05:56.542 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:05:56.672 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:56 trial092 ceph-mon[23047]: pgmap v338: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T04:05:56.729 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.726+0000 7f4e75be06c0 1 -- 10.20.193.92:0/1593945369 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4e7010f060 msgr2=0x7f4e7010f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:56.729 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.726+0000 7f4e75be06c0 1 --2- 10.20.193.92:0/1593945369 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4e7010f060 0x7f4e7010f430 secure :-1 s=READY pgs=346 gs=1 cs=0 l=1 c_cookie=17647559420883526408 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e600099a0 tx=0x7f4e6002ed00 comp rx=0 tx=0).stop 2026-02-13T04:05:56.729 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.726+0000 7f4e75be06c0 1 -- 10.20.193.92:0/1593945369 shutdown_connections 2026-02-13T04:05:56.729 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.726+0000 7f4e75be06c0 1 --2- 10.20.193.92:0/1593945369 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4e70115270 0x7f4e70175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:56.729 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.726+0000 7f4e75be06c0 1 --2- 10.20.193.92:0/1593945369 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4e7010fa50 0x7f4e70114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:56.729 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.726+0000 7f4e75be06c0 1 --2- 10.20.193.92:0/1593945369 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4e7010f060 0x7f4e7010f430 unknown :-1 s=CLOSED pgs=346 gs=1 cs=0 l=1 c_cookie=17647559420883526408 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:56.730 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.726+0000 7f4e75be06c0 1 -- 10.20.193.92:0/1593945369 >> 10.20.193.92:0/1593945369 conn(0x7f4e700ec980 msgr2=0x7f4e7010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:05:56.730 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.726+0000 7f4e75be06c0 1 -- 10.20.193.92:0/1593945369 shutdown_connections 2026-02-13T04:05:56.730 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.726+0000 7f4e75be06c0 1 -- 10.20.193.92:0/1593945369 wait complete. 2026-02-13T04:05:56.731 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.727+0000 7f4e75be06c0 1 Processor -- start 2026-02-13T04:05:56.732 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.727+0000 7f4e75be06c0 1 -- start start 2026-02-13T04:05:56.732 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.727+0000 7f4e75be06c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4e7010f060 0x7f4e700f8de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:56.732 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.727+0000 7f4e75be06c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4e70115270 0x7f4e70175b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:56.732 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.727+0000 7f4e75be06c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4e700f9410 0x7f4e700fe6e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:56.732 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.727+0000 7f4e75be06c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4e700f9b00 con 0x7f4e7010f060 2026-02-13T04:05:56.732 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.727+0000 7f4e75be06c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4e700fec20 con 0x7f4e70115270 2026-02-13T04:05:56.732 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.727+0000 7f4e75be06c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f4e700fede0 con 0x7f4e700f9410 2026-02-13T04:05:56.732 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.727+0000 7f4e74bde6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4e7010f060 0x7f4e700f8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:56.732 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.727+0000 7f4e74bde6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4e7010f060 0x7f4e700f8de0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:39666/0 (socket says 10.20.193.92:39666) 2026-02-13T04:05:56.732 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.727+0000 7f4e74bde6c0 1 -- 10.20.193.92:0/1177836597 learned_addr learned my addr 10.20.193.92:0/1177836597 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:05:56.732 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.727+0000 7f4e753df6c0 1 --2- 10.20.193.92:0/1177836597 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4e700f9410 0x7f4e700fe6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:56.733 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.727+0000 7f4e74bde6c0 1 -- 10.20.193.92:0/1177836597 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4e700f9410 msgr2=0x7f4e700fe6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:56.733 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.727+0000 7f4e74bde6c0 1 --2- 10.20.193.92:0/1177836597 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4e700f9410 0x7f4e700fe6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:56.733 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.727+0000 7f4e74bde6c0 1 -- 10.20.193.92:0/1177836597 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4e70115270 msgr2=0x7f4e70175b10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-13T04:05:56.733 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.727+0000 7f4e74bde6c0 1 --2- 10.20.193.92:0/1177836597 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4e70115270 0x7f4e70175b10 unknown :-1 s=START_CONNECT pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:56.733 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.727+0000 7f4e74bde6c0 1 -- 10.20.193.92:0/1177836597 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e60009590 con 0x7f4e7010f060 2026-02-13T04:05:56.733 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.728+0000 7f4e74bde6c0 1 --2- 10.20.193.92:0/1177836597 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4e7010f060 0x7f4e700f8de0 secure :-1 s=READY pgs=347 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e60031fd0 tx=0x7f4e6002f810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:05:56.733 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.728+0000 7f4e65ffb6c0 1 -- 10.20.193.92:0/1177836597 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4e600026b0 con 0x7f4e7010f060 2026-02-13T04:05:56.733 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.728+0000 7f4e65ffb6c0 1 -- 10.20.193.92:0/1177836597 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f4e60002d40 con 0x7f4e7010f060 2026-02-13T04:05:56.733 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.728+0000 7f4e65ffb6c0 1 -- 10.20.193.92:0/1177836597 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4e60007670 con 0x7f4e7010f060 2026-02-13T04:05:56.733 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.728+0000 7f4e75be06c0 1 -- 10.20.193.92:0/1177836597 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e700ff060 con 0x7f4e7010f060 2026-02-13T04:05:56.733 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.728+0000 7f4e75be06c0 1 -- 10.20.193.92:0/1177836597 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e700ff530 con 0x7f4e7010f060 2026-02-13T04:05:56.733 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.728+0000 7f4e3f7fe6c0 1 -- 10.20.193.92:0/1177836597 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e70110330 con 0x7f4e7010f060 2026-02-13T04:05:56.734 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.731+0000 7f4e65ffb6c0 1 -- 10.20.193.92:0/1177836597 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f4e60002810 con 0x7f4e7010f060 2026-02-13T04:05:56.735 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.733+0000 7f4e65ffb6c0 1 --2- 10.20.193.92:0/1177836597 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f4e4c0b56d0 0x7f4e4c0d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:05:56.736 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.733+0000 7f4e65ffb6c0 1 -- 10.20.193.92:0/1177836597 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f4e60107cd0 con 0x7f4e7010f060 2026-02-13T04:05:56.736 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.733+0000 7f4e67fff6c0 1 --2- 10.20.193.92:0/1177836597 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f4e4c0b56d0 0x7f4e4c0d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:05:56.736 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.733+0000 7f4e65ffb6c0 1 -- 10.20.193.92:0/1177836597 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4e60108150 con 0x7f4e7010f060 2026-02-13T04:05:56.736 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.733+0000 7f4e67fff6c0 1 --2- 10.20.193.92:0/1177836597 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f4e4c0b56d0 0x7f4e4c0d5b80 secure :-1 s=READY pgs=265 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e700ff770 tx=0x7f4e580093b0 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:05:56.861 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.858+0000 7f4e3f7fe6c0 1 -- 10.20.193.92:0/1177836597 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4e7010f430 con 0x7f4e7010f060 2026-02-13T04:05:56.861 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.859+0000 7f4e65ffb6c0 1 -- 10.20.193.92:0/1177836597 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f4e600ca670 con 0x7f4e7010f060 2026-02-13T04:05:56.861 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:05:56.862 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:05:56.863 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.860+0000 7f4e3f7fe6c0 1 -- 10.20.193.92:0/1177836597 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f4e4c0b56d0 msgr2=0x7f4e4c0d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:56.863 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.860+0000 7f4e3f7fe6c0 1 --2- 10.20.193.92:0/1177836597 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f4e4c0b56d0 0x7f4e4c0d5b80 secure :-1 s=READY pgs=265 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e700ff770 tx=0x7f4e580093b0 comp rx=0 tx=0).stop 2026-02-13T04:05:56.863 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.860+0000 7f4e3f7fe6c0 1 -- 10.20.193.92:0/1177836597 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4e7010f060 msgr2=0x7f4e700f8de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:05:56.863 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.860+0000 7f4e3f7fe6c0 1 --2- 10.20.193.92:0/1177836597 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4e7010f060 0x7f4e700f8de0 secure :-1 s=READY pgs=347 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4e60031fd0 tx=0x7f4e6002f810 comp rx=0 tx=0).stop 2026-02-13T04:05:56.863 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.860+0000 7f4e3f7fe6c0 1 -- 10.20.193.92:0/1177836597 shutdown_connections 2026-02-13T04:05:56.863 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.860+0000 7f4e3f7fe6c0 1 --2- 10.20.193.92:0/1177836597 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f4e4c0b56d0 0x7f4e4c0d5b80 unknown :-1 s=CLOSED pgs=265 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:56.863 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.860+0000 7f4e3f7fe6c0 1 --2- 10.20.193.92:0/1177836597 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4e70115270 0x7f4e70175b10 unknown :-1 s=CLOSED pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:56.863 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.860+0000 7f4e3f7fe6c0 1 --2- 10.20.193.92:0/1177836597 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4e700f9410 0x7f4e700fe6e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:56.864 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.860+0000 7f4e3f7fe6c0 1 --2- 10.20.193.92:0/1177836597 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4e7010f060 0x7f4e700f8de0 unknown :-1 s=CLOSED pgs=347 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:05:56.864 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.860+0000 7f4e3f7fe6c0 1 -- 10.20.193.92:0/1177836597 >> 10.20.193.92:0/1177836597 conn(0x7f4e700ec980 msgr2=0x7f4e7010d540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:05:56.864 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.860+0000 7f4e3f7fe6c0 1 -- 10.20.193.92:0/1177836597 shutdown_connections 2026-02-13T04:05:56.864 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:05:56.860+0000 7f4e3f7fe6c0 1 -- 10.20.193.92:0/1177836597 wait complete. 2026-02-13T04:05:56.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:56 trial099 ceph-mon[27808]: pgmap v338: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T04:05:57.078 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:56 trial158 ceph-mon[27763]: pgmap v338: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.2 KiB/s rd, 9 op/s 2026-02-13T04:05:57.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:57 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/1177836597' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:57.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:57 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:05:57.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:57 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1177836597' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:57.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:57 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:05:58.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:57 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/1177836597' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:05:58.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:57 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2026-02-13T04:05:58.865 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:58 trial158 ceph-mon[27763]: pgmap v339: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:05:58.866 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:58 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:05:58.866 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:58 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:05:58.866 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:58 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:05:58.866 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:58 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:05:58.866 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:58 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:05:58.866 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:58 trial158 ceph-mon[27763]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:05:58.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:58 trial099 ceph-mon[27808]: pgmap v339: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:05:58.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:58 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:05:58.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:58 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:05:58.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:58 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:05:58.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:58 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:05:58.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:58 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:05:58.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:58 trial099 ceph-mon[27808]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:05:58.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:58 trial092 ceph-mon[23047]: pgmap v339: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.8 KiB/s rd, 10 op/s 2026-02-13T04:05:58.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:58 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:05:58.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:58 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2026-02-13T04:05:58.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:58 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' 2026-02-13T04:05:58.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:58 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2026-02-13T04:05:58.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:58 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2026-02-13T04:05:58.934 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:58 trial092 ceph-mon[23047]: from='mgr.14187 10.20.193.92:0/2514563770' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2026-02-13T04:05:59.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:05:59 trial099 ceph-mon[27808]: pgmap v340: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 9 op/s 2026-02-13T04:05:59.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:05:59 trial092 ceph-mon[23047]: pgmap v340: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 9 op/s 2026-02-13T04:05:59.968 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:06:00.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:05:59 trial158 ceph-mon[27763]: pgmap v340: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.1 KiB/s rd, 9 op/s 2026-02-13T04:06:00.150 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:06:00.350 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.346+0000 7f226f6986c0 1 -- 10.20.193.92:0/2555772173 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f22681110a0 msgr2=0x7f2268111520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:06:00.350 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.346+0000 7f226f6986c0 1 --2- 10.20.193.92:0/2555772173 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f22681110a0 0x7f2268111520 secure :-1 s=READY pgs=348 gs=1 cs=0 l=1 c_cookie=98047925673531547 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f226400aa40 tx=0x7f226402fde0 comp rx=0 tx=0).stop 2026-02-13T04:06:00.350 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.346+0000 7f226f6986c0 1 -- 10.20.193.92:0/2555772173 shutdown_connections 2026-02-13T04:06:00.350 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.346+0000 7f226f6986c0 1 --2- 10.20.193.92:0/2555772173 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f226810c480 0x7f2268110a50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:06:00.350 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.346+0000 7f226f6986c0 1 --2- 10.20.193.92:0/2555772173 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f22681110a0 0x7f2268111520 unknown :-1 s=CLOSED pgs=348 gs=1 cs=0 l=1 c_cookie=98047925673531547 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:06:00.350 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.346+0000 7f226f6986c0 1 --2- 10.20.193.92:0/2555772173 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f226810ba90 0x7f226810be60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:06:00.350 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.346+0000 7f226f6986c0 1 -- 10.20.193.92:0/2555772173 >> 10.20.193.92:0/2555772173 conn(0x7f22680e9700 msgr2=0x7f2268109b10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:06:00.350 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.346+0000 7f226f6986c0 1 -- 10.20.193.92:0/2555772173 shutdown_connections 2026-02-13T04:06:00.351 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.346+0000 7f226f6986c0 1 -- 10.20.193.92:0/2555772173 wait complete. 2026-02-13T04:06:00.351 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.347+0000 7f226f6986c0 1 Processor -- start 2026-02-13T04:06:00.351 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.347+0000 7f226f6986c0 1 -- start start 2026-02-13T04:06:00.351 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.347+0000 7f226f6986c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f226810ba90 0x7f2268121720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:06:00.351 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.347+0000 7f226f6986c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f226810c480 0x7f2268121c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:06:00.351 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.347+0000 7f226f6986c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f22681110a0 0x7f2268127020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:06:00.351 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.347+0000 7f226f6986c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2268127670 con 0x7f226810c480 2026-02-13T04:06:00.351 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.347+0000 7f226f6986c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f22681277e0 con 0x7f22681110a0 2026-02-13T04:06:00.351 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.347+0000 7f226f6986c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f22681279a0 con 0x7f226810ba90 2026-02-13T04:06:00.353 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.347+0000 7f226cc0c6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f226810c480 0x7f2268121c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:06:00.353 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.347+0000 7f226cc0c6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f226810c480 0x7f2268121c60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.92:3300/0 says I am v2:10.20.193.92:39692/0 (socket says 10.20.193.92:39692) 2026-02-13T04:06:00.353 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.347+0000 7f226cc0c6c0 1 -- 10.20.193.92:0/1413668498 learned_addr learned my addr 10.20.193.92:0/1413668498 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:06:00.353 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.347+0000 7f226d40d6c0 1 --2- 10.20.193.92:0/1413668498 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f226810ba90 0x7f2268121720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:06:00.353 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.347+0000 7f226dc0e6c0 1 --2- 10.20.193.92:0/1413668498 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f22681110a0 0x7f2268127020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:06:00.353 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.348+0000 7f226cc0c6c0 1 -- 10.20.193.92:0/1413668498 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f226810ba90 msgr2=0x7f2268121720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:06:00.353 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.348+0000 7f226cc0c6c0 1 --2- 10.20.193.92:0/1413668498 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f226810ba90 0x7f2268121720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:06:00.353 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.348+0000 7f226cc0c6c0 1 -- 10.20.193.92:0/1413668498 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f22681110a0 msgr2=0x7f2268127020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:06:00.353 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.348+0000 7f226cc0c6c0 1 --2- 10.20.193.92:0/1413668498 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f22681110a0 0x7f2268127020 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:06:00.353 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.348+0000 7f226cc0c6c0 1 -- 10.20.193.92:0/1413668498 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f226400a660 con 0x7f226810c480 2026-02-13T04:06:00.354 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.348+0000 7f226d40d6c0 1 --2- 10.20.193.92:0/1413668498 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f226810ba90 0x7f2268121720 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T04:06:00.354 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.348+0000 7f226cc0c6c0 1 --2- 10.20.193.92:0/1413668498 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f226810c480 0x7f2268121c60 secure :-1 s=READY pgs=349 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f225c009490 tx=0x7f225c00bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:06:00.354 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.348+0000 7f22567fc6c0 1 -- 10.20.193.92:0/1413668498 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f225c004a80 con 0x7f226810c480 2026-02-13T04:06:00.354 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.348+0000 7f226f6986c0 1 -- 10.20.193.92:0/1413668498 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2268127c80 con 0x7f226810c480 2026-02-13T04:06:00.354 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.348+0000 7f22567fc6c0 1 -- 10.20.193.92:0/1413668498 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f225c009030 con 0x7f226810c480 2026-02-13T04:06:00.354 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.348+0000 7f22567fc6c0 1 -- 10.20.193.92:0/1413668498 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f225c007440 con 0x7f226810c480 2026-02-13T04:06:00.354 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.348+0000 7f226f6986c0 1 -- 10.20.193.92:0/1413668498 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2268168360 con 0x7f226810c480 2026-02-13T04:06:00.354 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.349+0000 7f2237fff6c0 1 -- 10.20.193.92:0/1413668498 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f226805fb90 con 0x7f226810c480 2026-02-13T04:06:00.355 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.351+0000 7f22567fc6c0 1 -- 10.20.193.92:0/1413668498 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f225c004060 con 0x7f226810c480 2026-02-13T04:06:00.355 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.352+0000 7f22567fc6c0 1 --2- 10.20.193.92:0/1413668498 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f22440b56d0 0x7f22440d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:06:00.355 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.353+0000 7f22567fc6c0 1 -- 10.20.193.92:0/1413668498 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f225c0e3bc0 con 0x7f226810c480 2026-02-13T04:06:00.356 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.353+0000 7f22567fc6c0 1 -- 10.20.193.92:0/1413668498 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f225c11c620 con 0x7f226810c480 2026-02-13T04:06:00.356 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.353+0000 7f226d40d6c0 1 --2- 10.20.193.92:0/1413668498 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f22440b56d0 0x7f22440d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:06:00.356 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.354+0000 7f226d40d6c0 1 --2- 10.20.193.92:0/1413668498 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f22440b56d0 0x7f22440d5b80 secure :-1 s=READY pgs=266 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2258004750 tx=0x7f2258009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:06:00.482 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.479+0000 7f2237fff6c0 1 -- 10.20.193.92:0/1413668498 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2268122870 con 0x7f226810c480 2026-02-13T04:06:00.482 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.479+0000 7f22567fc6c0 1 -- 10.20.193.92:0/1413668498 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f225c0a6560 con 0x7f226810c480 2026-02-13T04:06:00.482 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:06:00.482 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:06:00.483 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.480+0000 7f2237fff6c0 1 -- 10.20.193.92:0/1413668498 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f22440b56d0 msgr2=0x7f22440d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:06:00.484 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.480+0000 7f2237fff6c0 1 --2- 10.20.193.92:0/1413668498 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f22440b56d0 0x7f22440d5b80 secure :-1 s=READY pgs=266 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2258004750 tx=0x7f2258009260 comp rx=0 tx=0).stop 2026-02-13T04:06:00.484 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.480+0000 7f2237fff6c0 1 -- 10.20.193.92:0/1413668498 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f226810c480 msgr2=0x7f2268121c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:06:00.484 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.480+0000 7f2237fff6c0 1 --2- 10.20.193.92:0/1413668498 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f226810c480 0x7f2268121c60 secure :-1 s=READY pgs=349 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f225c009490 tx=0x7f225c00bca0 comp rx=0 tx=0).stop 2026-02-13T04:06:00.484 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.480+0000 7f2237fff6c0 1 -- 10.20.193.92:0/1413668498 shutdown_connections 2026-02-13T04:06:00.484 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.480+0000 7f2237fff6c0 1 --2- 10.20.193.92:0/1413668498 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f22440b56d0 0x7f22440d5b80 unknown :-1 s=CLOSED pgs=266 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:06:00.484 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.480+0000 7f2237fff6c0 1 --2- 10.20.193.92:0/1413668498 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f22681110a0 0x7f2268127020 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:06:00.484 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.480+0000 7f2237fff6c0 1 --2- 10.20.193.92:0/1413668498 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f226810c480 0x7f2268121c60 unknown :-1 s=CLOSED pgs=349 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:06:00.484 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.480+0000 7f2237fff6c0 1 --2- 10.20.193.92:0/1413668498 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f226810ba90 0x7f2268121720 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:06:00.484 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.480+0000 7f2237fff6c0 1 -- 10.20.193.92:0/1413668498 >> 10.20.193.92:0/1413668498 conn(0x7f22680e9700 msgr2=0x7f2268109ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:06:00.484 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.480+0000 7f2237fff6c0 1 -- 10.20.193.92:0/1413668498 shutdown_connections 2026-02-13T04:06:00.485 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:00.481+0000 7f2237fff6c0 1 -- 10.20.193.92:0/1413668498 wait complete. 2026-02-13T04:06:00.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:06:00 trial099 ceph-mon[27808]: pgmap v341: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T04:06:00.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:06:00 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/1413668498' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:06:00.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:06:00 trial092 ceph-mon[23047]: pgmap v341: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T04:06:00.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:06:00 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/1413668498' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:06:01.078 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:06:00 trial158 ceph-mon[27763]: pgmap v341: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T04:06:01.078 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:06:00 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/1413668498' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:06:02.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:06:02 trial099 ceph-mon[27808]: pgmap v342: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T04:06:02.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:06:02 trial092 ceph-mon[23047]: pgmap v342: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T04:06:03.078 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:06:02 trial158 ceph-mon[27763]: pgmap v342: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 3.7 KiB/s rd, 7 op/s 2026-02-13T04:06:03.588 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:06:03.771 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:06:03.964 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:03.961+0000 7f4cd15736c0 1 -- 10.20.193.92:0/3576649153 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4cc40081c0 con 0x7f4cd41199a0 2026-02-13T04:06:03.965 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:03.961+0000 7f4cd35776c0 1 -- 10.20.193.92:0/3576649153 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4cd41199a0 msgr2=0x7f4cd4116df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:06:03.965 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:03.961+0000 7f4cd35776c0 1 --2- 10.20.193.92:0/3576649153 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4cd41199a0 0x7f4cd4116df0 secure :-1 s=READY pgs=350 gs=3 cs=0 l=1 c_cookie=18179327264836254169 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4cc4006fd0 tx=0x7f4cc402fd30 comp rx=0 tx=0).stop 2026-02-13T04:06:03.965 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:03.962+0000 7f4cd35776c0 1 -- 10.20.193.92:0/3576649153 shutdown_connections 2026-02-13T04:06:03.965 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:03.962+0000 7f4cd35776c0 1 --2- 10.20.193.92:0/3576649153 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4cd41199a0 0x7f4cd4116df0 unknown :-1 s=CLOSED pgs=350 gs=3 cs=0 l=1 c_cookie=18179327264836254169 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:06:03.965 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:03.962+0000 7f4cd35776c0 1 --2- 10.20.193.92:0/3576649153 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4cd4118f30 0x7f4cd4119380 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:06:03.965 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:03.962+0000 7f4cd35776c0 1 --2- 10.20.193.92:0/3576649153 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4cd411b3f0 0x7f4cd411b7c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:06:03.965 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:03.962+0000 7f4cd35776c0 1 -- 10.20.193.92:0/3576649153 >> 10.20.193.92:0/3576649153 conn(0x7f4cd405b290 msgr2=0x7f4cd405b690 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:06:03.965 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:03.962+0000 7f4cd35776c0 1 -- 10.20.193.92:0/3576649153 shutdown_connections 2026-02-13T04:06:03.965 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:03.962+0000 7f4cd35776c0 1 -- 10.20.193.92:0/3576649153 wait complete. 2026-02-13T04:06:03.967 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:03.962+0000 7f4cd35776c0 1 Processor -- start 2026-02-13T04:06:03.967 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:03.962+0000 7f4cd35776c0 1 -- start start 2026-02-13T04:06:03.968 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:03.963+0000 7f4cd35776c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4cd4118f30 0x7f4cd40fda60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:06:03.968 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:03.963+0000 7f4cd35776c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4cd41199a0 0x7f4cd40fdfa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:06:03.968 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:03.963+0000 7f4cd35776c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4cd411b3f0 0x7f4cd4103360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:06:03.968 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:03.963+0000 7f4cd35776c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd4103960 con 0x7f4cd4118f30 2026-02-13T04:06:03.968 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:03.963+0000 7f4cd35776c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd4103ad0 con 0x7f4cd411b3f0 2026-02-13T04:06:03.968 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:03.963+0000 7f4cd35776c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f4cd4103c90 con 0x7f4cd41199a0 2026-02-13T04:06:03.968 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:03.963+0000 7f4cd1d746c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4cd41199a0 0x7f4cd40fdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:06:03.968 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:03.963+0000 7f4cd1d746c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4cd41199a0 0x7f4cd40fdfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:53044/0 (socket says 10.20.193.92:53044) 2026-02-13T04:06:03.968 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:03.963+0000 7f4cd1d746c0 1 -- 10.20.193.92:0/796395342 learned_addr learned my addr 10.20.193.92:0/796395342 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:06:03.968 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:03.963+0000 7f4cd25756c0 1 --2- 10.20.193.92:0/796395342 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4cd4118f30 0x7f4cd40fda60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:06:03.968 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:03.963+0000 7f4cd2d766c0 1 --2- 10.20.193.92:0/796395342 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4cd411b3f0 0x7f4cd4103360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:06:03.969 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:03.963+0000 7f4cd1d746c0 1 -- 10.20.193.92:0/796395342 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4cd411b3f0 msgr2=0x7f4cd4103360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:06:03.969 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:03.963+0000 7f4cd1d746c0 1 --2- 10.20.193.92:0/796395342 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4cd411b3f0 0x7f4cd4103360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:06:03.969 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:03.963+0000 7f4cd1d746c0 1 -- 10.20.193.92:0/796395342 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4cd4118f30 msgr2=0x7f4cd40fda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:06:03.969 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:03.963+0000 7f4cd1d746c0 1 --2- 10.20.193.92:0/796395342 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4cd4118f30 0x7f4cd40fda60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:06:03.969 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:03.963+0000 7f4cd1d746c0 1 -- 10.20.193.92:0/796395342 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc400a5b0 con 0x7f4cd41199a0 2026-02-13T04:06:03.969 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:03.963+0000 7f4cd1d746c0 1 --2- 10.20.193.92:0/796395342 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4cd41199a0 0x7f4cd40fdfa0 secure :-1 s=READY pgs=119 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4cbc009490 tx=0x7f4cbc00bc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:06:03.969 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:03.964+0000 7f4cbb7fe6c0 1 -- 10.20.193.92:0/796395342 <== mon.1 v2:10.20.193.158:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4cbc004a80 con 0x7f4cd41199a0 2026-02-13T04:06:03.969 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:03.964+0000 7f4cbb7fe6c0 1 -- 10.20.193.92:0/796395342 <== mon.1 v2:10.20.193.158:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f4cbc009030 con 0x7f4cd41199a0 2026-02-13T04:06:03.969 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:03.964+0000 7f4cd35776c0 1 -- 10.20.193.92:0/796395342 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cd4103f70 con 0x7f4cd41199a0 2026-02-13T04:06:03.969 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:03.964+0000 7f4cbb7fe6c0 1 -- 10.20.193.92:0/796395342 <== mon.1 v2:10.20.193.158:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f4cbc0071c0 con 0x7f4cd41199a0 2026-02-13T04:06:03.969 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:03.964+0000 7f4cd35776c0 1 -- 10.20.193.92:0/796395342 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cd4104680 con 0x7f4cd41199a0 2026-02-13T04:06:03.969 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:03.965+0000 7f4cd35776c0 1 -- 10.20.193.92:0/796395342 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cd405e670 con 0x7f4cd41199a0 2026-02-13T04:06:03.970 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:03.967+0000 7f4cbb7fe6c0 1 -- 10.20.193.92:0/796395342 <== mon.1 v2:10.20.193.158:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f4cbc004e90 con 0x7f4cd41199a0 2026-02-13T04:06:03.971 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:03.969+0000 7f4cbb7fe6c0 1 --2- 10.20.193.92:0/796395342 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f4ca00b5650 0x7f4ca00d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:06:03.971 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:03.969+0000 7f4cbb7fe6c0 1 -- 10.20.193.92:0/796395342 <== mon.1 v2:10.20.193.158:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f4cbc0e3c80 con 0x7f4cd41199a0 2026-02-13T04:06:03.972 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:03.969+0000 7f4cd25756c0 1 --2- 10.20.193.92:0/796395342 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f4ca00b5650 0x7f4ca00d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:06:03.972 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:03.969+0000 7f4cbb7fe6c0 1 -- 10.20.193.92:0/796395342 <== mon.1 v2:10.20.193.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f4cbc0e4100 con 0x7f4cd41199a0 2026-02-13T04:06:03.972 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:03.969+0000 7f4cd25756c0 1 --2- 10.20.193.92:0/796395342 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f4ca00b5650 0x7f4ca00d5b00 secure :-1 s=READY pgs=267 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4cc8005b40 tx=0x7f4cc8009310 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:06:04.098 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:04.095+0000 7f4cd35776c0 1 -- 10.20.193.92:0/796395342 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4cd40febb0 con 0x7f4cd41199a0 2026-02-13T04:06:04.098 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:04.095+0000 7f4cbb7fe6c0 1 -- 10.20.193.92:0/796395342 <== mon.1 v2:10.20.193.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f4cbc0a6620 con 0x7f4cd41199a0 2026-02-13T04:06:04.098 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:06:04.098 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:06:04.099 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:04.096+0000 7f4cd35776c0 1 -- 10.20.193.92:0/796395342 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f4ca00b5650 msgr2=0x7f4ca00d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:06:04.100 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:04.096+0000 7f4cd35776c0 1 --2- 10.20.193.92:0/796395342 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f4ca00b5650 0x7f4ca00d5b00 secure :-1 s=READY pgs=267 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4cc8005b40 tx=0x7f4cc8009310 comp rx=0 tx=0).stop 2026-02-13T04:06:04.100 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:04.096+0000 7f4cd35776c0 1 -- 10.20.193.92:0/796395342 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4cd41199a0 msgr2=0x7f4cd40fdfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:06:04.100 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:04.096+0000 7f4cd35776c0 1 --2- 10.20.193.92:0/796395342 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4cd41199a0 0x7f4cd40fdfa0 secure :-1 s=READY pgs=119 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4cbc009490 tx=0x7f4cbc00bc50 comp rx=0 tx=0).stop 2026-02-13T04:06:04.100 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:04.096+0000 7f4cd35776c0 1 -- 10.20.193.92:0/796395342 shutdown_connections 2026-02-13T04:06:04.100 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:04.096+0000 7f4cd35776c0 1 --2- 10.20.193.92:0/796395342 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f4ca00b5650 0x7f4ca00d5b00 unknown :-1 s=CLOSED pgs=267 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:06:04.100 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:04.096+0000 7f4cd35776c0 1 --2- 10.20.193.92:0/796395342 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f4cd411b3f0 0x7f4cd4103360 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:06:04.100 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:04.096+0000 7f4cd35776c0 1 --2- 10.20.193.92:0/796395342 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f4cd41199a0 0x7f4cd40fdfa0 unknown :-1 s=CLOSED pgs=119 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:06:04.100 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:04.096+0000 7f4cd35776c0 1 --2- 10.20.193.92:0/796395342 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f4cd4118f30 0x7f4cd40fda60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:06:04.100 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:04.096+0000 7f4cd35776c0 1 -- 10.20.193.92:0/796395342 >> 10.20.193.92:0/796395342 conn(0x7f4cd405b290 msgr2=0x7f4cd40f4200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:06:04.100 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:04.097+0000 7f4cd35776c0 1 -- 10.20.193.92:0/796395342 shutdown_connections 2026-02-13T04:06:04.100 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:04.097+0000 7f4cd35776c0 1 -- 10.20.193.92:0/796395342 wait complete. 2026-02-13T04:06:04.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:06:04 trial099 ceph-mon[27808]: pgmap v343: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 10 op/s 2026-02-13T04:06:04.867 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:06:04 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/796395342' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:06:04.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:06:04 trial092 ceph-mon[23047]: pgmap v343: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 10 op/s 2026-02-13T04:06:04.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:06:04 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/796395342' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:06:05.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:06:04 trial158 ceph-mon[27763]: pgmap v343: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 10 op/s 2026-02-13T04:06:05.079 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:06:04 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/796395342' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:06:06.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:06:06 trial099 ceph-mon[27808]: pgmap v344: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T04:06:06.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:06:06 trial092 ceph-mon[23047]: pgmap v344: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T04:06:07.078 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:06:06 trial158 ceph-mon[27763]: pgmap v344: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 5.3 KiB/s rd, 10 op/s 2026-02-13T04:06:07.202 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:06:07.386 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:06:07.595 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.592+0000 7fed08f366c0 1 -- 10.20.193.92:0/1141438497 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fed040622d0 msgr2=0x7fed040607a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:06:07.595 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.592+0000 7fed08f366c0 1 --2- 10.20.193.92:0/1141438497 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fed040622d0 0x7fed040607a0 secure :-1 s=READY pgs=351 gs=1 cs=0 l=1 c_cookie=6786410953283470949 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecf0009970 tx=0x7fecf002ed50 comp rx=0 tx=0).stop 2026-02-13T04:06:07.595 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.593+0000 7fed08f366c0 1 -- 10.20.193.92:0/1141438497 shutdown_connections 2026-02-13T04:06:07.595 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.593+0000 7fed08f366c0 1 --2- 10.20.193.92:0/1141438497 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fed04159910 0x7fed04179cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:06:07.595 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.593+0000 7fed08f366c0 1 --2- 10.20.193.92:0/1141438497 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fed04060ce0 0x7fed04061110 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:06:07.595 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.593+0000 7fed08f366c0 1 --2- 10.20.193.92:0/1141438497 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fed040622d0 0x7fed040607a0 unknown :-1 s=CLOSED pgs=351 gs=1 cs=0 l=1 c_cookie=6786410953283470949 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:06:07.595 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.593+0000 7fed08f366c0 1 -- 10.20.193.92:0/1141438497 >> 10.20.193.92:0/1141438497 conn(0x7fed040ea6d0 msgr2=0x7fed0410aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:06:07.595 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.593+0000 7fed08f366c0 1 -- 10.20.193.92:0/1141438497 shutdown_connections 2026-02-13T04:06:07.595 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.593+0000 7fed08f366c0 1 -- 10.20.193.92:0/1141438497 wait complete. 2026-02-13T04:06:07.596 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.593+0000 7fed08f366c0 1 Processor -- start 2026-02-13T04:06:07.596 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.594+0000 7fed08f366c0 1 -- start start 2026-02-13T04:06:07.596 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.594+0000 7fed08f366c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fed04060ce0 0x7fed040f1f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:06:07.596 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.594+0000 7fed08f366c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fed040622d0 0x7fed040f2450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:06:07.596 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.594+0000 7fed08f366c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fed04159910 0x7fed040f77c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:06:07.596 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.594+0000 7fed08f366c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7fed040f7e10 con 0x7fed04159910 2026-02-13T04:06:07.596 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.594+0000 7fed08f366c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7fed040f7f80 con 0x7fed04060ce0 2026-02-13T04:06:07.596 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.594+0000 7fed08f366c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7fed040f8140 con 0x7fed040622d0 2026-02-13T04:06:07.596 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.594+0000 7fed037fe6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fed04060ce0 0x7fed040f1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:06:07.596 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.594+0000 7fed03fff6c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fed04159910 0x7fed040f77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:06:07.596 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.594+0000 7fed037fe6c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fed04060ce0 0x7fed040f1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.99:3300/0 says I am v2:10.20.193.92:44694/0 (socket says 10.20.193.92:44694) 2026-02-13T04:06:07.596 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.594+0000 7fed037fe6c0 1 -- 10.20.193.92:0/4858069 learned_addr learned my addr 10.20.193.92:0/4858069 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:06:07.596 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.594+0000 7fed02ffd6c0 1 --2- 10.20.193.92:0/4858069 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fed040622d0 0x7fed040f2450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:06:07.597 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.594+0000 7fed03fff6c0 1 -- 10.20.193.92:0/4858069 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fed040622d0 msgr2=0x7fed040f2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:06:07.597 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.594+0000 7fed03fff6c0 1 --2- 10.20.193.92:0/4858069 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fed040622d0 0x7fed040f2450 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:06:07.597 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.594+0000 7fed03fff6c0 1 -- 10.20.193.92:0/4858069 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fed04060ce0 msgr2=0x7fed040f1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:06:07.597 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.594+0000 7fed03fff6c0 1 --2- 10.20.193.92:0/4858069 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fed04060ce0 0x7fed040f1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:06:07.597 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.594+0000 7fed03fff6c0 1 -- 10.20.193.92:0/4858069 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf0009590 con 0x7fed04159910 2026-02-13T04:06:07.597 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.594+0000 7fed02ffd6c0 1 --2- 10.20.193.92:0/4858069 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fed040622d0 0x7fed040f2450 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-13T04:06:07.597 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.595+0000 7fed03fff6c0 1 --2- 10.20.193.92:0/4858069 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fed04159910 0x7fed040f77c0 secure :-1 s=READY pgs=352 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecf8006fd0 tx=0x7fecf800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:06:07.597 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.595+0000 7fed00ff96c0 1 -- 10.20.193.92:0/4858069 <== mon.0 v2:10.20.193.92:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fecf8003c40 con 0x7fed04159910 2026-02-13T04:06:07.597 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.595+0000 7fed00ff96c0 1 -- 10.20.193.92:0/4858069 <== mon.0 v2:10.20.193.92:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7fecf800a070 con 0x7fed04159910 2026-02-13T04:06:07.597 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.595+0000 7fed00ff96c0 1 -- 10.20.193.92:0/4858069 <== mon.0 v2:10.20.193.92:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7fecf80081c0 con 0x7fed04159910 2026-02-13T04:06:07.597 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.595+0000 7fed08f366c0 1 -- 10.20.193.92:0/4858069 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed040f8420 con 0x7fed04159910 2026-02-13T04:06:07.597 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.595+0000 7fed08f366c0 1 -- 10.20.193.92:0/4858069 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed040f8ae0 con 0x7fed04159910 2026-02-13T04:06:07.598 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.595+0000 7fed08f366c0 1 -- 10.20.193.92:0/4858069 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed040f8640 con 0x7fed04159910 2026-02-13T04:06:07.600 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.597+0000 7fed00ff96c0 1 -- 10.20.193.92:0/4858069 <== mon.0 v2:10.20.193.92:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7fecf8005860 con 0x7fed04159910 2026-02-13T04:06:07.601 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.599+0000 7fed00ff96c0 1 --2- 10.20.193.92:0/4858069 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fecd80b56d0 0x7fecd80d5b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:06:07.601 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.599+0000 7fed00ff96c0 1 -- 10.20.193.92:0/4858069 <== mon.0 v2:10.20.193.92:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7fecf80e4a00 con 0x7fed04159910 2026-02-13T04:06:07.601 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.599+0000 7fed037fe6c0 1 --2- 10.20.193.92:0/4858069 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fecd80b56d0 0x7fecd80d5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:06:07.601 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.599+0000 7fed00ff96c0 1 -- 10.20.193.92:0/4858069 <== mon.0 v2:10.20.193.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7fecf811d5e0 con 0x7fed04159910 2026-02-13T04:06:07.602 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.600+0000 7fed037fe6c0 1 --2- 10.20.193.92:0/4858069 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fecd80b56d0 0x7fecd80d5b80 secure :-1 s=READY pgs=268 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecf00023e0 tx=0x7fecf0005910 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:06:07.723 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.721+0000 7fed08f366c0 1 -- 10.20.193.92:0/4858069 --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fed040f3010 con 0x7fed04159910 2026-02-13T04:06:07.723 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.721+0000 7fed00ff96c0 1 -- 10.20.193.92:0/4858069 <== mon.0 v2:10.20.193.92:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7fecf80a73a0 con 0x7fed04159910 2026-02-13T04:06:07.724 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:06:07.724 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:06:07.725 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.722+0000 7fed08f366c0 1 -- 10.20.193.92:0/4858069 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fecd80b56d0 msgr2=0x7fecd80d5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:06:07.725 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.722+0000 7fed08f366c0 1 --2- 10.20.193.92:0/4858069 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fecd80b56d0 0x7fecd80d5b80 secure :-1 s=READY pgs=268 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecf00023e0 tx=0x7fecf0005910 comp rx=0 tx=0).stop 2026-02-13T04:06:07.725 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.722+0000 7fed08f366c0 1 -- 10.20.193.92:0/4858069 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fed04159910 msgr2=0x7fed040f77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:06:07.725 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.722+0000 7fed08f366c0 1 --2- 10.20.193.92:0/4858069 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fed04159910 0x7fed040f77c0 secure :-1 s=READY pgs=352 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fecf8006fd0 tx=0x7fecf800cc00 comp rx=0 tx=0).stop 2026-02-13T04:06:07.725 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.722+0000 7fed08f366c0 1 -- 10.20.193.92:0/4858069 shutdown_connections 2026-02-13T04:06:07.725 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.722+0000 7fed08f366c0 1 --2- 10.20.193.92:0/4858069 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7fed04159910 0x7fed040f77c0 unknown :-1 s=CLOSED pgs=352 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:06:07.725 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.722+0000 7fed08f366c0 1 --2- 10.20.193.92:0/4858069 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7fed040622d0 0x7fed040f2450 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:06:07.725 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.722+0000 7fed08f366c0 1 --2- 10.20.193.92:0/4858069 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7fecd80b56d0 0x7fecd80d5b80 unknown :-1 s=CLOSED pgs=268 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:06:07.725 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.723+0000 7fed08f366c0 1 --2- 10.20.193.92:0/4858069 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7fed04060ce0 0x7fed040f1f10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:06:07.725 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.723+0000 7fed08f366c0 1 -- 10.20.193.92:0/4858069 >> 10.20.193.92:0/4858069 conn(0x7fed040ea6d0 msgr2=0x7fed0410ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:06:07.725 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.723+0000 7fed08f366c0 1 -- 10.20.193.92:0/4858069 shutdown_connections 2026-02-13T04:06:07.725 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:07.723+0000 7fed08f366c0 1 -- 10.20.193.92:0/4858069 wait complete. 2026-02-13T04:06:08.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:06:08 trial099 ceph-mon[27808]: pgmap v345: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 10 op/s 2026-02-13T04:06:08.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:06:08 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/4858069' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:06:08.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:06:08 trial092 ceph-mon[23047]: pgmap v345: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 10 op/s 2026-02-13T04:06:08.933 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:06:08 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/4858069' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:06:09.078 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:06:08 trial158 ceph-mon[27763]: pgmap v345: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.8 KiB/s rd, 10 op/s 2026-02-13T04:06:09.078 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:06:08 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/4858069' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:06:10.828 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph health --format=json 2026-02-13T04:06:10.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:06:10 trial099 ceph-mon[27808]: pgmap v346: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 10 op/s 2026-02-13T04:06:10.879 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:06:10 trial092 ceph-mon[23047]: pgmap v346: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 10 op/s 2026-02-13T04:06:10.880 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:06:10 trial158 ceph-mon[27763]: pgmap v346: 97 pgs: 97 active+clean; 655 KiB data, 326 MiB used, 8.2 TiB / 8.2 TiB avail; 4.7 KiB/s rd, 10 op/s 2026-02-13T04:06:11.013 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:06:11.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.205+0000 7f65a5f736c0 1 -- 10.20.193.92:0/1523151118 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f65a010f060 msgr2=0x7f65a010f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:06:11.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.205+0000 7f65a5f736c0 1 --2- 10.20.193.92:0/1523151118 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f65a010f060 0x7f65a010f430 secure :-1 s=READY pgs=353 gs=1 cs=0 l=1 c_cookie=16163619833643601177 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65900099a0 tx=0x7f659002ed00 comp rx=0 tx=0).stop 2026-02-13T04:06:11.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.205+0000 7f65a5f736c0 1 -- 10.20.193.92:0/1523151118 shutdown_connections 2026-02-13T04:06:11.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.205+0000 7f65a5f736c0 1 --2- 10.20.193.92:0/1523151118 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f65a0115270 0x7f65a0175c10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:06:11.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.205+0000 7f65a5f736c0 1 --2- 10.20.193.92:0/1523151118 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f65a010fa50 0x7f65a0114a90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:06:11.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.205+0000 7f65a5f736c0 1 --2- 10.20.193.92:0/1523151118 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f65a010f060 0x7f65a010f430 unknown :-1 s=CLOSED pgs=353 gs=1 cs=0 l=1 c_cookie=16163619833643601177 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:06:11.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.205+0000 7f65a5f736c0 1 -- 10.20.193.92:0/1523151118 >> 10.20.193.92:0/1523151118 conn(0x7f65a00ec980 msgr2=0x7f65a010cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:06:11.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.205+0000 7f65a5f736c0 1 -- 10.20.193.92:0/1523151118 shutdown_connections 2026-02-13T04:06:11.208 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.206+0000 7f65a5f736c0 1 -- 10.20.193.92:0/1523151118 wait complete. 2026-02-13T04:06:11.209 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.206+0000 7f65a5f736c0 1 Processor -- start 2026-02-13T04:06:11.209 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.207+0000 7f65a5f736c0 1 -- start start 2026-02-13T04:06:11.209 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.207+0000 7f65a5f736c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f65a010f060 0x7f65a011cf30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:06:11.209 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.207+0000 7f65a5f736c0 1 --2- >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f65a0115270 0x7f65a011d470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:06:11.209 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.207+0000 7f65a5f736c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f65a0122830 0x7f65a0122cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:06:11.209 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.207+0000 7f65a5f736c0 1 -- --> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] -- mon_getmap magic: 0 -- 0x7f65a0123240 con 0x7f65a0115270 2026-02-13T04:06:11.209 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.207+0000 7f65a5f736c0 1 -- --> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] -- mon_getmap magic: 0 -- 0x7f65a01233b0 con 0x7f65a0122830 2026-02-13T04:06:11.209 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.207+0000 7f65a5f736c0 1 -- --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_getmap magic: 0 -- 0x7f65a0123570 con 0x7f65a010f060 2026-02-13T04:06:11.209 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.207+0000 7f65a4f716c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f65a010f060 0x7f65a011cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:06:11.209 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.207+0000 7f65a57726c0 1 --2- >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f65a0122830 0x7f65a0122cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:06:11.209 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.207+0000 7f65a4f716c0 1 --2- >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f65a010f060 0x7f65a011cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.158:3300/0 says I am v2:10.20.193.92:57876/0 (socket says 10.20.193.92:57876) 2026-02-13T04:06:11.209 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.207+0000 7f65a4f716c0 1 -- 10.20.193.92:0/4201458411 learned_addr learned my addr 10.20.193.92:0/4201458411 (peer_addr_for_me v2:10.20.193.92:0/0) 2026-02-13T04:06:11.210 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.207+0000 7f6597fff6c0 1 --2- 10.20.193.92:0/4201458411 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f65a0115270 0x7f65a011d470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:06:11.210 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.207+0000 7f65a4f716c0 1 -- 10.20.193.92:0/4201458411 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f65a0122830 msgr2=0x7f65a0122cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:06:11.210 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.207+0000 7f65a4f716c0 1 --2- 10.20.193.92:0/4201458411 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f65a0122830 0x7f65a0122cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:06:11.210 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.207+0000 7f65a4f716c0 1 -- 10.20.193.92:0/4201458411 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f65a0115270 msgr2=0x7f65a011d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:06:11.210 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.207+0000 7f65a4f716c0 1 --2- 10.20.193.92:0/4201458411 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f65a0115270 0x7f65a011d470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:06:11.210 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.207+0000 7f65a4f716c0 1 -- 10.20.193.92:0/4201458411 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6590009590 con 0x7f65a010f060 2026-02-13T04:06:11.210 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.208+0000 7f65a4f716c0 1 --2- 10.20.193.92:0/4201458411 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f65a010f060 0x7f65a011cf30 secure :-1 s=READY pgs=120 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f659002f210 tx=0x7f659002f810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:06:11.210 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.208+0000 7f6595ffb6c0 1 -- 10.20.193.92:0/4201458411 <== mon.1 v2:10.20.193.158:3300/0 1 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f65900046b0 con 0x7f65a010f060 2026-02-13T04:06:11.210 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.208+0000 7f6595ffb6c0 1 -- 10.20.193.92:0/4201458411 <== mon.1 v2:10.20.193.158:3300/0 2 ==== config(30 keys) ==== 1219+0+0 (secure 0 0 0) 0x7f6590002be0 con 0x7f65a010f060 2026-02-13T04:06:11.210 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.208+0000 7f65a5f736c0 1 -- 10.20.193.92:0/4201458411 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65a01639c0 con 0x7f65a010f060 2026-02-13T04:06:11.210 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.208+0000 7f6595ffb6c0 1 -- 10.20.193.92:0/4201458411 <== mon.1 v2:10.20.193.158:3300/0 3 ==== mon_map magic: 0 ==== 437+0+0 (secure 0 0 0) 0x7f65900073f0 con 0x7f65a010f060 2026-02-13T04:06:11.210 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.208+0000 7f65a5f736c0 1 -- 10.20.193.92:0/4201458411 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65a0163df0 con 0x7f65a010f060 2026-02-13T04:06:11.211 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.208+0000 7f656f7fe6c0 1 -- 10.20.193.92:0/4201458411 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65a0110330 con 0x7f65a010f060 2026-02-13T04:06:11.213 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.210+0000 7f6595ffb6c0 1 -- 10.20.193.92:0/4201458411 <== mon.1 v2:10.20.193.158:3300/0 4 ==== mgrmap(e 17) ==== 157083+0+0 (secure 0 0 0) 0x7f65900026b0 con 0x7f65a010f060 2026-02-13T04:06:11.214 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.212+0000 7f6595ffb6c0 1 --2- 10.20.193.92:0/4201458411 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f657c0b5650 0x7f657c0d5b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-13T04:06:11.214 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.212+0000 7f6595ffb6c0 1 -- 10.20.193.92:0/4201458411 <== mon.1 v2:10.20.193.158:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8238+0+0 (secure 0 0 0) 0x7f6590107c10 con 0x7f65a010f060 2026-02-13T04:06:11.214 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.212+0000 7f6597fff6c0 1 --2- 10.20.193.92:0/4201458411 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f657c0b5650 0x7f657c0d5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-13T04:06:11.214 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.212+0000 7f6595ffb6c0 1 -- 10.20.193.92:0/4201458411 <== mon.1 v2:10.20.193.158:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+230863 (secure 0 0 0) 0x7f6590108100 con 0x7f65a010f060 2026-02-13T04:06:11.215 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.212+0000 7f6597fff6c0 1 --2- 10.20.193.92:0/4201458411 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f657c0b5650 0x7f657c0d5b00 secure :-1 s=READY pgs=269 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65a01238c0 tx=0x7f6588009260 comp rx=0 tx=0).ready entity=mgr.14187 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-13T04:06:11.338 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.336+0000 7f656f7fe6c0 1 -- 10.20.193.92:0/4201458411 --> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f65a010f430 con 0x7f65a010f060 2026-02-13T04:06:11.338 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.336+0000 7f6595ffb6c0 1 -- 10.20.193.92:0/4201458411 <== mon.1 v2:10.20.193.158:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+190 (secure 0 0 0) 0x7f65900ca5f0 con 0x7f65a010f060 2026-02-13T04:06:11.338 INFO:teuthology.orchestra.run.trial092.stdout: 2026-02-13T04:06:11.338 INFO:teuthology.orchestra.run.trial092.stdout:{"status":"HEALTH_WARN","checks":{"CEPHADM_APPLY_SPEC_FAIL":{"severity":"HEALTH_WARN","summary":{"message":"Failed to apply 1 service(s): osd.default","count":1},"muted":false}},"mutes":[]} 2026-02-13T04:06:11.340 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.337+0000 7f656f7fe6c0 1 -- 10.20.193.92:0/4201458411 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f657c0b5650 msgr2=0x7f657c0d5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:06:11.340 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.337+0000 7f656f7fe6c0 1 --2- 10.20.193.92:0/4201458411 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f657c0b5650 0x7f657c0d5b00 secure :-1 s=READY pgs=269 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65a01238c0 tx=0x7f6588009260 comp rx=0 tx=0).stop 2026-02-13T04:06:11.340 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.337+0000 7f656f7fe6c0 1 -- 10.20.193.92:0/4201458411 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f65a010f060 msgr2=0x7f65a011cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-13T04:06:11.340 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.337+0000 7f656f7fe6c0 1 --2- 10.20.193.92:0/4201458411 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f65a010f060 0x7f65a011cf30 secure :-1 s=READY pgs=120 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f659002f210 tx=0x7f659002f810 comp rx=0 tx=0).stop 2026-02-13T04:06:11.340 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.338+0000 7f656f7fe6c0 1 -- 10.20.193.92:0/4201458411 shutdown_connections 2026-02-13T04:06:11.340 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.338+0000 7f656f7fe6c0 1 --2- 10.20.193.92:0/4201458411 >> [v2:10.20.193.92:6800/4191527999,v1:10.20.193.92:6801/4191527999] conn(0x7f657c0b5650 0x7f657c0d5b00 unknown :-1 s=CLOSED pgs=269 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:06:11.340 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.338+0000 7f656f7fe6c0 1 --2- 10.20.193.92:0/4201458411 >> [v2:10.20.193.99:3300/0,v1:10.20.193.99:6789/0] conn(0x7f65a0122830 0x7f65a0122cd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:06:11.340 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.338+0000 7f656f7fe6c0 1 --2- 10.20.193.92:0/4201458411 >> [v2:10.20.193.92:3300/0,v1:10.20.193.92:6789/0] conn(0x7f65a0115270 0x7f65a011d470 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:06:11.340 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.338+0000 7f656f7fe6c0 1 --2- 10.20.193.92:0/4201458411 >> [v2:10.20.193.158:3300/0,v1:10.20.193.158:6789/0] conn(0x7f65a010f060 0x7f65a011cf30 unknown :-1 s=CLOSED pgs=120 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-13T04:06:11.340 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.338+0000 7f656f7fe6c0 1 -- 10.20.193.92:0/4201458411 >> 10.20.193.92:0/4201458411 conn(0x7f65a00ec980 msgr2=0x7f65a010cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-13T04:06:11.340 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.338+0000 7f656f7fe6c0 1 -- 10.20.193.92:0/4201458411 shutdown_connections 2026-02-13T04:06:11.340 INFO:teuthology.orchestra.run.trial092.stderr:2026-02-13T04:06:11.338+0000 7f656f7fe6c0 1 -- 10.20.193.92:0/4201458411 wait complete. 2026-02-13T04:06:11.444 INFO:tasks.cephadm:Teardown begin 2026-02-13T04:06:11.444 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/cephadm.py", line 2025, in task healthy(ctx=ctx, config=config) File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/ceph.py", line 1557, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/ceph_manager.py", line 3393, in wait_until_healthy assert time.time() - start < timeout, \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: timeout expired in wait_until_healthy 2026-02-13T04:06:11.446 DEBUG:teuthology.orchestra.run.trial092:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T04:06:11.501 DEBUG:teuthology.orchestra.run.trial099:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T04:06:11.531 DEBUG:teuthology.orchestra.run.trial158:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T04:06:11.558 INFO:tasks.cephadm:Disabling cephadm mgr module 2026-02-13T04:06:11.558 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 -- ceph mgr module disable cephadm 2026-02-13T04:06:11.683 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:06:11 trial092 ceph-mon[23047]: from='client.? 10.20.193.92:0/4201458411' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:06:11.738 INFO:teuthology.orchestra.run.trial092.stderr:Inferring config /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/mon.a/config 2026-02-13T04:06:11.774 INFO:teuthology.orchestra.run.trial092.stderr:Error: statfs /etc/ceph/ceph.client.admin.keyring: no such file or directory 2026-02-13T04:06:11.799 DEBUG:teuthology.orchestra.run:got remote process result: 125 2026-02-13T04:06:11.799 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2026-02-13T04:06:11.799 DEBUG:teuthology.orchestra.run.trial092:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-13T04:06:11.828 INFO:journalctl@ceph.mon.c.trial158.stdout:Feb 13 04:06:11 trial158 ceph-mon[27763]: from='client.? 10.20.193.92:0/4201458411' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:06:11.837 DEBUG:teuthology.orchestra.run.trial099:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-13T04:06:11.852 DEBUG:teuthology.orchestra.run.trial158:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2026-02-13T04:06:11.866 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:06:11 trial099 ceph-mon[27808]: from='client.? 10.20.193.92:0/4201458411' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2026-02-13T04:06:11.868 INFO:tasks.cephadm:Stopping all daemons... 2026-02-13T04:06:11.868 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2026-02-13T04:06:11.868 DEBUG:teuthology.orchestra.run.trial092:> sudo systemctl stop ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mon.a 2026-02-13T04:06:12.063 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:06:11 trial092 systemd[1]: Stopping Ceph mon.a for 1fefccae-0890-11f1-bcc5-d404e6e7d460... 2026-02-13T04:06:12.333 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:06:12 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mon-a[23043]: 2026-02-13T04:06:12.060+0000 7f209c7f76c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T04:06:12.333 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:06:12 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mon-a[23043]: 2026-02-13T04:06:12.060+0000 7f209c7f76c0 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2026-02-13T04:06:12.333 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:06:12 trial092 podman[73437]: 2026-02-13 04:06:12.182825003 +0000 UTC m=+0.149133642 container died da16d12499066fcd05f665c57cbb4a9be18c294971f953c482a38d1507613870 (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mon-a, io.buildah.version=1.33.7, vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, ceph=True, summary=Rocky Linux Base image, OSD_FLAVOR=default, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, version=10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10) 2026-02-13T04:06:12.333 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:06:12 trial092 podman[73437]: 2026-02-13 04:06:12.242807816 +0000 UTC m=+0.209116455 container remove da16d12499066fcd05f665c57cbb4a9be18c294971f953c482a38d1507613870 (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mon-a, CEPH_REF=wip-pdonnell-testing-20260210.171210, OSD_FLAVOR=default, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, version=10, license=BSD-3-Clause, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T04:06:12.333 INFO:journalctl@ceph.mon.a.trial092.stdout:Feb 13 04:06:12 trial092 bash[73437]: ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mon-a 2026-02-13T04:06:12.350 DEBUG:teuthology.orchestra.run.trial092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mon.a.service' 2026-02-13T04:06:12.423 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T04:06:12.423 INFO:tasks.cephadm.mon.a:Stopped mon.a 2026-02-13T04:06:12.423 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2026-02-13T04:06:12.423 DEBUG:teuthology.orchestra.run.trial099:> sudo systemctl stop ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mon.b 2026-02-13T04:06:12.720 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:06:12 trial099 systemd[1]: Stopping Ceph mon.b for 1fefccae-0890-11f1-bcc5-d404e6e7d460... 2026-02-13T04:06:12.720 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:06:12 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mon-b[27804]: 2026-02-13T04:06:12.524+0000 7fbdc1d3b6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T04:06:12.720 INFO:journalctl@ceph.mon.b.trial099.stdout:Feb 13 04:06:12 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mon-b[27804]: 2026-02-13T04:06:12.524+0000 7fbdc1d3b6c0 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2026-02-13T04:06:12.800 DEBUG:teuthology.orchestra.run.trial099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mon.b.service' 2026-02-13T04:06:12.836 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T04:06:12.837 INFO:tasks.cephadm.mon.c:Stopped mon.b 2026-02-13T04:06:12.837 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2026-02-13T04:06:12.837 DEBUG:teuthology.orchestra.run.trial158:> sudo systemctl stop ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mon.c 2026-02-13T04:06:13.063 DEBUG:teuthology.orchestra.run.trial158:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mon.c.service' 2026-02-13T04:06:13.100 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T04:06:13.100 INFO:tasks.cephadm.mon.c:Stopped mon.c 2026-02-13T04:06:13.100 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2026-02-13T04:06:13.100 DEBUG:teuthology.orchestra.run.trial092:> sudo systemctl stop ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mgr.x 2026-02-13T04:06:13.403 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 04:06:13 trial092 systemd[1]: Stopping Ceph mgr.x for 1fefccae-0890-11f1-bcc5-d404e6e7d460... 2026-02-13T04:06:13.404 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 04:06:13 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T04:06:13.279+0000 7fb2048e46c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T04:06:13.404 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 04:06:13 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x[23272]: 2026-02-13T04:06:13.279+0000 7fb2048e46c0 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2026-02-13T04:06:13.404 INFO:journalctl@ceph.mgr.x.trial092.stdout:Feb 13 04:06:13 trial092 podman[73568]: 2026-02-13 04:06:13.331973411 +0000 UTC m=+0.075294752 container died 59a2d583c8c52778cadae4e272cef3e86070e333dca177918087bdda31107eea (image=quay.ceph.io/ceph-ci/ceph:8f8d38294e4db8750b4b1649f62ce37caa63080f-rockylinux-10, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mgr-x, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, ceph=True, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.licenses=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_REF=wip-pdonnell-testing-20260210.171210, summary=Rocky Linux Base image, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, version=10, name=rockylinux, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T04:06:13.517 DEBUG:teuthology.orchestra.run.trial092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mgr.x.service' 2026-02-13T04:06:13.584 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T04:06:13.584 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2026-02-13T04:06:13.584 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2026-02-13T04:06:13.584 DEBUG:teuthology.orchestra.run.trial099:> sudo systemctl stop ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mgr.y 2026-02-13T04:06:13.798 DEBUG:teuthology.orchestra.run.trial099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mgr.y.service' 2026-02-13T04:06:13.831 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T04:06:13.832 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2026-02-13T04:06:13.832 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2026-02-13T04:06:13.832 DEBUG:teuthology.orchestra.run.trial158:> sudo systemctl stop ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mgr.z 2026-02-13T04:06:14.053 DEBUG:teuthology.orchestra.run.trial158:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mgr.z.service' 2026-02-13T04:06:14.087 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T04:06:14.087 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2026-02-13T04:06:14.087 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2026-02-13T04:06:14.087 DEBUG:teuthology.orchestra.run.trial092:> sudo systemctl stop ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@osd.0 2026-02-13T04:06:14.433 INFO:journalctl@ceph.osd.0.trial092.stdout:Feb 13 04:06:14 trial092 systemd[1]: Stopping Ceph osd.0 for 1fefccae-0890-11f1-bcc5-d404e6e7d460... 2026-02-13T04:06:14.434 INFO:journalctl@ceph.osd.0.trial092.stdout:Feb 13 04:06:14 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-0[35814]: 2026-02-13T04:06:14.265+0000 7f4b2a7f16c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T04:06:14.434 INFO:journalctl@ceph.osd.0.trial092.stdout:Feb 13 04:06:14 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-0[35814]: 2026-02-13T04:06:14.265+0000 7f4b2a7f16c0 -1 osd.0 78 *** Got signal Terminated *** 2026-02-13T04:06:14.434 INFO:journalctl@ceph.osd.0.trial092.stdout:Feb 13 04:06:14 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-0[35814]: 2026-02-13T04:06:14.265+0000 7f4b2a7f16c0 -1 osd.0 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T04:06:19.675 INFO:journalctl@ceph.osd.0.trial092.stdout:Feb 13 04:06:19 trial092 podman[73697]: 2026-02-13 04:06:19.371428919 +0000 UTC m=+5.128610607 container died c9f33a672b60f43e060ce7ce9a2785ef83b8f44961128e36e6f218c882b487e3 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-0, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.licenses=BSD-3-Clause, license=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.version=10, summary=Rocky Linux Base image, OSD_FLAVOR=default, version=10, io.buildah.version=1.33.7, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, vendor=Rocky Enterprise Software Foundation, ceph=True, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux) 2026-02-13T04:06:19.675 INFO:journalctl@ceph.osd.0.trial092.stdout:Feb 13 04:06:19 trial092 podman[73697]: 2026-02-13 04:06:19.430120708 +0000 UTC m=+5.187302396 container remove c9f33a672b60f43e060ce7ce9a2785ef83b8f44961128e36e6f218c882b487e3 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-0, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, ceph=True, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, version=10, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, io.buildah.version=1.33.7, name=rockylinux, summary=Rocky Linux Base image, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation) 2026-02-13T04:06:19.675 INFO:journalctl@ceph.osd.0.trial092.stdout:Feb 13 04:06:19 trial092 bash[73697]: ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-0 2026-02-13T04:06:19.934 INFO:journalctl@ceph.osd.0.trial092.stdout:Feb 13 04:06:19 trial092 podman[73801]: 2026-02-13 04:06:19.673117407 +0000 UTC m=+0.026179162 container create bfe78416be5ec5c84f90e4ccc177402c6574dede3dc8832eded49ff06f73d28f (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-0-deactivate, summary=Rocky Linux Base image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, ceph=True, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, license=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, version=10, org.opencontainers.image.version=10) 2026-02-13T04:06:19.934 INFO:journalctl@ceph.osd.0.trial092.stdout:Feb 13 04:06:19 trial092 podman[73801]: 2026-02-13 04:06:19.728422696 +0000 UTC m=+0.081484461 container init bfe78416be5ec5c84f90e4ccc177402c6574dede3dc8832eded49ff06f73d28f (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-0-deactivate, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, version=10, ceph=True, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.licenses=BSD-3-Clause, name=rockylinux, license=BSD-3-Clause, io.buildah.version=1.33.7, OSD_FLAVOR=default, vendor=Rocky Enterprise Software Foundation) 2026-02-13T04:06:19.934 INFO:journalctl@ceph.osd.0.trial092.stdout:Feb 13 04:06:19 trial092 podman[73801]: 2026-02-13 04:06:19.733812121 +0000 UTC m=+0.086873876 container start bfe78416be5ec5c84f90e4ccc177402c6574dede3dc8832eded49ff06f73d28f (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-0-deactivate, org.opencontainers.image.title=rockylinux, org.opencontainers.image.authors=Ceph Release Team , license=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/, name=rockylinux, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, summary=Rocky Linux Base image, OSD_FLAVOR=default, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, ceph=True) 2026-02-13T04:06:19.934 INFO:journalctl@ceph.osd.0.trial092.stdout:Feb 13 04:06:19 trial092 podman[73801]: 2026-02-13 04:06:19.734574235 +0000 UTC m=+0.087636000 container attach bfe78416be5ec5c84f90e4ccc177402c6574dede3dc8832eded49ff06f73d28f (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-0-deactivate, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.title=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, version=10, vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, OSD_FLAVOR=default, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, license=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, name=rockylinux) 2026-02-13T04:06:19.934 INFO:journalctl@ceph.osd.0.trial092.stdout:Feb 13 04:06:19 trial092 podman[73801]: 2026-02-13 04:06:19.663857674 +0000 UTC m=+0.016919439 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T04:06:19.934 INFO:journalctl@ceph.osd.0.trial092.stdout:Feb 13 04:06:19 trial092 podman[73801]: 2026-02-13 04:06:19.920748741 +0000 UTC m=+0.273810506 container died bfe78416be5ec5c84f90e4ccc177402c6574dede3dc8832eded49ff06f73d28f (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-0-deactivate, org.opencontainers.image.version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , license=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10, org.opencontainers.image.title=rockylinux, io.buildah.version=1.33.7, name=rockylinux, ceph=True, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210) 2026-02-13T04:06:20.011 DEBUG:teuthology.orchestra.run.trial092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@osd.0.service' 2026-02-13T04:06:20.082 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T04:06:20.082 INFO:tasks.cephadm.osd.0:Stopped osd.0 2026-02-13T04:06:20.082 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2026-02-13T04:06:20.082 DEBUG:teuthology.orchestra.run.trial099:> sudo systemctl stop ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@osd.1 2026-02-13T04:06:20.367 INFO:journalctl@ceph.osd.1.trial099.stdout:Feb 13 04:06:20 trial099 systemd[1]: Stopping Ceph osd.1 for 1fefccae-0890-11f1-bcc5-d404e6e7d460... 2026-02-13T04:06:20.367 INFO:journalctl@ceph.osd.1.trial099.stdout:Feb 13 04:06:20 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-1[33772]: 2026-02-13T04:06:20.176+0000 7f49c2b3c6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T04:06:20.367 INFO:journalctl@ceph.osd.1.trial099.stdout:Feb 13 04:06:20 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-1[33772]: 2026-02-13T04:06:20.176+0000 7f49c2b3c6c0 -1 osd.1 78 *** Got signal Terminated *** 2026-02-13T04:06:20.367 INFO:journalctl@ceph.osd.1.trial099.stdout:Feb 13 04:06:20 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-1[33772]: 2026-02-13T04:06:20.176+0000 7f49c2b3c6c0 -1 osd.1 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T04:06:25.564 INFO:journalctl@ceph.osd.1.trial099.stdout:Feb 13 04:06:25 trial099 podman[60043]: 2026-02-13 04:06:25.24753233 +0000 UTC m=+5.082507621 container died 0892e5535be2521fc8cdc96b42ca8d05043facee5e823718a24396a30ea6aa0e (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-1, license=BSD-3-Clause, org.opencontainers.image.version=10, summary=Rocky Linux Base image, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, io.buildah.version=1.33.7, name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, version=10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T04:06:25.565 INFO:journalctl@ceph.osd.1.trial099.stdout:Feb 13 04:06:25 trial099 podman[60043]: 2026-02-13 04:06:25.257541525 +0000 UTC m=+5.092516816 container remove 0892e5535be2521fc8cdc96b42ca8d05043facee5e823718a24396a30ea6aa0e (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-1, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, summary=Rocky Linux Base image, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, ceph=True, org.opencontainers.image.version=10, version=10, name=rockylinux, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, license=BSD-3-Clause, OSD_FLAVOR=default) 2026-02-13T04:06:25.565 INFO:journalctl@ceph.osd.1.trial099.stdout:Feb 13 04:06:25 trial099 bash[60043]: ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-1 2026-02-13T04:06:25.565 INFO:journalctl@ceph.osd.1.trial099.stdout:Feb 13 04:06:25 trial099 podman[60179]: 2026-02-13 04:06:25.392369359 +0000 UTC m=+0.016778663 container create 70943737bdd41cc02476b86f6bfe383e16cd1feb1c4d334c004501ce652a2843 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-1-deactivate, OSD_FLAVOR=default, summary=Rocky Linux Base image, io.buildah.version=1.33.7, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, license=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , ceph=True, name=rockylinux, org.opencontainers.image.title=rockylinux, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.version=10, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210) 2026-02-13T04:06:25.565 INFO:journalctl@ceph.osd.1.trial099.stdout:Feb 13 04:06:25 trial099 podman[60179]: 2026-02-13 04:06:25.425006826 +0000 UTC m=+0.049416120 container init 70943737bdd41cc02476b86f6bfe383e16cd1feb1c4d334c004501ce652a2843 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-1-deactivate, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, summary=Rocky Linux Base image, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, OSD_FLAVOR=default, name=rockylinux, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.title=rockylinux, version=10, org.opencontainers.image.licenses=BSD-3-Clause, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , ceph=True) 2026-02-13T04:06:25.565 INFO:journalctl@ceph.osd.1.trial099.stdout:Feb 13 04:06:25 trial099 podman[60179]: 2026-02-13 04:06:25.427595628 +0000 UTC m=+0.052004942 container start 70943737bdd41cc02476b86f6bfe383e16cd1feb1c4d334c004501ce652a2843 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-1-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.authors=Ceph Release Team , ceph=True, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, name=rockylinux, org.opencontainers.image.title=rockylinux, version=10, org.opencontainers.image.licenses=BSD-3-Clause, license=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, summary=Rocky Linux Base image, io.buildah.version=1.33.7, org.opencontainers.image.version=10) 2026-02-13T04:06:25.565 INFO:journalctl@ceph.osd.1.trial099.stdout:Feb 13 04:06:25 trial099 podman[60179]: 2026-02-13 04:06:25.428089414 +0000 UTC m=+0.052498718 container attach 70943737bdd41cc02476b86f6bfe383e16cd1feb1c4d334c004501ce652a2843 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-1-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, OSD_FLAVOR=default, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, summary=Rocky Linux Base image, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, license=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, version=10, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-pdonnell-testing-20260210.171210, name=rockylinux, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-13T04:06:25.565 INFO:journalctl@ceph.osd.1.trial099.stdout:Feb 13 04:06:25 trial099 podman[60179]: 2026-02-13 04:06:25.38540416 +0000 UTC m=+0.009813474 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T04:06:25.625 DEBUG:teuthology.orchestra.run.trial099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@osd.1.service' 2026-02-13T04:06:25.663 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T04:06:25.663 INFO:tasks.cephadm.osd.1:Stopped osd.1 2026-02-13T04:06:25.663 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2026-02-13T04:06:25.663 DEBUG:teuthology.orchestra.run.trial158:> sudo systemctl stop ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@osd.2 2026-02-13T04:06:26.079 INFO:journalctl@ceph.osd.2.trial158.stdout:Feb 13 04:06:25 trial158 systemd[1]: Stopping Ceph osd.2 for 1fefccae-0890-11f1-bcc5-d404e6e7d460... 2026-02-13T04:06:26.079 INFO:journalctl@ceph.osd.2.trial158.stdout:Feb 13 04:06:25 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-2[33876]: 2026-02-13T04:06:25.768+0000 7f90f9d406c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T04:06:26.079 INFO:journalctl@ceph.osd.2.trial158.stdout:Feb 13 04:06:25 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-2[33876]: 2026-02-13T04:06:25.768+0000 7f90f9d406c0 -1 osd.2 78 *** Got signal Terminated *** 2026-02-13T04:06:26.079 INFO:journalctl@ceph.osd.2.trial158.stdout:Feb 13 04:06:25 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-2[33876]: 2026-02-13T04:06:25.768+0000 7f90f9d406c0 -1 osd.2 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T04:06:31.153 INFO:journalctl@ceph.osd.2.trial158.stdout:Feb 13 04:06:30 trial158 podman[62170]: 2026-02-13 04:06:30.847929414 +0000 UTC m=+5.092071617 container died 9194a8cd74d4391301d270397abcdb4f2fb25c021fb78eee605d6f632b9ab06f (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-2, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, OSD_FLAVOR=default, name=rockylinux, ceph=True, vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, license=BSD-3-Clause, summary=Rocky Linux Base image, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f) 2026-02-13T04:06:31.153 INFO:journalctl@ceph.osd.2.trial158.stdout:Feb 13 04:06:30 trial158 podman[62170]: 2026-02-13 04:06:30.858247868 +0000 UTC m=+5.102390071 container remove 9194a8cd74d4391301d270397abcdb4f2fb25c021fb78eee605d6f632b9ab06f (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-2, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.title=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, summary=Rocky Linux Base image, license=BSD-3-Clause, org.opencontainers.image.version=10, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, name=rockylinux, version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, io.buildah.version=1.33.7) 2026-02-13T04:06:31.153 INFO:journalctl@ceph.osd.2.trial158.stdout:Feb 13 04:06:30 trial158 bash[62170]: ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-2 2026-02-13T04:06:31.153 INFO:journalctl@ceph.osd.2.trial158.stdout:Feb 13 04:06:30 trial158 podman[62302]: 2026-02-13 04:06:30.988534594 +0000 UTC m=+0.016766085 container create 5a98f1743f86cd611c1d7ba0a9df77261de99aa0bb113fc219539b764ae2805c (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-2-deactivate, name=rockylinux, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.title=rockylinux, version=10, vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T04:06:31.153 INFO:journalctl@ceph.osd.2.trial158.stdout:Feb 13 04:06:31 trial158 podman[62302]: 2026-02-13 04:06:31.018439295 +0000 UTC m=+0.046670736 container init 5a98f1743f86cd611c1d7ba0a9df77261de99aa0bb113fc219539b764ae2805c (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-2-deactivate, vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, summary=Rocky Linux Base image, CEPH_REF=wip-pdonnell-testing-20260210.171210, name=rockylinux, org.opencontainers.image.title=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, ceph=True, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-13T04:06:31.153 INFO:journalctl@ceph.osd.2.trial158.stdout:Feb 13 04:06:31 trial158 podman[62302]: 2026-02-13 04:06:31.021043162 +0000 UTC m=+0.049274603 container start 5a98f1743f86cd611c1d7ba0a9df77261de99aa0bb113fc219539b764ae2805c (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-2-deactivate, version=10, OSD_FLAVOR=default, ceph=True, summary=Rocky Linux Base image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.licenses=BSD-3-Clause, name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-13T04:06:31.153 INFO:journalctl@ceph.osd.2.trial158.stdout:Feb 13 04:06:31 trial158 podman[62302]: 2026-02-13 04:06:31.021524395 +0000 UTC m=+0.049755836 container attach 5a98f1743f86cd611c1d7ba0a9df77261de99aa0bb113fc219539b764ae2805c (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-2-deactivate, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-pdonnell-testing-20260210.171210, io.buildah.version=1.33.7, org.opencontainers.image.licenses=BSD-3-Clause, name=rockylinux, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.title=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, summary=Rocky Linux Base image, license=BSD-3-Clause, version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, vendor=Rocky Enterprise Software Foundation) 2026-02-13T04:06:31.153 INFO:journalctl@ceph.osd.2.trial158.stdout:Feb 13 04:06:31 trial158 podman[62302]: 2026-02-13 04:06:30.981929088 +0000 UTC m=+0.010160529 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T04:06:31.185 DEBUG:teuthology.orchestra.run.trial158:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@osd.2.service' 2026-02-13T04:06:31.220 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T04:06:31.220 INFO:tasks.cephadm.osd.2:Stopped osd.2 2026-02-13T04:06:31.220 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2026-02-13T04:06:31.220 DEBUG:teuthology.orchestra.run.trial092:> sudo systemctl stop ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@osd.3 2026-02-13T04:06:31.683 INFO:journalctl@ceph.osd.3.trial092.stdout:Feb 13 04:06:31 trial092 systemd[1]: Stopping Ceph osd.3 for 1fefccae-0890-11f1-bcc5-d404e6e7d460... 2026-02-13T04:06:31.683 INFO:journalctl@ceph.osd.3.trial092.stdout:Feb 13 04:06:31 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-3[41445]: 2026-02-13T04:06:31.404+0000 7f187b7576c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T04:06:31.683 INFO:journalctl@ceph.osd.3.trial092.stdout:Feb 13 04:06:31 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-3[41445]: 2026-02-13T04:06:31.404+0000 7f187b7576c0 -1 osd.3 78 *** Got signal Terminated *** 2026-02-13T04:06:31.683 INFO:journalctl@ceph.osd.3.trial092.stdout:Feb 13 04:06:31 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-3[41445]: 2026-02-13T04:06:31.404+0000 7f187b7576c0 -1 osd.3 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T04:06:36.819 INFO:journalctl@ceph.osd.3.trial092.stdout:Feb 13 04:06:36 trial092 podman[73919]: 2026-02-13 04:06:36.520352906 +0000 UTC m=+5.138846208 container died d10056d496ee7a657f5331ae7694862cb3be69d959c54bb9611f643ca0d0a695 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-3, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, name=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.title=rockylinux, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, io.buildah.version=1.33.7, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-13T04:06:36.819 INFO:journalctl@ceph.osd.3.trial092.stdout:Feb 13 04:06:36 trial092 podman[73919]: 2026-02-13 04:06:36.579265034 +0000 UTC m=+5.197758326 container remove d10056d496ee7a657f5331ae7694862cb3be69d959c54bb9611f643ca0d0a695 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-3, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, license=BSD-3-Clause, org.opencontainers.image.version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.authors=Ceph Release Team , FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, ceph=True, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, name=rockylinux, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux) 2026-02-13T04:06:36.819 INFO:journalctl@ceph.osd.3.trial092.stdout:Feb 13 04:06:36 trial092 bash[73919]: ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-3 2026-02-13T04:06:37.076 INFO:journalctl@ceph.osd.3.trial092.stdout:Feb 13 04:06:36 trial092 podman[74026]: 2026-02-13 04:06:36.818010098 +0000 UTC m=+0.027294431 container create e72c5efde75120a2aa9cfdfc76c92b6de66ed379c073c32ea81647cb663eb34c (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-3-deactivate, ceph=True, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, version=10, io.buildah.version=1.33.7, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, OSD_FLAVOR=default, summary=Rocky Linux Base image) 2026-02-13T04:06:37.076 INFO:journalctl@ceph.osd.3.trial092.stdout:Feb 13 04:06:36 trial092 podman[74026]: 2026-02-13 04:06:36.869729756 +0000 UTC m=+0.079014079 container init e72c5efde75120a2aa9cfdfc76c92b6de66ed379c073c32ea81647cb663eb34c (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-3-deactivate, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, OSD_FLAVOR=default, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, version=10, org.opencontainers.image.title=rockylinux, io.buildah.version=1.33.7, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, license=BSD-3-Clause, org.opencontainers.image.version=10, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T04:06:37.076 INFO:journalctl@ceph.osd.3.trial092.stdout:Feb 13 04:06:36 trial092 podman[74026]: 2026-02-13 04:06:36.875062466 +0000 UTC m=+0.084346799 container start e72c5efde75120a2aa9cfdfc76c92b6de66ed379c073c32ea81647cb663eb34c (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-3-deactivate, name=rockylinux, license=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7, OSD_FLAVOR=default, org.opencontainers.image.version=10, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, vendor=Rocky Enterprise Software Foundation) 2026-02-13T04:06:37.076 INFO:journalctl@ceph.osd.3.trial092.stdout:Feb 13 04:06:36 trial092 podman[74026]: 2026-02-13 04:06:36.876015233 +0000 UTC m=+0.085299587 container attach e72c5efde75120a2aa9cfdfc76c92b6de66ed379c073c32ea81647cb663eb34c (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-3-deactivate, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_REF=wip-pdonnell-testing-20260210.171210, io.buildah.version=1.33.7, OSD_FLAVOR=default, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.title=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, summary=Rocky Linux Base image, ceph=True, name=rockylinux, version=10) 2026-02-13T04:06:37.076 INFO:journalctl@ceph.osd.3.trial092.stdout:Feb 13 04:06:36 trial092 podman[74026]: 2026-02-13 04:06:36.808069482 +0000 UTC m=+0.017353815 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T04:06:37.076 INFO:journalctl@ceph.osd.3.trial092.stdout:Feb 13 04:06:37 trial092 podman[74026]: 2026-02-13 04:06:37.061695323 +0000 UTC m=+0.270979656 container died e72c5efde75120a2aa9cfdfc76c92b6de66ed379c073c32ea81647cb663eb34c (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-3-deactivate, OSD_FLAVOR=default, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, name=rockylinux, license=BSD-3-Clause, ceph=True, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.title=rockylinux, io.buildah.version=1.33.7, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation) 2026-02-13T04:06:37.151 DEBUG:teuthology.orchestra.run.trial092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@osd.3.service' 2026-02-13T04:06:37.221 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T04:06:37.221 INFO:tasks.cephadm.osd.3:Stopped osd.3 2026-02-13T04:06:37.221 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2026-02-13T04:06:37.221 DEBUG:teuthology.orchestra.run.trial099:> sudo systemctl stop ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@osd.4 2026-02-13T04:06:37.616 INFO:journalctl@ceph.osd.4.trial099.stdout:Feb 13 04:06:37 trial099 systemd[1]: Stopping Ceph osd.4 for 1fefccae-0890-11f1-bcc5-d404e6e7d460... 2026-02-13T04:06:37.616 INFO:journalctl@ceph.osd.4.trial099.stdout:Feb 13 04:06:37 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-4[40210]: 2026-02-13T04:06:37.319+0000 7f9e2a5056c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T04:06:37.616 INFO:journalctl@ceph.osd.4.trial099.stdout:Feb 13 04:06:37 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-4[40210]: 2026-02-13T04:06:37.319+0000 7f9e2a5056c0 -1 osd.4 78 *** Got signal Terminated *** 2026-02-13T04:06:37.616 INFO:journalctl@ceph.osd.4.trial099.stdout:Feb 13 04:06:37 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-4[40210]: 2026-02-13T04:06:37.319+0000 7f9e2a5056c0 -1 osd.4 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T04:06:40.328 INFO:journalctl@ceph.osd.5.trial158.stdout:Feb 13 04:06:40 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-5[40185]: 2026-02-13T04:06:40.005+0000 7f22a8c716c0 -1 osd.5 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.059842+0000 front 2026-02-13T04:06:15.059695+0000 (oldest deadline 2026-02-13T04:06:39.759671+0000) 2026-02-13T04:06:41.328 INFO:journalctl@ceph.osd.5.trial158.stdout:Feb 13 04:06:41 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-5[40185]: 2026-02-13T04:06:41.036+0000 7f22a8c716c0 -1 osd.5 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.059842+0000 front 2026-02-13T04:06:15.059695+0000 (oldest deadline 2026-02-13T04:06:39.759671+0000) 2026-02-13T04:06:41.433 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:06:41 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:06:41.064+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.868796+0000 front 2026-02-13T04:06:16.868651+0000 (oldest deadline 2026-02-13T04:06:40.968550+0000) 2026-02-13T04:06:42.113 INFO:journalctl@ceph.osd.6.trial092.stdout:Feb 13 04:06:41 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-6[47366]: 2026-02-13T04:06:41.703+0000 7f8474d0c6c0 -1 osd.6 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.542154+0000 front 2026-02-13T04:06:15.542266+0000 (oldest deadline 2026-02-13T04:06:41.442258+0000) 2026-02-13T04:06:42.328 INFO:journalctl@ceph.osd.5.trial158.stdout:Feb 13 04:06:42 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-5[40185]: 2026-02-13T04:06:42.005+0000 7f22a8c716c0 -1 osd.5 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.059842+0000 front 2026-02-13T04:06:15.059695+0000 (oldest deadline 2026-02-13T04:06:39.759671+0000) 2026-02-13T04:06:42.328 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:06:41 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:06:41.966+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.285288+0000 front 2026-02-13T04:06:16.285227+0000 (oldest deadline 2026-02-13T04:06:40.985214+0000) 2026-02-13T04:06:42.433 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:06:42 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:06:42.111+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.868796+0000 front 2026-02-13T04:06:16.868651+0000 (oldest deadline 2026-02-13T04:06:40.968550+0000) 2026-02-13T04:06:42.692 INFO:journalctl@ceph.osd.4.trial099.stdout:Feb 13 04:06:42 trial099 podman[60321]: 2026-02-13 04:06:42.38758244 +0000 UTC m=+5.081912972 container died 469fe54152d96b22c326ae7a7e4b768826108162e34abb83223a782b1e0f38a2 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-4, ceph=True, name=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, io.buildah.version=1.33.7, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_REF=wip-pdonnell-testing-20260210.171210, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.title=rockylinux, OSD_FLAVOR=default, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-13T04:06:42.692 INFO:journalctl@ceph.osd.4.trial099.stdout:Feb 13 04:06:42 trial099 podman[60321]: 2026-02-13 04:06:42.395753105 +0000 UTC m=+5.090083647 container remove 469fe54152d96b22c326ae7a7e4b768826108162e34abb83223a782b1e0f38a2 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-4, OSD_FLAVOR=default, version=10, name=rockylinux, org.opencontainers.image.authors=Ceph Release Team , license=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, summary=Rocky Linux Base image, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, io.buildah.version=1.33.7) 2026-02-13T04:06:42.692 INFO:journalctl@ceph.osd.4.trial099.stdout:Feb 13 04:06:42 trial099 bash[60321]: ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-4 2026-02-13T04:06:42.692 INFO:journalctl@ceph.osd.4.trial099.stdout:Feb 13 04:06:42 trial099 podman[60456]: 2026-02-13 04:06:42.523717007 +0000 UTC m=+0.015683872 container create 42f3a5f895e36ba06d1a4c70a5ca972c53437dcf7f9d555598d9ce355b60c5db (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-4-deactivate, OSD_FLAVOR=default, version=10, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.authors=Ceph Release Team , ceph=True, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-13T04:06:42.692 INFO:journalctl@ceph.osd.4.trial099.stdout:Feb 13 04:06:42 trial099 podman[60456]: 2026-02-13 04:06:42.556599147 +0000 UTC m=+0.048566013 container init 42f3a5f895e36ba06d1a4c70a5ca972c53437dcf7f9d555598d9ce355b60c5db (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-4-deactivate, OSD_FLAVOR=default, license=BSD-3-Clause, version=10, org.opencontainers.image.version=10, ceph=True, org.opencontainers.image.title=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.licenses=BSD-3-Clause, io.buildah.version=1.33.7, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, summary=Rocky Linux Base image, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, name=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210) 2026-02-13T04:06:42.692 INFO:journalctl@ceph.osd.4.trial099.stdout:Feb 13 04:06:42 trial099 podman[60456]: 2026-02-13 04:06:42.558902891 +0000 UTC m=+0.050869756 container start 42f3a5f895e36ba06d1a4c70a5ca972c53437dcf7f9d555598d9ce355b60c5db (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-4-deactivate, version=10, name=rockylinux, ceph=True, summary=Rocky Linux Base image, org.opencontainers.image.licenses=BSD-3-Clause, license=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, io.buildah.version=1.33.7, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T04:06:42.692 INFO:journalctl@ceph.osd.4.trial099.stdout:Feb 13 04:06:42 trial099 podman[60456]: 2026-02-13 04:06:42.559368114 +0000 UTC m=+0.051334989 container attach 42f3a5f895e36ba06d1a4c70a5ca972c53437dcf7f9d555598d9ce355b60c5db (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-4-deactivate, org.opencontainers.image.version=10, ceph=True, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, summary=Rocky Linux Base image, OSD_FLAVOR=default, license=BSD-3-Clause, name=rockylinux, org.opencontainers.image.authors=Ceph Release Team , vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.licenses=BSD-3-Clause, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-13T04:06:42.692 INFO:journalctl@ceph.osd.4.trial099.stdout:Feb 13 04:06:42 trial099 podman[60456]: 2026-02-13 04:06:42.517122315 +0000 UTC m=+0.009089190 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T04:06:42.692 INFO:journalctl@ceph.osd.4.trial099.stdout:Feb 13 04:06:42 trial099 podman[60456]: 2026-02-13 04:06:42.689855907 +0000 UTC m=+0.181822762 container died 42f3a5f895e36ba06d1a4c70a5ca972c53437dcf7f9d555598d9ce355b60c5db (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-4-deactivate, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.licenses=BSD-3-Clause, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, OSD_FLAVOR=default, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210, name=rockylinux, org.opencontainers.image.authors=Ceph Release Team , vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, ceph=True, summary=Rocky Linux Base image) 2026-02-13T04:06:42.719 DEBUG:teuthology.orchestra.run.trial099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@osd.4.service' 2026-02-13T04:06:42.754 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T04:06:42.755 INFO:tasks.cephadm.osd.4:Stopped osd.4 2026-02-13T04:06:42.755 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2026-02-13T04:06:42.755 DEBUG:teuthology.orchestra.run.trial158:> sudo systemctl stop ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@osd.5 2026-02-13T04:06:43.078 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:06:43 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:06:43.003+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.285288+0000 front 2026-02-13T04:06:16.285227+0000 (oldest deadline 2026-02-13T04:06:40.985214+0000) 2026-02-13T04:06:43.078 INFO:journalctl@ceph.osd.5.trial158.stdout:Feb 13 04:06:42 trial158 systemd[1]: Stopping Ceph osd.5 for 1fefccae-0890-11f1-bcc5-d404e6e7d460... 2026-02-13T04:06:43.078 INFO:journalctl@ceph.osd.5.trial158.stdout:Feb 13 04:06:42 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-5[40185]: 2026-02-13T04:06:42.851+0000 7f22ac5ac6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T04:06:43.078 INFO:journalctl@ceph.osd.5.trial158.stdout:Feb 13 04:06:42 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-5[40185]: 2026-02-13T04:06:42.851+0000 7f22ac5ac6c0 -1 osd.5 78 *** Got signal Terminated *** 2026-02-13T04:06:43.078 INFO:journalctl@ceph.osd.5.trial158.stdout:Feb 13 04:06:42 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-5[40185]: 2026-02-13T04:06:42.851+0000 7f22ac5ac6c0 -1 osd.5 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T04:06:43.079 INFO:journalctl@ceph.osd.5.trial158.stdout:Feb 13 04:06:42 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-5[40185]: 2026-02-13T04:06:42.983+0000 7f22a8c716c0 -1 osd.5 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.059842+0000 front 2026-02-13T04:06:15.059695+0000 (oldest deadline 2026-02-13T04:06:39.759671+0000) 2026-02-13T04:06:43.079 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:06:42 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:06:42.898+0000 7f8d3a08d6c0 -1 osd.8 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:17.412616+0000 front 2026-02-13T04:06:17.412803+0000 (oldest deadline 2026-02-13T04:06:42.712632+0000) 2026-02-13T04:06:43.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:42 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:42.844+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.945152+0000 front 2026-02-13T04:06:15.945228+0000 (oldest deadline 2026-02-13T04:06:41.845216+0000) 2026-02-13T04:06:43.149 INFO:journalctl@ceph.osd.6.trial092.stdout:Feb 13 04:06:42 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-6[47366]: 2026-02-13T04:06:42.738+0000 7f8474d0c6c0 -1 osd.6 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.542154+0000 front 2026-02-13T04:06:15.542266+0000 (oldest deadline 2026-02-13T04:06:41.442258+0000) 2026-02-13T04:06:43.433 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:06:43 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:06:43.147+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.868796+0000 front 2026-02-13T04:06:16.868651+0000 (oldest deadline 2026-02-13T04:06:40.968550+0000) 2026-02-13T04:06:44.117 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:43 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:43.837+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.945152+0000 front 2026-02-13T04:06:15.945228+0000 (oldest deadline 2026-02-13T04:06:41.845216+0000) 2026-02-13T04:06:44.151 INFO:journalctl@ceph.osd.6.trial092.stdout:Feb 13 04:06:43 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-6[47366]: 2026-02-13T04:06:43.787+0000 7f8474d0c6c0 -1 osd.6 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.542154+0000 front 2026-02-13T04:06:15.542266+0000 (oldest deadline 2026-02-13T04:06:41.442258+0000) 2026-02-13T04:06:44.329 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:06:43 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:06:43.977+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.285288+0000 front 2026-02-13T04:06:16.285227+0000 (oldest deadline 2026-02-13T04:06:40.985214+0000) 2026-02-13T04:06:44.329 INFO:journalctl@ceph.osd.5.trial158.stdout:Feb 13 04:06:43 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-5[40185]: 2026-02-13T04:06:43.976+0000 7f22a8c716c0 -1 osd.5 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.059842+0000 front 2026-02-13T04:06:15.059695+0000 (oldest deadline 2026-02-13T04:06:39.759671+0000) 2026-02-13T04:06:44.329 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:06:43 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:06:43.948+0000 7f8d3a08d6c0 -1 osd.8 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:17.412616+0000 front 2026-02-13T04:06:17.412803+0000 (oldest deadline 2026-02-13T04:06:42.712632+0000) 2026-02-13T04:06:44.433 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:06:44 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:06:44.149+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.868796+0000 front 2026-02-13T04:06:16.868651+0000 (oldest deadline 2026-02-13T04:06:40.968550+0000) 2026-02-13T04:06:45.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:44 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:44.829+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.945152+0000 front 2026-02-13T04:06:15.945228+0000 (oldest deadline 2026-02-13T04:06:41.845216+0000) 2026-02-13T04:06:45.183 INFO:journalctl@ceph.osd.6.trial092.stdout:Feb 13 04:06:44 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-6[47366]: 2026-02-13T04:06:44.826+0000 7f8474d0c6c0 -1 osd.6 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.542154+0000 front 2026-02-13T04:06:15.542266+0000 (oldest deadline 2026-02-13T04:06:41.442258+0000) 2026-02-13T04:06:45.329 INFO:journalctl@ceph.osd.5.trial158.stdout:Feb 13 04:06:44 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-5[40185]: 2026-02-13T04:06:44.970+0000 7f22a8c716c0 -1 osd.5 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.059842+0000 front 2026-02-13T04:06:15.059695+0000 (oldest deadline 2026-02-13T04:06:39.759671+0000) 2026-02-13T04:06:45.329 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:06:44 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:06:44.975+0000 7f8d3a08d6c0 -1 osd.8 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:17.412616+0000 front 2026-02-13T04:06:17.412803+0000 (oldest deadline 2026-02-13T04:06:42.712632+0000) 2026-02-13T04:06:45.329 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:06:44 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:06:44.945+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.285288+0000 front 2026-02-13T04:06:16.285227+0000 (oldest deadline 2026-02-13T04:06:40.985214+0000) 2026-02-13T04:06:45.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:06:45 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:06:45.187+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.868796+0000 front 2026-02-13T04:06:16.868651+0000 (oldest deadline 2026-02-13T04:06:40.968550+0000) 2026-02-13T04:06:46.117 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:45 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:45.802+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.945152+0000 front 2026-02-13T04:06:15.945228+0000 (oldest deadline 2026-02-13T04:06:41.845216+0000) 2026-02-13T04:06:46.117 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:45 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:45.802+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:21.845442+0000 front 2026-02-13T04:06:21.845538+0000 (oldest deadline 2026-02-13T04:06:45.345507+0000) 2026-02-13T04:06:46.117 INFO:journalctl@ceph.osd.7.trial099.stdout:Feb 13 04:06:46 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-7[46494]: 2026-02-13T04:06:46.040+0000 7fb90dd626c0 -1 osd.7 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:19.634175+0000 front 2026-02-13T04:06:19.634185+0000 (oldest deadline 2026-02-13T04:06:45.534339+0000) 2026-02-13T04:06:46.183 INFO:journalctl@ceph.osd.6.trial092.stdout:Feb 13 04:06:45 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-6[47366]: 2026-02-13T04:06:45.846+0000 7f8474d0c6c0 -1 osd.6 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.542154+0000 front 2026-02-13T04:06:15.542266+0000 (oldest deadline 2026-02-13T04:06:41.442258+0000) 2026-02-13T04:06:46.328 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:06:45 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:06:45.998+0000 7f8d3a08d6c0 -1 osd.8 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:17.412616+0000 front 2026-02-13T04:06:17.412803+0000 (oldest deadline 2026-02-13T04:06:42.712632+0000) 2026-02-13T04:06:46.328 INFO:journalctl@ceph.osd.5.trial158.stdout:Feb 13 04:06:46 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-5[40185]: 2026-02-13T04:06:46.000+0000 7f22a8c716c0 -1 osd.5 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.059842+0000 front 2026-02-13T04:06:15.059695+0000 (oldest deadline 2026-02-13T04:06:39.759671+0000) 2026-02-13T04:06:46.328 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:06:45 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:06:45.908+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.285288+0000 front 2026-02-13T04:06:16.285227+0000 (oldest deadline 2026-02-13T04:06:40.985214+0000) 2026-02-13T04:06:46.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:06:46 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:06:46.181+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.868796+0000 front 2026-02-13T04:06:16.868651+0000 (oldest deadline 2026-02-13T04:06:40.968550+0000) 2026-02-13T04:06:47.116 INFO:journalctl@ceph.osd.7.trial099.stdout:Feb 13 04:06:47 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-7[46494]: 2026-02-13T04:06:47.083+0000 7fb90dd626c0 -1 osd.7 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:19.634175+0000 front 2026-02-13T04:06:19.634185+0000 (oldest deadline 2026-02-13T04:06:45.534339+0000) 2026-02-13T04:06:47.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:46 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:46.847+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.945152+0000 front 2026-02-13T04:06:15.945228+0000 (oldest deadline 2026-02-13T04:06:41.845216+0000) 2026-02-13T04:06:47.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:46 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:46.847+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:21.845442+0000 front 2026-02-13T04:06:21.845538+0000 (oldest deadline 2026-02-13T04:06:45.345507+0000) 2026-02-13T04:06:47.183 INFO:journalctl@ceph.osd.6.trial092.stdout:Feb 13 04:06:46 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-6[47366]: 2026-02-13T04:06:46.842+0000 7f8474d0c6c0 -1 osd.6 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.542154+0000 front 2026-02-13T04:06:15.542266+0000 (oldest deadline 2026-02-13T04:06:41.442258+0000) 2026-02-13T04:06:47.183 INFO:journalctl@ceph.osd.6.trial092.stdout:Feb 13 04:06:46 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-6[47366]: 2026-02-13T04:06:46.842+0000 7f8474d0c6c0 -1 osd.6 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:24.343082+0000 front 2026-02-13T04:06:24.342805+0000 (oldest deadline 2026-02-13T04:06:46.042793+0000) 2026-02-13T04:06:47.328 INFO:journalctl@ceph.osd.5.trial158.stdout:Feb 13 04:06:46 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-5[40185]: 2026-02-13T04:06:46.998+0000 7f22a8c716c0 -1 osd.5 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.059842+0000 front 2026-02-13T04:06:15.059695+0000 (oldest deadline 2026-02-13T04:06:39.759671+0000) 2026-02-13T04:06:47.328 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:06:46 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:06:46.992+0000 7f8d3a08d6c0 -1 osd.8 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:17.412616+0000 front 2026-02-13T04:06:17.412803+0000 (oldest deadline 2026-02-13T04:06:42.712632+0000) 2026-02-13T04:06:47.328 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:06:46 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:06:46.958+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.285288+0000 front 2026-02-13T04:06:16.285227+0000 (oldest deadline 2026-02-13T04:06:40.985214+0000) 2026-02-13T04:06:47.328 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:06:46 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:06:46.958+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:25.085589+0000 front 2026-02-13T04:06:25.085811+0000 (oldest deadline 2026-02-13T04:06:46.785653+0000) 2026-02-13T04:06:47.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:06:47 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:06:47.213+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.868796+0000 front 2026-02-13T04:06:16.868651+0000 (oldest deadline 2026-02-13T04:06:40.968550+0000) 2026-02-13T04:06:47.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:06:47 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:06:47.213+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:20.968894+0000 front 2026-02-13T04:06:20.968792+0000 (oldest deadline 2026-02-13T04:06:46.868811+0000) 2026-02-13T04:06:48.104 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:47 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:47.800+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.945152+0000 front 2026-02-13T04:06:15.945228+0000 (oldest deadline 2026-02-13T04:06:41.845216+0000) 2026-02-13T04:06:48.104 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:47 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:47.800+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:21.845442+0000 front 2026-02-13T04:06:21.845538+0000 (oldest deadline 2026-02-13T04:06:45.345507+0000) 2026-02-13T04:06:48.183 INFO:journalctl@ceph.osd.6.trial092.stdout:Feb 13 04:06:47 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-6[47366]: 2026-02-13T04:06:47.888+0000 7f8474d0c6c0 -1 osd.6 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.542154+0000 front 2026-02-13T04:06:15.542266+0000 (oldest deadline 2026-02-13T04:06:41.442258+0000) 2026-02-13T04:06:48.183 INFO:journalctl@ceph.osd.6.trial092.stdout:Feb 13 04:06:47 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-6[47366]: 2026-02-13T04:06:47.888+0000 7f8474d0c6c0 -1 osd.6 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:24.343082+0000 front 2026-02-13T04:06:24.342805+0000 (oldest deadline 2026-02-13T04:06:46.042793+0000) 2026-02-13T04:06:48.214 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:06:48 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:06:48.021+0000 7f8d3a08d6c0 -1 osd.8 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:17.412616+0000 front 2026-02-13T04:06:17.412803+0000 (oldest deadline 2026-02-13T04:06:42.712632+0000) 2026-02-13T04:06:48.214 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:06:47 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:06:47.976+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.285288+0000 front 2026-02-13T04:06:16.285227+0000 (oldest deadline 2026-02-13T04:06:40.985214+0000) 2026-02-13T04:06:48.214 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:06:47 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:06:47.976+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:25.085589+0000 front 2026-02-13T04:06:25.085811+0000 (oldest deadline 2026-02-13T04:06:46.785653+0000) 2026-02-13T04:06:48.214 INFO:journalctl@ceph.osd.5.trial158.stdout:Feb 13 04:06:47 trial158 podman[62444]: 2026-02-13 04:06:47.921295806 +0000 UTC m=+5.081606054 container died 0671f28bd3931c2d580fc7afc09d1f33013ca19db1ba11415504b798541ff15a (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-5, ceph=True, org.opencontainers.image.title=rockylinux, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, version=10, license=BSD-3-Clause, name=rockylinux, org.opencontainers.image.version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, summary=Rocky Linux Base image, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-13T04:06:48.214 INFO:journalctl@ceph.osd.5.trial158.stdout:Feb 13 04:06:47 trial158 podman[62444]: 2026-02-13 04:06:47.930027854 +0000 UTC m=+5.090338091 container remove 0671f28bd3931c2d580fc7afc09d1f33013ca19db1ba11415504b798541ff15a (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-5, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.version=10, io.buildah.version=1.33.7, name=rockylinux, summary=Rocky Linux Base image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, ceph=True, vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T04:06:48.214 INFO:journalctl@ceph.osd.5.trial158.stdout:Feb 13 04:06:47 trial158 bash[62444]: ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-5 2026-02-13T04:06:48.214 INFO:journalctl@ceph.osd.5.trial158.stdout:Feb 13 04:06:48 trial158 podman[62579]: 2026-02-13 04:06:48.061187568 +0000 UTC m=+0.015411483 container create 469fcd80a0c8b8f03f7bfedf61a5b69fa73f38c3efe81395da3f2e4664b48b95 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-5-deactivate, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.title=rockylinux, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux, summary=Rocky Linux Base image, license=BSD-3-Clause, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, CEPH_REF=wip-pdonnell-testing-20260210.171210, io.buildah.version=1.33.7, org.opencontainers.image.licenses=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-13T04:06:48.214 INFO:journalctl@ceph.osd.5.trial158.stdout:Feb 13 04:06:48 trial158 podman[62579]: 2026-02-13 04:06:48.090412544 +0000 UTC m=+0.044636469 container init 469fcd80a0c8b8f03f7bfedf61a5b69fa73f38c3efe81395da3f2e4664b48b95 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-5-deactivate, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , ceph=True, io.buildah.version=1.33.7, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, org.opencontainers.image.version=10, license=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, org.opencontainers.image.title=rockylinux, OSD_FLAVOR=default) 2026-02-13T04:06:48.214 INFO:journalctl@ceph.osd.5.trial158.stdout:Feb 13 04:06:48 trial158 podman[62579]: 2026-02-13 04:06:48.093127239 +0000 UTC m=+0.047351164 container start 469fcd80a0c8b8f03f7bfedf61a5b69fa73f38c3efe81395da3f2e4664b48b95 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-5-deactivate, org.opencontainers.image.documentation=https://docs.ceph.com/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, io.buildah.version=1.33.7, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, name=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.title=rockylinux, version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, org.opencontainers.image.version=10, license=BSD-3-Clause, OSD_FLAVOR=default, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation) 2026-02-13T04:06:48.214 INFO:journalctl@ceph.osd.5.trial158.stdout:Feb 13 04:06:48 trial158 podman[62579]: 2026-02-13 04:06:48.094022589 +0000 UTC m=+0.048246514 container attach 469fcd80a0c8b8f03f7bfedf61a5b69fa73f38c3efe81395da3f2e4664b48b95 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-5-deactivate, org.opencontainers.image.authors=Ceph Release Team , license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, name=rockylinux, summary=Rocky Linux Base image, version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, OSD_FLAVOR=default, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-13T04:06:48.214 INFO:journalctl@ceph.osd.5.trial158.stdout:Feb 13 04:06:48 trial158 podman[62579]: 2026-02-13 04:06:48.054677641 +0000 UTC m=+0.008901556 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T04:06:48.214 INFO:journalctl@ceph.osd.5.trial158.stdout:Feb 13 04:06:48 trial158 podman[62579]: 2026-02-13 04:06:48.213456488 +0000 UTC m=+0.167680413 container died 469fcd80a0c8b8f03f7bfedf61a5b69fa73f38c3efe81395da3f2e4664b48b95 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-5-deactivate, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.opencontainers.image.licenses=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , version=10, name=rockylinux, io.buildah.version=1.33.7, summary=Rocky Linux Base image, license=BSD-3-Clause, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, ceph=True, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux) 2026-02-13T04:06:48.247 DEBUG:teuthology.orchestra.run.trial158:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@osd.5.service' 2026-02-13T04:06:48.284 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T04:06:48.284 INFO:tasks.cephadm.osd.5:Stopped osd.5 2026-02-13T04:06:48.284 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2026-02-13T04:06:48.284 DEBUG:teuthology.orchestra.run.trial092:> sudo systemctl stop ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@osd.6 2026-02-13T04:06:48.366 INFO:journalctl@ceph.osd.7.trial099.stdout:Feb 13 04:06:48 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-7[46494]: 2026-02-13T04:06:48.101+0000 7fb90dd626c0 -1 osd.7 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:19.634175+0000 front 2026-02-13T04:06:19.634185+0000 (oldest deadline 2026-02-13T04:06:45.534339+0000) 2026-02-13T04:06:48.473 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:06:48 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:06:48.217+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.868796+0000 front 2026-02-13T04:06:16.868651+0000 (oldest deadline 2026-02-13T04:06:40.968550+0000) 2026-02-13T04:06:48.473 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:06:48 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:06:48.217+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:20.968894+0000 front 2026-02-13T04:06:20.968792+0000 (oldest deadline 2026-02-13T04:06:46.868811+0000) 2026-02-13T04:06:48.473 INFO:journalctl@ceph.osd.6.trial092.stdout:Feb 13 04:06:48 trial092 systemd[1]: Stopping Ceph osd.6 for 1fefccae-0890-11f1-bcc5-d404e6e7d460... 2026-02-13T04:06:48.473 INFO:journalctl@ceph.osd.6.trial092.stdout:Feb 13 04:06:48 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-6[47366]: 2026-02-13T04:06:48.470+0000 7f847c64f6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T04:06:48.473 INFO:journalctl@ceph.osd.6.trial092.stdout:Feb 13 04:06:48 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-6[47366]: 2026-02-13T04:06:48.470+0000 7f847c64f6c0 -1 osd.6 78 *** Got signal Terminated *** 2026-02-13T04:06:48.473 INFO:journalctl@ceph.osd.6.trial092.stdout:Feb 13 04:06:48 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-6[47366]: 2026-02-13T04:06:48.470+0000 7f847c64f6c0 -1 osd.6 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T04:06:49.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:48 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:48.787+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.945152+0000 front 2026-02-13T04:06:15.945228+0000 (oldest deadline 2026-02-13T04:06:41.845216+0000) 2026-02-13T04:06:49.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:48 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:48.787+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:21.845442+0000 front 2026-02-13T04:06:21.845538+0000 (oldest deadline 2026-02-13T04:06:45.345507+0000) 2026-02-13T04:06:49.170 INFO:journalctl@ceph.osd.6.trial092.stdout:Feb 13 04:06:48 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-6[47366]: 2026-02-13T04:06:48.864+0000 7f8474d0c6c0 -1 osd.6 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.542154+0000 front 2026-02-13T04:06:15.542266+0000 (oldest deadline 2026-02-13T04:06:41.442258+0000) 2026-02-13T04:06:49.170 INFO:journalctl@ceph.osd.6.trial092.stdout:Feb 13 04:06:48 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-6[47366]: 2026-02-13T04:06:48.864+0000 7f8474d0c6c0 -1 osd.6 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:24.343082+0000 front 2026-02-13T04:06:24.342805+0000 (oldest deadline 2026-02-13T04:06:46.042793+0000) 2026-02-13T04:06:49.328 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:06:49 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:06:49.035+0000 7f8d3a08d6c0 -1 osd.8 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:17.412616+0000 front 2026-02-13T04:06:17.412803+0000 (oldest deadline 2026-02-13T04:06:42.712632+0000) 2026-02-13T04:06:49.328 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:06:49 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:06:49.007+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.285288+0000 front 2026-02-13T04:06:16.285227+0000 (oldest deadline 2026-02-13T04:06:40.985214+0000) 2026-02-13T04:06:49.328 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:06:49 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:06:49.007+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:25.085589+0000 front 2026-02-13T04:06:25.085811+0000 (oldest deadline 2026-02-13T04:06:46.785653+0000) 2026-02-13T04:06:49.433 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:06:49 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:06:49.168+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.868796+0000 front 2026-02-13T04:06:16.868651+0000 (oldest deadline 2026-02-13T04:06:40.968550+0000) 2026-02-13T04:06:49.433 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:06:49 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:06:49.168+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:20.968894+0000 front 2026-02-13T04:06:20.968792+0000 (oldest deadline 2026-02-13T04:06:46.868811+0000) 2026-02-13T04:06:49.616 INFO:journalctl@ceph.osd.7.trial099.stdout:Feb 13 04:06:49 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-7[46494]: 2026-02-13T04:06:49.134+0000 7fb90dd626c0 -1 osd.7 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:19.634175+0000 front 2026-02-13T04:06:19.634185+0000 (oldest deadline 2026-02-13T04:06:45.534339+0000) 2026-02-13T04:06:50.102 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:49 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:49.771+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.945152+0000 front 2026-02-13T04:06:15.945228+0000 (oldest deadline 2026-02-13T04:06:41.845216+0000) 2026-02-13T04:06:50.102 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:49 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:49.771+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:21.845442+0000 front 2026-02-13T04:06:21.845538+0000 (oldest deadline 2026-02-13T04:06:45.345507+0000) 2026-02-13T04:06:50.179 INFO:journalctl@ceph.osd.6.trial092.stdout:Feb 13 04:06:49 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-6[47366]: 2026-02-13T04:06:49.817+0000 7f8474d0c6c0 -1 osd.6 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.542154+0000 front 2026-02-13T04:06:15.542266+0000 (oldest deadline 2026-02-13T04:06:41.442258+0000) 2026-02-13T04:06:50.179 INFO:journalctl@ceph.osd.6.trial092.stdout:Feb 13 04:06:49 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-6[47366]: 2026-02-13T04:06:49.817+0000 7f8474d0c6c0 -1 osd.6 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:24.343082+0000 front 2026-02-13T04:06:24.342805+0000 (oldest deadline 2026-02-13T04:06:46.042793+0000) 2026-02-13T04:06:50.328 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:06:50 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:06:50.011+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.285288+0000 front 2026-02-13T04:06:16.285227+0000 (oldest deadline 2026-02-13T04:06:40.985214+0000) 2026-02-13T04:06:50.328 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:06:50 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:06:50.011+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:25.085589+0000 front 2026-02-13T04:06:25.085811+0000 (oldest deadline 2026-02-13T04:06:46.785653+0000) 2026-02-13T04:06:50.328 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:06:50 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:06:50.014+0000 7f8d3a08d6c0 -1 osd.8 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:17.412616+0000 front 2026-02-13T04:06:17.412803+0000 (oldest deadline 2026-02-13T04:06:42.712632+0000) 2026-02-13T04:06:50.366 INFO:journalctl@ceph.osd.7.trial099.stdout:Feb 13 04:06:50 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-7[46494]: 2026-02-13T04:06:50.099+0000 7fb90dd626c0 -1 osd.7 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:19.634175+0000 front 2026-02-13T04:06:19.634185+0000 (oldest deadline 2026-02-13T04:06:45.534339+0000) 2026-02-13T04:06:50.433 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:06:50 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:06:50.177+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.868796+0000 front 2026-02-13T04:06:16.868651+0000 (oldest deadline 2026-02-13T04:06:40.968550+0000) 2026-02-13T04:06:50.433 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:06:50 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:06:50.177+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:20.968894+0000 front 2026-02-13T04:06:20.968792+0000 (oldest deadline 2026-02-13T04:06:46.868811+0000) 2026-02-13T04:06:51.088 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:50 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:50.779+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.945152+0000 front 2026-02-13T04:06:15.945228+0000 (oldest deadline 2026-02-13T04:06:41.845216+0000) 2026-02-13T04:06:51.088 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:50 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:50.779+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:21.845442+0000 front 2026-02-13T04:06:21.845538+0000 (oldest deadline 2026-02-13T04:06:45.345507+0000) 2026-02-13T04:06:51.133 INFO:journalctl@ceph.osd.6.trial092.stdout:Feb 13 04:06:50 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-6[47366]: 2026-02-13T04:06:50.865+0000 7f8474d0c6c0 -1 osd.6 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.542154+0000 front 2026-02-13T04:06:15.542266+0000 (oldest deadline 2026-02-13T04:06:41.442258+0000) 2026-02-13T04:06:51.133 INFO:journalctl@ceph.osd.6.trial092.stdout:Feb 13 04:06:50 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-6[47366]: 2026-02-13T04:06:50.865+0000 7f8474d0c6c0 -1 osd.6 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:24.343082+0000 front 2026-02-13T04:06:24.342805+0000 (oldest deadline 2026-02-13T04:06:46.042793+0000) 2026-02-13T04:06:51.328 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:06:51 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:06:51.011+0000 7f8d3a08d6c0 -1 osd.8 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:17.412616+0000 front 2026-02-13T04:06:17.412803+0000 (oldest deadline 2026-02-13T04:06:42.712632+0000) 2026-02-13T04:06:51.328 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:06:51 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:06:51.038+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.285288+0000 front 2026-02-13T04:06:16.285227+0000 (oldest deadline 2026-02-13T04:06:40.985214+0000) 2026-02-13T04:06:51.328 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:06:51 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:06:51.038+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:25.085589+0000 front 2026-02-13T04:06:25.085811+0000 (oldest deadline 2026-02-13T04:06:46.785653+0000) 2026-02-13T04:06:51.366 INFO:journalctl@ceph.osd.7.trial099.stdout:Feb 13 04:06:51 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-7[46494]: 2026-02-13T04:06:51.085+0000 7fb90dd626c0 -1 osd.7 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:19.634175+0000 front 2026-02-13T04:06:19.634185+0000 (oldest deadline 2026-02-13T04:06:45.534339+0000) 2026-02-13T04:06:51.433 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:06:51 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:06:51.131+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.868796+0000 front 2026-02-13T04:06:16.868651+0000 (oldest deadline 2026-02-13T04:06:40.968550+0000) 2026-02-13T04:06:51.433 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:06:51 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:06:51.131+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:20.968894+0000 front 2026-02-13T04:06:20.968792+0000 (oldest deadline 2026-02-13T04:06:46.868811+0000) 2026-02-13T04:06:52.114 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:51 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:51.808+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.945152+0000 front 2026-02-13T04:06:15.945228+0000 (oldest deadline 2026-02-13T04:06:41.845216+0000) 2026-02-13T04:06:52.114 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:51 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:51.808+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:21.845442+0000 front 2026-02-13T04:06:21.845538+0000 (oldest deadline 2026-02-13T04:06:45.345507+0000) 2026-02-13T04:06:52.120 INFO:journalctl@ceph.osd.6.trial092.stdout:Feb 13 04:06:51 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-6[47366]: 2026-02-13T04:06:51.858+0000 7f8474d0c6c0 -1 osd.6 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.542154+0000 front 2026-02-13T04:06:15.542266+0000 (oldest deadline 2026-02-13T04:06:41.442258+0000) 2026-02-13T04:06:52.120 INFO:journalctl@ceph.osd.6.trial092.stdout:Feb 13 04:06:51 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-6[47366]: 2026-02-13T04:06:51.858+0000 7f8474d0c6c0 -1 osd.6 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:24.343082+0000 front 2026-02-13T04:06:24.342805+0000 (oldest deadline 2026-02-13T04:06:46.042793+0000) 2026-02-13T04:06:52.329 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:06:52 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:06:52.058+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.285288+0000 front 2026-02-13T04:06:16.285227+0000 (oldest deadline 2026-02-13T04:06:40.985214+0000) 2026-02-13T04:06:52.329 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:06:52 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:06:52.058+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:25.085589+0000 front 2026-02-13T04:06:25.085811+0000 (oldest deadline 2026-02-13T04:06:46.785653+0000) 2026-02-13T04:06:52.329 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:06:52 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:06:52.027+0000 7f8d3a08d6c0 -1 osd.8 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:17.412616+0000 front 2026-02-13T04:06:17.412803+0000 (oldest deadline 2026-02-13T04:06:42.712632+0000) 2026-02-13T04:06:52.366 INFO:journalctl@ceph.osd.7.trial099.stdout:Feb 13 04:06:52 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-7[46494]: 2026-02-13T04:06:52.110+0000 7fb90dd626c0 -1 osd.7 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:19.634175+0000 front 2026-02-13T04:06:19.634185+0000 (oldest deadline 2026-02-13T04:06:45.534339+0000) 2026-02-13T04:06:52.433 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:06:52 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:06:52.117+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.868796+0000 front 2026-02-13T04:06:16.868651+0000 (oldest deadline 2026-02-13T04:06:40.968550+0000) 2026-02-13T04:06:52.433 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:06:52 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:06:52.117+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:20.968894+0000 front 2026-02-13T04:06:20.968792+0000 (oldest deadline 2026-02-13T04:06:46.868811+0000) 2026-02-13T04:06:52.433 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:06:52 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:06:52.117+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:27.369306+0000 front 2026-02-13T04:06:27.369548+0000 (oldest deadline 2026-02-13T04:06:51.469293+0000) 2026-02-13T04:06:53.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:52 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:52.766+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.945152+0000 front 2026-02-13T04:06:15.945228+0000 (oldest deadline 2026-02-13T04:06:41.845216+0000) 2026-02-13T04:06:53.117 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:52 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:52.766+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:21.845442+0000 front 2026-02-13T04:06:21.845538+0000 (oldest deadline 2026-02-13T04:06:45.345507+0000) 2026-02-13T04:06:53.117 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:52 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:52.766+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:26.346361+0000 front 2026-02-13T04:06:26.346298+0000 (oldest deadline 2026-02-13T04:06:52.246370+0000) 2026-02-13T04:06:53.161 INFO:journalctl@ceph.osd.6.trial092.stdout:Feb 13 04:06:52 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-6[47366]: 2026-02-13T04:06:52.843+0000 7f8474d0c6c0 -1 osd.6 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.542154+0000 front 2026-02-13T04:06:15.542266+0000 (oldest deadline 2026-02-13T04:06:41.442258+0000) 2026-02-13T04:06:53.161 INFO:journalctl@ceph.osd.6.trial092.stdout:Feb 13 04:06:52 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-6[47366]: 2026-02-13T04:06:52.843+0000 7f8474d0c6c0 -1 osd.6 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:24.343082+0000 front 2026-02-13T04:06:24.342805+0000 (oldest deadline 2026-02-13T04:06:46.042793+0000) 2026-02-13T04:06:53.329 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:06:53 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:06:53.061+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.285288+0000 front 2026-02-13T04:06:16.285227+0000 (oldest deadline 2026-02-13T04:06:40.985214+0000) 2026-02-13T04:06:53.329 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:06:53 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:06:53.061+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:25.085589+0000 front 2026-02-13T04:06:25.085811+0000 (oldest deadline 2026-02-13T04:06:46.785653+0000) 2026-02-13T04:06:53.329 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:06:53 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:06:53.029+0000 7f8d3a08d6c0 -1 osd.8 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:17.412616+0000 front 2026-02-13T04:06:17.412803+0000 (oldest deadline 2026-02-13T04:06:42.712632+0000) 2026-02-13T04:06:53.433 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:06:53 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:06:53.159+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.868796+0000 front 2026-02-13T04:06:16.868651+0000 (oldest deadline 2026-02-13T04:06:40.968550+0000) 2026-02-13T04:06:53.433 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:06:53 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:06:53.159+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:20.968894+0000 front 2026-02-13T04:06:20.968792+0000 (oldest deadline 2026-02-13T04:06:46.868811+0000) 2026-02-13T04:06:53.433 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:06:53 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:06:53.159+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:27.369306+0000 front 2026-02-13T04:06:27.369548+0000 (oldest deadline 2026-02-13T04:06:51.469293+0000) 2026-02-13T04:06:53.616 INFO:journalctl@ceph.osd.7.trial099.stdout:Feb 13 04:06:53 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-7[46494]: 2026-02-13T04:06:53.124+0000 7fb90dd626c0 -1 osd.7 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:19.634175+0000 front 2026-02-13T04:06:19.634185+0000 (oldest deadline 2026-02-13T04:06:45.534339+0000) 2026-02-13T04:06:53.861 INFO:journalctl@ceph.osd.6.trial092.stdout:Feb 13 04:06:53 trial092 podman[74137]: 2026-02-13 04:06:53.556355658 +0000 UTC m=+5.108523835 container died 300350a4f4ab9de32ecc52dac19c52696f8a9246423323ab25d70b06139200c3 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-6, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, io.buildah.version=1.33.7, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, summary=Rocky Linux Base image, version=10, org.opencontainers.image.title=rockylinux, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, org.opencontainers.image.authors=Ceph Release Team , CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation) 2026-02-13T04:06:53.862 INFO:journalctl@ceph.osd.6.trial092.stdout:Feb 13 04:06:53 trial092 podman[74137]: 2026-02-13 04:06:53.61473072 +0000 UTC m=+5.166898897 container remove 300350a4f4ab9de32ecc52dac19c52696f8a9246423323ab25d70b06139200c3 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-6, org.opencontainers.image.documentation=https://docs.ceph.com/, io.buildah.version=1.33.7, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_REF=wip-pdonnell-testing-20260210.171210, license=BSD-3-Clause, name=rockylinux, org.opencontainers.image.authors=Ceph Release Team , version=10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.version=10, summary=Rocky Linux Base image, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation) 2026-02-13T04:06:53.862 INFO:journalctl@ceph.osd.6.trial092.stdout:Feb 13 04:06:53 trial092 bash[74137]: ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-6 2026-02-13T04:06:54.115 INFO:journalctl@ceph.osd.6.trial092.stdout:Feb 13 04:06:53 trial092 podman[74237]: 2026-02-13 04:06:53.860360201 +0000 UTC m=+0.029060596 container create 295c1bafc16f25d630dd7dd752a8014b28356e12168f66add562656f71980fbd (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-6-deactivate, version=10, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, license=BSD-3-Clause, ceph=True, vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-13T04:06:54.115 INFO:journalctl@ceph.osd.6.trial092.stdout:Feb 13 04:06:53 trial092 podman[74237]: 2026-02-13 04:06:53.912439206 +0000 UTC m=+0.081139601 container init 295c1bafc16f25d630dd7dd752a8014b28356e12168f66add562656f71980fbd (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-6-deactivate, summary=Rocky Linux Base image, version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , ceph=True, vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.version=10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux, org.opencontainers.image.title=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, io.buildah.version=1.33.7, license=BSD-3-Clause, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-13T04:06:54.115 INFO:journalctl@ceph.osd.6.trial092.stdout:Feb 13 04:06:53 trial092 podman[74237]: 2026-02-13 04:06:53.917575793 +0000 UTC m=+0.086276188 container start 295c1bafc16f25d630dd7dd752a8014b28356e12168f66add562656f71980fbd (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-6-deactivate, io.buildah.version=1.33.7, CEPH_REF=wip-pdonnell-testing-20260210.171210, vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, version=10, license=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image, org.opencontainers.image.version=10, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , ceph=True, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-13T04:06:54.115 INFO:journalctl@ceph.osd.6.trial092.stdout:Feb 13 04:06:53 trial092 podman[74237]: 2026-02-13 04:06:53.918607075 +0000 UTC m=+0.087307470 container attach 295c1bafc16f25d630dd7dd752a8014b28356e12168f66add562656f71980fbd (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-6-deactivate, org.opencontainers.image.licenses=BSD-3-Clause, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210, license=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, summary=Rocky Linux Base image, org.opencontainers.image.version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, version=10, org.opencontainers.image.authors=Ceph Release Team , ceph=True, vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux) 2026-02-13T04:06:54.115 INFO:journalctl@ceph.osd.6.trial092.stdout:Feb 13 04:06:53 trial092 podman[74237]: 2026-02-13 04:06:53.850789672 +0000 UTC m=+0.019490077 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T04:06:54.115 INFO:journalctl@ceph.osd.6.trial092.stdout:Feb 13 04:06:54 trial092 podman[74237]: 2026-02-13 04:06:54.100970264 +0000 UTC m=+0.269670669 container died 295c1bafc16f25d630dd7dd752a8014b28356e12168f66add562656f71980fbd (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-6-deactivate, version=10, summary=Rocky Linux Base image, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, license=BSD-3-Clause, ceph=True, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, OSD_FLAVOR=default, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.licenses=BSD-3-Clause, io.buildah.version=1.33.7) 2026-02-13T04:06:54.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:53 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:53.805+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.945152+0000 front 2026-02-13T04:06:15.945228+0000 (oldest deadline 2026-02-13T04:06:41.845216+0000) 2026-02-13T04:06:54.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:53 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:53.805+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:21.845442+0000 front 2026-02-13T04:06:21.845538+0000 (oldest deadline 2026-02-13T04:06:45.345507+0000) 2026-02-13T04:06:54.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:53 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:53.805+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:26.346361+0000 front 2026-02-13T04:06:26.346298+0000 (oldest deadline 2026-02-13T04:06:52.246370+0000) 2026-02-13T04:06:54.188 DEBUG:teuthology.orchestra.run.trial092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@osd.6.service' 2026-02-13T04:06:54.257 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T04:06:54.257 INFO:tasks.cephadm.osd.6:Stopped osd.6 2026-02-13T04:06:54.257 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2026-02-13T04:06:54.257 DEBUG:teuthology.orchestra.run.trial099:> sudo systemctl stop ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@osd.7 2026-02-13T04:06:54.328 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:06:54 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:06:54.000+0000 7f8d3a08d6c0 -1 osd.8 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:17.412616+0000 front 2026-02-13T04:06:17.412803+0000 (oldest deadline 2026-02-13T04:06:42.712632+0000) 2026-02-13T04:06:54.328 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:06:54 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:06:54.077+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.285288+0000 front 2026-02-13T04:06:16.285227+0000 (oldest deadline 2026-02-13T04:06:40.985214+0000) 2026-02-13T04:06:54.328 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:06:54 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:06:54.077+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:25.085589+0000 front 2026-02-13T04:06:25.085811+0000 (oldest deadline 2026-02-13T04:06:46.785653+0000) 2026-02-13T04:06:54.433 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:06:54 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:06:54.191+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.868796+0000 front 2026-02-13T04:06:16.868651+0000 (oldest deadline 2026-02-13T04:06:40.968550+0000) 2026-02-13T04:06:54.433 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:06:54 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:06:54.191+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:20.968894+0000 front 2026-02-13T04:06:20.968792+0000 (oldest deadline 2026-02-13T04:06:46.868811+0000) 2026-02-13T04:06:54.433 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:06:54 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:06:54.191+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:27.369306+0000 front 2026-02-13T04:06:27.369548+0000 (oldest deadline 2026-02-13T04:06:51.469293+0000) 2026-02-13T04:06:54.616 INFO:journalctl@ceph.osd.7.trial099.stdout:Feb 13 04:06:54 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-7[46494]: 2026-02-13T04:06:54.131+0000 7fb90dd626c0 -1 osd.7 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:19.634175+0000 front 2026-02-13T04:06:19.634185+0000 (oldest deadline 2026-02-13T04:06:45.534339+0000) 2026-02-13T04:06:54.616 INFO:journalctl@ceph.osd.7.trial099.stdout:Feb 13 04:06:54 trial099 systemd[1]: Stopping Ceph osd.7 for 1fefccae-0890-11f1-bcc5-d404e6e7d460... 2026-02-13T04:06:54.616 INFO:journalctl@ceph.osd.7.trial099.stdout:Feb 13 04:06:54 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-7[46494]: 2026-02-13T04:06:54.347+0000 7fb9156a56c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T04:06:54.616 INFO:journalctl@ceph.osd.7.trial099.stdout:Feb 13 04:06:54 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-7[46494]: 2026-02-13T04:06:54.347+0000 7fb9156a56c0 -1 osd.7 78 *** Got signal Terminated *** 2026-02-13T04:06:54.617 INFO:journalctl@ceph.osd.7.trial099.stdout:Feb 13 04:06:54 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-7[46494]: 2026-02-13T04:06:54.347+0000 7fb9156a56c0 -1 osd.7 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T04:06:55.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:54 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:54.755+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.945152+0000 front 2026-02-13T04:06:15.945228+0000 (oldest deadline 2026-02-13T04:06:41.845216+0000) 2026-02-13T04:06:55.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:54 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:54.755+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:21.845442+0000 front 2026-02-13T04:06:21.845538+0000 (oldest deadline 2026-02-13T04:06:45.345507+0000) 2026-02-13T04:06:55.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:54 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:54.755+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:26.346361+0000 front 2026-02-13T04:06:26.346298+0000 (oldest deadline 2026-02-13T04:06:52.246370+0000) 2026-02-13T04:06:55.328 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:06:55 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:06:55.025+0000 7f8d3a08d6c0 -1 osd.8 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:17.412616+0000 front 2026-02-13T04:06:17.412803+0000 (oldest deadline 2026-02-13T04:06:42.712632+0000) 2026-02-13T04:06:55.328 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:06:55 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:06:55.025+0000 7f8d3a08d6c0 -1 osd.8 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:30.113585+0000 front 2026-02-13T04:06:30.113593+0000 (oldest deadline 2026-02-13T04:06:54.213669+0000) 2026-02-13T04:06:55.328 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:06:55 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:06:55.113+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.285288+0000 front 2026-02-13T04:06:16.285227+0000 (oldest deadline 2026-02-13T04:06:40.985214+0000) 2026-02-13T04:06:55.328 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:06:55 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:06:55.113+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:25.085589+0000 front 2026-02-13T04:06:25.085811+0000 (oldest deadline 2026-02-13T04:06:46.785653+0000) 2026-02-13T04:06:55.328 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:06:55 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:06:55.113+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:29.086015+0000 front 2026-02-13T04:06:29.086023+0000 (oldest deadline 2026-02-13T04:06:54.386126+0000) 2026-02-13T04:06:55.616 INFO:journalctl@ceph.osd.7.trial099.stdout:Feb 13 04:06:55 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-7[46494]: 2026-02-13T04:06:55.171+0000 7fb90dd626c0 -1 osd.7 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:19.634175+0000 front 2026-02-13T04:06:19.634185+0000 (oldest deadline 2026-02-13T04:06:45.534339+0000) 2026-02-13T04:06:55.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:06:55 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:06:55.206+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.868796+0000 front 2026-02-13T04:06:16.868651+0000 (oldest deadline 2026-02-13T04:06:40.968550+0000) 2026-02-13T04:06:55.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:06:55 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:06:55.206+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:20.968894+0000 front 2026-02-13T04:06:20.968792+0000 (oldest deadline 2026-02-13T04:06:46.868811+0000) 2026-02-13T04:06:55.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:06:55 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:06:55.206+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:27.369306+0000 front 2026-02-13T04:06:27.369548+0000 (oldest deadline 2026-02-13T04:06:51.469293+0000) 2026-02-13T04:06:56.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:55 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:55.764+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.945152+0000 front 2026-02-13T04:06:15.945228+0000 (oldest deadline 2026-02-13T04:06:41.845216+0000) 2026-02-13T04:06:56.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:55 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:55.764+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:21.845442+0000 front 2026-02-13T04:06:21.845538+0000 (oldest deadline 2026-02-13T04:06:45.345507+0000) 2026-02-13T04:06:56.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:55 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:55.764+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:26.346361+0000 front 2026-02-13T04:06:26.346298+0000 (oldest deadline 2026-02-13T04:06:52.246370+0000) 2026-02-13T04:06:56.328 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:06:55 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:06:55.985+0000 7f8d3a08d6c0 -1 osd.8 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:17.412616+0000 front 2026-02-13T04:06:17.412803+0000 (oldest deadline 2026-02-13T04:06:42.712632+0000) 2026-02-13T04:06:56.328 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:06:55 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:06:55.985+0000 7f8d3a08d6c0 -1 osd.8 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:30.113585+0000 front 2026-02-13T04:06:30.113593+0000 (oldest deadline 2026-02-13T04:06:54.213669+0000) 2026-02-13T04:06:56.328 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:06:56 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:06:56.128+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.285288+0000 front 2026-02-13T04:06:16.285227+0000 (oldest deadline 2026-02-13T04:06:40.985214+0000) 2026-02-13T04:06:56.328 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:06:56 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:06:56.128+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:25.085589+0000 front 2026-02-13T04:06:25.085811+0000 (oldest deadline 2026-02-13T04:06:46.785653+0000) 2026-02-13T04:06:56.328 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:06:56 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:06:56.128+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:29.086015+0000 front 2026-02-13T04:06:29.086023+0000 (oldest deadline 2026-02-13T04:06:54.386126+0000) 2026-02-13T04:06:56.616 INFO:journalctl@ceph.osd.7.trial099.stdout:Feb 13 04:06:56 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-7[46494]: 2026-02-13T04:06:56.158+0000 7fb90dd626c0 -1 osd.7 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:19.634175+0000 front 2026-02-13T04:06:19.634185+0000 (oldest deadline 2026-02-13T04:06:45.534339+0000) 2026-02-13T04:06:56.616 INFO:journalctl@ceph.osd.7.trial099.stdout:Feb 13 04:06:56 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-7[46494]: 2026-02-13T04:06:56.158+0000 7fb90dd626c0 -1 osd.7 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:29.435157+0000 front 2026-02-13T04:06:29.435252+0000 (oldest deadline 2026-02-13T04:06:55.335175+0000) 2026-02-13T04:06:56.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:06:56 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:06:56.251+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.868796+0000 front 2026-02-13T04:06:16.868651+0000 (oldest deadline 2026-02-13T04:06:40.968550+0000) 2026-02-13T04:06:56.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:06:56 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:06:56.251+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:20.968894+0000 front 2026-02-13T04:06:20.968792+0000 (oldest deadline 2026-02-13T04:06:46.868811+0000) 2026-02-13T04:06:56.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:06:56 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:06:56.251+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:27.369306+0000 front 2026-02-13T04:06:27.369548+0000 (oldest deadline 2026-02-13T04:06:51.469293+0000) 2026-02-13T04:06:57.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:56 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:56.774+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.945152+0000 front 2026-02-13T04:06:15.945228+0000 (oldest deadline 2026-02-13T04:06:41.845216+0000) 2026-02-13T04:06:57.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:56 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:56.774+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:21.845442+0000 front 2026-02-13T04:06:21.845538+0000 (oldest deadline 2026-02-13T04:06:45.345507+0000) 2026-02-13T04:06:57.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:56 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:56.774+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:26.346361+0000 front 2026-02-13T04:06:26.346298+0000 (oldest deadline 2026-02-13T04:06:52.246370+0000) 2026-02-13T04:06:57.328 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:06:56 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:06:56.977+0000 7f8d3a08d6c0 -1 osd.8 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:17.412616+0000 front 2026-02-13T04:06:17.412803+0000 (oldest deadline 2026-02-13T04:06:42.712632+0000) 2026-02-13T04:06:57.328 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:06:56 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:06:56.977+0000 7f8d3a08d6c0 -1 osd.8 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:30.113585+0000 front 2026-02-13T04:06:30.113593+0000 (oldest deadline 2026-02-13T04:06:54.213669+0000) 2026-02-13T04:06:57.328 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:06:57 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:06:57.163+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.285288+0000 front 2026-02-13T04:06:16.285227+0000 (oldest deadline 2026-02-13T04:06:40.985214+0000) 2026-02-13T04:06:57.328 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:06:57 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:06:57.163+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:25.085589+0000 front 2026-02-13T04:06:25.085811+0000 (oldest deadline 2026-02-13T04:06:46.785653+0000) 2026-02-13T04:06:57.328 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:06:57 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:06:57.163+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:29.086015+0000 front 2026-02-13T04:06:29.086023+0000 (oldest deadline 2026-02-13T04:06:54.386126+0000) 2026-02-13T04:06:57.616 INFO:journalctl@ceph.osd.7.trial099.stdout:Feb 13 04:06:57 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-7[46494]: 2026-02-13T04:06:57.145+0000 7fb90dd626c0 -1 osd.7 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:19.634175+0000 front 2026-02-13T04:06:19.634185+0000 (oldest deadline 2026-02-13T04:06:45.534339+0000) 2026-02-13T04:06:57.616 INFO:journalctl@ceph.osd.7.trial099.stdout:Feb 13 04:06:57 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-7[46494]: 2026-02-13T04:06:57.145+0000 7fb90dd626c0 -1 osd.7 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:29.435157+0000 front 2026-02-13T04:06:29.435252+0000 (oldest deadline 2026-02-13T04:06:55.335175+0000) 2026-02-13T04:06:57.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:06:57 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:06:57.289+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.868796+0000 front 2026-02-13T04:06:16.868651+0000 (oldest deadline 2026-02-13T04:06:40.968550+0000) 2026-02-13T04:06:57.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:06:57 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:06:57.289+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:20.968894+0000 front 2026-02-13T04:06:20.968792+0000 (oldest deadline 2026-02-13T04:06:46.868811+0000) 2026-02-13T04:06:57.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:06:57 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:06:57.289+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:27.369306+0000 front 2026-02-13T04:06:27.369548+0000 (oldest deadline 2026-02-13T04:06:51.469293+0000) 2026-02-13T04:06:58.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:57 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:57.799+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.945152+0000 front 2026-02-13T04:06:15.945228+0000 (oldest deadline 2026-02-13T04:06:41.845216+0000) 2026-02-13T04:06:58.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:57 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:57.799+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:21.845442+0000 front 2026-02-13T04:06:21.845538+0000 (oldest deadline 2026-02-13T04:06:45.345507+0000) 2026-02-13T04:06:58.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:57 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:57.799+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:26.346361+0000 front 2026-02-13T04:06:26.346298+0000 (oldest deadline 2026-02-13T04:06:52.246370+0000) 2026-02-13T04:06:58.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:57 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:57.799+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6814 osd.3 since back 2026-02-13T04:06:36.346810+0000 front 2026-02-13T04:06:36.346958+0000 (oldest deadline 2026-02-13T04:06:56.846749+0000) 2026-02-13T04:06:58.328 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:06:58 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:06:58.168+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.285288+0000 front 2026-02-13T04:06:16.285227+0000 (oldest deadline 2026-02-13T04:06:40.985214+0000) 2026-02-13T04:06:58.328 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:06:58 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:06:58.168+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:25.085589+0000 front 2026-02-13T04:06:25.085811+0000 (oldest deadline 2026-02-13T04:06:46.785653+0000) 2026-02-13T04:06:58.328 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:06:58 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:06:58.168+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:29.086015+0000 front 2026-02-13T04:06:29.086023+0000 (oldest deadline 2026-02-13T04:06:54.386126+0000) 2026-02-13T04:06:58.328 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:06:57 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:06:57.981+0000 7f8d3a08d6c0 -1 osd.8 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:17.412616+0000 front 2026-02-13T04:06:17.412803+0000 (oldest deadline 2026-02-13T04:06:42.712632+0000) 2026-02-13T04:06:58.328 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:06:57 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:06:57.981+0000 7f8d3a08d6c0 -1 osd.8 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:30.113585+0000 front 2026-02-13T04:06:30.113593+0000 (oldest deadline 2026-02-13T04:06:54.213669+0000) 2026-02-13T04:06:58.328 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:06:57 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:06:57.981+0000 7f8d3a08d6c0 -1 osd.8 78 heartbeat_check: no reply from 10.20.193.92:6814 osd.3 since back 2026-02-13T04:06:34.213917+0000 front 2026-02-13T04:06:34.213975+0000 (oldest deadline 2026-02-13T04:06:57.113891+0000) 2026-02-13T04:06:58.616 INFO:journalctl@ceph.osd.7.trial099.stdout:Feb 13 04:06:58 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-7[46494]: 2026-02-13T04:06:58.140+0000 7fb90dd626c0 -1 osd.7 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:19.634175+0000 front 2026-02-13T04:06:19.634185+0000 (oldest deadline 2026-02-13T04:06:45.534339+0000) 2026-02-13T04:06:58.616 INFO:journalctl@ceph.osd.7.trial099.stdout:Feb 13 04:06:58 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-7[46494]: 2026-02-13T04:06:58.140+0000 7fb90dd626c0 -1 osd.7 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:29.435157+0000 front 2026-02-13T04:06:29.435252+0000 (oldest deadline 2026-02-13T04:06:55.335175+0000) 2026-02-13T04:06:58.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:06:58 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:06:58.330+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.868796+0000 front 2026-02-13T04:06:16.868651+0000 (oldest deadline 2026-02-13T04:06:40.968550+0000) 2026-02-13T04:06:58.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:06:58 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:06:58.330+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:20.968894+0000 front 2026-02-13T04:06:20.968792+0000 (oldest deadline 2026-02-13T04:06:46.868811+0000) 2026-02-13T04:06:58.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:06:58 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:06:58.330+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:27.369306+0000 front 2026-02-13T04:06:27.369548+0000 (oldest deadline 2026-02-13T04:06:51.469293+0000) 2026-02-13T04:06:58.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:06:58 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:06:58.330+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.92:6814 osd.3 since back 2026-02-13T04:06:31.469509+0000 front 2026-02-13T04:06:31.469724+0000 (oldest deadline 2026-02-13T04:06:57.369591+0000) 2026-02-13T04:06:59.107 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:58 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:58.808+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.945152+0000 front 2026-02-13T04:06:15.945228+0000 (oldest deadline 2026-02-13T04:06:41.845216+0000) 2026-02-13T04:06:59.107 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:58 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:58.808+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:21.845442+0000 front 2026-02-13T04:06:21.845538+0000 (oldest deadline 2026-02-13T04:06:45.345507+0000) 2026-02-13T04:06:59.107 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:58 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:58.808+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:26.346361+0000 front 2026-02-13T04:06:26.346298+0000 (oldest deadline 2026-02-13T04:06:52.246370+0000) 2026-02-13T04:06:59.107 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:58 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:58.808+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6814 osd.3 since back 2026-02-13T04:06:36.346810+0000 front 2026-02-13T04:06:36.346958+0000 (oldest deadline 2026-02-13T04:06:56.846749+0000) 2026-02-13T04:06:59.328 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:06:58 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:06:58.976+0000 7f8d3a08d6c0 -1 osd.8 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:17.412616+0000 front 2026-02-13T04:06:17.412803+0000 (oldest deadline 2026-02-13T04:06:42.712632+0000) 2026-02-13T04:06:59.328 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:06:58 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:06:58.976+0000 7f8d3a08d6c0 -1 osd.8 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:30.113585+0000 front 2026-02-13T04:06:30.113593+0000 (oldest deadline 2026-02-13T04:06:54.213669+0000) 2026-02-13T04:06:59.328 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:06:58 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:06:58.976+0000 7f8d3a08d6c0 -1 osd.8 78 heartbeat_check: no reply from 10.20.193.92:6814 osd.3 since back 2026-02-13T04:06:34.213917+0000 front 2026-02-13T04:06:34.213975+0000 (oldest deadline 2026-02-13T04:06:57.113891+0000) 2026-02-13T04:06:59.329 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:06:59 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:06:59.216+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.285288+0000 front 2026-02-13T04:06:16.285227+0000 (oldest deadline 2026-02-13T04:06:40.985214+0000) 2026-02-13T04:06:59.329 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:06:59 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:06:59.216+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:25.085589+0000 front 2026-02-13T04:06:25.085811+0000 (oldest deadline 2026-02-13T04:06:46.785653+0000) 2026-02-13T04:06:59.329 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:06:59 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:06:59.216+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:29.086015+0000 front 2026-02-13T04:06:29.086023+0000 (oldest deadline 2026-02-13T04:06:54.386126+0000) 2026-02-13T04:06:59.366 INFO:journalctl@ceph.osd.7.trial099.stdout:Feb 13 04:06:59 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-7[46494]: 2026-02-13T04:06:59.104+0000 7fb90dd626c0 -1 osd.7 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:19.634175+0000 front 2026-02-13T04:06:19.634185+0000 (oldest deadline 2026-02-13T04:06:45.534339+0000) 2026-02-13T04:06:59.366 INFO:journalctl@ceph.osd.7.trial099.stdout:Feb 13 04:06:59 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-7[46494]: 2026-02-13T04:06:59.104+0000 7fb90dd626c0 -1 osd.7 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:29.435157+0000 front 2026-02-13T04:06:29.435252+0000 (oldest deadline 2026-02-13T04:06:55.335175+0000) 2026-02-13T04:06:59.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:06:59 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:06:59.365+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.868796+0000 front 2026-02-13T04:06:16.868651+0000 (oldest deadline 2026-02-13T04:06:40.968550+0000) 2026-02-13T04:06:59.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:06:59 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:06:59.365+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:20.968894+0000 front 2026-02-13T04:06:20.968792+0000 (oldest deadline 2026-02-13T04:06:46.868811+0000) 2026-02-13T04:06:59.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:06:59 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:06:59.365+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:27.369306+0000 front 2026-02-13T04:06:27.369548+0000 (oldest deadline 2026-02-13T04:06:51.469293+0000) 2026-02-13T04:06:59.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:06:59 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:06:59.365+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.92:6814 osd.3 since back 2026-02-13T04:06:31.469509+0000 front 2026-02-13T04:06:31.469724+0000 (oldest deadline 2026-02-13T04:06:57.369591+0000) 2026-02-13T04:06:59.729 INFO:journalctl@ceph.osd.7.trial099.stdout:Feb 13 04:06:59 trial099 podman[60593]: 2026-02-13 04:06:59.417119699 +0000 UTC m=+5.081275255 container died 615225be74422eef7c532d50891ee1fd282d5f17217b4712f238e037afcbaaa2 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-7, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, license=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.authors=Ceph Release Team , summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, name=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, OSD_FLAVOR=default, version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.opencontainers.image.version=10) 2026-02-13T04:06:59.729 INFO:journalctl@ceph.osd.7.trial099.stdout:Feb 13 04:06:59 trial099 podman[60593]: 2026-02-13 04:06:59.42574632 +0000 UTC m=+5.089901876 container remove 615225be74422eef7c532d50891ee1fd282d5f17217b4712f238e037afcbaaa2 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-7, version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_REF=wip-pdonnell-testing-20260210.171210, OSD_FLAVOR=default, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, summary=Rocky Linux Base image, name=rockylinux, ceph=True, org.opencontainers.image.licenses=BSD-3-Clause, io.buildah.version=1.33.7) 2026-02-13T04:06:59.729 INFO:journalctl@ceph.osd.7.trial099.stdout:Feb 13 04:06:59 trial099 bash[60593]: ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-7 2026-02-13T04:06:59.730 INFO:journalctl@ceph.osd.7.trial099.stdout:Feb 13 04:06:59 trial099 podman[60720]: 2026-02-13 04:06:59.567587292 +0000 UTC m=+0.015272189 container create f85911b50a024327429b844a872a73c8fe4cf9dc2ef9626d422ac708747759bd (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-7-deactivate, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.documentation=https://docs.ceph.com/, license=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, name=rockylinux, org.opencontainers.image.authors=Ceph Release Team , vendor=Rocky Enterprise Software Foundation, ceph=True, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.licenses=BSD-3-Clause, version=10) 2026-02-13T04:06:59.730 INFO:journalctl@ceph.osd.7.trial099.stdout:Feb 13 04:06:59 trial099 podman[60720]: 2026-02-13 04:06:59.599225927 +0000 UTC m=+0.046910824 container init f85911b50a024327429b844a872a73c8fe4cf9dc2ef9626d422ac708747759bd (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-7-deactivate, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.version=10, io.buildah.version=1.33.7, CEPH_REF=wip-pdonnell-testing-20260210.171210, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, version=10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, OSD_FLAVOR=default, license=BSD-3-Clause, summary=Rocky Linux Base image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, vendor=Rocky Enterprise Software Foundation) 2026-02-13T04:06:59.730 INFO:journalctl@ceph.osd.7.trial099.stdout:Feb 13 04:06:59 trial099 podman[60720]: 2026-02-13 04:06:59.601912339 +0000 UTC m=+0.049597246 container start f85911b50a024327429b844a872a73c8fe4cf9dc2ef9626d422ac708747759bd (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-7-deactivate, version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, org.opencontainers.image.version=10, OSD_FLAVOR=default, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, io.buildah.version=1.33.7, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10) 2026-02-13T04:06:59.730 INFO:journalctl@ceph.osd.7.trial099.stdout:Feb 13 04:06:59 trial099 podman[60720]: 2026-02-13 04:06:59.602338971 +0000 UTC m=+0.050023868 container attach f85911b50a024327429b844a872a73c8fe4cf9dc2ef9626d422ac708747759bd (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-7-deactivate, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-pdonnell-testing-20260210.171210, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, license=BSD-3-Clause, org.opencontainers.image.version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, summary=Rocky Linux Base image, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/, vendor=Rocky Enterprise Software Foundation, version=10) 2026-02-13T04:06:59.730 INFO:journalctl@ceph.osd.7.trial099.stdout:Feb 13 04:06:59 trial099 podman[60720]: 2026-02-13 04:06:59.561341166 +0000 UTC m=+0.009026073 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T04:06:59.760 DEBUG:teuthology.orchestra.run.trial099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@osd.7.service' 2026-02-13T04:06:59.795 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T04:06:59.795 INFO:tasks.cephadm.osd.7:Stopped osd.7 2026-02-13T04:06:59.795 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2026-02-13T04:06:59.795 DEBUG:teuthology.orchestra.run.trial158:> sudo systemctl stop ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@osd.8 2026-02-13T04:07:00.078 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:06:59 trial158 systemd[1]: Stopping Ceph osd.8 for 1fefccae-0890-11f1-bcc5-d404e6e7d460... 2026-02-13T04:07:00.078 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:06:59 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:06:59.893+0000 7f8d419d06c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T04:07:00.078 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:06:59 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:06:59.893+0000 7f8d419d06c0 -1 osd.8 78 *** Got signal Terminated *** 2026-02-13T04:07:00.078 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:06:59 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:06:59.893+0000 7f8d419d06c0 -1 osd.8 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T04:07:00.079 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:06:59 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:06:59.931+0000 7f8d3a08d6c0 -1 osd.8 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:17.412616+0000 front 2026-02-13T04:06:17.412803+0000 (oldest deadline 2026-02-13T04:06:42.712632+0000) 2026-02-13T04:07:00.079 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:06:59 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:06:59.931+0000 7f8d3a08d6c0 -1 osd.8 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:30.113585+0000 front 2026-02-13T04:06:30.113593+0000 (oldest deadline 2026-02-13T04:06:54.213669+0000) 2026-02-13T04:07:00.079 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:06:59 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:06:59.931+0000 7f8d3a08d6c0 -1 osd.8 78 heartbeat_check: no reply from 10.20.193.92:6814 osd.3 since back 2026-02-13T04:06:34.213917+0000 front 2026-02-13T04:06:34.213975+0000 (oldest deadline 2026-02-13T04:06:57.113891+0000) 2026-02-13T04:07:00.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:59 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:59.761+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.945152+0000 front 2026-02-13T04:06:15.945228+0000 (oldest deadline 2026-02-13T04:06:41.845216+0000) 2026-02-13T04:07:00.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:59 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:59.761+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:21.845442+0000 front 2026-02-13T04:06:21.845538+0000 (oldest deadline 2026-02-13T04:06:45.345507+0000) 2026-02-13T04:07:00.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:59 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:59.761+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:26.346361+0000 front 2026-02-13T04:06:26.346298+0000 (oldest deadline 2026-02-13T04:06:52.246370+0000) 2026-02-13T04:07:00.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:06:59 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:06:59.761+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6814 osd.3 since back 2026-02-13T04:06:36.346810+0000 front 2026-02-13T04:06:36.346958+0000 (oldest deadline 2026-02-13T04:06:56.846749+0000) 2026-02-13T04:07:00.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:00 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:00.249+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.285288+0000 front 2026-02-13T04:06:16.285227+0000 (oldest deadline 2026-02-13T04:06:40.985214+0000) 2026-02-13T04:07:00.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:00 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:00.249+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:25.085589+0000 front 2026-02-13T04:06:25.085811+0000 (oldest deadline 2026-02-13T04:06:46.785653+0000) 2026-02-13T04:07:00.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:00 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:00.249+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:29.086015+0000 front 2026-02-13T04:06:29.086023+0000 (oldest deadline 2026-02-13T04:06:54.386126+0000) 2026-02-13T04:07:00.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:00 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:00.396+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.868796+0000 front 2026-02-13T04:06:16.868651+0000 (oldest deadline 2026-02-13T04:06:40.968550+0000) 2026-02-13T04:07:00.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:00 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:00.396+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:20.968894+0000 front 2026-02-13T04:06:20.968792+0000 (oldest deadline 2026-02-13T04:06:46.868811+0000) 2026-02-13T04:07:00.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:00 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:00.396+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:27.369306+0000 front 2026-02-13T04:06:27.369548+0000 (oldest deadline 2026-02-13T04:06:51.469293+0000) 2026-02-13T04:07:00.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:00 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:00.396+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.92:6814 osd.3 since back 2026-02-13T04:06:31.469509+0000 front 2026-02-13T04:06:31.469724+0000 (oldest deadline 2026-02-13T04:06:57.369591+0000) 2026-02-13T04:07:01.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:00 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:00.787+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.945152+0000 front 2026-02-13T04:06:15.945228+0000 (oldest deadline 2026-02-13T04:06:41.845216+0000) 2026-02-13T04:07:01.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:00 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:00.787+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:21.845442+0000 front 2026-02-13T04:06:21.845538+0000 (oldest deadline 2026-02-13T04:06:45.345507+0000) 2026-02-13T04:07:01.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:00 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:00.787+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:26.346361+0000 front 2026-02-13T04:06:26.346298+0000 (oldest deadline 2026-02-13T04:06:52.246370+0000) 2026-02-13T04:07:01.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:00 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:00.787+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6814 osd.3 since back 2026-02-13T04:06:36.346810+0000 front 2026-02-13T04:06:36.346958+0000 (oldest deadline 2026-02-13T04:06:56.846749+0000) 2026-02-13T04:07:01.292 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:07:00 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:07:00.893+0000 7f8d3a08d6c0 -1 osd.8 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:17.412616+0000 front 2026-02-13T04:06:17.412803+0000 (oldest deadline 2026-02-13T04:06:42.712632+0000) 2026-02-13T04:07:01.292 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:07:00 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:07:00.893+0000 7f8d3a08d6c0 -1 osd.8 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:30.113585+0000 front 2026-02-13T04:06:30.113593+0000 (oldest deadline 2026-02-13T04:06:54.213669+0000) 2026-02-13T04:07:01.292 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:07:00 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:07:00.893+0000 7f8d3a08d6c0 -1 osd.8 78 heartbeat_check: no reply from 10.20.193.92:6814 osd.3 since back 2026-02-13T04:06:34.213917+0000 front 2026-02-13T04:06:34.213975+0000 (oldest deadline 2026-02-13T04:06:57.113891+0000) 2026-02-13T04:07:01.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:01 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:01.291+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.285288+0000 front 2026-02-13T04:06:16.285227+0000 (oldest deadline 2026-02-13T04:06:40.985214+0000) 2026-02-13T04:07:01.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:01 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:01.291+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:25.085589+0000 front 2026-02-13T04:06:25.085811+0000 (oldest deadline 2026-02-13T04:06:46.785653+0000) 2026-02-13T04:07:01.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:01 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:01.291+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:29.086015+0000 front 2026-02-13T04:06:29.086023+0000 (oldest deadline 2026-02-13T04:06:54.386126+0000) 2026-02-13T04:07:01.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:01 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:01.387+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.868796+0000 front 2026-02-13T04:06:16.868651+0000 (oldest deadline 2026-02-13T04:06:40.968550+0000) 2026-02-13T04:07:01.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:01 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:01.387+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:20.968894+0000 front 2026-02-13T04:06:20.968792+0000 (oldest deadline 2026-02-13T04:06:46.868811+0000) 2026-02-13T04:07:01.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:01 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:01.387+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:27.369306+0000 front 2026-02-13T04:06:27.369548+0000 (oldest deadline 2026-02-13T04:06:51.469293+0000) 2026-02-13T04:07:01.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:01 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:01.387+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.92:6814 osd.3 since back 2026-02-13T04:06:31.469509+0000 front 2026-02-13T04:06:31.469724+0000 (oldest deadline 2026-02-13T04:06:57.369591+0000) 2026-02-13T04:07:02.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:01 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:01.760+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.945152+0000 front 2026-02-13T04:06:15.945228+0000 (oldest deadline 2026-02-13T04:06:41.845216+0000) 2026-02-13T04:07:02.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:01 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:01.760+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:21.845442+0000 front 2026-02-13T04:06:21.845538+0000 (oldest deadline 2026-02-13T04:06:45.345507+0000) 2026-02-13T04:07:02.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:01 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:01.760+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:26.346361+0000 front 2026-02-13T04:06:26.346298+0000 (oldest deadline 2026-02-13T04:06:52.246370+0000) 2026-02-13T04:07:02.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:01 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:01.760+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6814 osd.3 since back 2026-02-13T04:06:36.346810+0000 front 2026-02-13T04:06:36.346958+0000 (oldest deadline 2026-02-13T04:06:56.846749+0000) 2026-02-13T04:07:02.251 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:07:01 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:07:01.873+0000 7f8d3a08d6c0 -1 osd.8 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:17.412616+0000 front 2026-02-13T04:06:17.412803+0000 (oldest deadline 2026-02-13T04:06:42.712632+0000) 2026-02-13T04:07:02.251 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:07:01 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:07:01.873+0000 7f8d3a08d6c0 -1 osd.8 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:30.113585+0000 front 2026-02-13T04:06:30.113593+0000 (oldest deadline 2026-02-13T04:06:54.213669+0000) 2026-02-13T04:07:02.251 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:07:01 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:07:01.873+0000 7f8d3a08d6c0 -1 osd.8 78 heartbeat_check: no reply from 10.20.193.92:6814 osd.3 since back 2026-02-13T04:06:34.213917+0000 front 2026-02-13T04:06:34.213975+0000 (oldest deadline 2026-02-13T04:06:57.113891+0000) 2026-02-13T04:07:02.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:02 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:02.251+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.285288+0000 front 2026-02-13T04:06:16.285227+0000 (oldest deadline 2026-02-13T04:06:40.985214+0000) 2026-02-13T04:07:02.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:02 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:02.251+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:25.085589+0000 front 2026-02-13T04:06:25.085811+0000 (oldest deadline 2026-02-13T04:06:46.785653+0000) 2026-02-13T04:07:02.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:02 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:02.251+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:29.086015+0000 front 2026-02-13T04:06:29.086023+0000 (oldest deadline 2026-02-13T04:06:54.386126+0000) 2026-02-13T04:07:02.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:02 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:02.357+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.868796+0000 front 2026-02-13T04:06:16.868651+0000 (oldest deadline 2026-02-13T04:06:40.968550+0000) 2026-02-13T04:07:02.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:02 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:02.357+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:20.968894+0000 front 2026-02-13T04:06:20.968792+0000 (oldest deadline 2026-02-13T04:06:46.868811+0000) 2026-02-13T04:07:02.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:02 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:02.357+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:27.369306+0000 front 2026-02-13T04:06:27.369548+0000 (oldest deadline 2026-02-13T04:06:51.469293+0000) 2026-02-13T04:07:02.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:02 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:02.357+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.92:6814 osd.3 since back 2026-02-13T04:06:31.469509+0000 front 2026-02-13T04:06:31.469724+0000 (oldest deadline 2026-02-13T04:06:57.369591+0000) 2026-02-13T04:07:03.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:02 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:02.743+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.945152+0000 front 2026-02-13T04:06:15.945228+0000 (oldest deadline 2026-02-13T04:06:41.845216+0000) 2026-02-13T04:07:03.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:02 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:02.743+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:21.845442+0000 front 2026-02-13T04:06:21.845538+0000 (oldest deadline 2026-02-13T04:06:45.345507+0000) 2026-02-13T04:07:03.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:02 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:02.743+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:26.346361+0000 front 2026-02-13T04:06:26.346298+0000 (oldest deadline 2026-02-13T04:06:52.246370+0000) 2026-02-13T04:07:03.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:02 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:02.743+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6814 osd.3 since back 2026-02-13T04:06:36.346810+0000 front 2026-02-13T04:06:36.346958+0000 (oldest deadline 2026-02-13T04:06:56.846749+0000) 2026-02-13T04:07:03.283 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:07:02 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:07:02.907+0000 7f8d3a08d6c0 -1 osd.8 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:17.412616+0000 front 2026-02-13T04:06:17.412803+0000 (oldest deadline 2026-02-13T04:06:42.712632+0000) 2026-02-13T04:07:03.283 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:07:02 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:07:02.907+0000 7f8d3a08d6c0 -1 osd.8 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:30.113585+0000 front 2026-02-13T04:06:30.113593+0000 (oldest deadline 2026-02-13T04:06:54.213669+0000) 2026-02-13T04:07:03.283 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:07:02 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:07:02.907+0000 7f8d3a08d6c0 -1 osd.8 78 heartbeat_check: no reply from 10.20.193.92:6814 osd.3 since back 2026-02-13T04:06:34.213917+0000 front 2026-02-13T04:06:34.213975+0000 (oldest deadline 2026-02-13T04:06:57.113891+0000) 2026-02-13T04:07:03.283 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:07:02 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:07:02.907+0000 7f8d3a08d6c0 -1 osd.8 78 heartbeat_check: no reply from 10.20.193.99:6812 osd.4 since back 2026-02-13T04:06:37.114174+0000 front 2026-02-13T04:06:37.114035+0000 (oldest deadline 2026-02-13T04:07:02.414040+0000) 2026-02-13T04:07:03.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:03 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:03.282+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.285288+0000 front 2026-02-13T04:06:16.285227+0000 (oldest deadline 2026-02-13T04:06:40.985214+0000) 2026-02-13T04:07:03.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:03 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:03.282+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:25.085589+0000 front 2026-02-13T04:06:25.085811+0000 (oldest deadline 2026-02-13T04:06:46.785653+0000) 2026-02-13T04:07:03.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:03 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:03.282+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:29.086015+0000 front 2026-02-13T04:06:29.086023+0000 (oldest deadline 2026-02-13T04:06:54.386126+0000) 2026-02-13T04:07:03.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:03 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:03.391+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.868796+0000 front 2026-02-13T04:06:16.868651+0000 (oldest deadline 2026-02-13T04:06:40.968550+0000) 2026-02-13T04:07:03.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:03 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:03.391+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:20.968894+0000 front 2026-02-13T04:06:20.968792+0000 (oldest deadline 2026-02-13T04:06:46.868811+0000) 2026-02-13T04:07:03.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:03 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:03.391+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:27.369306+0000 front 2026-02-13T04:06:27.369548+0000 (oldest deadline 2026-02-13T04:06:51.469293+0000) 2026-02-13T04:07:03.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:03 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:03.391+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.92:6814 osd.3 since back 2026-02-13T04:06:31.469509+0000 front 2026-02-13T04:06:31.469724+0000 (oldest deadline 2026-02-13T04:06:57.369591+0000) 2026-02-13T04:07:03.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:03 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:03.391+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.99:6812 osd.4 since back 2026-02-13T04:06:37.369903+0000 front 2026-02-13T04:06:37.369867+0000 (oldest deadline 2026-02-13T04:07:03.269867+0000) 2026-02-13T04:07:04.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:03 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:03.774+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.945152+0000 front 2026-02-13T04:06:15.945228+0000 (oldest deadline 2026-02-13T04:06:41.845216+0000) 2026-02-13T04:07:04.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:03 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:03.774+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:21.845442+0000 front 2026-02-13T04:06:21.845538+0000 (oldest deadline 2026-02-13T04:06:45.345507+0000) 2026-02-13T04:07:04.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:03 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:03.774+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:26.346361+0000 front 2026-02-13T04:06:26.346298+0000 (oldest deadline 2026-02-13T04:06:52.246370+0000) 2026-02-13T04:07:04.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:03 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:03.774+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6814 osd.3 since back 2026-02-13T04:06:36.346810+0000 front 2026-02-13T04:06:36.346958+0000 (oldest deadline 2026-02-13T04:06:56.846749+0000) 2026-02-13T04:07:04.274 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:07:03 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:07:03.949+0000 7f8d3a08d6c0 -1 osd.8 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:17.412616+0000 front 2026-02-13T04:06:17.412803+0000 (oldest deadline 2026-02-13T04:06:42.712632+0000) 2026-02-13T04:07:04.274 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:07:03 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:07:03.949+0000 7f8d3a08d6c0 -1 osd.8 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:30.113585+0000 front 2026-02-13T04:06:30.113593+0000 (oldest deadline 2026-02-13T04:06:54.213669+0000) 2026-02-13T04:07:04.274 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:07:03 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:07:03.949+0000 7f8d3a08d6c0 -1 osd.8 78 heartbeat_check: no reply from 10.20.193.92:6814 osd.3 since back 2026-02-13T04:06:34.213917+0000 front 2026-02-13T04:06:34.213975+0000 (oldest deadline 2026-02-13T04:06:57.113891+0000) 2026-02-13T04:07:04.274 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:07:03 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8[46587]: 2026-02-13T04:07:03.949+0000 7f8d3a08d6c0 -1 osd.8 78 heartbeat_check: no reply from 10.20.193.99:6812 osd.4 since back 2026-02-13T04:06:37.114174+0000 front 2026-02-13T04:06:37.114035+0000 (oldest deadline 2026-02-13T04:07:02.414040+0000) 2026-02-13T04:07:04.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:04 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:04.273+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.285288+0000 front 2026-02-13T04:06:16.285227+0000 (oldest deadline 2026-02-13T04:06:40.985214+0000) 2026-02-13T04:07:04.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:04 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:04.273+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:25.085589+0000 front 2026-02-13T04:06:25.085811+0000 (oldest deadline 2026-02-13T04:06:46.785653+0000) 2026-02-13T04:07:04.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:04 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:04.273+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:29.086015+0000 front 2026-02-13T04:06:29.086023+0000 (oldest deadline 2026-02-13T04:06:54.386126+0000) 2026-02-13T04:07:04.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:04 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:04.408+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.868796+0000 front 2026-02-13T04:06:16.868651+0000 (oldest deadline 2026-02-13T04:06:40.968550+0000) 2026-02-13T04:07:04.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:04 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:04.408+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:20.968894+0000 front 2026-02-13T04:06:20.968792+0000 (oldest deadline 2026-02-13T04:06:46.868811+0000) 2026-02-13T04:07:04.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:04 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:04.408+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:27.369306+0000 front 2026-02-13T04:06:27.369548+0000 (oldest deadline 2026-02-13T04:06:51.469293+0000) 2026-02-13T04:07:04.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:04 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:04.408+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.92:6814 osd.3 since back 2026-02-13T04:06:31.469509+0000 front 2026-02-13T04:06:31.469724+0000 (oldest deadline 2026-02-13T04:06:57.369591+0000) 2026-02-13T04:07:04.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:04 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:04.408+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.99:6812 osd.4 since back 2026-02-13T04:06:37.369903+0000 front 2026-02-13T04:06:37.369867+0000 (oldest deadline 2026-02-13T04:07:03.269867+0000) 2026-02-13T04:07:05.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:04 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:04.811+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.945152+0000 front 2026-02-13T04:06:15.945228+0000 (oldest deadline 2026-02-13T04:06:41.845216+0000) 2026-02-13T04:07:05.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:04 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:04.811+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:21.845442+0000 front 2026-02-13T04:06:21.845538+0000 (oldest deadline 2026-02-13T04:06:45.345507+0000) 2026-02-13T04:07:05.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:04 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:04.811+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:26.346361+0000 front 2026-02-13T04:06:26.346298+0000 (oldest deadline 2026-02-13T04:06:52.246370+0000) 2026-02-13T04:07:05.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:04 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:04.811+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6814 osd.3 since back 2026-02-13T04:06:36.346810+0000 front 2026-02-13T04:06:36.346958+0000 (oldest deadline 2026-02-13T04:06:56.846749+0000) 2026-02-13T04:07:05.247 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:07:04 trial158 podman[62710]: 2026-02-13 04:07:04.952993766 +0000 UTC m=+5.072075864 container died 48c3131f7d9f9f6242b54df4aba41b50dafb832702c635453a612094030e32d6 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8, org.opencontainers.image.title=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause, io.buildah.version=1.33.7, org.opencontainers.image.version=10, name=rockylinux, license=BSD-3-Clause, vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, summary=Rocky Linux Base image, ceph=True, org.opencontainers.image.authors=Ceph Release Team , OSD_FLAVOR=default) 2026-02-13T04:07:05.247 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:07:04 trial158 podman[62710]: 2026-02-13 04:07:04.961870725 +0000 UTC m=+5.080952823 container remove 48c3131f7d9f9f6242b54df4aba41b50dafb832702c635453a612094030e32d6 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, version=10, OSD_FLAVOR=default, ceph=True, org.opencontainers.image.version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, license=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T04:07:05.247 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:07:04 trial158 bash[62710]: ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8 2026-02-13T04:07:05.247 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:07:05 trial158 podman[62845]: 2026-02-13 04:07:05.090943824 +0000 UTC m=+0.017379928 container create cfd98e14663a33f5d11066b7397a6db2966b9f34c4cafbe1a399efcb9562397e (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8-deactivate, OSD_FLAVOR=default, CEPH_REF=wip-pdonnell-testing-20260210.171210, version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.title=rockylinux, name=rockylinux, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.version=10, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, license=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, summary=Rocky Linux Base image, io.buildah.version=1.33.7) 2026-02-13T04:07:05.247 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:07:05 trial158 podman[62845]: 2026-02-13 04:07:05.120280369 +0000 UTC m=+0.046716493 container init cfd98e14663a33f5d11066b7397a6db2966b9f34c4cafbe1a399efcb9562397e (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8-deactivate, vendor=Rocky Enterprise Software Foundation, ceph=True, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image, version=10, org.opencontainers.image.title=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.version=10, OSD_FLAVOR=default, license=BSD-3-Clause, name=rockylinux, io.buildah.version=1.33.7, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation) 2026-02-13T04:07:05.247 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:07:05 trial158 podman[62845]: 2026-02-13 04:07:05.122864298 +0000 UTC m=+0.049300412 container start cfd98e14663a33f5d11066b7397a6db2966b9f34c4cafbe1a399efcb9562397e (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8-deactivate, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.title=rockylinux, license=BSD-3-Clause, OSD_FLAVOR=default, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.licenses=BSD-3-Clause, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, version=10, name=rockylinux, org.opencontainers.image.version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_REF=wip-pdonnell-testing-20260210.171210, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, ceph=True, summary=Rocky Linux Base image) 2026-02-13T04:07:05.247 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:07:05 trial158 podman[62845]: 2026-02-13 04:07:05.123423257 +0000 UTC m=+0.049859371 container attach cfd98e14663a33f5d11066b7397a6db2966b9f34c4cafbe1a399efcb9562397e (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.licenses=BSD-3-Clause, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, license=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, ceph=True, org.opencontainers.image.documentation=https://docs.ceph.com/, OSD_FLAVOR=default, summary=Rocky Linux Base image, version=10, org.opencontainers.image.authors=Ceph Release Team , vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.title=rockylinux, name=rockylinux) 2026-02-13T04:07:05.247 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:07:05 trial158 podman[62845]: 2026-02-13 04:07:05.083861202 +0000 UTC m=+0.010297316 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T04:07:05.247 INFO:journalctl@ceph.osd.8.trial158.stdout:Feb 13 04:07:05 trial158 podman[62845]: 2026-02-13 04:07:05.246455308 +0000 UTC m=+0.172891422 container died cfd98e14663a33f5d11066b7397a6db2966b9f34c4cafbe1a399efcb9562397e (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-8-deactivate, summary=Rocky Linux Base image, io.buildah.version=1.33.7, org.opencontainers.image.version=10, ceph=True, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, version=10, license=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-13T04:07:05.283 DEBUG:teuthology.orchestra.run.trial158:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@osd.8.service' 2026-02-13T04:07:05.318 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T04:07:05.318 INFO:tasks.cephadm.osd.8:Stopped osd.8 2026-02-13T04:07:05.318 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2026-02-13T04:07:05.318 DEBUG:teuthology.orchestra.run.trial092:> sudo systemctl stop ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@osd.9 2026-02-13T04:07:05.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:05 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:05.313+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.285288+0000 front 2026-02-13T04:06:16.285227+0000 (oldest deadline 2026-02-13T04:06:40.985214+0000) 2026-02-13T04:07:05.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:05 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:05.313+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:25.085589+0000 front 2026-02-13T04:06:25.085811+0000 (oldest deadline 2026-02-13T04:06:46.785653+0000) 2026-02-13T04:07:05.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:05 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:05.313+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:29.086015+0000 front 2026-02-13T04:06:29.086023+0000 (oldest deadline 2026-02-13T04:06:54.386126+0000) 2026-02-13T04:07:05.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:05 trial092 systemd[1]: Stopping Ceph osd.9 for 1fefccae-0890-11f1-bcc5-d404e6e7d460... 2026-02-13T04:07:05.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:05 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:05.412+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.868796+0000 front 2026-02-13T04:06:16.868651+0000 (oldest deadline 2026-02-13T04:06:40.968550+0000) 2026-02-13T04:07:05.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:05 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:05.412+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:20.968894+0000 front 2026-02-13T04:06:20.968792+0000 (oldest deadline 2026-02-13T04:06:46.868811+0000) 2026-02-13T04:07:05.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:05 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:05.412+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:27.369306+0000 front 2026-02-13T04:06:27.369548+0000 (oldest deadline 2026-02-13T04:06:51.469293+0000) 2026-02-13T04:07:05.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:05 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:05.412+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.92:6814 osd.3 since back 2026-02-13T04:06:31.469509+0000 front 2026-02-13T04:06:31.469724+0000 (oldest deadline 2026-02-13T04:06:57.369591+0000) 2026-02-13T04:07:05.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:05 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:05.412+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.99:6812 osd.4 since back 2026-02-13T04:06:37.369903+0000 front 2026-02-13T04:06:37.369867+0000 (oldest deadline 2026-02-13T04:07:03.269867+0000) 2026-02-13T04:07:05.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:05 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:05.506+0000 7f83e68ff6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T04:07:05.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:05 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:05.506+0000 7f83e68ff6c0 -1 osd.9 78 *** Got signal Terminated *** 2026-02-13T04:07:05.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:05 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:05.506+0000 7f83e68ff6c0 -1 osd.9 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T04:07:06.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:05 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:05.780+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.945152+0000 front 2026-02-13T04:06:15.945228+0000 (oldest deadline 2026-02-13T04:06:41.845216+0000) 2026-02-13T04:07:06.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:05 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:05.780+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:21.845442+0000 front 2026-02-13T04:06:21.845538+0000 (oldest deadline 2026-02-13T04:06:45.345507+0000) 2026-02-13T04:07:06.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:05 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:05.780+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:26.346361+0000 front 2026-02-13T04:06:26.346298+0000 (oldest deadline 2026-02-13T04:06:52.246370+0000) 2026-02-13T04:07:06.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:05 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:05.780+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6814 osd.3 since back 2026-02-13T04:06:36.346810+0000 front 2026-02-13T04:06:36.346958+0000 (oldest deadline 2026-02-13T04:06:56.846749+0000) 2026-02-13T04:07:06.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:06 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:06.275+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.285288+0000 front 2026-02-13T04:06:16.285227+0000 (oldest deadline 2026-02-13T04:06:40.985214+0000) 2026-02-13T04:07:06.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:06 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:06.275+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:25.085589+0000 front 2026-02-13T04:06:25.085811+0000 (oldest deadline 2026-02-13T04:06:46.785653+0000) 2026-02-13T04:07:06.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:06 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:06.275+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:29.086015+0000 front 2026-02-13T04:06:29.086023+0000 (oldest deadline 2026-02-13T04:06:54.386126+0000) 2026-02-13T04:07:06.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:06 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:06.275+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6812 osd.4 since back 2026-02-13T04:06:39.686601+0000 front 2026-02-13T04:06:39.686588+0000 (oldest deadline 2026-02-13T04:07:05.586646+0000) 2026-02-13T04:07:06.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:06 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:06.373+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.868796+0000 front 2026-02-13T04:06:16.868651+0000 (oldest deadline 2026-02-13T04:06:40.968550+0000) 2026-02-13T04:07:06.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:06 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:06.373+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:20.968894+0000 front 2026-02-13T04:06:20.968792+0000 (oldest deadline 2026-02-13T04:06:46.868811+0000) 2026-02-13T04:07:06.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:06 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:06.373+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:27.369306+0000 front 2026-02-13T04:06:27.369548+0000 (oldest deadline 2026-02-13T04:06:51.469293+0000) 2026-02-13T04:07:06.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:06 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:06.373+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.92:6814 osd.3 since back 2026-02-13T04:06:31.469509+0000 front 2026-02-13T04:06:31.469724+0000 (oldest deadline 2026-02-13T04:06:57.369591+0000) 2026-02-13T04:07:06.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:06 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:06.373+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.99:6812 osd.4 since back 2026-02-13T04:06:37.369903+0000 front 2026-02-13T04:06:37.369867+0000 (oldest deadline 2026-02-13T04:07:03.269867+0000) 2026-02-13T04:07:07.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:06 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:06.768+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.945152+0000 front 2026-02-13T04:06:15.945228+0000 (oldest deadline 2026-02-13T04:06:41.845216+0000) 2026-02-13T04:07:07.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:06 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:06.768+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:21.845442+0000 front 2026-02-13T04:06:21.845538+0000 (oldest deadline 2026-02-13T04:06:45.345507+0000) 2026-02-13T04:07:07.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:06 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:06.768+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:26.346361+0000 front 2026-02-13T04:06:26.346298+0000 (oldest deadline 2026-02-13T04:06:52.246370+0000) 2026-02-13T04:07:07.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:06 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:06.768+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6814 osd.3 since back 2026-02-13T04:06:36.346810+0000 front 2026-02-13T04:06:36.346958+0000 (oldest deadline 2026-02-13T04:06:56.846749+0000) 2026-02-13T04:07:07.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:06 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:06.768+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.99:6812 osd.4 since back 2026-02-13T04:06:42.147094+0000 front 2026-02-13T04:06:42.147108+0000 (oldest deadline 2026-02-13T04:07:06.247198+0000) 2026-02-13T04:07:07.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:07 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:07.257+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.285288+0000 front 2026-02-13T04:06:16.285227+0000 (oldest deadline 2026-02-13T04:06:40.985214+0000) 2026-02-13T04:07:07.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:07 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:07.257+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:25.085589+0000 front 2026-02-13T04:06:25.085811+0000 (oldest deadline 2026-02-13T04:06:46.785653+0000) 2026-02-13T04:07:07.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:07 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:07.257+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:29.086015+0000 front 2026-02-13T04:06:29.086023+0000 (oldest deadline 2026-02-13T04:06:54.386126+0000) 2026-02-13T04:07:07.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:07 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:07.257+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6812 osd.4 since back 2026-02-13T04:06:39.686601+0000 front 2026-02-13T04:06:39.686588+0000 (oldest deadline 2026-02-13T04:07:05.586646+0000) 2026-02-13T04:07:07.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:07 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:07.415+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.868796+0000 front 2026-02-13T04:06:16.868651+0000 (oldest deadline 2026-02-13T04:06:40.968550+0000) 2026-02-13T04:07:07.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:07 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:07.415+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:20.968894+0000 front 2026-02-13T04:06:20.968792+0000 (oldest deadline 2026-02-13T04:06:46.868811+0000) 2026-02-13T04:07:07.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:07 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:07.415+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:27.369306+0000 front 2026-02-13T04:06:27.369548+0000 (oldest deadline 2026-02-13T04:06:51.469293+0000) 2026-02-13T04:07:07.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:07 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:07.415+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.92:6814 osd.3 since back 2026-02-13T04:06:31.469509+0000 front 2026-02-13T04:06:31.469724+0000 (oldest deadline 2026-02-13T04:06:57.369591+0000) 2026-02-13T04:07:07.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:07 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:07.415+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.99:6812 osd.4 since back 2026-02-13T04:06:37.369903+0000 front 2026-02-13T04:06:37.369867+0000 (oldest deadline 2026-02-13T04:07:03.269867+0000) 2026-02-13T04:07:08.117 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:07 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:07.755+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.945152+0000 front 2026-02-13T04:06:15.945228+0000 (oldest deadline 2026-02-13T04:06:41.845216+0000) 2026-02-13T04:07:08.117 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:07 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:07.755+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:21.845442+0000 front 2026-02-13T04:06:21.845538+0000 (oldest deadline 2026-02-13T04:06:45.345507+0000) 2026-02-13T04:07:08.117 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:07 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:07.755+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:26.346361+0000 front 2026-02-13T04:06:26.346298+0000 (oldest deadline 2026-02-13T04:06:52.246370+0000) 2026-02-13T04:07:08.117 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:07 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:07.755+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6814 osd.3 since back 2026-02-13T04:06:36.346810+0000 front 2026-02-13T04:06:36.346958+0000 (oldest deadline 2026-02-13T04:06:56.846749+0000) 2026-02-13T04:07:08.117 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:07 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:07.755+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.99:6812 osd.4 since back 2026-02-13T04:06:42.147094+0000 front 2026-02-13T04:06:42.147108+0000 (oldest deadline 2026-02-13T04:07:06.247198+0000) 2026-02-13T04:07:08.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:08 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:08.222+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.285288+0000 front 2026-02-13T04:06:16.285227+0000 (oldest deadline 2026-02-13T04:06:40.985214+0000) 2026-02-13T04:07:08.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:08 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:08.222+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:25.085589+0000 front 2026-02-13T04:06:25.085811+0000 (oldest deadline 2026-02-13T04:06:46.785653+0000) 2026-02-13T04:07:08.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:08 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:08.222+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:29.086015+0000 front 2026-02-13T04:06:29.086023+0000 (oldest deadline 2026-02-13T04:06:54.386126+0000) 2026-02-13T04:07:08.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:08 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:08.222+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6812 osd.4 since back 2026-02-13T04:06:39.686601+0000 front 2026-02-13T04:06:39.686588+0000 (oldest deadline 2026-02-13T04:07:05.586646+0000) 2026-02-13T04:07:08.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:08 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:08.417+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.868796+0000 front 2026-02-13T04:06:16.868651+0000 (oldest deadline 2026-02-13T04:06:40.968550+0000) 2026-02-13T04:07:08.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:08 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:08.417+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:20.968894+0000 front 2026-02-13T04:06:20.968792+0000 (oldest deadline 2026-02-13T04:06:46.868811+0000) 2026-02-13T04:07:08.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:08 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:08.417+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:27.369306+0000 front 2026-02-13T04:06:27.369548+0000 (oldest deadline 2026-02-13T04:06:51.469293+0000) 2026-02-13T04:07:08.684 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:08 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:08.417+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.92:6814 osd.3 since back 2026-02-13T04:06:31.469509+0000 front 2026-02-13T04:06:31.469724+0000 (oldest deadline 2026-02-13T04:06:57.369591+0000) 2026-02-13T04:07:08.684 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:08 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:08.417+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.99:6812 osd.4 since back 2026-02-13T04:06:37.369903+0000 front 2026-02-13T04:06:37.369867+0000 (oldest deadline 2026-02-13T04:07:03.269867+0000) 2026-02-13T04:07:09.117 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:08 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:08.791+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.945152+0000 front 2026-02-13T04:06:15.945228+0000 (oldest deadline 2026-02-13T04:06:41.845216+0000) 2026-02-13T04:07:09.117 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:08 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:08.791+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:21.845442+0000 front 2026-02-13T04:06:21.845538+0000 (oldest deadline 2026-02-13T04:06:45.345507+0000) 2026-02-13T04:07:09.117 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:08 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:08.791+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:26.346361+0000 front 2026-02-13T04:06:26.346298+0000 (oldest deadline 2026-02-13T04:06:52.246370+0000) 2026-02-13T04:07:09.117 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:08 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:08.791+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6814 osd.3 since back 2026-02-13T04:06:36.346810+0000 front 2026-02-13T04:06:36.346958+0000 (oldest deadline 2026-02-13T04:06:56.846749+0000) 2026-02-13T04:07:09.117 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:08 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:08.791+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.99:6812 osd.4 since back 2026-02-13T04:06:42.147094+0000 front 2026-02-13T04:06:42.147108+0000 (oldest deadline 2026-02-13T04:07:06.247198+0000) 2026-02-13T04:07:09.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:09 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:09.212+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.285288+0000 front 2026-02-13T04:06:16.285227+0000 (oldest deadline 2026-02-13T04:06:40.985214+0000) 2026-02-13T04:07:09.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:09 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:09.212+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:25.085589+0000 front 2026-02-13T04:06:25.085811+0000 (oldest deadline 2026-02-13T04:06:46.785653+0000) 2026-02-13T04:07:09.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:09 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:09.212+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:29.086015+0000 front 2026-02-13T04:06:29.086023+0000 (oldest deadline 2026-02-13T04:06:54.386126+0000) 2026-02-13T04:07:09.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:09 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:09.212+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6812 osd.4 since back 2026-02-13T04:06:39.686601+0000 front 2026-02-13T04:06:39.686588+0000 (oldest deadline 2026-02-13T04:07:05.586646+0000) 2026-02-13T04:07:09.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:09 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:09.389+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.868796+0000 front 2026-02-13T04:06:16.868651+0000 (oldest deadline 2026-02-13T04:06:40.968550+0000) 2026-02-13T04:07:09.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:09 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:09.389+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:20.968894+0000 front 2026-02-13T04:06:20.968792+0000 (oldest deadline 2026-02-13T04:06:46.868811+0000) 2026-02-13T04:07:09.683 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:09 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:09.389+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:27.369306+0000 front 2026-02-13T04:06:27.369548+0000 (oldest deadline 2026-02-13T04:06:51.469293+0000) 2026-02-13T04:07:09.684 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:09 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:09.389+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.92:6814 osd.3 since back 2026-02-13T04:06:31.469509+0000 front 2026-02-13T04:06:31.469724+0000 (oldest deadline 2026-02-13T04:06:57.369591+0000) 2026-02-13T04:07:09.684 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:09 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:09.389+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.99:6812 osd.4 since back 2026-02-13T04:06:37.369903+0000 front 2026-02-13T04:06:37.369867+0000 (oldest deadline 2026-02-13T04:07:03.269867+0000) 2026-02-13T04:07:09.684 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:09 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:09.389+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.158:6812 osd.5 since back 2026-02-13T04:06:43.770297+0000 front 2026-02-13T04:06:43.770414+0000 (oldest deadline 2026-02-13T04:07:08.470292+0000) 2026-02-13T04:07:10.117 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:09 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:09.746+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.945152+0000 front 2026-02-13T04:06:15.945228+0000 (oldest deadline 2026-02-13T04:06:41.845216+0000) 2026-02-13T04:07:10.117 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:09 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:09.746+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:21.845442+0000 front 2026-02-13T04:06:21.845538+0000 (oldest deadline 2026-02-13T04:06:45.345507+0000) 2026-02-13T04:07:10.117 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:09 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:09.746+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:26.346361+0000 front 2026-02-13T04:06:26.346298+0000 (oldest deadline 2026-02-13T04:06:52.246370+0000) 2026-02-13T04:07:10.117 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:09 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:09.746+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6814 osd.3 since back 2026-02-13T04:06:36.346810+0000 front 2026-02-13T04:06:36.346958+0000 (oldest deadline 2026-02-13T04:06:56.846749+0000) 2026-02-13T04:07:10.117 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:09 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:09.746+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.99:6812 osd.4 since back 2026-02-13T04:06:42.147094+0000 front 2026-02-13T04:06:42.147108+0000 (oldest deadline 2026-02-13T04:07:06.247198+0000) 2026-02-13T04:07:10.480 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:10 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:10.168+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.285288+0000 front 2026-02-13T04:06:16.285227+0000 (oldest deadline 2026-02-13T04:06:40.985214+0000) 2026-02-13T04:07:10.480 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:10 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:10.168+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:25.085589+0000 front 2026-02-13T04:06:25.085811+0000 (oldest deadline 2026-02-13T04:06:46.785653+0000) 2026-02-13T04:07:10.480 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:10 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:10.168+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:29.086015+0000 front 2026-02-13T04:06:29.086023+0000 (oldest deadline 2026-02-13T04:06:54.386126+0000) 2026-02-13T04:07:10.480 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:10 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:10.168+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6812 osd.4 since back 2026-02-13T04:06:39.686601+0000 front 2026-02-13T04:06:39.686588+0000 (oldest deadline 2026-02-13T04:07:05.586646+0000) 2026-02-13T04:07:10.677 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:10 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:10.421+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.868796+0000 front 2026-02-13T04:06:16.868651+0000 (oldest deadline 2026-02-13T04:06:40.968550+0000) 2026-02-13T04:07:10.677 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:10 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:10.421+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:20.968894+0000 front 2026-02-13T04:06:20.968792+0000 (oldest deadline 2026-02-13T04:06:46.868811+0000) 2026-02-13T04:07:10.677 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:10 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:10.421+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:27.369306+0000 front 2026-02-13T04:06:27.369548+0000 (oldest deadline 2026-02-13T04:06:51.469293+0000) 2026-02-13T04:07:10.677 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:10 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:10.421+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.92:6814 osd.3 since back 2026-02-13T04:06:31.469509+0000 front 2026-02-13T04:06:31.469724+0000 (oldest deadline 2026-02-13T04:06:57.369591+0000) 2026-02-13T04:07:10.678 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:10 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:10.421+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.99:6812 osd.4 since back 2026-02-13T04:06:37.369903+0000 front 2026-02-13T04:06:37.369867+0000 (oldest deadline 2026-02-13T04:07:03.269867+0000) 2026-02-13T04:07:10.678 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:10 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9[53241]: 2026-02-13T04:07:10.421+0000 7f83e2fc46c0 -1 osd.9 78 heartbeat_check: no reply from 10.20.193.158:6812 osd.5 since back 2026-02-13T04:06:43.770297+0000 front 2026-02-13T04:06:43.770414+0000 (oldest deadline 2026-02-13T04:07:08.470292+0000) 2026-02-13T04:07:10.678 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:10 trial092 podman[74355]: 2026-02-13 04:07:10.612879633 +0000 UTC m=+5.129027382 container died a6466c708b1e15e2b8fecea5c99e06ffdd1976d91b5be3e9b0bab91c18e6e969 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, io.buildah.version=1.33.7, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.licenses=BSD-3-Clause, summary=Rocky Linux Base image, OSD_FLAVOR=default, vendor=Rocky Enterprise Software Foundation, version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True) 2026-02-13T04:07:10.678 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:10 trial092 podman[74355]: 2026-02-13 04:07:10.670795697 +0000 UTC m=+5.186943437 container remove a6466c708b1e15e2b8fecea5c99e06ffdd1976d91b5be3e9b0bab91c18e6e969 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9, OSD_FLAVOR=default, license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, version=10, org.opencontainers.image.version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, name=rockylinux, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.licenses=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, summary=Rocky Linux Base image, org.opencontainers.image.documentation=https://docs.ceph.com/) 2026-02-13T04:07:10.678 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:10 trial092 bash[74355]: ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9 2026-02-13T04:07:10.933 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:10 trial092 podman[74457]: 2026-02-13 04:07:10.905621966 +0000 UTC m=+0.026716224 container create 0f5cc3fabb84f95e7813cf83f75006809ad5e63156bbea200accf28bc2413edc (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, summary=Rocky Linux Base image, org.opencontainers.image.authors=Ceph Release Team , ceph=True, OSD_FLAVOR=default, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.version=10, io.buildah.version=1.33.7, version=10, vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/, license=BSD-3-Clause, name=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation) 2026-02-13T04:07:11.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:10 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:10.774+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.945152+0000 front 2026-02-13T04:06:15.945228+0000 (oldest deadline 2026-02-13T04:06:41.845216+0000) 2026-02-13T04:07:11.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:10 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:10.774+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:21.845442+0000 front 2026-02-13T04:06:21.845538+0000 (oldest deadline 2026-02-13T04:06:45.345507+0000) 2026-02-13T04:07:11.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:10 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:10.774+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:26.346361+0000 front 2026-02-13T04:06:26.346298+0000 (oldest deadline 2026-02-13T04:06:52.246370+0000) 2026-02-13T04:07:11.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:10 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:10.774+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6814 osd.3 since back 2026-02-13T04:06:36.346810+0000 front 2026-02-13T04:06:36.346958+0000 (oldest deadline 2026-02-13T04:06:56.846749+0000) 2026-02-13T04:07:11.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:10 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:10.774+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.99:6812 osd.4 since back 2026-02-13T04:06:42.147094+0000 front 2026-02-13T04:06:42.147108+0000 (oldest deadline 2026-02-13T04:07:06.247198+0000) 2026-02-13T04:07:11.192 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:10 trial092 podman[74457]: 2026-02-13 04:07:10.949152718 +0000 UTC m=+0.070246986 container init 0f5cc3fabb84f95e7813cf83f75006809ad5e63156bbea200accf28bc2413edc (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9-deactivate, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, summary=Rocky Linux Base image, version=10, org.opencontainers.image.licenses=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , ceph=True, OSD_FLAVOR=default, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, org.opencontainers.image.title=rockylinux, license=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, name=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10) 2026-02-13T04:07:11.192 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:10 trial092 podman[74457]: 2026-02-13 04:07:10.954338054 +0000 UTC m=+0.075432312 container start 0f5cc3fabb84f95e7813cf83f75006809ad5e63156bbea200accf28bc2413edc (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9-deactivate, license=BSD-3-Clause, name=rockylinux, OSD_FLAVOR=default, org.opencontainers.image.licenses=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.title=rockylinux, ceph=True, summary=Rocky Linux Base image, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.version=10) 2026-02-13T04:07:11.192 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:10 trial092 podman[74457]: 2026-02-13 04:07:10.955381315 +0000 UTC m=+0.076475573 container attach 0f5cc3fabb84f95e7813cf83f75006809ad5e63156bbea200accf28bc2413edc (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9-deactivate, org.opencontainers.image.licenses=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, ceph=True, summary=Rocky Linux Base image, version=10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, io.buildah.version=1.33.7, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.title=rockylinux, OSD_FLAVOR=default, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.version=10, org.opencontainers.image.authors=Ceph Release Team , name=rockylinux) 2026-02-13T04:07:11.192 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:10 trial092 podman[74457]: 2026-02-13 04:07:10.896394399 +0000 UTC m=+0.017488657 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T04:07:11.192 INFO:journalctl@ceph.osd.9.trial092.stdout:Feb 13 04:07:11 trial092 podman[74457]: 2026-02-13 04:07:11.142475437 +0000 UTC m=+0.263569695 container died 0f5cc3fabb84f95e7813cf83f75006809ad5e63156bbea200accf28bc2413edc (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-9-deactivate, OSD_FLAVOR=default, version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.version=10, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_REF=wip-pdonnell-testing-20260210.171210, ceph=True, vendor=Rocky Enterprise Software Foundation, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.title=rockylinux, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, name=rockylinux) 2026-02-13T04:07:11.229 DEBUG:teuthology.orchestra.run.trial092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@osd.9.service' 2026-02-13T04:07:11.300 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T04:07:11.301 INFO:tasks.cephadm.osd.9:Stopped osd.9 2026-02-13T04:07:11.301 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2026-02-13T04:07:11.301 DEBUG:teuthology.orchestra.run.trial099:> sudo systemctl stop ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@osd.10 2026-02-13T04:07:11.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:11 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:11.156+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.285288+0000 front 2026-02-13T04:06:16.285227+0000 (oldest deadline 2026-02-13T04:06:40.985214+0000) 2026-02-13T04:07:11.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:11 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:11.156+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:25.085589+0000 front 2026-02-13T04:06:25.085811+0000 (oldest deadline 2026-02-13T04:06:46.785653+0000) 2026-02-13T04:07:11.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:11 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:11.156+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:29.086015+0000 front 2026-02-13T04:06:29.086023+0000 (oldest deadline 2026-02-13T04:06:54.386126+0000) 2026-02-13T04:07:11.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:11 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:11.156+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6812 osd.4 since back 2026-02-13T04:06:39.686601+0000 front 2026-02-13T04:06:39.686588+0000 (oldest deadline 2026-02-13T04:07:05.586646+0000) 2026-02-13T04:07:11.616 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:11 trial099 systemd[1]: Stopping Ceph osd.10 for 1fefccae-0890-11f1-bcc5-d404e6e7d460... 2026-02-13T04:07:11.617 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:11 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:11.395+0000 7f9d23b136c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T04:07:11.617 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:11 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:11.395+0000 7f9d23b136c0 -1 osd.10 78 *** Got signal Terminated *** 2026-02-13T04:07:11.617 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:11 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:11.395+0000 7f9d23b136c0 -1 osd.10 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T04:07:12.117 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:11 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:11.789+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.945152+0000 front 2026-02-13T04:06:15.945228+0000 (oldest deadline 2026-02-13T04:06:41.845216+0000) 2026-02-13T04:07:12.117 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:11 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:11.789+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:21.845442+0000 front 2026-02-13T04:06:21.845538+0000 (oldest deadline 2026-02-13T04:06:45.345507+0000) 2026-02-13T04:07:12.117 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:11 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:11.789+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:26.346361+0000 front 2026-02-13T04:06:26.346298+0000 (oldest deadline 2026-02-13T04:06:52.246370+0000) 2026-02-13T04:07:12.117 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:11 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:11.789+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6814 osd.3 since back 2026-02-13T04:06:36.346810+0000 front 2026-02-13T04:06:36.346958+0000 (oldest deadline 2026-02-13T04:06:56.846749+0000) 2026-02-13T04:07:12.117 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:11 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:11.789+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.99:6812 osd.4 since back 2026-02-13T04:06:42.147094+0000 front 2026-02-13T04:06:42.147108+0000 (oldest deadline 2026-02-13T04:07:06.247198+0000) 2026-02-13T04:07:12.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:12 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:12.139+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.285288+0000 front 2026-02-13T04:06:16.285227+0000 (oldest deadline 2026-02-13T04:06:40.985214+0000) 2026-02-13T04:07:12.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:12 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:12.139+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:25.085589+0000 front 2026-02-13T04:06:25.085811+0000 (oldest deadline 2026-02-13T04:06:46.785653+0000) 2026-02-13T04:07:12.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:12 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:12.139+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:29.086015+0000 front 2026-02-13T04:06:29.086023+0000 (oldest deadline 2026-02-13T04:06:54.386126+0000) 2026-02-13T04:07:12.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:12 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:12.139+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6812 osd.4 since back 2026-02-13T04:06:39.686601+0000 front 2026-02-13T04:06:39.686588+0000 (oldest deadline 2026-02-13T04:07:05.586646+0000) 2026-02-13T04:07:13.117 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:12 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:12.758+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.945152+0000 front 2026-02-13T04:06:15.945228+0000 (oldest deadline 2026-02-13T04:06:41.845216+0000) 2026-02-13T04:07:13.117 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:12 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:12.758+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:21.845442+0000 front 2026-02-13T04:06:21.845538+0000 (oldest deadline 2026-02-13T04:06:45.345507+0000) 2026-02-13T04:07:13.117 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:12 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:12.758+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:26.346361+0000 front 2026-02-13T04:06:26.346298+0000 (oldest deadline 2026-02-13T04:06:52.246370+0000) 2026-02-13T04:07:13.117 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:12 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:12.758+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6814 osd.3 since back 2026-02-13T04:06:36.346810+0000 front 2026-02-13T04:06:36.346958+0000 (oldest deadline 2026-02-13T04:06:56.846749+0000) 2026-02-13T04:07:13.117 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:12 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:12.758+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.99:6812 osd.4 since back 2026-02-13T04:06:42.147094+0000 front 2026-02-13T04:06:42.147108+0000 (oldest deadline 2026-02-13T04:07:06.247198+0000) 2026-02-13T04:07:13.117 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:12 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:12.758+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.158:6812 osd.5 since back 2026-02-13T04:06:47.347673+0000 front 2026-02-13T04:06:47.347578+0000 (oldest deadline 2026-02-13T04:07:12.047611+0000) 2026-02-13T04:07:13.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:13 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:13.098+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.285288+0000 front 2026-02-13T04:06:16.285227+0000 (oldest deadline 2026-02-13T04:06:40.985214+0000) 2026-02-13T04:07:13.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:13 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:13.098+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:25.085589+0000 front 2026-02-13T04:06:25.085811+0000 (oldest deadline 2026-02-13T04:06:46.785653+0000) 2026-02-13T04:07:13.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:13 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:13.098+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:29.086015+0000 front 2026-02-13T04:06:29.086023+0000 (oldest deadline 2026-02-13T04:06:54.386126+0000) 2026-02-13T04:07:13.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:13 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:13.098+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6812 osd.4 since back 2026-02-13T04:06:39.686601+0000 front 2026-02-13T04:06:39.686588+0000 (oldest deadline 2026-02-13T04:07:05.586646+0000) 2026-02-13T04:07:13.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:13 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:13.098+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.158:6812 osd.5 since back 2026-02-13T04:06:46.686993+0000 front 2026-02-13T04:06:46.687010+0000 (oldest deadline 2026-02-13T04:07:12.587090+0000) 2026-02-13T04:07:14.117 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:13 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:13.767+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.945152+0000 front 2026-02-13T04:06:15.945228+0000 (oldest deadline 2026-02-13T04:06:41.845216+0000) 2026-02-13T04:07:14.117 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:13 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:13.767+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:21.845442+0000 front 2026-02-13T04:06:21.845538+0000 (oldest deadline 2026-02-13T04:06:45.345507+0000) 2026-02-13T04:07:14.117 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:13 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:13.767+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:26.346361+0000 front 2026-02-13T04:06:26.346298+0000 (oldest deadline 2026-02-13T04:06:52.246370+0000) 2026-02-13T04:07:14.117 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:13 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:13.767+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6814 osd.3 since back 2026-02-13T04:06:36.346810+0000 front 2026-02-13T04:06:36.346958+0000 (oldest deadline 2026-02-13T04:06:56.846749+0000) 2026-02-13T04:07:14.117 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:13 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:13.767+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.99:6812 osd.4 since back 2026-02-13T04:06:42.147094+0000 front 2026-02-13T04:06:42.147108+0000 (oldest deadline 2026-02-13T04:07:06.247198+0000) 2026-02-13T04:07:14.117 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:13 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:13.767+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.158:6812 osd.5 since back 2026-02-13T04:06:47.347673+0000 front 2026-02-13T04:06:47.347578+0000 (oldest deadline 2026-02-13T04:07:12.047611+0000) 2026-02-13T04:07:14.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:14 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:14.130+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.285288+0000 front 2026-02-13T04:06:16.285227+0000 (oldest deadline 2026-02-13T04:06:40.985214+0000) 2026-02-13T04:07:14.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:14 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:14.130+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:25.085589+0000 front 2026-02-13T04:06:25.085811+0000 (oldest deadline 2026-02-13T04:06:46.785653+0000) 2026-02-13T04:07:14.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:14 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:14.130+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:29.086015+0000 front 2026-02-13T04:06:29.086023+0000 (oldest deadline 2026-02-13T04:06:54.386126+0000) 2026-02-13T04:07:14.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:14 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:14.130+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6812 osd.4 since back 2026-02-13T04:06:39.686601+0000 front 2026-02-13T04:06:39.686588+0000 (oldest deadline 2026-02-13T04:07:05.586646+0000) 2026-02-13T04:07:14.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:14 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:14.130+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.158:6812 osd.5 since back 2026-02-13T04:06:46.686993+0000 front 2026-02-13T04:06:46.687010+0000 (oldest deadline 2026-02-13T04:07:12.587090+0000) 2026-02-13T04:07:15.117 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:14 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:14.795+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.945152+0000 front 2026-02-13T04:06:15.945228+0000 (oldest deadline 2026-02-13T04:06:41.845216+0000) 2026-02-13T04:07:15.117 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:14 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:14.795+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:21.845442+0000 front 2026-02-13T04:06:21.845538+0000 (oldest deadline 2026-02-13T04:06:45.345507+0000) 2026-02-13T04:07:15.117 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:14 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:14.795+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:26.346361+0000 front 2026-02-13T04:06:26.346298+0000 (oldest deadline 2026-02-13T04:06:52.246370+0000) 2026-02-13T04:07:15.117 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:14 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:14.795+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6814 osd.3 since back 2026-02-13T04:06:36.346810+0000 front 2026-02-13T04:06:36.346958+0000 (oldest deadline 2026-02-13T04:06:56.846749+0000) 2026-02-13T04:07:15.117 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:14 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:14.795+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.99:6812 osd.4 since back 2026-02-13T04:06:42.147094+0000 front 2026-02-13T04:06:42.147108+0000 (oldest deadline 2026-02-13T04:07:06.247198+0000) 2026-02-13T04:07:15.117 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:14 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:14.795+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.158:6812 osd.5 since back 2026-02-13T04:06:47.347673+0000 front 2026-02-13T04:06:47.347578+0000 (oldest deadline 2026-02-13T04:07:12.047611+0000) 2026-02-13T04:07:15.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:15 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:15.113+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.285288+0000 front 2026-02-13T04:06:16.285227+0000 (oldest deadline 2026-02-13T04:06:40.985214+0000) 2026-02-13T04:07:15.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:15 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:15.113+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:25.085589+0000 front 2026-02-13T04:06:25.085811+0000 (oldest deadline 2026-02-13T04:06:46.785653+0000) 2026-02-13T04:07:15.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:15 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:15.113+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:29.086015+0000 front 2026-02-13T04:06:29.086023+0000 (oldest deadline 2026-02-13T04:06:54.386126+0000) 2026-02-13T04:07:15.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:15 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:15.113+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6812 osd.4 since back 2026-02-13T04:06:39.686601+0000 front 2026-02-13T04:06:39.686588+0000 (oldest deadline 2026-02-13T04:07:05.586646+0000) 2026-02-13T04:07:15.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:15 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:15.113+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.158:6812 osd.5 since back 2026-02-13T04:06:46.686993+0000 front 2026-02-13T04:06:46.687010+0000 (oldest deadline 2026-02-13T04:07:12.587090+0000) 2026-02-13T04:07:15.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:15 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:15.113+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6822 osd.6 since back 2026-02-13T04:06:52.587331+0000 front 2026-02-13T04:06:52.587398+0000 (oldest deadline 2026-02-13T04:07:14.887269+0000) 2026-02-13T04:07:16.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:15 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:15.756+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:15.945152+0000 front 2026-02-13T04:06:15.945228+0000 (oldest deadline 2026-02-13T04:06:41.845216+0000) 2026-02-13T04:07:16.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:15 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:15.756+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:21.845442+0000 front 2026-02-13T04:06:21.845538+0000 (oldest deadline 2026-02-13T04:06:45.345507+0000) 2026-02-13T04:07:16.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:15 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:15.756+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:26.346361+0000 front 2026-02-13T04:06:26.346298+0000 (oldest deadline 2026-02-13T04:06:52.246370+0000) 2026-02-13T04:07:16.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:15 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:15.756+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6814 osd.3 since back 2026-02-13T04:06:36.346810+0000 front 2026-02-13T04:06:36.346958+0000 (oldest deadline 2026-02-13T04:06:56.846749+0000) 2026-02-13T04:07:16.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:15 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:15.756+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.99:6812 osd.4 since back 2026-02-13T04:06:42.147094+0000 front 2026-02-13T04:06:42.147108+0000 (oldest deadline 2026-02-13T04:07:06.247198+0000) 2026-02-13T04:07:16.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:15 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:15.756+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.158:6812 osd.5 since back 2026-02-13T04:06:47.347673+0000 front 2026-02-13T04:06:47.347578+0000 (oldest deadline 2026-02-13T04:07:12.047611+0000) 2026-02-13T04:07:16.116 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:15 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10[52734]: 2026-02-13T04:07:15.756+0000 7f9d201d86c0 -1 osd.10 78 heartbeat_check: no reply from 10.20.193.92:6822 osd.6 since back 2026-02-13T04:06:52.047849+0000 front 2026-02-13T04:06:52.047920+0000 (oldest deadline 2026-02-13T04:07:14.947805+0000) 2026-02-13T04:07:16.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:16 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:16.143+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.285288+0000 front 2026-02-13T04:06:16.285227+0000 (oldest deadline 2026-02-13T04:06:40.985214+0000) 2026-02-13T04:07:16.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:16 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:16.143+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:25.085589+0000 front 2026-02-13T04:06:25.085811+0000 (oldest deadline 2026-02-13T04:06:46.785653+0000) 2026-02-13T04:07:16.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:16 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:16.143+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:29.086015+0000 front 2026-02-13T04:06:29.086023+0000 (oldest deadline 2026-02-13T04:06:54.386126+0000) 2026-02-13T04:07:16.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:16 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:16.143+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6812 osd.4 since back 2026-02-13T04:06:39.686601+0000 front 2026-02-13T04:06:39.686588+0000 (oldest deadline 2026-02-13T04:07:05.586646+0000) 2026-02-13T04:07:16.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:16 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:16.143+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.158:6812 osd.5 since back 2026-02-13T04:06:46.686993+0000 front 2026-02-13T04:06:46.687010+0000 (oldest deadline 2026-02-13T04:07:12.587090+0000) 2026-02-13T04:07:16.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:16 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:16.143+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6822 osd.6 since back 2026-02-13T04:06:52.587331+0000 front 2026-02-13T04:06:52.587398+0000 (oldest deadline 2026-02-13T04:07:14.887269+0000) 2026-02-13T04:07:16.746 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:16 trial099 podman[60852]: 2026-02-13 04:07:16.455689387 +0000 UTC m=+5.072216370 container died 84f8f135163a98bbf6bd1525bb9f1adcba4b598c3b7d21965ab793b518c9040d (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10, org.opencontainers.image.documentation=https://docs.ceph.com/, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.title=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, io.buildah.version=1.33.7, version=10, OSD_FLAVOR=default, ceph=True, org.opencontainers.image.authors=Ceph Release Team , summary=Rocky Linux Base image, org.opencontainers.image.licenses=BSD-3-Clause, license=BSD-3-Clause, name=rockylinux) 2026-02-13T04:07:16.747 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:16 trial099 podman[60852]: 2026-02-13 04:07:16.46404405 +0000 UTC m=+5.080571033 container remove 84f8f135163a98bbf6bd1525bb9f1adcba4b598c3b7d21965ab793b518c9040d (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10, summary=Rocky Linux Base image, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.licenses=BSD-3-Clause, OSD_FLAVOR=default, name=rockylinux, org.opencontainers.image.authors=Ceph Release Team , license=BSD-3-Clause, org.opencontainers.image.title=rockylinux, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_REF=wip-pdonnell-testing-20260210.171210, io.buildah.version=1.33.7, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, ceph=True) 2026-02-13T04:07:16.747 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:16 trial099 bash[60852]: ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10 2026-02-13T04:07:16.747 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:16 trial099 podman[60979]: 2026-02-13 04:07:16.592581015 +0000 UTC m=+0.016212675 container create 9c62ebc0fec93902c8e4749ce9ad0a7f393849c846f71dc2c8ee93dd231084a3 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10-deactivate, org.opencontainers.image.licenses=BSD-3-Clause, version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.version=10, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, io.buildah.version=1.33.7, OSD_FLAVOR=default, org.opencontainers.image.title=rockylinux, ceph=True, CEPH_REF=wip-pdonnell-testing-20260210.171210, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.authors=Ceph Release Team , license=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/) 2026-02-13T04:07:16.747 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:16 trial099 podman[60979]: 2026-02-13 04:07:16.624434583 +0000 UTC m=+0.048066233 container init 9c62ebc0fec93902c8e4749ce9ad0a7f393849c846f71dc2c8ee93dd231084a3 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10-deactivate, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.licenses=BSD-3-Clause, name=rockylinux, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, summary=Rocky Linux Base image, ceph=True, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, license=BSD-3-Clause, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.authors=Ceph Release Team , io.buildah.version=1.33.7, OSD_FLAVOR=default, vendor=Rocky Enterprise Software Foundation) 2026-02-13T04:07:16.747 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:16 trial099 podman[60979]: 2026-02-13 04:07:16.627375046 +0000 UTC m=+0.051006716 container start 9c62ebc0fec93902c8e4749ce9ad0a7f393849c846f71dc2c8ee93dd231084a3 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10-deactivate, io.buildah.version=1.33.7, OSD_FLAVOR=default, CEPH_REF=wip-pdonnell-testing-20260210.171210, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.version=10, org.opencontainers.image.licenses=BSD-3-Clause, version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, license=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.title=rockylinux, name=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.authors=Ceph Release Team , summary=Rocky Linux Base image) 2026-02-13T04:07:16.747 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:16 trial099 podman[60979]: 2026-02-13 04:07:16.627890492 +0000 UTC m=+0.051522152 container attach 9c62ebc0fec93902c8e4749ce9ad0a7f393849c846f71dc2c8ee93dd231084a3 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-10-deactivate, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, org.opencontainers.image.licenses=BSD-3-Clause, version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, ceph=True, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, CEPH_REF=wip-pdonnell-testing-20260210.171210, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, name=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, OSD_FLAVOR=default, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git) 2026-02-13T04:07:16.747 INFO:journalctl@ceph.osd.10.trial099.stdout:Feb 13 04:07:16 trial099 podman[60979]: 2026-02-13 04:07:16.585692271 +0000 UTC m=+0.009323931 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T04:07:16.791 DEBUG:teuthology.orchestra.run.trial099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@osd.10.service' 2026-02-13T04:07:16.826 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T04:07:16.826 INFO:tasks.cephadm.osd.10:Stopped osd.10 2026-02-13T04:07:16.827 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2026-02-13T04:07:16.827 DEBUG:teuthology.orchestra.run.trial158:> sudo systemctl stop ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@osd.11 2026-02-13T04:07:17.159 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:16 trial158 systemd[1]: Stopping Ceph osd.11 for 1fefccae-0890-11f1-bcc5-d404e6e7d460... 2026-02-13T04:07:17.159 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:16 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:16.921+0000 7f70ed7f26c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --osd-objectstore=bluestore (PID: 1) UID: 0 2026-02-13T04:07:17.159 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:16 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:16.921+0000 7f70ed7f26c0 -1 osd.11 78 *** Got signal Terminated *** 2026-02-13T04:07:17.159 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:16 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:16.921+0000 7f70ed7f26c0 -1 osd.11 78 *** Immediate shutdown (osd_fast_shutdown=true) *** 2026-02-13T04:07:17.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:17 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:17.158+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.285288+0000 front 2026-02-13T04:06:16.285227+0000 (oldest deadline 2026-02-13T04:06:40.985214+0000) 2026-02-13T04:07:17.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:17 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:17.158+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:25.085589+0000 front 2026-02-13T04:06:25.085811+0000 (oldest deadline 2026-02-13T04:06:46.785653+0000) 2026-02-13T04:07:17.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:17 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:17.158+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:29.086015+0000 front 2026-02-13T04:06:29.086023+0000 (oldest deadline 2026-02-13T04:06:54.386126+0000) 2026-02-13T04:07:17.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:17 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:17.158+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6812 osd.4 since back 2026-02-13T04:06:39.686601+0000 front 2026-02-13T04:06:39.686588+0000 (oldest deadline 2026-02-13T04:07:05.586646+0000) 2026-02-13T04:07:17.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:17 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:17.158+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.158:6812 osd.5 since back 2026-02-13T04:06:46.686993+0000 front 2026-02-13T04:06:46.687010+0000 (oldest deadline 2026-02-13T04:07:12.587090+0000) 2026-02-13T04:07:17.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:17 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:17.158+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6822 osd.6 since back 2026-02-13T04:06:52.587331+0000 front 2026-02-13T04:06:52.587398+0000 (oldest deadline 2026-02-13T04:07:14.887269+0000) 2026-02-13T04:07:18.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:18 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:18.126+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.285288+0000 front 2026-02-13T04:06:16.285227+0000 (oldest deadline 2026-02-13T04:06:40.985214+0000) 2026-02-13T04:07:18.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:18 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:18.126+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:25.085589+0000 front 2026-02-13T04:06:25.085811+0000 (oldest deadline 2026-02-13T04:06:46.785653+0000) 2026-02-13T04:07:18.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:18 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:18.126+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:29.086015+0000 front 2026-02-13T04:06:29.086023+0000 (oldest deadline 2026-02-13T04:06:54.386126+0000) 2026-02-13T04:07:18.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:18 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:18.126+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6812 osd.4 since back 2026-02-13T04:06:39.686601+0000 front 2026-02-13T04:06:39.686588+0000 (oldest deadline 2026-02-13T04:07:05.586646+0000) 2026-02-13T04:07:18.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:18 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:18.126+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.158:6812 osd.5 since back 2026-02-13T04:06:46.686993+0000 front 2026-02-13T04:06:46.687010+0000 (oldest deadline 2026-02-13T04:07:12.587090+0000) 2026-02-13T04:07:18.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:18 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:18.126+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6822 osd.6 since back 2026-02-13T04:06:52.587331+0000 front 2026-02-13T04:06:52.587398+0000 (oldest deadline 2026-02-13T04:07:14.887269+0000) 2026-02-13T04:07:19.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:19 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:19.095+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.285288+0000 front 2026-02-13T04:06:16.285227+0000 (oldest deadline 2026-02-13T04:06:40.985214+0000) 2026-02-13T04:07:19.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:19 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:19.095+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:25.085589+0000 front 2026-02-13T04:06:25.085811+0000 (oldest deadline 2026-02-13T04:06:46.785653+0000) 2026-02-13T04:07:19.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:19 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:19.095+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:29.086015+0000 front 2026-02-13T04:06:29.086023+0000 (oldest deadline 2026-02-13T04:06:54.386126+0000) 2026-02-13T04:07:19.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:19 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:19.095+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6812 osd.4 since back 2026-02-13T04:06:39.686601+0000 front 2026-02-13T04:06:39.686588+0000 (oldest deadline 2026-02-13T04:07:05.586646+0000) 2026-02-13T04:07:19.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:19 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:19.095+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.158:6812 osd.5 since back 2026-02-13T04:06:46.686993+0000 front 2026-02-13T04:06:46.687010+0000 (oldest deadline 2026-02-13T04:07:12.587090+0000) 2026-02-13T04:07:19.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:19 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:19.095+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6822 osd.6 since back 2026-02-13T04:06:52.587331+0000 front 2026-02-13T04:06:52.587398+0000 (oldest deadline 2026-02-13T04:07:14.887269+0000) 2026-02-13T04:07:20.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:20 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:20.080+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.285288+0000 front 2026-02-13T04:06:16.285227+0000 (oldest deadline 2026-02-13T04:06:40.985214+0000) 2026-02-13T04:07:20.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:20 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:20.080+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:25.085589+0000 front 2026-02-13T04:06:25.085811+0000 (oldest deadline 2026-02-13T04:06:46.785653+0000) 2026-02-13T04:07:20.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:20 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:20.080+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:29.086015+0000 front 2026-02-13T04:06:29.086023+0000 (oldest deadline 2026-02-13T04:06:54.386126+0000) 2026-02-13T04:07:20.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:20 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:20.080+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6812 osd.4 since back 2026-02-13T04:06:39.686601+0000 front 2026-02-13T04:06:39.686588+0000 (oldest deadline 2026-02-13T04:07:05.586646+0000) 2026-02-13T04:07:20.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:20 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:20.080+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.158:6812 osd.5 since back 2026-02-13T04:06:46.686993+0000 front 2026-02-13T04:06:46.687010+0000 (oldest deadline 2026-02-13T04:07:12.587090+0000) 2026-02-13T04:07:20.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:20 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:20.080+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6822 osd.6 since back 2026-02-13T04:06:52.587331+0000 front 2026-02-13T04:06:52.587398+0000 (oldest deadline 2026-02-13T04:07:14.887269+0000) 2026-02-13T04:07:21.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:21 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:21.110+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6806 osd.0 since back 2026-02-13T04:06:16.285288+0000 front 2026-02-13T04:06:16.285227+0000 (oldest deadline 2026-02-13T04:06:40.985214+0000) 2026-02-13T04:07:21.578 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:21 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:21.110+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6804 osd.1 since back 2026-02-13T04:06:25.085589+0000 front 2026-02-13T04:06:25.085811+0000 (oldest deadline 2026-02-13T04:06:46.785653+0000) 2026-02-13T04:07:21.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:21 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:21.110+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.158:6804 osd.2 since back 2026-02-13T04:06:29.086015+0000 front 2026-02-13T04:06:29.086023+0000 (oldest deadline 2026-02-13T04:06:54.386126+0000) 2026-02-13T04:07:21.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:21 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:21.110+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6812 osd.4 since back 2026-02-13T04:06:39.686601+0000 front 2026-02-13T04:06:39.686588+0000 (oldest deadline 2026-02-13T04:07:05.586646+0000) 2026-02-13T04:07:21.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:21 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:21.110+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.158:6812 osd.5 since back 2026-02-13T04:06:46.686993+0000 front 2026-02-13T04:06:46.687010+0000 (oldest deadline 2026-02-13T04:07:12.587090+0000) 2026-02-13T04:07:21.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:21 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:21.110+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.92:6822 osd.6 since back 2026-02-13T04:06:52.587331+0000 front 2026-02-13T04:06:52.587398+0000 (oldest deadline 2026-02-13T04:07:14.887269+0000) 2026-02-13T04:07:21.579 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:21 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11[53073]: 2026-02-13T04:07:21.110+0000 7f70e9eb76c0 -1 osd.11 78 heartbeat_check: no reply from 10.20.193.99:6820 osd.7 since back 2026-02-13T04:06:55.387654+0000 front 2026-02-13T04:06:55.387626+0000 (oldest deadline 2026-02-13T04:07:20.687634+0000) 2026-02-13T04:07:22.280 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:21 trial158 podman[62982]: 2026-02-13 04:07:21.991238649 +0000 UTC m=+5.082008185 container died d876f89e3de3c161a03eaa2056050d0ca4c8644786114857b44a8578109b95bd (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11, vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.licenses=BSD-3-Clause, ceph=True, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.version=10, summary=Rocky Linux Base image, io.buildah.version=1.33.7, CEPH_REF=wip-pdonnell-testing-20260210.171210, version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, OSD_FLAVOR=default, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, license=BSD-3-Clause, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, name=rockylinux) 2026-02-13T04:07:22.280 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:21 trial158 podman[62982]: 2026-02-13 04:07:21.999446664 +0000 UTC m=+5.090216200 container remove d876f89e3de3c161a03eaa2056050d0ca4c8644786114857b44a8578109b95bd (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, OSD_FLAVOR=default, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, license=BSD-3-Clause, org.opencontainers.image.version=10, org.opencontainers.image.licenses=BSD-3-Clause, CEPH_REF=wip-pdonnell-testing-20260210.171210, ceph=True, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, vendor=Rocky Enterprise Software Foundation, io.buildah.version=1.33.7, org.opencontainers.image.documentation=https://docs.ceph.com/, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, name=rockylinux, summary=Rocky Linux Base image, version=10, org.opencontainers.image.title=rockylinux) 2026-02-13T04:07:22.280 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:21 trial158 bash[62982]: ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11 2026-02-13T04:07:22.280 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:22 trial158 podman[63109]: 2026-02-13 04:07:22.126142999 +0000 UTC m=+0.015693643 container create e3cc24147e4840484f50d832e799ce8086f18a6884e6046a215fdc8d7f464b97 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11-deactivate, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, ceph=True, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.documentation=https://docs.ceph.com/, vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, OSD_FLAVOR=default, summary=Rocky Linux Base image, io.buildah.version=1.33.7, name=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.licenses=BSD-3-Clause, version=10) 2026-02-13T04:07:22.280 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:22 trial158 podman[63109]: 2026-02-13 04:07:22.152408643 +0000 UTC m=+0.041959307 container init e3cc24147e4840484f50d832e799ce8086f18a6884e6046a215fdc8d7f464b97 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11-deactivate, org.opencontainers.image.version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, version=10, vendor=Rocky Enterprise Software Foundation, license=BSD-3-Clause, OSD_FLAVOR=default, io.buildah.version=1.33.7, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, name=rockylinux, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, CEPH_REF=wip-pdonnell-testing-20260210.171210, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.authors=Ceph Release Team ) 2026-02-13T04:07:22.280 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:22 trial158 podman[63109]: 2026-02-13 04:07:22.154829056 +0000 UTC m=+0.044379700 container start e3cc24147e4840484f50d832e799ce8086f18a6884e6046a215fdc8d7f464b97 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11-deactivate, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, vendor=Rocky Enterprise Software Foundation, OSD_FLAVOR=default, org.opencontainers.image.version=10, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.licenses=BSD-3-Clause, version=10, io.buildah.version=1.33.7, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, org.opencontainers.image.documentation=https://docs.ceph.com/, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, summary=Rocky Linux Base image, ceph=True, org.opencontainers.image.title=rockylinux, license=BSD-3-Clause) 2026-02-13T04:07:22.280 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:22 trial158 podman[63109]: 2026-02-13 04:07:22.155422249 +0000 UTC m=+0.044972913 container attach e3cc24147e4840484f50d832e799ce8086f18a6884e6046a215fdc8d7f464b97 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11-deactivate, GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, org.opencontainers.image.title=rockylinux, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, name=rockylinux, CEPH_REF=wip-pdonnell-testing-20260210.171210, version=10, org.opencontainers.image.authors=Ceph Release Team , org.opencontainers.image.version=10, summary=Rocky Linux Base image, vendor=Rocky Enterprise Software Foundation, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, ceph=True, OSD_FLAVOR=default, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, org.opencontainers.image.licenses=BSD-3-Clause, org.opencontainers.image.documentation=https://docs.ceph.com/, license=BSD-3-Clause, io.buildah.version=1.33.7) 2026-02-13T04:07:22.280 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:22 trial158 podman[63109]: 2026-02-13 04:07:22.119936451 +0000 UTC m=+0.009487105 image pull b86a4a15c2dcd78db08124ee64cb48fcd681d6db032e313da19d063813b235da quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9 2026-02-13T04:07:22.280 INFO:journalctl@ceph.osd.11.trial158.stdout:Feb 13 04:07:22 trial158 podman[63109]: 2026-02-13 04:07:22.279168839 +0000 UTC m=+0.168719493 container died e3cc24147e4840484f50d832e799ce8086f18a6884e6046a215fdc8d7f464b97 (image=quay.ceph.io/ceph-ci/ceph@sha256:63f911038232e331f6e269b8b72d48700ca549f85e7c5b5176a58489c268cee9, name=ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-osd-11-deactivate, OSD_FLAVOR=default, org.opencontainers.image.source=https://git.resf.org/sig_core/rocky-kiwi-descriptions/src/branch/r10, ceph=True, license=BSD-3-Clause, io.buildah.version=1.33.7, org.opencontainers.image.version=10, org.opencontainers.image.vendor=Rocky Enterprise Software Foundation, CEPH_REF=wip-pdonnell-testing-20260210.171210, version=10, org.opencontainers.image.documentation=https://docs.ceph.com/, vendor=Rocky Enterprise Software Foundation, CEPH_SHA1=8f8d38294e4db8750b4b1649f62ce37caa63080f, name=rockylinux, FROM_IMAGE=docker.io/rockylinux/rockylinux:10, summary=Rocky Linux Base image, CEPH_GIT_REPO=https://github.com/ceph/ceph-ci.git, org.opencontainers.image.title=rockylinux, org.opencontainers.image.authors=Ceph Release Team , GANESHA_REPO_BASEURL=https://buildlogs.centos.org/centos/$releasever-stream/storage/$basearch/nfsganesha-5/, org.opencontainers.image.licenses=BSD-3-Clause) 2026-02-13T04:07:22.311 DEBUG:teuthology.orchestra.run.trial158:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@osd.11.service' 2026-02-13T04:07:22.345 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T04:07:22.345 INFO:tasks.cephadm.osd.11:Stopped osd.11 2026-02-13T04:07:22.345 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2026-02-13T04:07:22.345 DEBUG:teuthology.orchestra.run.trial092:> sudo systemctl stop ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mds.a 2026-02-13T04:07:22.683 INFO:journalctl@ceph.mds.a.trial092.stdout:Feb 13 04:07:22 trial092 systemd[1]: Stopping Ceph mds.a for 1fefccae-0890-11f1-bcc5-d404e6e7d460... 2026-02-13T04:07:22.683 INFO:journalctl@ceph.mds.a.trial092.stdout:Feb 13 04:07:22 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-a[58650]: 2026-02-13T04:07:22.531+0000 7fad4ddb56c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T04:07:22.683 INFO:journalctl@ceph.mds.a.trial092.stdout:Feb 13 04:07:22 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-a[58650]: 2026-02-13T04:07:22.531+0000 7fad4ddb56c0 -1 mds.a *** got signal Terminated *** 2026-02-13T04:07:23.754 DEBUG:teuthology.orchestra.run.trial092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mds.a.service' 2026-02-13T04:07:23.819 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T04:07:23.819 INFO:tasks.cephadm.mds.a:Stopped mds.a 2026-02-13T04:07:23.819 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2026-02-13T04:07:23.819 DEBUG:teuthology.orchestra.run.trial092:> sudo systemctl stop ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mds.d 2026-02-13T04:07:24.183 INFO:journalctl@ceph.mds.d.trial092.stdout:Feb 13 04:07:23 trial092 systemd[1]: Stopping Ceph mds.d for 1fefccae-0890-11f1-bcc5-d404e6e7d460... 2026-02-13T04:07:24.183 INFO:journalctl@ceph.mds.d.trial092.stdout:Feb 13 04:07:24 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-d[57831]: 2026-02-13T04:07:24.037+0000 7fb298a5a6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T04:07:24.183 INFO:journalctl@ceph.mds.d.trial092.stdout:Feb 13 04:07:24 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-d[57831]: 2026-02-13T04:07:24.037+0000 7fb298a5a6c0 -1 mds.d *** got signal Terminated *** 2026-02-13T04:07:25.288 DEBUG:teuthology.orchestra.run.trial092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mds.d.service' 2026-02-13T04:07:25.353 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T04:07:25.353 INFO:tasks.cephadm.mds.d:Stopped mds.d 2026-02-13T04:07:25.354 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2026-02-13T04:07:25.354 DEBUG:teuthology.orchestra.run.trial092:> sudo systemctl stop ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mds.g 2026-02-13T04:07:25.683 INFO:journalctl@ceph.mds.g.trial092.stdout:Feb 13 04:07:25 trial092 systemd[1]: Stopping Ceph mds.g for 1fefccae-0890-11f1-bcc5-d404e6e7d460... 2026-02-13T04:07:25.683 INFO:journalctl@ceph.mds.g.trial092.stdout:Feb 13 04:07:25 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-g[58287]: 2026-02-13T04:07:25.530+0000 7fdcd23ff6c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T04:07:25.683 INFO:journalctl@ceph.mds.g.trial092.stdout:Feb 13 04:07:25 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-g[58287]: 2026-02-13T04:07:25.530+0000 7fdcd23ff6c0 -1 mds.g *** got signal Terminated *** 2026-02-13T04:07:26.650 DEBUG:teuthology.orchestra.run.trial092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mds.g.service' 2026-02-13T04:07:26.714 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T04:07:26.714 INFO:tasks.cephadm.mds.g:Stopped mds.g 2026-02-13T04:07:26.714 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2026-02-13T04:07:26.714 DEBUG:teuthology.orchestra.run.trial092:> sudo systemctl stop ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mds.j 2026-02-13T04:07:27.183 INFO:journalctl@ceph.mds.j.trial092.stdout:Feb 13 04:07:26 trial092 systemd[1]: Stopping Ceph mds.j for 1fefccae-0890-11f1-bcc5-d404e6e7d460... 2026-02-13T04:07:27.183 INFO:journalctl@ceph.mds.j.trial092.stdout:Feb 13 04:07:26 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-j[57533]: 2026-02-13T04:07:26.926+0000 7fdb79e576c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T04:07:27.183 INFO:journalctl@ceph.mds.j.trial092.stdout:Feb 13 04:07:26 trial092 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-j[57533]: 2026-02-13T04:07:26.926+0000 7fdb79e576c0 -1 mds.j *** got signal Terminated *** 2026-02-13T04:07:28.047 DEBUG:teuthology.orchestra.run.trial092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mds.j.service' 2026-02-13T04:07:28.111 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T04:07:28.111 INFO:tasks.cephadm.mds.j:Stopped mds.j 2026-02-13T04:07:28.111 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2026-02-13T04:07:28.111 DEBUG:teuthology.orchestra.run.trial099:> sudo systemctl stop ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mds.b 2026-02-13T04:07:28.616 INFO:journalctl@ceph.mds.b.trial099.stdout:Feb 13 04:07:28 trial099 systemd[1]: Stopping Ceph mds.b for 1fefccae-0890-11f1-bcc5-d404e6e7d460... 2026-02-13T04:07:28.616 INFO:journalctl@ceph.mds.b.trial099.stdout:Feb 13 04:07:28 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-b[57261]: 2026-02-13T04:07:28.207+0000 7fc5a38836c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T04:07:28.616 INFO:journalctl@ceph.mds.b.trial099.stdout:Feb 13 04:07:28 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-b[57261]: 2026-02-13T04:07:28.207+0000 7fc5a38836c0 -1 mds.b *** got signal Terminated *** 2026-02-13T04:07:36.287 DEBUG:teuthology.orchestra.run.trial099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mds.b.service' 2026-02-13T04:07:36.321 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T04:07:36.321 INFO:tasks.cephadm.mds.b:Stopped mds.b 2026-02-13T04:07:36.321 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2026-02-13T04:07:36.321 DEBUG:teuthology.orchestra.run.trial099:> sudo systemctl stop ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mds.e 2026-02-13T04:07:36.616 INFO:journalctl@ceph.mds.e.trial099.stdout:Feb 13 04:07:36 trial099 systemd[1]: Stopping Ceph mds.e for 1fefccae-0890-11f1-bcc5-d404e6e7d460... 2026-02-13T04:07:36.616 INFO:journalctl@ceph.mds.e.trial099.stdout:Feb 13 04:07:36 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-e[56614]: 2026-02-13T04:07:36.451+0000 7f437bb156c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T04:07:36.616 INFO:journalctl@ceph.mds.e.trial099.stdout:Feb 13 04:07:36 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-e[56614]: 2026-02-13T04:07:36.451+0000 7f437bb156c0 -1 mds.e *** got signal Terminated *** 2026-02-13T04:07:37.701 DEBUG:teuthology.orchestra.run.trial099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mds.e.service' 2026-02-13T04:07:37.732 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T04:07:37.732 INFO:tasks.cephadm.mds.e:Stopped mds.e 2026-02-13T04:07:37.732 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2026-02-13T04:07:37.732 DEBUG:teuthology.orchestra.run.trial099:> sudo systemctl stop ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mds.h 2026-02-13T04:07:38.116 INFO:journalctl@ceph.mds.h.trial099.stdout:Feb 13 04:07:37 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-h[56939]: 2026-02-13T04:07:37.857+0000 7f3c2089a6c0 -1 mds.h *** got signal Terminated *** 2026-02-13T04:07:39.293 DEBUG:teuthology.orchestra.run.trial099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mds.h.service' 2026-02-13T04:07:39.325 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T04:07:39.326 INFO:tasks.cephadm.mds.h:Stopped mds.h 2026-02-13T04:07:39.326 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2026-02-13T04:07:39.326 DEBUG:teuthology.orchestra.run.trial099:> sudo systemctl stop ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mds.k 2026-02-13T04:07:39.616 INFO:journalctl@ceph.mds.k.trial099.stdout:Feb 13 04:07:39 trial099 systemd[1]: Stopping Ceph mds.k for 1fefccae-0890-11f1-bcc5-d404e6e7d460... 2026-02-13T04:07:39.616 INFO:journalctl@ceph.mds.k.trial099.stdout:Feb 13 04:07:39 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-k[56288]: 2026-02-13T04:07:39.449+0000 7f24a8e556c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T04:07:39.616 INFO:journalctl@ceph.mds.k.trial099.stdout:Feb 13 04:07:39 trial099 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-k[56288]: 2026-02-13T04:07:39.449+0000 7f24a8e556c0 -1 mds.k *** got signal Terminated *** 2026-02-13T04:07:40.519 DEBUG:teuthology.orchestra.run.trial099:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mds.k.service' 2026-02-13T04:07:40.550 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T04:07:40.550 INFO:tasks.cephadm.mds.k:Stopped mds.k 2026-02-13T04:07:40.551 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2026-02-13T04:07:40.551 DEBUG:teuthology.orchestra.run.trial158:> sudo systemctl stop ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mds.c 2026-02-13T04:07:40.828 INFO:journalctl@ceph.mds.c.trial158.stdout:Feb 13 04:07:40 trial158 systemd[1]: Stopping Ceph mds.c for 1fefccae-0890-11f1-bcc5-d404e6e7d460... 2026-02-13T04:07:40.828 INFO:journalctl@ceph.mds.c.trial158.stdout:Feb 13 04:07:40 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-c[57910]: 2026-02-13T04:07:40.650+0000 7f3f202e36c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T04:07:40.829 INFO:journalctl@ceph.mds.c.trial158.stdout:Feb 13 04:07:40 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-c[57910]: 2026-02-13T04:07:40.650+0000 7f3f202e36c0 -1 mds.c *** got signal Terminated *** 2026-02-13T04:07:42.348 DEBUG:teuthology.orchestra.run.trial158:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mds.c.service' 2026-02-13T04:07:42.382 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T04:07:42.382 INFO:tasks.cephadm.mds.c:Stopped mds.c 2026-02-13T04:07:42.382 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2026-02-13T04:07:42.382 DEBUG:teuthology.orchestra.run.trial158:> sudo systemctl stop ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mds.f 2026-02-13T04:07:42.578 INFO:journalctl@ceph.mds.f.trial158.stdout:Feb 13 04:07:42 trial158 systemd[1]: Stopping Ceph mds.f for 1fefccae-0890-11f1-bcc5-d404e6e7d460... 2026-02-13T04:07:42.579 INFO:journalctl@ceph.mds.f.trial158.stdout:Feb 13 04:07:42 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-f[57577]: 2026-02-13T04:07:42.512+0000 7f87f60406c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T04:07:42.579 INFO:journalctl@ceph.mds.f.trial158.stdout:Feb 13 04:07:42 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-f[57577]: 2026-02-13T04:07:42.512+0000 7f87f60406c0 -1 mds.f *** got signal Terminated *** 2026-02-13T04:07:45.413 DEBUG:teuthology.orchestra.run.trial158:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mds.f.service' 2026-02-13T04:07:45.445 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T04:07:45.446 INFO:tasks.cephadm.mds.f:Stopped mds.f 2026-02-13T04:07:45.446 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2026-02-13T04:07:45.446 DEBUG:teuthology.orchestra.run.trial158:> sudo systemctl stop ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mds.i 2026-02-13T04:07:45.828 INFO:journalctl@ceph.mds.i.trial158.stdout:Feb 13 04:07:45 trial158 systemd[1]: Stopping Ceph mds.i for 1fefccae-0890-11f1-bcc5-d404e6e7d460... 2026-02-13T04:07:45.828 INFO:journalctl@ceph.mds.i.trial158.stdout:Feb 13 04:07:45 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-i[58234]: 2026-02-13T04:07:45.573+0000 7f8e0ea516c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T04:07:45.828 INFO:journalctl@ceph.mds.i.trial158.stdout:Feb 13 04:07:45 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-i[58234]: 2026-02-13T04:07:45.573+0000 7f8e0ea516c0 -1 mds.i *** got signal Terminated *** 2026-02-13T04:07:48.266 DEBUG:teuthology.orchestra.run.trial158:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mds.i.service' 2026-02-13T04:07:48.298 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T04:07:48.298 INFO:tasks.cephadm.mds.i:Stopped mds.i 2026-02-13T04:07:48.298 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2026-02-13T04:07:48.298 DEBUG:teuthology.orchestra.run.trial158:> sudo systemctl stop ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mds.l 2026-02-13T04:07:48.578 INFO:journalctl@ceph.mds.l.trial158.stdout:Feb 13 04:07:48 trial158 systemd[1]: Stopping Ceph mds.l for 1fefccae-0890-11f1-bcc5-d404e6e7d460... 2026-02-13T04:07:48.578 INFO:journalctl@ceph.mds.l.trial158.stdout:Feb 13 04:07:48 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-l[57259]: 2026-02-13T04:07:48.429+0000 7f695a8f86c0 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2026-02-13T04:07:48.578 INFO:journalctl@ceph.mds.l.trial158.stdout:Feb 13 04:07:48 trial158 ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460-mds-l[57259]: 2026-02-13T04:07:48.429+0000 7f695a8f86c0 -1 mds.l *** got signal Terminated *** 2026-02-13T04:07:49.474 DEBUG:teuthology.orchestra.run.trial158:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1fefccae-0890-11f1-bcc5-d404e6e7d460@mds.l.service' 2026-02-13T04:07:49.507 DEBUG:teuthology.orchestra.run:got remote process result: None 2026-02-13T04:07:49.508 INFO:tasks.cephadm.mds.l:Stopped mds.l 2026-02-13T04:07:49.508 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 --force --keep-logs 2026-02-13T04:07:49.694 INFO:teuthology.orchestra.run.trial092.stdout:Deleting cluster with fsid: 1fefccae-0890-11f1-bcc5-d404e6e7d460 2026-02-13T04:07:52.892 DEBUG:teuthology.orchestra.run.trial099:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 --force --keep-logs 2026-02-13T04:07:53.012 INFO:teuthology.orchestra.run.trial099.stdout:Deleting cluster with fsid: 1fefccae-0890-11f1-bcc5-d404e6e7d460 2026-02-13T04:07:54.799 DEBUG:teuthology.orchestra.run.trial158:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 --force --keep-logs 2026-02-13T04:07:54.917 INFO:teuthology.orchestra.run.trial158.stdout:Deleting cluster with fsid: 1fefccae-0890-11f1-bcc5-d404e6e7d460 2026-02-13T04:07:56.724 DEBUG:teuthology.orchestra.run.trial092:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T04:07:56.784 DEBUG:teuthology.orchestra.run.trial099:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T04:07:56.811 DEBUG:teuthology.orchestra.run.trial158:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2026-02-13T04:07:56.840 INFO:tasks.cephadm:Archiving crash dumps... 2026-02-13T04:07:56.844 DEBUG:teuthology.misc:Transferring archived files from trial092:/var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48125/remote/trial092/crash 2026-02-13T04:07:56.845 DEBUG:teuthology.orchestra.run.trial092:> sudo tar c -f - -C /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/crash -- . 2026-02-13T04:07:56.900 INFO:teuthology.orchestra.run.trial092.stderr:tar: /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-13T04:07:56.900 INFO:teuthology.orchestra.run.trial092.stderr:tar: Error is not recoverable: exiting now 2026-02-13T04:07:56.903 DEBUG:teuthology.misc:Transferring archived files from trial099:/var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48125/remote/trial099/crash 2026-02-13T04:07:56.905 DEBUG:teuthology.orchestra.run.trial099:> sudo tar c -f - -C /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/crash -- . 2026-02-13T04:07:56.931 INFO:teuthology.orchestra.run.trial099.stderr:tar: /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-13T04:07:56.931 INFO:teuthology.orchestra.run.trial099.stderr:tar: Error is not recoverable: exiting now 2026-02-13T04:07:56.933 DEBUG:teuthology.misc:Transferring archived files from trial158:/var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/crash to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48125/remote/trial158/crash 2026-02-13T04:07:56.934 DEBUG:teuthology.orchestra.run.trial158:> sudo tar c -f - -C /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/crash -- . 2026-02-13T04:07:56.960 INFO:teuthology.orchestra.run.trial158.stderr:tar: /var/lib/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/crash: Cannot open: No such file or directory 2026-02-13T04:07:56.960 INFO:teuthology.orchestra.run.trial158.stderr:tar: Error is not recoverable: exiting now 2026-02-13T04:07:56.961 INFO:tasks.cephadm:Checking cluster log for badness... 2026-02-13T04:07:56.962 DEBUG:teuthology.orchestra.run.trial092:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v FS_DEGRADED | grep -E -v 'fs.*is degraded' | grep -E -v 'filesystem is degraded' | grep -E -v FS_INLINE_DATA_DEPRECATED | grep -E -v FS_WITH_FAILED_MDS | grep -E -v MDS_ALL_DOWN | grep -E -v 'filesystem is offline' | grep -E -v 'is offline because no MDS' | grep -E -v MDS_DAMAGE | grep -E -v MDS_DEGRADED | grep -E -v MDS_FAILED | grep -E -v MDS_INSUFFICIENT_STANDBY | grep -E -v 'insufficient standby MDS daemons available' | grep -E -v MDS_UP_LESS_THAN_MAX | grep -E -v 'online, but wants' | grep -E -v 'filesystem is online with fewer MDS than max_mds' | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'do not have an application enabled' | grep -E -v 'overall HEALTH_' | grep -E -v 'Replacing daemon' | grep -E -v 'deprecated feature inline_data' | grep -E -v BLUESTORE_SLOW_OP_ALERT | grep -E -v 'slow operation indications in BlueStore' | grep -E -v 'experiencing slow operations in BlueStore' | grep -E -v MGR_MODULE_ERROR | grep -E -v OSD_DOWN | grep -E -v 'osd.* is down' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSD_DOWN\)' | grep -E -v '\(OSD_' | grep -E -v 'but it is still running' | grep -E -v 'is not responding' | grep -E -v 'osds down' | grep -E -v 'osd.* is down' | grep -E -v PG_AVAILABILITY | grep -E -v PG_DEGRADED | grep -E -v 'Reduced data availability' | grep -E -v 'Degraded data redundancy' | grep -E -v 'pg .* is stuck inactive' | grep -E -v 'pg .* is .*degraded' | head -n 1 2026-02-13T04:07:57.020 INFO:teuthology.orchestra.run.trial092.stdout:2026-02-13T03:58:54.720761+0000 mon.a (mon.0) 372 : cluster [WRN] Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T04:07:57.021 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2026-02-13T04:07:57.022 DEBUG:teuthology.orchestra.run.trial092:> sudo grep -E '\[SEC\]' /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v FS_DEGRADED | grep -E -v 'fs.*is degraded' | grep -E -v 'filesystem is degraded' | grep -E -v FS_INLINE_DATA_DEPRECATED | grep -E -v FS_WITH_FAILED_MDS | grep -E -v MDS_ALL_DOWN | grep -E -v 'filesystem is offline' | grep -E -v 'is offline because no MDS' | grep -E -v MDS_DAMAGE | grep -E -v MDS_DEGRADED | grep -E -v MDS_FAILED | grep -E -v MDS_INSUFFICIENT_STANDBY | grep -E -v 'insufficient standby MDS daemons available' | grep -E -v MDS_UP_LESS_THAN_MAX | grep -E -v 'online, but wants' | grep -E -v 'filesystem is online with fewer MDS than max_mds' | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'do not have an application enabled' | grep -E -v 'overall HEALTH_' | grep -E -v 'Replacing daemon' | grep -E -v 'deprecated feature inline_data' | grep -E -v BLUESTORE_SLOW_OP_ALERT | grep -E -v 'slow operation indications in BlueStore' | grep -E -v 'experiencing slow operations in BlueStore' | grep -E -v MGR_MODULE_ERROR | grep -E -v OSD_DOWN | grep -E -v 'osd.* is down' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSD_DOWN\)' | grep -E -v '\(OSD_' | grep -E -v 'but it is still running' | grep -E -v 'is not responding' | grep -E -v 'osds down' | grep -E -v 'osd.* is down' | grep -E -v PG_AVAILABILITY | grep -E -v PG_DEGRADED | grep -E -v 'Reduced data availability' | grep -E -v 'Degraded data redundancy' | grep -E -v 'pg .* is stuck inactive' | grep -E -v 'pg .* is .*degraded' | head -n 1 2026-02-13T04:07:57.082 DEBUG:teuthology.orchestra.run.trial092:> sudo grep -E '\[ERR\]' /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v FS_DEGRADED | grep -E -v 'fs.*is degraded' | grep -E -v 'filesystem is degraded' | grep -E -v FS_INLINE_DATA_DEPRECATED | grep -E -v FS_WITH_FAILED_MDS | grep -E -v MDS_ALL_DOWN | grep -E -v 'filesystem is offline' | grep -E -v 'is offline because no MDS' | grep -E -v MDS_DAMAGE | grep -E -v MDS_DEGRADED | grep -E -v MDS_FAILED | grep -E -v MDS_INSUFFICIENT_STANDBY | grep -E -v 'insufficient standby MDS daemons available' | grep -E -v MDS_UP_LESS_THAN_MAX | grep -E -v 'online, but wants' | grep -E -v 'filesystem is online with fewer MDS than max_mds' | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'do not have an application enabled' | grep -E -v 'overall HEALTH_' | grep -E -v 'Replacing daemon' | grep -E -v 'deprecated feature inline_data' | grep -E -v BLUESTORE_SLOW_OP_ALERT | grep -E -v 'slow operation indications in BlueStore' | grep -E -v 'experiencing slow operations in BlueStore' | grep -E -v MGR_MODULE_ERROR | grep -E -v OSD_DOWN | grep -E -v 'osd.* is down' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSD_DOWN\)' | grep -E -v '\(OSD_' | grep -E -v 'but it is still running' | grep -E -v 'is not responding' | grep -E -v 'osds down' | grep -E -v 'osd.* is down' | grep -E -v PG_AVAILABILITY | grep -E -v PG_DEGRADED | grep -E -v 'Reduced data availability' | grep -E -v 'Degraded data redundancy' | grep -E -v 'pg .* is stuck inactive' | grep -E -v 'pg .* is .*degraded' | head -n 1 2026-02-13T04:07:57.146 DEBUG:teuthology.orchestra.run.trial092:> sudo grep -E '\[WRN\]' /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v FS_DEGRADED | grep -E -v 'fs.*is degraded' | grep -E -v 'filesystem is degraded' | grep -E -v FS_INLINE_DATA_DEPRECATED | grep -E -v FS_WITH_FAILED_MDS | grep -E -v MDS_ALL_DOWN | grep -E -v 'filesystem is offline' | grep -E -v 'is offline because no MDS' | grep -E -v MDS_DAMAGE | grep -E -v MDS_DEGRADED | grep -E -v MDS_FAILED | grep -E -v MDS_INSUFFICIENT_STANDBY | grep -E -v 'insufficient standby MDS daemons available' | grep -E -v MDS_UP_LESS_THAN_MAX | grep -E -v 'online, but wants' | grep -E -v 'filesystem is online with fewer MDS than max_mds' | grep -E -v POOL_APP_NOT_ENABLED | grep -E -v 'do not have an application enabled' | grep -E -v 'overall HEALTH_' | grep -E -v 'Replacing daemon' | grep -E -v 'deprecated feature inline_data' | grep -E -v BLUESTORE_SLOW_OP_ALERT | grep -E -v 'slow operation indications in BlueStore' | grep -E -v 'experiencing slow operations in BlueStore' | grep -E -v MGR_MODULE_ERROR | grep -E -v OSD_DOWN | grep -E -v 'osd.* is down' | grep -E -v 'overall HEALTH_' | grep -E -v '\(OSD_DOWN\)' | grep -E -v '\(OSD_' | grep -E -v 'but it is still running' | grep -E -v 'is not responding' | grep -E -v 'osds down' | grep -E -v 'osd.* is down' | grep -E -v PG_AVAILABILITY | grep -E -v PG_DEGRADED | grep -E -v 'Reduced data availability' | grep -E -v 'Degraded data redundancy' | grep -E -v 'pg .* is stuck inactive' | grep -E -v 'pg .* is .*degraded' | head -n 1 2026-02-13T04:07:57.208 INFO:teuthology.orchestra.run.trial092.stdout:2026-02-13T03:58:54.720761+0000 mon.a (mon.0) 372 : cluster [WRN] Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL) 2026-02-13T04:07:57.209 INFO:tasks.cephadm:Compressing logs... 2026-02-13T04:07:57.209 DEBUG:teuthology.orchestra.run.trial092:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T04:07:57.213 DEBUG:teuthology.orchestra.run.trial099:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T04:07:57.215 DEBUG:teuthology.orchestra.run.trial158:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T04:07:57.238 INFO:teuthology.orchestra.run.trial099.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-13T04:07:57.238 INFO:teuthology.orchestra.run.trial099.stderr:: No such file or directory 2026-02-13T04:07:57.239 INFO:teuthology.orchestra.run.trial099.stderr:gzip -5 --verbose -- /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mgr.y.log 2026-02-13T04:07:57.242 INFO:teuthology.orchestra.run.trial099.stderr:gzip -5 --verbose -- /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mds.b.log 2026-02-13T04:07:57.243 INFO:teuthology.orchestra.run.trial099.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mds.h.log 2026-02-13T04:07:57.243 INFO:teuthology.orchestra.run.trial099.stderr:/var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-osd.7.log 2026-02-13T04:07:57.243 INFO:teuthology.orchestra.run.trial099.stderr:gzip -5 --verbose -- /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph.cephadm.log 2026-02-13T04:07:57.243 INFO:teuthology.orchestra.run.trial099.stderr:/var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mds.h.log: 92.9% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-13T04:07:57.243 INFO:teuthology.orchestra.run.trial099.stderr:/var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-osd.10.log 2026-02-13T04:07:57.243 INFO:teuthology.orchestra.run.trial099.stderr:/var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-osd.4.log 2026-02-13T04:07:57.243 INFO:teuthology.orchestra.run.trial099.stderr: 35.2% -- replaced with /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph.cephadm.log.gz 2026-02-13T04:07:57.243 INFO:teuthology.orchestra.run.trial099.stderr:/var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph.audit.log 2026-02-13T04:07:57.243 INFO:teuthology.orchestra.run.trial099.stderr:/var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mon.b.log 2026-02-13T04:07:57.243 INFO:teuthology.orchestra.run.trial099.stderr:/var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-volume.log 2026-02-13T04:07:57.244 INFO:teuthology.orchestra.run.trial099.stderr: 92.2% -- replaced with /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mgr.y.log.gz 2026-02-13T04:07:57.244 INFO:teuthology.orchestra.run.trial099.stderr:/var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-osd.1.log 2026-02-13T04:07:57.244 INFO:teuthology.orchestra.run.trial099.stderr:/var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph.log 2026-02-13T04:07:57.244 INFO:teuthology.orchestra.run.trial099.stderr:gzip -5 --verbose -- /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mds.k.log 2026-02-13T04:07:57.244 INFO:teuthology.orchestra.run.trial099.stderr:/var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-osd.1.log: /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph.log: gzip -5 --verbose -- /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mds.e.log 2026-02-13T04:07:57.244 INFO:teuthology.orchestra.run.trial099.stderr:/var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mds.k.log: 91.0% -- replaced with /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph.audit.log.gz 2026-02-13T04:07:57.244 INFO:teuthology.orchestra.run.trial099.stderr:/var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mds.e.log: 87.2% -- replaced with /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph.log.gz 2026-02-13T04:07:57.248 INFO:teuthology.orchestra.run.trial158.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-13T04:07:57.248 INFO:teuthology.orchestra.run.trial158.stderr:: No such file or directory 2026-02-13T04:07:57.248 INFO:teuthology.orchestra.run.trial158.stderr:gzip -5 --verbose -- /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-osd.2.log 2026-02-13T04:07:57.248 INFO:teuthology.orchestra.run.trial158.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mds.i.log 2026-02-13T04:07:57.248 INFO:teuthology.orchestra.run.trial158.stderr:/var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mon.c.log 2026-02-13T04:07:57.249 INFO:teuthology.orchestra.run.trial158.stderr:/var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mds.f.log 2026-02-13T04:07:57.249 INFO:teuthology.orchestra.run.trial158.stderr:/var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-osd.5.log 2026-02-13T04:07:57.249 INFO:teuthology.orchestra.run.trial158.stderr:/var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph.cephadm.log 2026-02-13T04:07:57.249 INFO:teuthology.orchestra.run.trial158.stderr: 93.8% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-13T04:07:57.249 INFO:teuthology.orchestra.run.trial158.stderr:/var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-osd.11.log 2026-02-13T04:07:57.249 INFO:teuthology.orchestra.run.trial158.stderr:/var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph.audit.log 2026-02-13T04:07:57.249 INFO:teuthology.orchestra.run.trial158.stderr: 35.2% -- replaced with /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph.cephadm.log.gz 2026-02-13T04:07:57.249 INFO:teuthology.orchestra.run.trial158.stderr:/var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-volume.log 2026-02-13T04:07:57.249 INFO:teuthology.orchestra.run.trial158.stderr:/var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mgr.z.log 2026-02-13T04:07:57.249 INFO:teuthology.orchestra.run.trial158.stderr:/var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mds.l.log 2026-02-13T04:07:57.249 INFO:teuthology.orchestra.run.trial158.stderr:/var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mds.c.log 2026-02-13T04:07:57.250 INFO:teuthology.orchestra.run.trial158.stderr:/var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph.log 2026-02-13T04:07:57.250 INFO:teuthology.orchestra.run.trial158.stderr:/var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-osd.8.log 2026-02-13T04:07:57.250 INFO:teuthology.orchestra.run.trial158.stderr: 91.0% -- replaced with /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph.audit.log.gz 2026-02-13T04:07:57.250 INFO:teuthology.orchestra.run.trial158.stderr:/var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph.log: /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-osd.8.log: 87.2% -- replaced with /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph.log.gz 2026-02-13T04:07:57.250 INFO:teuthology.orchestra.run.trial158.stderr: 92.4% -- replaced with /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mgr.z.log.gz 2026-02-13T04:07:57.251 INFO:teuthology.orchestra.run.trial158.stderr: 93.9% -- replaced with /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-volume.log.gz 2026-02-13T04:07:57.251 INFO:teuthology.orchestra.run.trial099.stderr: 93.4% -- replaced with /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-volume.log.gz 2026-02-13T04:07:57.251 INFO:teuthology.orchestra.run.trial099.stderr: 94.1% -- replaced with /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mds.h.log.gz 2026-02-13T04:07:57.252 INFO:teuthology.orchestra.run.trial158.stderr: 94.1% -- replaced with /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mds.i.log.gz 2026-02-13T04:07:57.253 INFO:teuthology.orchestra.run.trial158.stderr: 94.3% -- replaced with /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mds.f.log.gz 2026-02-13T04:07:57.254 INFO:teuthology.orchestra.run.trial099.stderr: 94.8% -- replaced with /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mds.k.log.gz 2026-02-13T04:07:57.255 INFO:teuthology.orchestra.run.trial158.stderr: 94.1% -- replaced with /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mds.c.log.gz 2026-02-13T04:07:57.255 INFO:teuthology.orchestra.run.trial099.stderr: 94.5% -- replaced with /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mds.e.log.gz 2026-02-13T04:07:57.257 INFO:teuthology.orchestra.run.trial158.stderr: 94.8% -- replaced with /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mds.l.log.gz 2026-02-13T04:07:57.264 INFO:teuthology.orchestra.run.trial092.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2026-02-13T04:07:57.264 INFO:teuthology.orchestra.run.trial092.stderr:: No such file or directory 2026-02-13T04:07:57.265 INFO:teuthology.orchestra.run.trial092.stderr:gzip -5 --verbose -- /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mon.a.log 2026-02-13T04:07:57.265 INFO:teuthology.orchestra.run.trial092.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mds.d.log 2026-02-13T04:07:57.266 INFO:teuthology.orchestra.run.trial092.stderr:/var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mds.j.log 2026-02-13T04:07:57.267 INFO:teuthology.orchestra.run.trial092.stderr:/var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-osd.0.log 2026-02-13T04:07:57.268 INFO:teuthology.orchestra.run.trial092.stderr:/var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-osd.3.log 2026-02-13T04:07:57.268 INFO:teuthology.orchestra.run.trial092.stderr: 94.5% -- replaced with /var/log/ceph/cephadm.log.gz 2026-02-13T04:07:57.268 INFO:teuthology.orchestra.run.trial092.stderr:/var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph.cephadm.log 2026-02-13T04:07:57.269 INFO:teuthology.orchestra.run.trial092.stderr:/var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mds.a.log 2026-02-13T04:07:57.270 INFO:teuthology.orchestra.run.trial092.stderr:/var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph.cephadm.log: 94.9% -- replaced with /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mds.j.log.gz 2026-02-13T04:07:57.270 INFO:teuthology.orchestra.run.trial092.stderr: 60.5% -- replaced with /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph.cephadm.log.gz 2026-02-13T04:07:57.270 INFO:teuthology.orchestra.run.trial092.stderr:gzip -5 --verbose -- /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mds.g.log 2026-02-13T04:07:57.271 INFO:teuthology.orchestra.run.trial092.stderr:/var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph.audit.log 2026-02-13T04:07:57.271 INFO:teuthology.orchestra.run.trial092.stderr:/var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-volume.log 2026-02-13T04:07:57.273 INFO:teuthology.orchestra.run.trial092.stderr:/var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph.audit.log: 94.9% -- replaced with /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mds.g.log.gz 2026-02-13T04:07:57.274 INFO:teuthology.orchestra.run.trial092.stderr:/var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-volume.log: 90.9% -- replaced with /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph.audit.log.gz 2026-02-13T04:07:57.275 INFO:teuthology.orchestra.run.trial092.stderr:gzip -5 --verbose -- /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-osd.6.log 2026-02-13T04:07:57.275 INFO:teuthology.orchestra.run.trial099.stderr: 93.3% -- replaced with /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mds.b.log.gz 2026-02-13T04:07:57.276 INFO:teuthology.orchestra.run.trial092.stderr:gzip -5 --verbose -- /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mgr.x.log 2026-02-13T04:07:57.277 INFO:teuthology.orchestra.run.trial092.stderr:/var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph.log 2026-02-13T04:07:57.277 INFO:teuthology.orchestra.run.trial092.stderr:/var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-osd.9.log 2026-02-13T04:07:57.280 INFO:teuthology.orchestra.run.trial092.stderr:/var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-osd.9.log: /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph.log: 94.9% -- replaced with /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mds.d.log.gz 2026-02-13T04:07:57.280 INFO:teuthology.orchestra.run.trial092.stderr: 93.0% -- replaced with /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-volume.log.gz 2026-02-13T04:07:57.280 INFO:teuthology.orchestra.run.trial092.stderr: 87.2% -- replaced with /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph.log.gz 2026-02-13T04:07:57.284 INFO:teuthology.orchestra.run.trial092.stderr: 95.1% -- replaced with /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mds.a.log.gz 2026-02-13T04:07:57.343 INFO:teuthology.orchestra.run.trial099.stderr: 91.8% -- replaced with /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mon.b.log.gz 2026-02-13T04:07:57.347 INFO:teuthology.orchestra.run.trial158.stderr: 91.8% -- replaced with /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mon.c.log.gz 2026-02-13T04:07:57.377 INFO:teuthology.orchestra.run.trial158.stderr: 92.8% -- replaced with /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-osd.11.log.gz 2026-02-13T04:07:57.382 INFO:teuthology.orchestra.run.trial092.stderr: 90.0% -- replaced with /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mgr.x.log.gz 2026-02-13T04:07:57.416 INFO:teuthology.orchestra.run.trial158.stderr: 92.3% -- replaced with /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-osd.8.log.gz 2026-02-13T04:07:57.426 INFO:teuthology.orchestra.run.trial099.stderr: 92.2% -- replaced with /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-osd.4.log.gz 2026-02-13T04:07:57.428 INFO:teuthology.orchestra.run.trial099.stderr: 92.4% -- replaced with /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-osd.7.log.gz 2026-02-13T04:07:57.433 INFO:teuthology.orchestra.run.trial158.stderr: 92.2% -- replaced with /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-osd.2.log.gz 2026-02-13T04:07:57.450 INFO:teuthology.orchestra.run.trial099.stderr: 92.1% -- replaced with /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-osd.1.log.gz 2026-02-13T04:07:57.452 INFO:teuthology.orchestra.run.trial092.stderr: 92.5% -- replaced with /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-osd.0.log.gz 2026-02-13T04:07:57.455 INFO:teuthology.orchestra.run.trial092.stderr: 92.3% -- replaced with /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-osd.3.log.gz 2026-02-13T04:07:57.459 INFO:teuthology.orchestra.run.trial092.stderr: 92.2% -- replaced with /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-osd.6.log.gz 2026-02-13T04:07:57.461 INFO:teuthology.orchestra.run.trial092.stderr: 92.0% -- replaced with /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-osd.9.log.gz 2026-02-13T04:07:57.461 INFO:teuthology.orchestra.run.trial158.stderr: 92.2% -- replaced with /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-osd.5.log.gz 2026-02-13T04:07:57.462 INFO:teuthology.orchestra.run.trial158.stderr: 2026-02-13T04:07:57.463 INFO:teuthology.orchestra.run.trial158.stderr:real 0m0.230s 2026-02-13T04:07:57.463 INFO:teuthology.orchestra.run.trial158.stderr:user 0m0.823s 2026-02-13T04:07:57.463 INFO:teuthology.orchestra.run.trial158.stderr:sys 0m0.075s 2026-02-13T04:07:57.476 INFO:teuthology.orchestra.run.trial099.stderr: 92.5% -- replaced with /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-osd.10.log.gz 2026-02-13T04:07:57.478 INFO:teuthology.orchestra.run.trial099.stderr: 2026-02-13T04:07:57.478 INFO:teuthology.orchestra.run.trial099.stderr:real 0m0.248s 2026-02-13T04:07:57.478 INFO:teuthology.orchestra.run.trial099.stderr:user 0m0.949s 2026-02-13T04:07:57.478 INFO:teuthology.orchestra.run.trial099.stderr:sys 0m0.077s 2026-02-13T04:07:57.591 INFO:teuthology.orchestra.run.trial092.stderr: 90.1% -- replaced with /var/log/ceph/1fefccae-0890-11f1-bcc5-d404e6e7d460/ceph-mon.a.log.gz 2026-02-13T04:07:57.594 INFO:teuthology.orchestra.run.trial092.stderr: 2026-02-13T04:07:57.594 INFO:teuthology.orchestra.run.trial092.stderr:real 0m0.349s 2026-02-13T04:07:57.594 INFO:teuthology.orchestra.run.trial092.stderr:user 0m1.068s 2026-02-13T04:07:57.595 INFO:teuthology.orchestra.run.trial092.stderr:sys 0m0.197s 2026-02-13T04:07:57.596 INFO:tasks.cephadm:Archiving logs... 2026-02-13T04:07:57.596 DEBUG:teuthology.misc:Transferring archived files from trial092:/var/log/ceph to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48125/remote/trial092/log 2026-02-13T04:07:57.597 DEBUG:teuthology.orchestra.run.trial092:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-13T04:07:57.831 DEBUG:teuthology.misc:Transferring archived files from trial099:/var/log/ceph to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48125/remote/trial099/log 2026-02-13T04:07:57.832 DEBUG:teuthology.orchestra.run.trial099:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-13T04:07:57.952 DEBUG:teuthology.misc:Transferring archived files from trial158:/var/log/ceph to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48125/remote/trial158/log 2026-02-13T04:07:57.952 DEBUG:teuthology.orchestra.run.trial158:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-13T04:07:58.063 INFO:tasks.cephadm:Removing cluster... 2026-02-13T04:07:58.063 DEBUG:teuthology.orchestra.run.trial092:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 --force 2026-02-13T04:07:58.249 INFO:teuthology.orchestra.run.trial092.stdout:Deleting cluster with fsid: 1fefccae-0890-11f1-bcc5-d404e6e7d460 2026-02-13T04:07:58.520 DEBUG:teuthology.orchestra.run.trial099:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 --force 2026-02-13T04:07:58.639 INFO:teuthology.orchestra.run.trial099.stdout:Deleting cluster with fsid: 1fefccae-0890-11f1-bcc5-d404e6e7d460 2026-02-13T04:07:58.797 DEBUG:teuthology.orchestra.run.trial158:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1fefccae-0890-11f1-bcc5-d404e6e7d460 --force 2026-02-13T04:07:58.918 INFO:teuthology.orchestra.run.trial158.stdout:Deleting cluster with fsid: 1fefccae-0890-11f1-bcc5-d404e6e7d460 2026-02-13T04:07:59.072 INFO:tasks.cephadm:Removing cephadm ... 2026-02-13T04:07:59.072 DEBUG:teuthology.orchestra.run.trial092:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-13T04:07:59.111 DEBUG:teuthology.orchestra.run.trial099:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-13T04:07:59.129 DEBUG:teuthology.orchestra.run.trial158:> rm -rf /home/ubuntu/cephtest/cephadm 2026-02-13T04:07:59.148 INFO:tasks.cephadm:Teardown complete 2026-02-13T04:07:59.148 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_a2c505dae37458c5537fa44f1320bd04eef25bb1/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.12/contextlib.py", line 137, in __enter__ return next(self.gen) ^^^^^^^^^^^^^^ File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/cephadm.py", line 2025, in task healthy(ctx=ctx, config=config) File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/ceph.py", line 1557, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/github.com_batrick_ceph_cfcf307502511ba51c39a8b9085c2fcde505d421/qa/tasks/ceph_manager.py", line 3393, in wait_until_healthy assert time.time() - start < timeout, \ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AssertionError: timeout expired in wait_until_healthy 2026-02-13T04:07:59.150 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2026-02-13T04:07:59.165 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-13T04:07:59.178 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-13T04:07:59.178 DEBUG:teuthology.orchestra.run.trial092:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-13T04:07:59.182 DEBUG:teuthology.orchestra.run.trial099:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-13T04:07:59.185 DEBUG:teuthology.orchestra.run.trial158:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-13T04:07:59.451 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-13T04:07:59.463 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-13T04:07:59.463 DEBUG:teuthology.orchestra.run.trial092:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T04:07:59.466 DEBUG:teuthology.orchestra.run.trial099:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T04:07:59.468 DEBUG:teuthology.orchestra.run.trial158:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-13T04:07:59.482 INFO:teuthology.orchestra.run.trial099.stderr:bash: line 1: ntpq: command not found 2026-02-13T04:07:59.484 INFO:teuthology.orchestra.run.trial158.stderr:bash: line 1: ntpq: command not found 2026-02-13T04:07:59.499 INFO:teuthology.orchestra.run.trial092.stderr:bash: line 1: ntpq: command not found 2026-02-13T04:07:59.509 INFO:teuthology.orchestra.run.trial099.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T04:07:59.509 INFO:teuthology.orchestra.run.trial099.stdout:=============================================================================== 2026-02-13T04:07:59.509 INFO:teuthology.orchestra.run.trial099.stdout:^+ tick.nowherenet.org 1 6 377 49 +6659us[+6659us] +/- 22ms 2026-02-13T04:07:59.510 INFO:teuthology.orchestra.run.trial099.stdout:^+ ip74-208-14-149.pbiaas.c> 2 6 377 50 -2294us[-2108us] +/- 24ms 2026-02-13T04:07:59.510 INFO:teuthology.orchestra.run.trial099.stdout:^* ntp2.wiktel.com 1 6 377 49 -3829us[-3642us] +/- 20ms 2026-02-13T04:07:59.510 INFO:teuthology.orchestra.run.trial099.stdout:^- 23.186.168.132 2 6 355 109 -1817us[-1641us] +/- 57ms 2026-02-13T04:07:59.510 INFO:teuthology.orchestra.run.trial158.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T04:07:59.510 INFO:teuthology.orchestra.run.trial158.stdout:=============================================================================== 2026-02-13T04:07:59.510 INFO:teuthology.orchestra.run.trial158.stdout:^* 50.205.57.38 1 6 377 47 +75us[ +38us] +/- 4783us 2026-02-13T04:07:59.510 INFO:teuthology.orchestra.run.trial158.stdout:^- perturb.org 2 6 377 51 +3859us[+3823us] +/- 51ms 2026-02-13T04:07:59.510 INFO:teuthology.orchestra.run.trial158.stdout:^+ 149.28.61.105.vultruserc> 3 6 377 51 -113us[ -149us] +/- 4424us 2026-02-13T04:07:59.510 INFO:teuthology.orchestra.run.trial158.stdout:^- time3.lshiy.com 2 6 377 50 -33us[ -69us] +/- 120ms 2026-02-13T04:07:59.534 INFO:teuthology.orchestra.run.trial092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-13T04:07:59.534 INFO:teuthology.orchestra.run.trial092.stdout:=============================================================================== 2026-02-13T04:07:59.534 INFO:teuthology.orchestra.run.trial092.stdout:^- 155.248.196.28 2 6 377 49 -608us[ -608us] +/- 49ms 2026-02-13T04:07:59.534 INFO:teuthology.orchestra.run.trial092.stdout:^- pi4.rellim.com 2 6 377 51 +3960us[+4229us] +/- 51ms 2026-02-13T04:07:59.534 INFO:teuthology.orchestra.run.trial092.stdout:^* pool-96-231-54-40.washdc> 1 6 377 49 +1043us[+1314us] +/- 6411us 2026-02-13T04:07:59.534 INFO:teuthology.orchestra.run.trial092.stdout:^- 23.186.168.129 2 6 377 107 -722us[ -475us] +/- 57ms 2026-02-13T04:07:59.535 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-13T04:07:59.546 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-13T04:07:59.546 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-13T04:07:59.559 DEBUG:teuthology.orchestra.run.trial092:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-13T04:07:59.676 DEBUG:teuthology.orchestra.run.trial099:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-13T04:07:59.723 DEBUG:teuthology.orchestra.run.trial158:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-13T04:07:59.772 DEBUG:teuthology.orchestra.run.trial092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T04:07:59.833 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T04:07:59.833 DEBUG:teuthology.orchestra.run.trial099:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T04:07:59.861 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T04:07:59.862 DEBUG:teuthology.orchestra.run.trial158:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2026-02-13T04:07:59.889 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T04:07:59.890 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-13T04:07:59.905 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-13T04:07:59.923 INFO:teuthology.task.internal:Duration was 820.163908 seconds 2026-02-13T04:07:59.923 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-13T04:07:59.937 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-13T04:07:59.938 DEBUG:teuthology.orchestra.run.trial092:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-13T04:07:59.942 DEBUG:teuthology.orchestra.run.trial099:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-13T04:07:59.945 DEBUG:teuthology.orchestra.run.trial158:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-13T04:07:59.980 INFO:teuthology.orchestra.run.trial099.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T04:07:59.981 INFO:teuthology.orchestra.run.trial158.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T04:08:00.021 INFO:teuthology.orchestra.run.trial092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-13T04:08:00.483 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-13T04:08:00.483 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial092.front.sepia.ceph.com 2026-02-13T04:08:00.483 DEBUG:teuthology.orchestra.run.trial092:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-13T04:08:00.529 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial099.front.sepia.ceph.com 2026-02-13T04:08:00.529 DEBUG:teuthology.orchestra.run.trial099:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-13T04:08:00.549 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial158.front.sepia.ceph.com 2026-02-13T04:08:00.550 DEBUG:teuthology.orchestra.run.trial158:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-13T04:08:00.570 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-13T04:08:00.570 DEBUG:teuthology.orchestra.run.trial092:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T04:08:00.574 DEBUG:teuthology.orchestra.run.trial099:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T04:08:00.592 DEBUG:teuthology.orchestra.run.trial158:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T04:08:00.863 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-13T04:08:00.864 DEBUG:teuthology.orchestra.run.trial092:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T04:08:00.867 DEBUG:teuthology.orchestra.run.trial099:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T04:08:00.870 DEBUG:teuthology.orchestra.run.trial158:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-13T04:08:00.892 INFO:teuthology.orchestra.run.trial099.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T04:08:00.894 INFO:teuthology.orchestra.run.trial099.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T04:08:00.894 INFO:teuthology.orchestra.run.trial099.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T04:08:00.894 INFO:teuthology.orchestra.run.trial099.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-13T04:08:00.894 INFO:teuthology.orchestra.run.trial099.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-13T04:08:00.895 INFO:teuthology.orchestra.run.trial158.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T04:08:00.897 INFO:teuthology.orchestra.run.trial158.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T04:08:00.897 INFO:teuthology.orchestra.run.trial158.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T04:08:00.897 INFO:teuthology.orchestra.run.trial158.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-13T04:08:00.897 INFO:teuthology.orchestra.run.trial158.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-13T04:08:00.906 INFO:teuthology.orchestra.run.trial099.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 90.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-13T04:08:00.911 INFO:teuthology.orchestra.run.trial158.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 90.5% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-13T04:08:00.918 INFO:teuthology.orchestra.run.trial092.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-13T04:08:00.919 INFO:teuthology.orchestra.run.trial092.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-13T04:08:00.920 INFO:teuthology.orchestra.run.trial092.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-13T04:08:00.920 INFO:teuthology.orchestra.run.trial092.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-13T04:08:00.921 INFO:teuthology.orchestra.run.trial092.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-13T04:08:00.971 INFO:teuthology.orchestra.run.trial092.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 92.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-13T04:08:00.975 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-13T04:08:00.991 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-13T04:08:00.991 DEBUG:teuthology.orchestra.run.trial092:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-13T04:08:01.047 DEBUG:teuthology.orchestra.run.trial099:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-13T04:08:01.073 DEBUG:teuthology.orchestra.run.trial158:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-13T04:08:01.099 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-13T04:08:01.115 DEBUG:teuthology.orchestra.run.trial092:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-13T04:08:01.119 DEBUG:teuthology.orchestra.run.trial099:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-13T04:08:01.121 DEBUG:teuthology.orchestra.run.trial158:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-13T04:08:01.143 INFO:teuthology.orchestra.run.trial099.stdout:kernel.core_pattern = core 2026-02-13T04:08:01.161 INFO:teuthology.orchestra.run.trial158.stdout:kernel.core_pattern = core 2026-02-13T04:08:01.187 INFO:teuthology.orchestra.run.trial092.stdout:kernel.core_pattern = core 2026-02-13T04:08:01.214 DEBUG:teuthology.orchestra.run.trial092:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-13T04:08:01.250 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T04:08:01.250 DEBUG:teuthology.orchestra.run.trial099:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-13T04:08:01.267 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T04:08:01.268 DEBUG:teuthology.orchestra.run.trial158:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-13T04:08:01.285 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-13T04:08:01.285 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-13T04:08:01.302 INFO:teuthology.task.internal:Transferring archived files... 2026-02-13T04:08:01.303 DEBUG:teuthology.misc:Transferring archived files from trial092:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48125/remote/trial092 2026-02-13T04:08:01.303 DEBUG:teuthology.orchestra.run.trial092:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-13T04:08:01.366 DEBUG:teuthology.misc:Transferring archived files from trial099:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48125/remote/trial099 2026-02-13T04:08:01.367 DEBUG:teuthology.orchestra.run.trial099:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-13T04:08:01.397 DEBUG:teuthology.misc:Transferring archived files from trial158:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/pdonnell-2026-02-13_01:53:26-fs-wip-pdonnell-testing-20260210.171210-distro-default-trial/48125/remote/trial158 2026-02-13T04:08:01.397 DEBUG:teuthology.orchestra.run.trial158:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-13T04:08:01.434 INFO:teuthology.task.internal:Removing archive directory... 2026-02-13T04:08:01.434 DEBUG:teuthology.orchestra.run.trial092:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-13T04:08:01.438 DEBUG:teuthology.orchestra.run.trial099:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-13T04:08:01.441 DEBUG:teuthology.orchestra.run.trial158:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-13T04:08:01.482 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-13T04:08:01.500 INFO:teuthology.task.internal:Not uploading archives. 2026-02-13T04:08:01.501 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-13T04:08:01.516 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-13T04:08:01.517 DEBUG:teuthology.orchestra.run.trial092:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-13T04:08:01.520 DEBUG:teuthology.orchestra.run.trial099:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-13T04:08:01.523 DEBUG:teuthology.orchestra.run.trial158:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-13T04:08:01.538 INFO:teuthology.orchestra.run.trial099.stdout: 786525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 13 04:08 /home/ubuntu/cephtest 2026-02-13T04:08:01.539 INFO:teuthology.orchestra.run.trial158.stdout: 786461 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 13 04:08 /home/ubuntu/cephtest 2026-02-13T04:08:01.555 INFO:teuthology.orchestra.run.trial092.stdout: 1048605 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 13 04:08 /home/ubuntu/cephtest 2026-02-13T04:08:01.557 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-13T04:08:01.574 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-13T04:08:01.614 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 8dec4b357aab872d3b63ec979924962a64be83dd description: fs/workload/{0-distro begin/{0-install 1-cephadm 2-logrotate 3-kernel} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-comp-ec-root omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-fscrypt/{with-fscrypt-dummy} 0-subvolume/{with-no-extra-options} 0-use-snaprealm/{global} 1-check-counter 2-scrub/no 3-snaps/yes 4-flush/no 5-quiesce/with-quiesce 6-workunit/suites/pjd}} duration: 820.1639080047607 failure_reason: '"2026-02-13T03:58:54.720761+0000 mon.a (mon.0) 372 : cluster [WRN] Health check failed: Failed to apply 1 service(s): osd.default (CEPHADM_APPLY_SPEC_FAIL)" in cluster log' flavor: default owner: scheduled_pdonnell@soko04.front.sepia.ceph.com sentry_event: null status: fail success: false 2026-02-13T04:08:01.615 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-13T04:08:01.749 INFO:teuthology.run:FAIL